I have also put bright contrasting colors on my walls but have been able to muster courage to team them up with bright upholstery. In fact i have muted them down with beige and white combination with some highlights of gold and browns.
Though I do have an experimentative streak in me, I have never been able to go the typical gypsy way. Full of Kitch and colors and prints and textures.I like harmony of colors and textures. What do you like?