My heart swells with compassion for these Souls because I've had these feelings myself. I used to think that I had to completely remove myself from those situations where I wasn't accepted for who I am, spiritually. With the benefit of wisdom and age, however, I've learned that I can be me wherever I find myself.
Running away from 'reality' and sticking with only 'Spiritual' people will not aid anyone's spiritual growth. It's been my experience that doing so often leads to spiritual atrophy.
I wish to make it clear that I am not advocating staying in any situation that is harmful to the well-being of mind, body or Soul.
What I am saying is that you have the choice and the ability to shine your Light wherever you are. In fact, the Light you shine in any particular place may be the beacon that will aid others in their own spiritual growth.