Great advice from Dr. Daniel Amen:
When you're 18, you worry about what everybody is thinking of you; when you're 40, you don't give a darn what anybody thinks of you; when you're 60, you realize nobody's been thinking about you at all.
Bottom line: people think about themselves, not you. So, don't worry about what others may think of you as you pursue your goals.