I have turned down a woman whom asked me out because I was not attracted to her and the other time was due to their

Personality and too young in the head

If a woman does not like you you are a creep if they like you it's a different story it's best not to let is bother you