If you are Gay, then sexual harassment would pertain to your chosen lifestyle and to You, personally.
But, if you are not gay.. then it wouldn't have any particular meaning to you, personally, and therefore wouldn't be considered as pertaining to you.
Of course I can understand how this comment would offend you in your capacity, just wanting to be accepted by society and willing to go to great lengths to be open minded and amendable to a diverse population.