That's different. To begin with, it's communication between equals. "Young man" or "young lady" is only used by an older person to a younger one. One who's an inferior. And not in a position to say, "Don't call me that!"
What is exceptionally cringe worthy is Boss man. I never heard it until I moved south but for some reason clerks in stores have called me boss man which grates on my nerves like fingernails on a chalk board.