It's not the walking around, it's the traffic and the parking that's such a hassle.
The only thing I worry about to any extent is the street people.98% of them are harmless and some are amusing. The other 2% can belligerent or even psychotic. My youngest son and I had the misfortune of being quite close when some deranged nut stabbed a random person to death. And-we were in the middle of a large group of people heading back to the parking lot-not by ourselves.