I hear you. The crowding got to me after 21 years. The odd part is I had no desire to visit the city when I was a kid... only went in twice on field trips until I went off to college. If it weren't for the love of my life, I doubt I ever would have had to much to do with the place. My parents regretted their insistence that I come back from Michigan after college... big time! <ggg> when I pulled that one.
I got caught up in it though (I am not an OUTDR type). I was into the "culture"... foreign films and theatre... fell into theatre as a way to eke out a living while I partied my ass off with the would.be.has.been rock 'n roll stars... The loft parties in Brooklyn are among my favorite memories.
Every time I headed back into town after a trip to the "country" (a city euphemism for the 'burbs), I would feel joy as the bus rounded the bend into the Lincoln Tunnel and the skyline popped. I was HOME! I knew it was time to get out when that joy turned to "Oh no, not again." Took me two years but when it happened... it happened in a flash.
Feel like I let myself out of prison on the permanent release program. Never say never though. Part of me wants to go in to enjoy downtown without those ugly shadow casting towers... wish they would not rebuild. I worked down there for the first 3 years of my life in Manhattan... they made for dark brutal wind tunnels during the day. I doubt I would make a special trip to "Ground Zero"... still don't think I could handle it. Sobbing in public is not becoming but I'd love to visit the Seaport and wander the streets to the Battery just to see how it has changed.