No problems wanting to see NYC. Great place, many levels better than LA. And since you are flying in and out of major cities, flights should be OK. And that is my only advice, plan your flights carefully making sure you get the times you want. Check nearby airports like Newark when flying out of NYC, it will open up time opportunities.
As far as the asshole thing, I was in Berlin in early 1990. Got in the afternoon, drank until 6:00am the next day. The following day I was catching a 6:00am train to Geneva. I was so hung over on my free day in Berlin, I really considered not going to the wall. I decided if I didn’t go (I did go, it was painful), I would have been truly an asshole. Wanting to go to NYC would not be anywhere near in the same league. 