No, this is bad nitpicking. Shows do this all the time, ALL shows. Fill the gaps by yourself. We don't know the specifics of the skyscraper. Maybe it was abandoned for some reasons? We don't know those. I don't remember the episode very well, but I'm sure that there's an obvious explanation. This is just unnecessary nitpicking.