Because in most companies, you're having lunch with VPs and CEOs regularly? I've only worked at one company where I regularly saw anybody at the VP level and up on a regular basis. Unless you're working at a small company, this example just doesn't have any basis in reality.
I was poking fun at them saying no one will be in the office by pointing out that if you're literally the only non-manager in the office then you've got some advantages.