Yes - and be very direct about this. Ask them "So why do you like this job? Why is this a great place to work?" I've had someone pause, look at me and tell me why it was a bad place and I should run away.
I had a hiring manager make me an attractive offer--and then in the next breath tell me that he was planning on leaving the company, and I should run. The gist was "my boss is watching so I have to make the offer, but he'll pop into your office at 4PM and tell you you're working until 9PM on a regular basis and otherwise interferes constantly. I've been unable to protect my team from this. You can do better."
I sent him an explicit "thanks for the generous offer, but I've chosen to go elsewhere after consideration" email so he had something to forward, thanked him kindly privately, and ran like hell.
It's pretty amazing what you'll run into across a career. I've probably seen more WTFs from the hiring side of the table than from the people I've interviewed to hire.
