During a break go to the font desk and tell the receptionist, "I'm here today for an interview today, can I please ask to see someone from HR". Wait for the HR rep. "Hey, I spoke with the first couple interviewers and it seems like it won't be a good fit. I would hate to take the next interviewer's time". They will understand and everyone will be happy at the end.