Interestingly, a lot of people would probably say this is all very unprofessional, hurting my future chances, bad career planning and what have you. But my experience has been to the contrary: Because I have met a lot of different people and done a lot of different things I tend to have a broader perspective on things. And nobody has ever held anything I have done against me.
So my point stands: Just do it...