This is pretty common, and there's certainly a wave of open source software based companies currently. Definitely a tricky thing to navigate, of course.

Typically I find it works best when the company is very clear about which areas they feel should be open source and which areas they will be monetizing. Its the ambiguity and loss of trust that creates tension.