Yeah it's complicated to get V4L2 working on Linux and requires recompiling a few things from my experience - we eventually got hardware acceleration on ffmpeg on Ubuntu + RPi working but it was a lot of trial and error, and I really didn't document it too well... can't imagine this won't come back to bite me...