BeagleBone + Gentoo + RT Patches?

[uudruid74]

It would seem that to get a Linux kernel on a BeagleBone, you need to patch Vanilla kernel sources, not use a Gentoo kernel. For my needs latency is more important than just about anything else, so I was wondering if anyone knew how hard it would be to install the RT patches over the BeagleBone patches (or would vice versa be easier?)

For those that are about to ask, this is for a project intended to do some tests on real-time audio processing at high sample rates.