This amazingly helps quite a lot! The idle time between frames is down from 0.8ms to 0.66ms now.

This reverts commit 07106959.

This reverts commit f5e7cc2e.

This actually makes us slightly slower, due to increased register pressure, but I think if I can alleviate that we'll see a speedup.

Woo!

This reverts commit 05116f49.

Blah, this increased our delay from 1ms to 1.2ms. Not sure why it seemed to help at first.

Almost fast enough.. just 1.3ms more to shave off per frame.