Without looking at the source 5tons... And going on what you've just said, i'm curious...

does the whole face tracking code re-execute from fresh every frame, or does it use the last position, and previous frame information to get a better grip on where the face is?