Flash looks for keyframes when you scrub, so one solution is to make sure that your .flv is encoded at the same framerate as your source movie and/or hub .swf.

Also, you can manually set the buffer time on a netConnection and you can set the _soundbuftime property (default is 5) manually.