I ended up fixing this myself.

In the publish settings, I set the audio stream to "raw"