Trying to figure out why voice channels still don't work. This morning, someone suggested that I take a look at the Conduwuity tutorial for setting up livekit. There were some difference and clarifications that the Tuwunel tutorial did not have, but my problem was not resolved.
Later, I had a friend connect... but it worked! They were running Chrome. This made me think that the reason I cannot connect is because of a problem with LibreWolf or a plugin I use. I tried disabling all plugins, and it worked for me too!
So I did a binary search on my extensions, and found out that the plugin which causes it fail is ProtonVPN. My guess is that ProtonVPN refuses to relay the data that LiveKit needs to work.
Checking the ProtonVPN settings, it seems that there's a setting called "WebRTC Leak Protection". Disabling that fixes it, allowing me to use ProtonVPN and Matrix Call at the same time.