I am a master’s student whose thesis will concern applying audio spatialization techniques within telecommunication platforms. I wanted to work with Jitsi Meet, being an open source platform and with a great and responsive community. I will likely be pretty active here in the spring of next year as I work on it, but wanted to ask some preliminary questions to get a sense of what is going on at a lower level.
I’ve read that jitsi-bridge is relaying media channels (both audio and video?) to the participants in a conference. My thoughts hearing this is that the best approach would then be to just have the clients manipulate/spatialize these audio streams locally (with some small latency). I was curious what component of Jitsi is receiving the audio of participants. There is also some issue, I realize, that Jitsi optimizes for an active speaker, but I wasn’t sure if this actually prevents the streams of other participants from being relayed?
If anyone has dealt with audio in this way, I would be grateful to hear any of your dev experiences.