The maximum handled at meet.jit.si is said to be 300 - and personally I doubt that it involves 300 full HD video streams at the same time. However it involves optimizations by the best Jitsi engineers available, so you may have to work a bit at that.
Just to ask clarification, it means single server with jitsi, prosody, jicofo and jibri etc on same server?
Can anyone suggest what specs are needed for server running on public cloud say Azure or AWS.
@damencho How beefy of a server do you need for the 500-participants / 300-sending scenario?
We have tested with 100 test participants all sending simulcast vp8 video, and all receiving either 1 720p, 9 360p or 24 180p, and for us, a bare metal 6 cpu (12 thread) 3+ ghz machine runs fine, but if we try the same test on a virtual server – even one with 20 cpus (40 threads), we see periodic audio problems. (We’re using 64kbps opus for audio… Could that be a factor?)
Anything special we should tune on the server to help with these large conferences? We would especially like to move off bare metal but right now we can’t because of the audio problems on virtual servers.
I think you are stressing the bridge too much which was causing your issues. If you are monitoring the bridge you will see the stress metric it pushes and especially the rtp delay. Those metrics are useful to tune up the system based on the machines you use.
To be able to use several bridges in a single conference you need to configure octo.
yes, the virtual aspect could be the issue. When everything is taken in account, a virtual machine is just a process in the hypervisor and it must be very difficult - maybe even impossible - to separate inside a vm the process that need to work in real time from the other that don’t need it. And in a commercial hypervisor you can’t just decide that Omatic’s whole VM should be realtime while the others customer VMs are waiting. That’s what is different between VM and bare metal I guess.
The only way is to be smarter about buffering, up to a limit because you can’t delay indefinitely data in a meeting. Did you try RED BTW ? IIRC you said to me once that you would report back on your experience. I think I have seen still recently that there were changes in Chrome to support RED better.