I followed the official Jitsi guide to install in Debian/Ubuntu. Everything works perfectly except that when starting a video call, it takes 30 seconds to 1 minute to start the camera and audio. You can enter the meeting perfectly, but you cannot do anything until those times mentioned above. The VPS is hosted in Azure.
Did you test the same server connecting from a different location with a different client?