High CPU utilization with multiple clients

I am running a private jitsi meet server on my own device. When I have 11 or fewer client instances running on the server, there is no problem. However, with more than 11, the E2E RTT spikes as does the CPU usage, the frame rate drops, and everything becomes jerky. Any fixes?