Our server is currently running jitsi-meet and i want to ask if jitsi can handle multiple rooms out of the box? If not, what steps should i take? I heard about multiple videobridges but have no idea how it works
Yes. How many rooms you can have going at the same time depends on your server specifications.
As demand increases, separating video bridge servers from the meeting server will be a good idea.