Protect public facing JVB server

We have a public facing JVB server for our external jitsi clients.
How can we protect from unauthorised used by somebody our JVB server?