java.lang.NullPointerException in Jicofo log when starting a videobridge

Install & Config
#1

Hi
I am seeing a Null Pointer exception everytime JVB is started.
The below is the config of the Jicofo and JVB on different servers, but when I tried with the JVB on the same servers as jicofo , the same issue occurs.
This issues seems to have been occurring ever since have enabled websockets.
Everything seems to work okay (including octo) despite this error.

If anyone could explain the error and how to get rid of it, would be great.
If it is a known issue and should be ignore that would be good to know too

Below are the configs and jifcofo, prosody and jvb logs

nginx addition for WS

location ~ ^/colibri-ws/bridge3/(.*) {
proxy_pass http://<IP_of_JVB>:9090/colibri-ws/bridge3/$1$is_args$args;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection “upgrade”;
tcp_nodelay on;
}

sip communicator property of JVB

org.ice4j.ice.harvest.DISABLE_AWS_HARVESTER=true
org.ice4j.ice.harvest.STUN_MAPPING_HARVESTER_ADDRESSES=meet-jit-si-turnrelay.jitsi.net:443
org.jitsi.videobridge.ENABLE_STATISTICS=true
org.jitsi.videobridge.STATISTICS_TRANSPORT=muc

org.jitsi.videobridge.xmpp.user.shard.HOSTNAME=mydomain
org.jitsi.videobridge.xmpp.user.shard.DOMAIN=auth.mydomain
org.jitsi.videobridge.xmpp.user.shard.USERNAME=jvb
org.jitsi.videobridge.xmpp.user.shard.PASSWORD=
org.jitsi.videobridge.xmpp.user.shard.MUC_JIDS=JvbBrewery@internal.auth.mydomain
org.jitsi.videobridge.xmpp.user.shard.MUC_NICKNAME=bridge3
org.jitsi.videobridge.xmpp.user.shard.DISABLE_CERTIFICATE_VERIFICATION=true

org.jitsi.videobridge.rest.COLIBRI_WS_TLS=true
org.jitsi.videobridge.rest.COLIBRI_WS_DOMAIN=mydomain:443
org.jitsi.videobridge.rest.COLIBRI_WS_PATH=colibri-ws
org.jitsi.videobridge.rest.COLIBRI_WS_SERVER_ID=bridge3

org.jitsi.videobridge.octo.BIND_ADDRESS=
org.jitsi.videobridge.octo.PUBLIC_ADDRESS=
org.jitsi.videobridge.octo.BIND_PORT=4096
org.jitsi.videobridge.REGION=region1

sip communicator property of jicofo

org.jitsi.jicofo.BRIDGE_MUC=JvbBrewery@internal.auth.mydomain
org.jitsi.jicofo.auth.URL=XMPP:mydomain
org.jitsi.jicofo.auth.DISABLE_AUTOLOGIN=true
org.jitsi.jicofo.jibri.BREWERY=JibriBrewery@internal.auth.mydomain
org.jitsi.jicofo.jibri.PENDING_TIMEOUT=90
org.jitsi.jicofo.HEALTH_CHECK_INTERVAL=-1

#org.jitsi.jicofo.BridgeSelector.BRIDGE_SELECTION_STRATEGY=RegionBasedBridgeSelectionStrategy
org.jitsi.jicofo.BridgeSelector.BRIDGE_SELECTION_STRATEGY=SplitBridgeSelectionStrategy

jicofo Log

[Thu Apr 22 18:55:41 BST 2021] INFO Added brewery instance: jvbbrewery@internal.auth.mydomain/bridge3
[Thu Apr 22 18:55:41 BST 2021] INFO Added new videobridge: Bridge[jid=jvbbrewery@internal.auth.mydomain/bridge3, relayId=, region=region1, stress=0.00]
[Thu Apr 22 18:55:41 BST 2021] SEVERE Exception in packet listener
java.lang.NullPointerException
at org.jitsi.jicofo.bridge.JvbDoctor.addBridge(JvbDoctor.java:159)
at org.jitsi.jicofo.bridge.BridgeSelector.addJvbAddress(BridgeSelector.java:124)
at org.jitsi.jicofo.bridge.BridgeMucDetector.onInstanceStatusChanged(BridgeMucDetector.java:166)
at org.jitsi.jicofo.bridge.BridgeMucDetector.onInstanceStatusChanged(BridgeMucDetector.java:36)
at org.jitsi.jicofo.xmpp.BaseBrewery.processInstanceStatusChanged(BaseBrewery.java:354)
at org.jitsi.jicofo.xmpp.BaseBrewery.processMemberPresence(BaseBrewery.java:310)
at org.jitsi.jicofo.xmpp.BaseBrewery.chatRoomPropertyChanged(BaseBrewery.java:265)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.lambda$notifyMemberPropertyChanged$4(ChatRoomImpl.java:948)
at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:895)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.notifyMemberPropertyChanged(ChatRoomImpl.java:948)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.processOtherPresence(ChatRoomImpl.java:1223)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.processPresence(ChatRoomImpl.java:1261)
at org.jivesoftware.smackx.muc.MultiUserChat$3.processStanza(MultiUserChat.java:251)
at org.jivesoftware.smack.AbstractXMPPConnection$6.run(AbstractXMPPConnection.java:1263)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

jvb log

[Thu Apr 22 18:55:35 BST 2021] INFO Initialized newConfig: merge of system properties,/etc/jitsi/videobridge/jvb.conf: 1,system properties,reference.conf @ jar:file:/usr/share/jitsi-videobridge/jitsi-videobridge.jar!/reference.conf: 1,reference.conf @ jar:file:/usr/share/jitsi-videobridge/lib/jitsi-media-transform-1.0-198-g1babb83.jar!/reference.conf: 1,reference.conf @ jar:file:/usr/share/jitsi-videobridge/lib/ice4j-3.0-22-g67ffceb.jar!/reference.conf: 1
[Thu Apr 22 18:55:35 BST 2021] INFO loading config file at path /etc/jitsi/videobridge/sip-communicator.properties
[Thu Apr 22 18:55:35 BST 2021] INFO Initialized legacyConfig: sip communicator props (no description provided)
[Thu Apr 22 18:55:35 BST 2021] INFO Reloading the Typesafe config source (previously reloaded 0 times).
[Thu Apr 22 18:55:36 BST 2021] INFO Discovered public address 185.237.98.20:14565/udp from STUN server 152.67.143.103:443/udp using local address 185.237.98.20:0/udp
[Thu Apr 22 18:55:36 BST 2021] INFO Using org.ice4j.ice.harvest.StunMappingCandidateHarvester, face=/185.237.98.20, mask=/185.237.98.20
[Thu Apr 22 18:55:36 BST 2021] INFO Initialized mapping harvesters (delay=383ms). stunDiscoveryFailed=false
[Thu Apr 22 18:55:36 BST 2021] WARNING Disabling certificate verification!
[Thu Apr 22 18:55:36 BST 2021] INFO LastNReducer with reductionScale: 0.75 recoverScale: 1.25 impactTime: PT1M minLastN: 0 maxEnforcedLastN: 40
[Thu Apr 22 18:55:36 BST 2021] INFO TaskPools detected 4 processors, creating the CPU pool with that many threads
[Thu Apr 22 18:55:36 BST 2021] INFO Running with open files limit 65000 (hard 65000), thread limit 65000 (hard 65000).
[Thu Apr 22 18:55:36 BST 2021] INFO Starting with 60 second interval.
[Thu Apr 22 18:55:36 BST 2021] INFO Started with interval=10000, timeout=PT30S, maxDuration=PT3S, stickyFailures=false.
[Thu Apr 22 18:55:36 BST 2021] INFO Initialized with bind address 185.237.98.20 and bind port 4096. Receive buffer size 10485760 (asked for 10485760). Send buffer size 212992 (asked for 10485760).
[Thu Apr 22 18:55:36 BST 2021] INFO Created Octo UDP transport
[Thu Apr 22 18:55:36 BST 2021] INFO Created OctoTransport
[Thu Apr 22 18:55:36 BST 2021] INFO Not starting CallstatsService, disabled in configuration.
[Thu Apr 22 18:55:36 BST 2021] INFO Starting public http server
[Thu Apr 22 18:55:36 BST 2021] INFO Base URL: wss://mydomain:443/colibri-ws/bridge3
[Thu Apr 22 18:55:36 BST 2021] INFO Logging initialized @1015ms to org.eclipse.jetty.util.log.JavaUtilLog
[Thu Apr 22 18:55:36 BST 2021] INFO Registering servlet at /colibri-ws/*, baseUrl = wss://mydomain:443/colibri-ws/bridge3
[Thu Apr 22 18:55:36 BST 2021] INFO jetty-9.4.15.v20190215; built: 2019-02-15T16:53:49.381Z; git: eb70b240169fcf1abbd86af36482d1c49826fa0b; jvm 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10
[Thu Apr 22 18:55:36 BST 2021] INFO Connected.
[Thu Apr 22 18:55:36 BST 2021] INFO Logging in.
[Thu Apr 22 18:55:36 BST 2021] INFO Started o.e.j.s.ServletContextHandler@67b9b51a{/,null,AVAILABLE}
[Thu Apr 22 18:55:36 BST 2021] INFO Started ServerConnector@5117dd67{HTTP/1.1,[http/1.1]}{0.0.0.0:9090}
[Thu Apr 22 18:55:36 BST 2021] INFO Started @1195ms
[Thu Apr 22 18:55:36 BST 2021] INFO Starting private http server
[Thu Apr 22 18:55:36 BST 2021] INFO Joined MUC: jvbbrewery@internal.auth.mydomain

prosody log

Apr 22 18:55:36 socket debug server.lua: accepted new client connection from 185.237.98.20:42362 to 5222
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper warn Session filters applied
Apr 22 18:55:36 c2s55f0f8ae05b0 info Client connected
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Client sent opening stream:stream to auth.mydomain
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unauthed]: <?xml version='1.0'?>
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unauthed]: <stream:stream xmlns=‘jabber:client’ from=‘auth.mydomain’ id=‘ac4eb514-e867-4656-91a1-b2db34b5cc28’ version=‘1.0’ xmlns:stream=‘http://etherx.jabber.org/streams’ xml:lang=‘en’>
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sent reply stream:stream to client
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Not offering mechanism PLAIN on insecure connection
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Not offering disabled mechanism DIGEST-MD5
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Offering mechanism SCRAM-SHA-1
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unauthed]: stream:features
Apr 22 18:55:36 runnerCog-JTGz debug creating new coroutine
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Received[c2s_unauthed]:
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unauthed]:
Apr 22 18:55:36 socket debug server.lua: we need to do tls, but delaying until send buffer empty
Apr 22 18:55:36 c2s55f0f8ae05b0 debug TLS negotiation started for c2s_unauthed…
Apr 22 18:55:36 socket debug server.lua: attempting to start tls on tcp{client}: 0x55f0f9337818
Apr 22 18:55:36 socket debug server.lua: ssl handshake done
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Client sent opening stream:stream to auth.mydomain
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unauthed]: <?xml version='1.0'?>
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unauthed]: <stream:stream xmlns=‘jabber:client’ from=‘auth.mydomain’ id=‘6a25f1c0-c123-4eb3-afdf-7fe3680a8985’ version=‘1.0’ xmlns:stream=‘http://etherx.jabber.org/streams’ xml:lang=‘en’>
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sent reply stream:stream to client
Apr 22 18:55:36 c2s55f0f8ae05b0 info Stream encrypted (TLSv1.2 with ECDHE-RSA-AES128-GCM-SHA256)
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Offering mechanism PLAIN
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Not offering disabled mechanism DIGEST-MD5
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Offering mechanism SCRAM-SHA-1
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Offering mechanism SCRAM-SHA-1-PLUS
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unauthed]: stream:features
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Received[c2s_unauthed]:
Apr 22 18:55:36 auth.mydomain:auth_internal_plain debug get_password for username ‘jvb’
Apr 22 18:55:36 auth.mydomain:saslauth debug sasl reply: cj1YPW1LZVkwd0h8Pls2XF19aGdlV3kiflE1M1dJUSU/PjgwZjI3OGE4LTU5MjEtNDIyZC1iMzQ1LTU5NDFmOGI0NDUzYSxzPU1EQm1OemRtTmpZdFlUTTFOaTAwTVRJMkxXRmtaVFl0T0Raa09UaGhNelpqT0RRMCxpPTQwOTY=
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unauthed]:
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Received[c2s_unauthed]:
Apr 22 18:55:36 c2s55f0f8ae05b0 info Authenticated as jvb@auth.mydomain
Apr 22 18:55:36 auth.mydomain:saslauth debug sasl reply: dj1oOHFqcEJZQy93Z3pydmFMSG5MTXVzTTgrY0U9
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unbound]:
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Client sent opening stream:stream to auth.mydomain
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unbound]: <?xml version='1.0'?>
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unbound]: <stream:stream xmlns=‘jabber:client’ from=‘auth.mydomain’ id=‘53610584-3a30-42f7-b9fd-21282856426b’ version=‘1.0’ xmlns:stream=‘http://etherx.jabber.org/streams’ xml:lang=‘en’>
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sent reply stream:stream to client
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s_unbound]: stream:features
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Received[c2s_unbound]:
Apr 22 18:55:36 rostermanager debug load_roster: asked for: jvb@auth.mydomain
Apr 22 18:55:36 rostermanager debug load_roster: loading for new user: jvb@auth.mydomain
Apr 22 18:55:36 rostermanager debug load_roster: cache miss, loading from storage
Apr 22 18:55:36 c2s55f0f8ae05b0 debug No legacy vCard to migrate or already migrated
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug Filtering stanza type iq to from
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Resource bound: jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Received[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvb@auth.mydomain/EJGCKZno (not from the MUC host) 3R911-15,
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug Filtering stanza type iq to jvb@auth.mydomain/EJGCKZno from
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Received[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ internal.auth.mydomain
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug Filtering stanza type iq to jvb@auth.mydomain/EJGCKZno from internal.auth.mydomain
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite internal.auth.mydomain (not from the MUC host) 3R911-18,
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Received[c2s]:
Apr 22 18:55:36 auth.mydomain:pep debug get_pep_service(“jvb”)
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jvbbrewery@internal.auth.mydomain/bridge3
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvb@auth.mydomain/EJGCKZno (not from the MUC host) 3R911-17,
Apr 22 18:55:36 internal.auth.mydomain:muc debug no occupant found for jvbbrewery@internal.auth.mydomain/bridge3; creating new occupant object for jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug Filtering stanza type presence to jvb@auth.mydomain/EJGCKZno from jvbbrewery@internal.auth.mydomain/focus
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvbbrewery@internal.auth.mydomain/focus (not from the MUC host) VAMDk-36,
Apr 22 18:55:36 c2s55f0f91fecc0 debug Sending[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug Filtering stanza type presence to focus@auth.mydomain/focus1627861540066264 from jvbbrewery@internal.auth.mydomain/bridge3
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ focus@auth.mydomain/focus1627861540066264
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvbbrewery@internal.auth.mydomain/bridge3 (not from the MUC host) 3R911-17,
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug Filtering stanza type presence to jvb@auth.mydomain/EJGCKZno from jvbbrewery@internal.auth.mydomain/bridge3
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvbbrewery@internal.auth.mydomain/bridge3 (not from the MUC host) 3R911-17,
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvbbrewery@internal.auth.mydomain (not from the MUC host) ,
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug Filtering stanza type message to jvb@auth.mydomain/EJGCKZno from jvbbrewery@internal.auth.mydomain
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvbbrewery@internal.auth.mydomain (not from the MUC host) ,
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Received[c2s]:
Apr 22 18:55:36 auth.mydomain:pep debug get_pep_service(“jvb”)
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jvbbrewery@internal.auth.mydomain/bridge3
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvb@auth.mydomain/EJGCKZno (not from the MUC host) 3R911-23,
Apr 22 18:55:36 internal.auth.mydomain:muc debug presence update for jvbbrewery@internal.auth.mydomain/bridge3 from session jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:36 c2s55f0f91fecc0 debug Sending[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug Filtering stanza type presence to focus@auth.mydomain/focus1627861540066264 from jvbbrewery@internal.auth.mydomain/bridge3
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ focus@auth.mydomain/focus1627861540066264
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvbbrewery@internal.auth.mydomain/bridge3 (not from the MUC host) 3R911-23,
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug Filtering stanza type presence to jvb@auth.mydomain/EJGCKZno from jvbbrewery@internal.auth.mydomain/bridge3
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvbbrewery@internal.auth.mydomain/bridge3 (not from the MUC host) 3R911-23,
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Received[c2s]:
Apr 22 18:55:36 auth.mydomain:pep debug get_pep_service(“jvb”)
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvb@auth.mydomain/EJGCKZno (not from the MUC host) 3R911-24,
Apr 22 18:55:36 c2s55f0f8ae05b0 debug Sending[c2s]:
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug Filtering stanza type presence to from jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:36 conference.mydomain:muc_domain_mapper debug No need to rewrite jvb@auth.mydomain/EJGCKZno (not from the MUC host) 3R911-24,
Apr 22 18:55:36 datamanager debug Removing empty offline datastore for user jvb@auth.mydomain
Apr 22 18:55:38 c2s55f0f8e93540 debug Received[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ auth.mydomain
Apr 22 18:55:38 c2s55f0f8e93540 debug Sending[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug Filtering stanza type iq to jibri@auth.mydomain/aa5j8rv2 from auth.mydomain
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jibri@auth.mydomain/aa5j8rv2
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite auth.mydomain (not from the MUC host) WILuT-604603,
Apr 22 18:55:38 c2s55f0f9214680 debug Received[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ auth.mydomain
Apr 22 18:55:38 c2s55f0f9214680 debug Sending[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug Filtering stanza type iq to jibri@auth.mydomain/G1XaGEqo from auth.mydomain
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jibri@auth.mydomain/G1XaGEqo
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite auth.mydomain (not from the MUC host) U1nPE-604125,
Apr 22 18:55:38 c2s55f0f8f92940 debug Received[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ auth.mydomain
Apr 22 18:55:38 c2s55f0f8f92940 debug Sending[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug Filtering stanza type iq to jibri@auth.mydomain/wTuNX2by from auth.mydomain
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jibri@auth.mydomain/wTuNX2by
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite auth.mydomain (not from the MUC host) 6tOiU-604655,
Apr 22 18:55:38 c2s55f0f9183d50 debug Received[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ auth.mydomain
Apr 22 18:55:38 c2s55f0f9183d50 debug Sending[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug Filtering stanza type iq to jibri@auth.mydomain/1zMavIpX from auth.mydomain
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jibri@auth.mydomain/1zMavIpX
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite auth.mydomain (not from the MUC host) TZtO1-604342,
Apr 22 18:55:38 c2s55f0f8f25240 debug Received[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ auth.mydomain
Apr 22 18:55:38 c2s55f0f8f25240 debug Sending[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug Filtering stanza type iq to jibri@auth.mydomain/zkuQDT2q from auth.mydomain
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jibri@auth.mydomain/zkuQDT2q
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite auth.mydomain (not from the MUC host) JeBD1-604017,
Apr 22 18:55:38 c2s55f0f91b90f0 debug Received[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ auth.mydomain
Apr 22 18:55:38 c2s55f0f91b90f0 debug Sending[c2s]:
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug Filtering stanza type iq to jibri@auth.mydomain/QkZserRY from auth.mydomain
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jibri@auth.mydomain/QkZserRY
Apr 22 18:55:38 conference.mydomain:muc_domain_mapper debug No need to rewrite auth.mydomain (not from the MUC host) GO6uh-603907,
Apr 22 18:55:41 c2s55f0f8ae05b0 debug Received[c2s]:
Apr 22 18:55:41 auth.mydomain:pep debug get_pep_service(“jvb”)
Apr 22 18:55:41 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jvbbrewery@internal.auth.mydomain/bridge3
Apr 22 18:55:41 conference.mydomain:muc_domain_mapper debug No need to rewrite jvb@auth.mydomain/EJGCKZno (not from the MUC host) 3R911-27,
Apr 22 18:55:41 internal.auth.mydomain:muc debug presence update for jvbbrewery@internal.auth.mydomain/bridge3 from session jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:41 c2s55f0f91fecc0 debug Sending[c2s]:
Apr 22 18:55:41 conference.mydomain:muc_domain_mapper debug Filtering stanza type presence to focus@auth.mydomain/focus1627861540066264 from jvbbrewery@internal.auth.mydomain/bridge3
Apr 22 18:55:41 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ focus@auth.mydomain/focus1627861540066264
Apr 22 18:55:41 conference.mydomain:muc_domain_mapper debug No need to rewrite jvbbrewery@internal.auth.mydomain/bridge3 (not from the MUC host) 3R911-27,
Apr 22 18:55:41 c2s55f0f8ae05b0 debug Sending[c2s]:
Apr 22 18:55:41 conference.mydomain:muc_domain_mapper debug Filtering stanza type presence to jvb@auth.mydomain/EJGCKZno from jvbbrewery@internal.auth.mydomain/bridge3
Apr 22 18:55:41 conference.mydomain:muc_domain_mapper debug No need to rewrite out ‘to’ jvb@auth.mydomain/EJGCKZno
Apr 22 18:55:41 conference.mydomain:muc_domain_mapper debug No need to rewrite jvbbrewery@internal.auth.mydomain/bridge3 (not from the MUC host) 3R911-27,

#2

Anyone have any idea of this?
Thanks

#3

any ideas ?

#4

Are these latest stable versions?

#5

Hi Damian,
The Prosody, jicofo and videobridge version that are installed are below

2021-04-26T12:32:37.567Z [modules/version/ComponentsVersions.js] Got xmpp version: Prosody(0.11.7,Linux)
Logger.js:154 2021-04-26T12:32:37.567Z [modules/version/ComponentsVersions.js] Got focus version: JiCoFo(1.0.644,Linux)
Logger.js:154 2021-04-26T12:32:37.812Z [modules/version/ComponentsVersions.js] Got videobridge version: 2.1.376-g9f12bfe2

#6

You better update to the latest and see whether you repro again.

#7

Hi Damian
We have now upgraded to the latest, but still see the same java exception
Everything seems okay despite the exception occurs upon starting up the videobridge

#8

Can you attach the new exception logs …

#9

Hi Damian

I have pasted below, the log of when jicofo starts (jicofo.log only) and when jvb starts (both jicofo.log and jvb.log)

Jicofo log when Starting jicofo

[Mon May 10 18:21:28 BST 2021] INFO Stopping services.
Bad level value for property: .level
[Mon May 10 18:21:28 BST 2021] INFO Starting Jicofo.
[Mon May 10 18:21:28 BST 2021] INFO Initialized newConfig: merge of /etc/jitsi/jicofo/jicofo.conf: 1,system properties,reference.conf @ jar:file:/usr/share/jicofo/jicofo.jar!/reference.conf: 1
[Mon May 10 18:21:28 BST 2021] INFO loading config file at path /etc/jitsi/jicofo/sip-communicator.properties
[Mon May 10 18:21:28 BST 2021] INFO Initialized legacyConfig: sip communicator props (no description provided)
[Mon May 10 18:21:28 BST 2021] INFO Reloading the Typesafe config source (previously reloaded 0 times).
[Mon May 10 18:21:28 BST 2021] INFO No dedicated Service XMPP connection configured, re-using the client XMPP connection.
[Mon May 10 18:21:29 BST 2021] INFO Using org.jitsi.jicofo.bridge.SplitBridgeSelectionStrategy
[Mon May 10 18:21:29 BST 2021] WARNING JVB health-checks disabled
[Mon May 10 18:21:29 BST 2021] INFO Initialized with JID=jvbbrewery@internal.auth.mydomain
[Mon May 10 18:21:29 BST 2021] INFO Initialized with JID=jibribrewery@internal.auth.mydomain
[Mon May 10 18:21:29 BST 2021] INFO No SIP Jibri detector configured.
[Mon May 10 18:21:29 BST 2021] INFO No Jigasi detector configured.
[Mon May 10 18:21:29 BST 2021] INFO Connected, JID= null
[Mon May 10 18:21:29 BST 2021] INFO Initialized octoId=1
[Mon May 10 18:21:29 BST 2021] INFO Starting authentication service with config=AuthConfig[enabled=true, type=XMPP, loginUrl=mydomain, logoutUrl=null, authenticationLifetime=PT24H, enableAutoLogin=false].
[Mon May 10 18:21:29 BST 2021] INFO Auto login disabled
[Mon May 10 18:21:29 BST 2021] INFO Authentication lifetime: PT24H
[Mon May 10 18:21:29 BST 2021] INFO Registering IQ handlers with XmppConnection.
[Mon May 10 18:21:29 BST 2021] INFO Starting HTTP server with config: host=null, port=8888, tlsPort=8843, isTls=false, keyStorePath=null.
[Mon May 10 18:21:29 BST 2021] INFO Joined the room.
[Mon May 10 18:21:29 BST 2021] INFO Joined the room.
[Mon May 10 18:21:29 BST 2021] INFO Set replyTimeout=PT15S
[Mon May 10 18:21:29 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-413505957
[Mon May 10 18:21:29 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-673578973
[Mon May 10 18:21:29 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-983673772
[Mon May 10 18:21:29 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-603781540
[Mon May 10 18:21:29 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-120383875
[Mon May 10 18:21:29 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-484855720
[Mon May 10 18:21:29 BST 2021] INFO Logging initialized @994ms to org.eclipse.jetty.util.log.Slf4jLog
[Mon May 10 18:21:29 BST 2021] INFO jetty-9.4.35.v20201120; built: 2020-11-20T21:17:03.964Z; git: bdc54f03a5e0a7e280fab27f55c3c75ee8da89fb; jvm 1.8.0_292-8u292-b10-0ubuntu1~18.04-b10
[Mon May 10 18:21:29 BST 2021] WARNING A provider org.jitsi.rest.Version registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runtime. Due to constraint configuration problems the provider org.jitsi.rest.Version will be ignored.
[Mon May 10 18:21:30 BST 2021] INFO Started o.e.j.s.ServletContextHandler@2de50ee4{/,null,AVAILABLE}
[Mon May 10 18:21:30 BST 2021] INFO Started ServerConnector@7a7471ce{HTTP/1.1, (http/1.1)}{0.0.0.0:8888}
[Mon May 10 18:21:30 BST 2021] INFO Started @1712ms

When starting JVB

Jicofo log

[Mon May 10 18:24:21 BST 2021] INFO Added brewery instance: jvbbrewery@internal.auth.mydomain/bridge3
[Mon May 10 18:24:21 BST 2021] INFO Added new videobridge: Bridge[jid=jvbbrewery@internal.auth.mydomain/bridge3, relayId=185.237.98.20:4096, region=region1, stress=0.00]
[Mon May 10 18:24:21 BST 2021] SEVERE Exception in packet listener
java.lang.NullPointerException
at org.jitsi.jicofo.bridge.JvbDoctor.addBridge(JvbDoctor.java:145)
at org.jitsi.jicofo.bridge.BridgeSelector.addJvbAddress(BridgeSelector.java:122)
at org.jitsi.jicofo.bridge.BridgeMucDetector.onInstanceStatusChanged(BridgeMucDetector.kt:49)
at org.jitsi.jicofo.bridge.BridgeMucDetector.onInstanceStatusChanged(BridgeMucDetector.kt:32)
at org.jitsi.jicofo.xmpp.BaseBrewery.processInstanceStatusChanged(BaseBrewery.java:299)
at org.jitsi.jicofo.xmpp.BaseBrewery.processMemberPresence(BaseBrewery.java:273)
at org.jitsi.jicofo.xmpp.BaseBrewery.memberPresenceChanged(BaseBrewery.java:219)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.lambda$fireMemberPresenceEvent$1(ChatRoomImpl.java:559)
at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:895)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.fireMemberPresenceEvent(ChatRoomImpl.java:559)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.processOtherPresence(ChatRoomImpl.java:831)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.processPresence(ChatRoomImpl.java:869)
at org.jivesoftware.smackx.muc.MultiUserChat$3.processStanza(MultiUserChat.java:251)
at org.jivesoftware.smack.AbstractXMPPConnection$6.run(AbstractXMPPConnection.java:1263)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

jvb log

Mon May 10 18:24:15 BST 2021] INFO Initialized newConfig: merge of /etc/jitsi/videobridge/jvb.conf: 1,application.conf @ jar:file:/usr/share/jitsi-videobridge/jitsi-videobridge.jar!/application.conf: 1,system properties,reference.conf @ jar:file:/usr/share/jitsi-videobridge/jitsi-videobridge.jar!/reference.conf: 1,reference.conf @ jar:file:/usr/share/jitsi-videobridge/lib/jitsi-media-transform-1.0-229-gfa5ea3f.jar!/reference.conf: 1,reference.conf @ jar:file:/usr/share/jitsi-videobridge/lib/ice4j-3.0-25-g5a299cd.jar!/reference.conf: 1
[Mon May 10 18:24:16 BST 2021] INFO loading config file at path /etc/jitsi/videobridge/sip-communicator.properties
[Mon May 10 18:24:16 BST 2021] INFO Initialized legacyConfig: sip communicator props (no description provided)
[Mon May 10 18:24:16 BST 2021] INFO Reloading the Typesafe config source (previously reloaded 0 times).
[Mon May 10 18:24:16 BST 2021] INFO Discovered public address 185.237.98.20:28889/udp from STUN server 152.67.143.103:443/udp using local address 185.237.98.20:0/udp
[Mon May 10 18:24:16 BST 2021] INFO Using org.ice4j.ice.harvest.StunMappingCandidateHarvester, face=/185.237.98.20, mask=/185.237.98.20
[Mon May 10 18:24:16 BST 2021] INFO Initialized mapping harvesters (delay=350ms). stunDiscoveryFailed=false
[Mon May 10 18:24:16 BST 2021] INFO Initializing a new MucClient for [ org.jitsi.xmpp.mucclient.MucClientConfiguration id=shard domain=auth.mydomain hostname=mydomain port=null username=jvb mucs=[JvbBrewery@internal.auth.mydomain] mucNickname=bridge3 disableCertificateVerification=true]
[Mon May 10 18:24:16 BST 2021] WARNING Disabling certificate verification!
[Mon May 10 18:24:16 BST 2021] INFO LastNReducer with reductionScale: 0.75 recoverScale: 1.25 impactTime: PT1M minLastN: 1 maxEnforcedLastN: 40
[Mon May 10 18:24:16 BST 2021] INFO TaskPools detected 4 processors, creating the CPU pool with that many threads
[Mon May 10 18:24:16 BST 2021] INFO Dispatching a thread to connect and login.
[Mon May 10 18:24:16 BST 2021] INFO Running with open files limit 65000 (hard 65000), thread limit 65000 (hard 65000).
[Mon May 10 18:24:16 BST 2021] INFO Starting with 60 second interval.
[Mon May 10 18:24:16 BST 2021] INFO Started with interval=10000, timeout=PT30S, maxDuration=PT3S, stickyFailures=false.
[Mon May 10 18:24:16 BST 2021] INFO Initialized with bind address 185.237.98.20 and bind port 4096. Receive buffer size 10485760 (asked for 10485760). Send buffer size 212992 (asked for 10485760).
[Mon May 10 18:24:16 BST 2021] INFO Created Octo UDP transport
[Mon May 10 18:24:16 BST 2021] INFO Created OctoTransport
[Mon May 10 18:24:16 BST 2021] INFO Not starting CallstatsService, disabled in configuration.
[Mon May 10 18:24:16 BST 2021] INFO Starting public http server
[Mon May 10 18:24:16 BST 2021] INFO Base URL: wss://mydomain:443/colibri-ws/bridge3
[Mon May 10 18:24:16 BST 2021] INFO Logging initialized @1021ms to org.eclipse.jetty.util.log.JavaUtilLog
[Mon May 10 18:24:16 BST 2021] INFO Registering servlet at /colibri-ws/*, baseUrl = wss://mydomain:443/colibri-ws/bridge3
[Mon May 10 18:24:16 BST 2021] INFO jetty-9.4.35.v20201120; built: 2020-11-20T21:17:03.964Z; git: bdc54f03a5e0a7e280fab27f55c3c75ee8da89fb; jvm 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10
[Mon May 10 18:24:16 BST 2021] INFO Connected.
[Mon May 10 18:24:16 BST 2021] INFO Logging in.
[Mon May 10 18:24:16 BST 2021] INFO Started o.e.j.s.ServletContextHandler@6436a7db{/,null,AVAILABLE}
[Mon May 10 18:24:16 BST 2021] INFO Started ServerConnector@2e48362c{HTTP/1.1, (http/1.1)}{0.0.0.0:9090}
[Mon May 10 18:24:16 BST 2021] INFO Started @1173ms
[Mon May 10 18:24:16 BST 2021] INFO Starting private http server
[Mon May 10 18:24:16 BST 2021] INFO Authenticated, b=false
[Mon May 10 18:24:16 BST 2021] INFO Joined MUC: jvbbrewery@internal.auth.mydomain
[Mon May 10 18:24:16 BST 2021] INFO jetty-9.4.35.v20201120; built: 2020-11-20T21:17:03.964Z; git: bdc54f03a5e0a7e280fab27f55c3c75ee8da89fb; jvm 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10
[Mon May 10 18:24:17 BST 2021] WARNING A provider org.jitsi.rest.Health registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runtime. Due to constraint configuration problems the provider org.jitsi.rest.Health will be ignored.
[Mon May 10 18:24:17 BST 2021] WARNING A provider org.jitsi.rest.Version registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runtime. Due to constraint configuration problems the provider org.jitsi.rest.Version will be ignored.
[Mon May 10 18:24:17 BST 2021] INFO Started o.e.j.s.ServletContextHandler@7c1812b3{/,null,AVAILABLE}
[Mon May 10 18:24:17 BST 2021] INFO Started ServerConnector@5f6722d3{HTTP/1.1, (http/1.1)}{127.0.0.1:8080}
[Mon May 10 18:24:17 BST 2021] INFO Started @2117ms

Thanks

#10

This is strange can you check your logging.properties file /etc/jitsi/jicofo/logging.properties
Maybe there is an error there that breaks stuff …

#11

Thats the logging properties file

handlers=java.util.logging.ConsoleHandler
java.util.logging.ConsoleHandler.level=ALL
java.util.logging.ConsoleHandler.formatter=java.util.logging.SimpleFormatter
java.util.logging.SimpleFormatter.format=[%1$tc] %4$s %5$s%6$s%n
.level=DEBUG

#12

I’ve changed level to INFO, so the Bad level value for property: .level has gone, but the exception still remains on starting a JVB

#13

Updated log when changin level to INFO

Jicofo starting log

[Mon May 10 19:34:16 BST 2021] INFO Starting Jicofo.
[Mon May 10 19:34:17 BST 2021] INFO Initialized newConfig: merge of /etc/jitsi/jicofo/jicofo.conf: 1,system properties,reference.conf @ jar:file:/usr/share/jicofo/jicofo.jar!/reference.conf: 1
[Mon May 10 19:34:17 BST 2021] INFO loading config file at path /etc/jitsi/jicofo/sip-communicator.properties
[Mon May 10 19:34:17 BST 2021] INFO Initialized legacyConfig: sip communicator props (no description provided)
[Mon May 10 19:34:17 BST 2021] INFO Reloading the Typesafe config source (previously reloaded 0 times).
[Mon May 10 19:34:17 BST 2021] INFO No dedicated Service XMPP connection configured, re-using the client XMPP connection.
[Mon May 10 19:34:17 BST 2021] INFO Using org.jitsi.jicofo.bridge.SplitBridgeSelectionStrategy
[Mon May 10 19:34:17 BST 2021] WARNING JVB health-checks disabled
[Mon May 10 19:34:17 BST 2021] INFO Initialized with JID=jvbbrewery@internal.auth.mydomain
[Mon May 10 19:34:17 BST 2021] INFO Initialized with JID=jibribrewery@internal.auth.mydomain
[Mon May 10 19:34:17 BST 2021] INFO No SIP Jibri detector configured.
[Mon May 10 19:34:17 BST 2021] INFO No Jigasi detector configured.
[Mon May 10 19:34:17 BST 2021] INFO Initialized octoId=1
[Mon May 10 19:34:17 BST 2021] INFO Starting authentication service with config=AuthConfig[enabled=true, type=XMPP, loginUrl=mydomain, logoutUrl=null, authenticationLifetime=PT24H, enableAutoLogin=fals e].
[Mon May 10 19:34:17 BST 2021] INFO Auto login disabled
[Mon May 10 19:34:17 BST 2021] INFO Authentication lifetime: PT24H
[Mon May 10 19:34:17 BST 2021] INFO Registering IQ handlers with XmppConnection.
[Mon May 10 19:34:17 BST 2021] INFO Starting HTTP server with config: host=null, port=8888, tlsPort=8843, isTls=false, keyStorePath=null.
[Mon May 10 19:34:17 BST 2021] INFO Connected, JID= null
[Mon May 10 19:34:17 BST 2021] INFO Logging initialized @964ms to org.eclipse.jetty.util.log.Slf4jLog
[Mon May 10 19:34:17 BST 2021] INFO Joined the room.
[Mon May 10 19:34:17 BST 2021] INFO jetty-9.4.35.v20201120; built: 2020-11-20T21:17:03.964Z; git: bdc54f03a5e0a7e280fab27f55c3c75ee8da89fb; jvm 1.8.0_292-8u292-b10-0ubuntu1~18.04-b10
[Mon May 10 19:34:17 BST 2021] INFO Joined the room.
[Mon May 10 19:34:17 BST 2021] INFO Set replyTimeout=PT15S
[Mon May 10 19:34:17 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-413505957
[Mon May 10 19:34:17 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-673578973
[Mon May 10 19:34:17 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-983673772
[Mon May 10 19:34:17 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-603781540
[Mon May 10 19:34:17 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-120383875
[Mon May 10 19:34:17 BST 2021] INFO Added brewery instance: jibribrewery@internal.auth.mydomain/jibri-instanse-484855720
[Mon May 10 19:34:18 BST 2021] WARNING A provider org.jitsi.rest.Version registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runtime. Due to constraint configura tion problems the provider org.jitsi.rest.Version will be ignored.
[Mon May 10 19:34:18 BST 2021] INFO Started o.e.j.s.ServletContextHandler@2de50ee4{/,null,AVAILABLE}
[Mon May 10 19:34:18 BST 2021] INFO Started ServerConnector@7a7471ce{HTTP/1.1, (http/1.1)}{0.0.0.0:8888}
[Mon May 10 19:34:18 BST 2021] INFO Started @1656ms

jicofo log when JVB starts

[Mon May 10 19:34:51 BST 2021] INFO Added brewery instance: jvbbrewery@internal.auth.mydomain/bridge3
[Mon May 10 19:34:51 BST 2021] INFO Added new videobridge: Bridge[jid=jvbbrewery@internal.auth.mydomain/bridge3, relayId=185.237.98.20:4096, region=region1, stress=0.00]
[Mon May 10 19:34:51 BST 2021] SEVERE Exception in packet listener
java.lang.NullPointerException
at org.jitsi.jicofo.bridge.JvbDoctor.addBridge(JvbDoctor.java:145)
at org.jitsi.jicofo.bridge.BridgeSelector.addJvbAddress(BridgeSelector.java:122)
at org.jitsi.jicofo.bridge.BridgeMucDetector.onInstanceStatusChanged(BridgeMucDetector.kt:49)
at org.jitsi.jicofo.bridge.BridgeMucDetector.onInstanceStatusChanged(BridgeMucDetector.kt:32)
at org.jitsi.jicofo.xmpp.BaseBrewery.processInstanceStatusChanged(BaseBrewery.java:299)
at org.jitsi.jicofo.xmpp.BaseBrewery.processMemberPresence(BaseBrewery.java:273)
at org.jitsi.jicofo.xmpp.BaseBrewery.memberPresenceChanged(BaseBrewery.java:219)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.lambda$fireMemberPresenceEvent$1(ChatRoomImpl.java:559)
at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:895)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.fireMemberPresenceEvent(ChatRoomImpl.java:559)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.processOtherPresence(ChatRoomImpl.java:831)
at org.jitsi.impl.protocol.xmpp.ChatRoomImpl.processPresence(ChatRoomImpl.java:869)
at org.jivesoftware.smackx.muc.MultiUserChat$3.processStanza(MultiUserChat.java:251)
at org.jivesoftware.smack.AbstractXMPPConnection$6.run(AbstractXMPPConnection.java:1263)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

JVB log when starting

[Mon May 10 19:34:46 BST 2021] INFO Initialized newConfig: merge of /etc/jitsi/videobridge/jvb.conf: 1,application.conf @ jar:file:/usr/share/jitsi-videobridge/jitsi-videobridge.jar!/application.conf: 1,sys tem properties,reference.conf @ jar:file:/usr/share/jitsi-videobridge/jitsi-videobridge.jar!/reference.conf: 1,reference.conf @ jar:file:/usr/share/jitsi-videobridge/lib/jitsi-media-transform-1.0-229-gfa5ea 3f.jar!/reference.conf: 1,reference.conf @ jar:file:/usr/share/jitsi-videobridge/lib/ice4j-3.0-25-g5a299cd.jar!/reference.conf: 1
[Mon May 10 19:34:46 BST 2021] INFO loading config file at path /etc/jitsi/videobridge/sip-communicator.properties
[Mon May 10 19:34:46 BST 2021] INFO Initialized legacyConfig: sip communicator props (no description provided)
[Mon May 10 19:34:46 BST 2021] INFO Reloading the Typesafe config source (previously reloaded 0 times).
[Mon May 10 19:34:46 BST 2021] INFO Discovered public address 185.237.98.20:14086/udp from STUN server 152.67.134.217:443/udp using local address 185.237.98.20:0/udp
[Mon May 10 19:34:46 BST 2021] INFO Using org.ice4j.ice.harvest.StunMappingCandidateHarvester, face=/185.237.98.20, mask=/185.237.98.20
[Mon May 10 19:34:46 BST 2021] INFO Initialized mapping harvesters (delay=327ms). stunDiscoveryFailed=false
[Mon May 10 19:34:46 BST 2021] INFO Initializing a new MucClient for [ org.jitsi.xmpp.mucclient.MucClientConfiguration id=shard domain=auth.mydomain hostname=mydomain port=null username=jvb mucs=[ JvbBrewery@internal.auth.mydomain] mucNickname=bridge3 disableCertificateVerification=true]
[Mon May 10 19:34:46 BST 2021] WARNING Disabling certificate verification!
[Mon May 10 19:34:46 BST 2021] INFO LastNReducer with reductionScale: 0.75 recoverScale: 1.25 impactTime: PT1M minLastN: 1 maxEnforcedLastN: 40
[Mon May 10 19:34:46 BST 2021] INFO TaskPools detected 4 processors, creating the CPU pool with that many threads
[Mon May 10 19:34:46 BST 2021] INFO Dispatching a thread to connect and login.
[Mon May 10 19:34:46 BST 2021] INFO Running with open files limit 65000 (hard 65000), thread limit 65000 (hard 65000).
[Mon May 10 19:34:46 BST 2021] INFO Starting with 60 second interval.
[Mon May 10 19:34:46 BST 2021] INFO Started with interval=10000, timeout=PT30S, maxDuration=PT3S, stickyFailures=false.
[Mon May 10 19:34:46 BST 2021] INFO Initialized with bind address 185.237.98.20 and bind port 4096. Receive buffer size 10485760 (asked for 10485760). Send buffer size 212992 (asked for 10485760).
[Mon May 10 19:34:46 BST 2021] INFO Created Octo UDP transport
[Mon May 10 19:34:46 BST 2021] INFO Created OctoTransport
[Mon May 10 19:34:46 BST 2021] INFO Not starting CallstatsService, disabled in configuration.
[Mon May 10 19:34:46 BST 2021] INFO Starting public http server
[Mon May 10 19:34:46 BST 2021] INFO Base URL: wss://mydomain:443/colibri-ws/bridge3
[Mon May 10 19:34:46 BST 2021] INFO Logging initialized @985ms to org.eclipse.jetty.util.log.JavaUtilLog
[Mon May 10 19:34:46 BST 2021] INFO Registering servlet at /colibri-ws/*, baseUrl = wss://mydomain:443/colibri-ws/bridge3
[Mon May 10 19:34:46 BST 2021] INFO jetty-9.4.35.v20201120; built: 2020-11-20T21:17:03.964Z; git: bdc54f03a5e0a7e280fab27f55c3c75ee8da89fb; jvm 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10
[Mon May 10 19:34:46 BST 2021] INFO Connected.
[Mon May 10 19:34:46 BST 2021] INFO Logging in.
[Mon May 10 19:34:46 BST 2021] INFO Authenticated, b=false
[Mon May 10 19:34:46 BST 2021] INFO Joined MUC: jvbbrewery@internal.auth.mydomain
[Mon May 10 19:34:46 BST 2021] INFO Started o.e.j.s.ServletContextHandler@2dc995f4{/,null,AVAILABLE}
[Mon May 10 19:34:46 BST 2021] INFO Started ServerConnector@5f9be66c{HTTP/1.1, (http/1.1)}{0.0.0.0:9090}
[Mon May 10 19:34:46 BST 2021] INFO Started @1169ms
[Mon May 10 19:34:46 BST 2021] INFO Starting private http server
[Mon May 10 19:34:46 BST 2021] INFO jetty-9.4.35.v20201120; built: 2020-11-20T21:17:03.964Z; git: bdc54f03a5e0a7e280fab27f55c3c75ee8da89fb; jvm 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10
[Mon May 10 19:34:47 BST 2021] WARNING A provider org.jitsi.rest.Health registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runtime. Due to constraint configurat ion problems the provider org.jitsi.rest.Health will be ignored.
[Mon May 10 19:34:47 BST 2021] WARNING A provider org.jitsi.rest.Version registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runtime. Due to constraint configura tion problems the provider org.jitsi.rest.Version will be ignored.
[Mon May 10 19:34:47 BST 2021] INFO Started o.e.j.s.ServletContextHandler@5edf2821{/,null,AVAILABLE}
[Mon May 10 19:34:47 BST 2021] INFO Started ServerConnector@681a8b4e{HTTP/1.1, (http/1.1)}{127.0.0.1:8080}

#14

That’s all in /etc/jitsi/jicofo/logging.properties, can you leave it empty to see whether that changes anything?

#15

If I empty the file, there is no logging whatsoever
As mentioned, i got rid of the Bad level value for property by setting .level to INFO