"Localpart must not contain '@'" Error in JVP log when I add a new videobridge

Does anyone know why I am getting the “Localpart must not contain ‘@’” Error in JVP log when I add a new videobridge to my jisti meet standard install? Jicofi log shows a failed to allocate channels severe error when this occurs.

I have tried reinstalling both my JMS and the additional JVB using the latest stable and also tried with latest unstable builds (yesterday). The JMS works fine without any errors but once I add the additional JVB and start a meeting, I get the error messages.

these are both my jvb and jicofo logs:

JVB Log
JVB 2020-10-28 03:57:29.291 INFO: [21] org.jitsi.videobridge.health.Health.log() Performed a successful health check in 41ms. Sticky failure: false
JVB 2020-10-28 03:57:29.867 WARNING: [274] org.jivesoftware.smack.AbstractXMPPConnection.callConnectionClosedOnErrorListener() Connection XMPPTCPConnection[jvb@auth./K11ySgus] (0) closed with error
org.jxmpp.stringprep.XmppStringprepException: Localpart must not contain ‘@’
at org.jxmpp.stringprep.simple.SimpleXmppStringprep.localprep(SimpleXmppStringprep.java:74)
at org.jxmpp.stringprep.XmppStringPrepUtil.localprep(XmppStringPrepUtil.java:62)
at org.jxmpp.jid.parts.Localpart.from(Localpart.java:137)
at org.jitsi.xmpp.extensions.colibri.ColibriIQProvider.parse(ColibriIQProvider.java:289)
at org.jitsi.xmpp.extensions.colibri.ColibriIQProvider.parse(ColibriIQProvider.java:36)
at org.jivesoftware.smack.provider.Provider.parse(Provider.java:43)
at org.jivesoftware.smack.util.PacketParserUtils.parseIQ(PacketParserUtils.java:633)
at org.jivesoftware.smack.util.PacketParserUtils.parseStanza(PacketParserUtils.java:153)
at org.jivesoftware.smack.AbstractXMPPConnection.parseAndProcessStanza(AbstractXMPPConnection.java:1083)
at org.jivesoftware.smack.tcp.XMPPTCPConnection.access$500(XMPPTCPConnection.java:151)
at org.jivesoftware.smack.tcp.XMPPTCPConnection$PacketReader.parsePackets(XMPPTCPConnection.java:1044)
at org.jivesoftware.smack.tcp.XMPPTCPConnection$PacketReader.access$300(XMPPTCPConnection.java:1000)
at org.jivesoftware.smack.tcp.XMPPTCPConnection$PacketReader$1.run(XMPPTCPConnection.java:1016)
at java.base/java.lang.Thread.run(Thread.java:832)
JVB 2020-10-28 03:57:29.869 INFO: [274] org.jitsi.xmpp.mucclient.MucClient.log() [MucClient id=shard hostname=] closed on error:
org.jxmpp.stringprep.XmppStringprepException: Localpart must not contain ‘@’
at org.jxmpp.stringprep.simple.SimpleXmppStringprep.localprep(SimpleXmppStringprep.java:74)
at org.jxmpp.stringprep.XmppStringPrepUtil.localprep(XmppStringPrepUtil.java:62)
at org.jxmpp.jid.parts.Localpart.from(Localpart.java:137)
at org.jitsi.xmpp.extensions.colibri.ColibriIQProvider.parse(ColibriIQProvider.java:289)
at org.jitsi.xmpp.extensions.colibri.ColibriIQProvider.parse(ColibriIQProvider.java:36)
at org.jivesoftware.smack.provider.Provider.parse(Provider.java:43)
at org.jivesoftware.smack.util.PacketParserUtils.parseIQ(PacketParserUtils.java:633)
at org.jivesoftware.smack.util.PacketParserUtils.parseStanza(PacketParserUtils.java:153)
at org.jivesoftware.smack.AbstractXMPPConnection.parseAndProcessStanza(AbstractXMPPConnection.java:1083)
at org.jivesoftware.smack.tcp.XMPPTCPConnection.access$500(XMPPTCPConnection.java:151)
at org.jivesoftware.smack.tcp.XMPPTCPConnection$PacketReader.parsePackets(XMPPTCPConnection.java:1044)
at org.jivesoftware.smack.tcp.XMPPTCPConnection$PacketReader.access$300(XMPPTCPConnection.java:1000)
at org.jivesoftware.smack.tcp.XMPPTCPConnection$PacketReader$1.run(XMPPTCPConnection.java:1016)
at java.base/java.lang.Thread.run(Thread.java:832)
JVB 2020-10-28 03:57:30.426 SEVERE: [17] org.jitsi.xmpp.mucclient.MucClient.log() Failed to send stanza:
org.jivesoftware.smack.SmackException$NotConnectedException: The connection XMPPTCPConnection[jvb@auth./K11ySgus] (0) is no longer connected. done=true smResumptionPossible=false
at org.jivesoftware.smack.tcp.XMPPTCPConnection$PacketWriter.throwNotConnectedExceptionIfDoneAndResumptionNotPossible(XMPPTCPConnection.java:1327)
at org.jivesoftware.smack.tcp.XMPPTCPConnection.throwNotConnectedExceptionIfAppropriate(XMPPTCPConnection.java:358)
at org.jivesoftware.smack.AbstractXMPPConnection.sendStanza(AbstractXMPPConnection.java:670)
at org.jitsi.xmpp.mucclient.MucClient$MucWrapper.setPresenceExtensions(MucClient.java:612)
at org.jitsi.xmpp.mucclient.MucClient.lambda$setPresenceExtensions$1(MucClient.java:364)
at java.base/java.util.concurrent.ConcurrentHashMap$ValuesView.forEach(ConcurrentHashMap.java:4780)
at org.jitsi.xmpp.mucclient.MucClient.setPresenceExtensions(MucClient.java:364)
at org.jitsi.xmpp.mucclient.MucClient.setPresenceExtension(MucClient.java:353)
at org.jitsi.xmpp.mucclient.MucClientManager.lambda$setPresenceExtension$1(MucClientManager.java:179)
at java.base/java.util.concurrent.ConcurrentHashMap$ValuesView.forEach(ConcurrentHashMap.java:4780)
at org.jitsi.xmpp.mucclient.MucClientManager.setPresenceExtension(MucClientManager.java:178)
at org.jitsi.videobridge.xmpp.ClientConnectionImpl.setPresenceExtension(ClientConnectionImpl.java:163)
at org.jitsi.videobridge.stats.MucStatsTransport.publishStatistics(MucStatsTransport.java:65)
at org.jitsi.videobridge.stats.StatsTransport.publishStatistics(StatsTransport.java:51)
at org.jitsi.videobridge.stats.StatsManager$TransportPeriodicRunnable.doRun(StatsManager.java:377)
at org.jitsi.utils.concurrent.PeriodicRunnableWithObject.run(PeriodicRunnableWithObject.java:87)
at org.jitsi.utils.concurrent.RecurringRunnableExecutor.run(RecurringRunnableExecutor.java:216)
at org.jitsi.utils.concurrent.RecurringRunnableExecutor.runInThread(RecurringRunnableExecutor.java:292)
at org.jitsi.utils.concurrent.RecurringRunnableExecutor.access$000(RecurringRunnableExecutor.java:36)
at org.jitsi.utils.concurrent.RecurringRunnableExecutor$1.run(RecurringRunnableExecutor.java:328)
JVB 2020-10-28 03:57:39.293 INFO: [21] org.jitsi.videobridge.Videobridge.log() CAT=stat create_conf,conf_id=56670be5393e9f70 conf_name=null,logging=false,conf_count=1,ch_count=0,v_streams=0
JVB 2020-10-28 03:57:39.314 INFO: [21] org.jitsi.videobridge.health.Health.log() Performed a successful health check in 21ms. Sticky failure: false
JVB 2020-10-28 03:57:41.676 INFO: [594] org.jitsi.xmpp.mucclient.MucClient.log() [MucClient id=shard hostname=] connected
JVB 2020-10-28 03:57:42.123 INFO: [594] org.jitsi.xmpp.mucclient.MucClient.log() Leaving a MUC we already occupy.

On the Jicofo log:
Jicofo 2020-10-27 22:57:42.395 INFO: [31] org.jitsi.jicofo.bridge.JvbDoctor.log() Scheduled health-check task for: jvbbrewery@internal.auth./region1
Jicofo 2020-10-27 22:57:44.789 SEVERE: [288] org.jitsi.jicofo.AbstractChannelAllocator.log() jvbbrewery@internal.auth./region1 - failed to allocate channels, will consider the bridge faulty: Timed out waiting for a response.
org.jitsi.protocol.xmpp.colibri.exception.TimeoutException: Timed out waiting for a response.
at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.maybeThrowOperationFailed(ColibriConferenceImpl.java:342)
at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.createColibriChannels(ColibriConferenceImpl.java:282)
at org.jitsi.protocol.xmpp.colibri.ColibriConference.createColibriChannels(ColibriConference.java:112)
at org.jitsi.jicofo.ParticipantChannelAllocator.doAllocateChannels(ParticipantChannelAllocator.java:111)
at org.jitsi.jicofo.AbstractChannelAllocator.allocateChannels(AbstractChannelAllocator.java:271)
at org.jitsi.jicofo.AbstractChannelAllocator.doRun(AbstractChannelAllocator.java:190)
at org.jitsi.jicofo.AbstractChannelAllocator.run(AbstractChannelAllocator.java:150)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
at java.base/java.lang.Thread.run(Thread.java:832)
Jicofo 2020-10-27 22:57:44.790 SEVERE: [289] org.jitsi.jicofo.AbstractChannelAllocator.log() jvbbrewery@internal.auth./region1 - failed to allocate channels, will consider the bridge faulty: Creator thread has failed to allocate channels: Timed out waiting for a response.
org.jitsi.protocol.xmpp.colibri.exception.TimeoutException: Creator thread has failed to allocate channels: Timed out waiting for a response.
at org.jitsi.protocol.xmpp.colibri.exception.TimeoutException.clone(TimeoutException.java:39)
at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl$ConferenceCreationSemaphore.acquire(ColibriConferenceImpl.java:916)
at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.acquireCreateConferenceSemaphore(ColibriConferenceImpl.java:414)
at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.createColibriChannels(ColibriConferenceImpl.java:251)
at org.jitsi.protocol.xmpp.colibri.ColibriConference.createColibriChannels(ColibriConference.java:112)
at org.jitsi.jicofo.ParticipantChannelAllocator.doAllocateChannels(ParticipantChannelAllocator.java:111)
at org.jitsi.jicofo.AbstractChannelAllocator.allocateChannels(AbstractChannelAllocator.java:271)
at org.jitsi.jicofo.AbstractChannelAllocator.doRun(AbstractChannelAllocator.java:190)
at org.jitsi.jicofo.AbstractChannelAllocator.run(AbstractChannelAllocator.java:150)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
at java.base/java.lang.Thread.run(Thread.java:832)
Jicofo 2020-10-27 22:59:36.181 INFO: [31] org.jitsi.jicofo.xmpp.BaseBrewery.log() Removed brewery instance: jvbbrewery@internal.auth./region1
Jicofo 2020-10-27 22:59:36.181 INFO: [31] org.jitsi.jicofo.xmpp.BaseBrewery.log() A bridge left the MUC: jvbbrewery@internal.auth./region1
Jicofo 2020-10-27 22:59:36.181 INFO: [31] org.jitsi.jicofo.bridge.BridgeSelector.log() Removing JVB: jvbbrewery@internal.auth./region1

You are using new jicofo with older jvb.

Thanks - I thought JVB in the nightly build is the latest version of JVB. I installed JVB2 instead and it now works fine. Thanks for the catch.