Strange Jigasi exception when starting subtitles

Hello,

we’ve got Jigasi working for subtitles with Google Cloud on our test machine. Now trying to replicate working config on another machine and got the following error:

java.lang.NullPointerException: Cannot invoke “org.jitsi.jigasi.AudioModeration.xmppProviderRegistered()” because the return value of “org.jitsi.jigasi.JvbConference.getAudioModeration()” is null

Full trace is below:

2021-11-11 15:54:20.161 INFO: [53] org.jitsi.jigasi.xmpp.CallControl.handleDialIq().195 [ctx=1636646060159166320016] Got dial request null → jitsi_meet_transcribe room: testingjibriua1v7_11112021_0608am@conference.my_domain.com
2021-11-11 15:54:20.309 INFO: [53] org.jitsi.jigasi.JvbConference.start().484 [ctx=1636646060159166320016] Starting JVB conference room: testingjibriua1v7_11112021_0608am@conference.my_domain.com
2021-11-11 15:54:20.317 INFO: [53] org.jitsi.jigasi.JvbConference.setXmppProvider().617 [ctx=1636646060159166320016] Using ProtocolProviderServiceJabberImpl(Jabber:4913216a@meet2.my_domain.com/4913216a)
2021-11-11 15:54:20.353 INFO: [56] org.igniterealtime.jbosh.BOSHClient.init() Starting with 1 request processors
2021-11-11 15:54:20.507 INFO: [56] impl.protocol.jabber.OperationSetBasicTelephonyJabberImpl.registrationStateChanged().127 Jingle : ON
2021-11-11 15:54:20.507 INFO: [56] org.jitsi.jigasi.JvbConference.registrationStateChanged().673 [ctx=1636646060159166320016] Registering XMPP.
2021-11-11 15:54:20.538 INFO: [56] impl.protocol.jabber.ProtocolProviderServiceJabberImpl.authenticated().2423 Authenticated: false
2021-11-11 15:54:20.538 SEVERE: [56] service.protocol.AbstractProtocolProviderService.fireRegistrationStateChanged().201 An error occurred while executing RegistrationStateChangeListener#registrationStateChanged(RegistrationStateChangeEvent) of org.jitsi.jigasi.JvbConference@7c79eb7c
java.lang.NullPointerException: Cannot invoke “org.jitsi.jigasi.AudioModeration.xmppProviderRegistered()” because the return value of “org.jitsi.jigasi.JvbConference.getAudioModeration()” is null
at org.jitsi.jigasi.JvbConference.registrationStateChanged(JvbConference.java:651)
at net.java.sip.communicator.service.protocol.AbstractProtocolProviderService.fireRegistrationStateChanged(AbstractProtocolProviderService.java:187)
at net.java.sip.communicator.service.protocol.AbstractProtocolProviderService.fireRegistrationStateChanged(AbstractProtocolProviderService.java:141)
at net.java.sip.communicator.impl.protocol.jabber.ProtocolProviderServiceJabberImpl.connectAndLogin(ProtocolProviderServiceJabberImpl.java:1389)
at net.java.sip.communicator.impl.protocol.jabber.ProtocolProviderServiceJabberImpl.connectAndLogin(ProtocolProviderServiceJabberImpl.java:970)
at net.java.sip.communicator.impl.protocol.jabber.ProtocolProviderServiceJabberImpl.initializeConnectAndLogin(ProtocolProviderServiceJabberImpl.java:795)
at net.java.sip.communicator.impl.protocol.jabber.ProtocolProviderServiceJabberImpl.register(ProtocolProviderServiceJabberImpl.java:500)
at org.jitsi.jigasi.util.RegisterThread.run(RegisterThread.java:59)
2021-11-11 15:54:30.320 SEVERE: [53] org.jitsi.jigasi.xmpp.CallControlMucActivator.processIQInternal().626 [ctx=1636646060159166320016] Error processing RayoIq
java.lang.Exception: Fail to join muc!
at org.jitsi.jigasi.xmpp.CallControlMucActivator$WaitToJoinRoom.waitToJoinRoom(CallControlMucActivator.java:725)
at org.jitsi.jigasi.xmpp.CallControlMucActivator$DialIqHandler.setDialResponseAndRegisterHangUpHandler(CallControlMucActivator.java:658)
at org.jitsi.jigasi.xmpp.CallControlMucActivator$DialIqHandler.processIQInternal(CallControlMucActivator.java:615)
at org.jitsi.jigasi.xmpp.CallControlMucActivator$DialIqHandler.lambda$processIQ$0(CallControlMucActivator.java:576)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
at java.base/java.lang.Thread.run(Thread.java:831)

Jigasi is installed on the same machine were jitsi is installed. We use hidden domain and custom username/password for jigasi. Login to MUC works because when we change password to a wrong value we see different exception (org.jivesoftware.smack.sasl.SASLErrorException: SASLError using SCRAM-SHA-1: not-authorized).

The above exception happens only when moderator starts subtitles. Jigasi has a fresh install on this server from jitsi repositories. Other jitsi packages were just updated too.

Would appreciate any directions where to look for the cause of this error in config files.

Thank you,
Andrew

Yep, that was fixed yesterday in the latest build in unstable you can update to using that.

@damencho thanks for your reply! Could you please provide a hint how to install jigasi form the unstable branch? Shall we manually download a .deb package?

Thanks,
Andrew

yeah if you have the stable https://download.jitsi.org stable/ just change it to https://download.jitsi.org unstable/

Forgot to ask: do we need only jigasi from unstable or every jitsi package from unstable?

With every such jitsi packages update we lose our customizations, like logo, favicon etc. Is there any way to preserve those between updates without creating a full source fork at github? Thanks!

Only jigasi from unstable, but seems there are more bugs in it about transcribers … We need to merge this fix: Fixes another NPE when audio moderation not found. by damencho · Pull Request #386 · jitsi/jigasi · GitHub and get that version.

Merged.

@damencho thanks for the merges. We have tried the following build of jigasi from the unstable branch:

jigasi_1.1-214-g759029d-1_amd64.deb

Jigasi boots and joins MUC correctly but when you try to start subtitles the following errors are logged:

2021-11-12 10:31:09.774 SEVERE: [108] net.sf.fmj.media.Log.error() Failed to build a graph for the given custom options.
2021-11-12 10:31:09.774 SEVERE: [108] net.sf.fmj.media.Log.error() Failed to realize: net.sf.fmj.media.ProcessEngine@2e8ff218
2021-11-12 10:31:09.774 SEVERE: [108] net.sf.fmj.media.Log.error() Cannot build a flow graph with the customized options:
2021-11-12 10:31:09.775 SEVERE: [108] net.sf.fmj.media.Log.error() Unable to transcode format: LINEAR, 48000.0 Hz, 16-bit, Mono, LittleEndian, Signed
2021-11-12 10:31:09.775 SEVERE: [108] net.sf.fmj.media.Log.error() to: opus/rtp, 48000.0 Hz, Stereo
2021-11-12 10:31:09.775 SEVERE: [108] net.sf.fmj.media.Log.error() outputting to: raw.rtp
2021-11-12 10:31:09.775 SEVERE: [108] net.sf.fmj.media.Log.error() Unable to add customed codecs:
2021-11-12 10:31:09.775 SEVERE: [108] net.sf.fmj.media.Log.error() org.jitsi.impl.neomedia.audiolevel.AudioLevelEffect2@169bcb93
2021-11-12 10:31:09.776 SEVERE: [107] net.sf.fmj.media.Log.error() Error: Unable to realize net.sf.fmj.media.ProcessEngine@2e8ff218

The full stack trace is here:

jigasi_1.1-214-g759029d-1.log (6.3 KB)

Do you have any ideas what else should be changed to make it working?

Thank you,
Andrew

Hi @damencho ,

did you have chance to review the above exception? Older messages in this forum say that it may be related to native sound processing libraries not being found. But I’ve checked the libjitsimeet jar from jigasi unstable repo and those native libraries are included there.

Any ideas what is going on? Unfortunately, it is a true blocker for us.

Thanks,
Andrew

Not really. You can enable translator mode and it will not do any transcoding and just pass too the transcriber service opus.

Enable

and try again