Jigasi Transcription

Hi, I set up a call between a web client and an Android client. I don’t see the CC button in the Android client but Transcription joins by clicking the CC button in the web client.
I don’t see any transcription (actual text), changed between JSON and TXT but nothing.
I dot org/jitsi/jigasi/transcription/GoogleCloudTranscriptionService.java with breakpoints and some are hit: like line 288.
(muting the Mic on the Android client maybe a cause for the Transcriber to disconnect)
Nothing seems to happen with the audio. I don’t think anything gets sent out.
I start talking at 18:16:00, “test123” and end Transcription.

2020-02-27 18:15:03.142 SEVERE: [15] org.jitsi.impl.neomedia.device.DeviceConfiguration.log() Failed to register custom Renderer org.jitsi.impl.neomedia.jmfext.media.renderer.audio.PulseAudioRenderer with JMF.
:
2020-02-27 18:15:34.918 SEVERE: [67] org.jitsi.jigasi.JvbConference.registrationStateChanged().599 [ctx=15828237311831582122704] Registered bosh sid: f2acb918-2a1a-4f97-a293-b4d37db11053
:
2020-02-27 18:15:38.089 WARNING: [104] org.jitsi.stats.media.StatsServiceFactory.log() appSecret missing. Skipping callstats init
18:15:38 SENT (1): <body rid='4563385871510229' ack='4563385871510227' sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns='http://jabber.org/protocol/httpbind'><iq to='jigatrans@conference.example.com/focus' id='sbH2d-72' type='set'><jingle xmlns='urn:xmpp:jingle:1' action='transport-info' sid='4ct5r907obeob'><content creator='initiator' name='audio'><transport xmlns='urn:xmpp:jingle:transports:ice-udp:1' ufrag='35c1h1e23qavph' pwd='7c9r63gakk881ioqf453d1h3lj'><candidate foundation='1' component='1' protocol='udp' priority='2130706431' generation='0' id='1' ip='fe80:0:0:0:b6ba:1537:97da:922f' port='10000' type='host' network='0'/><candidate foundation='2' component='1' protocol='udp' priority='2130706431' generation='0' id='2' ip='10.0.2.15' port='10001' type='host' network='0'/></transport></content></jingle></iq></body><body rid='4563385871510230' sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns='http://jabber.org/protocol/httpbind'><iq to='jigatrans@conference.example.com/focus' id='sbH2d-74' type='get'><query xmlns='http://jabber.org/protocol/disco#info'></query></iq></body><body rid='4563385871510231' ack='4563385871510229' sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns='http://jabber.org/protocol/httpbind'><iq to='jigatrans@conference.example.com/focus' id='sbH2d-76' type='set'><jingle xmlns='urn:xmpp:jingle:1' action='session-info' sid='4ct5r907obeob'><ringing xmlns='urn:xmpp:jingle:apps:rtp:info:1'/></jingle></iq></body><body rid='4563385871510232' sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns='http://jabber.org/protocol/httpbind'><presence to='jigatrans@conference.example.com/7699a073' id='sbH2d-53'><x xmlns='http://jabber.org/protocol/muc'></x><transcription-status xmlns='jabber:client' status='ON'/><c xmlns='http://jabber.org/protocol/caps' hash='sha-1' node='http://jitsi.org' ver='nE6DyiAsk8FngHpoNzLgPBVm9SU='/><nick xmlns="http://jabber.org/protocol/nick">Transcriber</nick><region xmlns='http://jitsi.org/jitsi-meet' id='Europe/Amsterdam'/><stat name='version' value='Jigasi 1.1.build.git'/></presence></body><body rid='4563385871510233' sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns='http://jabber.org/protocol/httpbind'></body><body rid='4563385871510234' ack='4563385871510232' sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns='http://jabber.org/protocol/httpbind'><iq to='jigatrans@conference.example.com/focus' id='sbH2d-79' type='set'><jingle xmlns='urn:xmpp:jingle:1' action='session-accept' responder='transcriber@recorder.example.com/7699a073' sid='4ct5r907obeob'><content creator='initiator' name='audio'><description xmlns='urn:xmpp:jingle:apps:rtp:1' media='audio' ssrc='1056990732'><payload-type xmlns='urn:xmpp:jingle:apps:rtp:1' id='111' name='opus' channels='2' clockrate='48000'><parameter name='usedtx' value='1'/><parameter name='ptime' value='20'/></payload-type><rtp-hdrext xmlns='urn:xmpp:jingle:apps:rtp:rtp-hdrext:0' uri='urn:ietf:params:rtp-hdrext:ssrc-audio-level' senders='both' id='1'><parameter name='attributes'/></rtp-hdrext><source xmlns='urn:xmpp:jingle:apps:rtp:ssma:0' ssrc='1056990732'><parameter name='cname' value='d959cf5e-cf41-4790-955a-84f69e312897'/><parameter name='msid' value='81589328-898e-4c56-8529-f7162da14b83 audio926120216'/><parameter name='mslabel' value='81589328-898e-4c56-8529-f7162da14b83'/><parameter name='label' value='audio926120216'/></source></description><inputevt xmlns='http://jitsi.org/protocol/inputevt'/><transport xmlns='urn:xmpp:jingle:transports:ice-udp:1'><fingerprint xmlns='urn:xmpp:jingle:apps:dtls:0' hash='sha-1'>B2:F4:FD:48:AE:55:9A:F2:F5:30:5D:79:92:3A:79:D3:6F:36:24:D2</fingerprint></transport></content></jingle></iq></body><body rid='4563385871510235' sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns='http://jabber.org/protocol/httpbind'></body><body rid='4563385871510236' ack='4563385871510234' sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns='http://jabber.org/protocol/httpbind'><presence to='jigatrans@conference.example.com/7699a073' id='sbH2d-53'><status>Connected</status><x xmlns='http://jabber.org/protocol/muc'></x><transcription-status xmlns='jabber:client' status='ON'/><c xmlns='http://jabber.org/protocol/caps' hash='sha-1' node='http://jitsi.org' ver='nE6DyiAsk8FngHpoNzLgPBVm9SU='/><nick xmlns="http://jabber.org/protocol/nick">Transcriber</nick><region xmlns='http://jitsi.org/jitsi-meet' id='Europe/Amsterdam'/><stat name='version' value='Jigasi 1.1.build.git'/></presence></body>
18:15:38 RECV (1): <body sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns:stream='http://etherx.jabber.org/streams' xmlns='http://jabber.org/protocol/httpbind'><presence id='sbH2d-53' xmlns='jabber:client' to='transcriber@recorder.example.com/7699a073' from='jigatrans@conference.example.com/7699a073'><status xmlns='http://jabber.org/protocol/httpbind'>Connected</status><transcription-status status='ON'/><c ver='nE6DyiAsk8FngHpoNzLgPBVm9SU=' hash='sha-1' node='http://jitsi.org' xmlns='http://jabber.org/protocol/caps'/><nick xmlns='http://jabber.org/protocol/nick'>Transcriber</nick><region id='Europe/Amsterdam' xmlns='http://jitsi.org/jitsi-meet'/><stat value='Jigasi 1.1.build.git' name='version' xmlns='http://jabber.org/protocol/httpbind'/><x xmlns='http://jabber.org/protocol/muc#user'><item jid='transcriber@recorder.example.com/7699a073' affiliation='none' role='participant'/><status code='110'/></x></presence></body>
18:16:04 RECV (1): <body sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns:stream='http://etherx.jabber.org/streams' xmlns='http://jabber.org/protocol/httpbind'><presence xmlns='jabber:client' to='transcriber@recorder.example.com/7699a073' from='jigatrans@conference.example.com/eb8e10bd'><stats-id>Jerel-y6z</stats-id><c ver='bInwKC/7Lt0uq2Y1/f66QQKgRS4=' hash='sha-1' node='http://jitsi.org/jitsimeet' xmlns='http://jabber.org/protocol/caps'/><avatar-id>75e7f6316e29151b599a5462a7443b32</avatar-id><nick xmlns='http://jabber.org/protocol/nick'>a</nick><audiomuted xmlns='http://jitsi.org/jitmeet/audio'>false</audiomuted><videoType xmlns='http://jitsi.org/jitmeet/video'>camera</videoType><videomuted xmlns='http://jitsi.org/jitmeet/video'>false</videomuted><jitsi_participant_requestingTranscription/><x xmlns='http://jabber.org/protocol/muc#user'><item jid='eb8e10bd-84da-402b-bed2-30862960b889@guest.example.com/44710187-2a00-47e3-bd7d-099d904922c1' affiliation='owner' role='moderator'/></x></presence></body
18:16:04 RECV (1): >
18:16:05 RECV (0): <body sid='c46e4f19-8d74-4084-9646-1555edbe88d9' xmlns:stream='http://etherx.jabber.org/streams' xmlns='http://jabber.org/protocol/httpbind'><iq type='result' to='jigasi@auth.example.com/jitsi-2fh6bn4' from='auth.example.com' id='sbH2d-83' xmlns='jabber:client'/></body>
18:16:07 RECV (1): <body sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns:stream='http://etherx.jabber.org/streams' xmlns='http://jabber.org/protocol/httpbind'><presence id='sbH2d-53' xmlns='jabber:client' to='transcriber@recorder.example.com/7699a073' from='jigatrans@conference.example.com/7699a073'><status xmlns='http://jabber.org/protocol/httpbind'>Connected</status><transcription-status status='OFF'/><c ver='nE6DyiAsk8FngHpoNzLgPBVm9SU=' hash='sha-1' node='http://jitsi.org' xmlns='http://jabber.org/protocol/caps'/><nick xmlns='http://jabber.org/protocol/nick'>Transcriber</nick><region id='Europe/Amsterdam' xmlns='http://jitsi.org/jitsi-meet'/><stat value='Jigasi 1.1.build.git' name='version' xmlns='http://jabber.org/protocol/httpbind'/><x xmlns='http://jabber.org/protocol/muc#user'><item jid='transcriber@recorder.example.com/7699a073' affiliation='none' role='participant'/><status code='110'/></x></presence></body>
18:16:07 RECV (1): <body sid='f2acb918-2a1a-4f97-a293-b4d37db11053' xmlns:stream='http://etherx.jabber.org/streams' xmlns='http://jabber.org/protocol/httpbind'><presence type='unavailable' to='transcriber@recorder.example.com/7699a073' from='jigatrans@conference.example.com/7699a073' id='sbH2d-85' xmlns='jabber:client'><x xmlns='http://jabber.org/protocol/muc#user'><item role='none' affiliation='none'/><status code='110'/></x></presence></body>
2020-02-27 18:16:07.542 SEVERE: [105] org.jitsi.impl.neomedia.RTPConnectorOutputStream.log() Failed to send a packet to target /10.0.2.15:10000:java.io.IOException: No active socket.
2020-02-27 18:16:07.557 INFO: [135] org.jitsi.jigasi.transcription.AbstractTranscriptPublisher.log() Wrote final transcript to /home/user1/transcripts/2020-02-27T17:15:37.603367Z_097b362e-55b5-4f10-b5f5-7d786ce70d2c/transcript_2020-02-27T17:15:37.604206Z_967a3773-1814-41bf-87b8-29bd442fab9c.txt

The transcript just shows participants joining (different call/test):

Transcript, started at 4:57:12 PM:
________________________________________________________________________________
<4:57:12 PM> Fellow Jitser joined the conference
<4:57:12 PM> a joined the conference
________________________________________________________________________________


End of transcript at Feb 27, 2020, 4:58:35 PM
  • The PCAP logs show a lot of local traffic and a lone call to 91.121.47.14 (what for?).

  • Is a paid account with GCloud necessary for transcription to work?

  • I don’t get anything like this in the logs: [jitsi-users] Jigasi Transcription

  • I assume the IP/port in /10.0.2.15:10000:java.io.IOException: No active socket. are autoconfigured (10000 is probably the minimum port, but 10.0.2.15 is the internal IP address but I don’t have that in the sip-communicator.propertie).

  • Where to put breakpoints to see the outgoing (audio) requests to GCloud and responses?

  • I run with/out the following properties:

--domain=example.com
--host=localhost  
--port=5347 
--subdomain (not)
--secret=secret 
--min-port (not)
--max-port (not)
--user_name=focus --user_domain=auth.example.com --user_password=pass

–user_name=focus --user_domain=auth.example.com --user_password=pass are not mentioned in the Jigasi readme but I do use them, (while I don’t set subdomain, min-and max-port as program parameters) but I think min-port (10000) is hard coded somewhere