[Solved partially]Jibri recording stucked with recording has stopped , then busy

Hi All,
My issues faced to all around jibri. Unable to record, even unable to stream.
My guess: some component version mismatch

Recording issue:
My recording start to prepare and after a while message coming: recording has stopped.

Jicofo log:
Jicofo 2019-04-28 08:45:41.071 INFO: [93] org.jitsi.jicofo.recording.jibri.JibriSession.log() Got Jibri status update: Jibri jibribrewery@internal.auth.webconf.globolearning.eu/jibri-nickname has status pending and failure reason null, current Jibri jid is jibribrewery@internal.auth.webconf.globolearning.eu/jibri-nickname
Jicofo 2019-04-28 08:45:41.071 INFO: [93] org.jitsi.jicofo.recording.jibri.JibriSession.log() Starting session with Jibri jibribrewery@internal.auth.webconf.globolearning.eu/jibri-nickname
Jicofo 2019-04-28 08:45:41.073 INFO: [93] org.jitsi.jicofo.recording.jibri.JibriRecorder.log() Started Jibri session
Jicofo 2019-04-28 08:45:55.773 INFO: [37] org.jitsi.jicofo.recording.jibri.JibriDetector.onInstanceStatusChanged().136 Received Jibri jibribrewery@internal.auth.webconf.globolearning.eu/jibri-nickname status
Jicofo 2019-04-28 08:45:55.775 INFO: [37] org.jitsi.jicofo.recording.jibri.JibriDetector.notifyJibriStatus().174 Jibri: jibribrewery@internal.auth.webconf.globolearning.eu/jibri-nickname available: false
Jicofo 2019-04-28 08:47:01.484 INFO: [106] org.jitsi.jicofo.recording.jibri.JibriSession.log() Updating status from JIBRI: for test@conference.webconf.globolearning.eu
Jicofo 2019-04-28 08:47:01.484 INFO: [106] org.jitsi.jicofo.recording.jibri.JibriSession.log() Got Jibri status update: Jibri jibribrewery@internal.auth.webconf.globolearning.eu/jibri-nickname has status off and failure reason error, current Jibri jid is jibribrewery@internal.auth.webconf.globolearning.eu/jibri-nickname
Jicofo 2019-04-28 08:47:01.484 INFO: [106] org.jitsi.jicofo.recording.jibri.JibriSession.log() Jibri is no longer pending, cancelling pending timeout task
Jicofo 2019-04-28 08:47:01.485 INFO: [106] org.jitsi.jicofo.recording.jibri.JibriSession.log() Jibri failed, trying to fall back to another Jibri
Jicofo 2019-04-28 08:47:01.486 SEVERE: [106] org.jitsi.jicofo.recording.jibri.JibriSession.log() Unable to find an available Jibri, can’t start
Jicofo 2019-04-28 08:47:01.486 INFO: [106] org.jitsi.jicofo.recording.jibri.JibriSession.log() Failed to fall back to another Jibri, this session has now failed
Jicofo 2019-04-28 08:47:01.486 INFO: [106] org.jitsi.jicofo.recording.jibri.JibriRecorder.log() Got jibri status off and failure error
Jicofo 2019-04-28 08:47:01.487 INFO: [106] org.jitsi.jicofo.recording.jibri.JibriRecorder.log() Publishing new jibri-recording-status: in: test@conference.webconf.globolearning.eu
Jicofo 2019-04-28 08:47:01.488 INFO: [106] org.jitsi.jicofo.recording.jibri.JibriSession.log() Cleaning up current JibriSession

Jicofo log
2019-04-28 10:47:01.069 INFO: [49] org.jitsi.jibri.selenium.JibriSelenium.onSeleniumStateChange() Transitioning from state Starting up to Error: SESSION Failed to join call
2019-04-28 10:47:01.315 INFO: [49] org.jitsi.jibri.service.impl.FileRecordingJibriService.onServiceStateChange() File recording service transitioning from state Starting up to Error: SESSION Failed to join call
2019-04-28 10:47:01.435 INFO: [49] org.jitsi.jibri.api.xmpp.XmppApi.invoke() Current service had an error, sending error iq
2019-04-28 10:47:01.458 FINE: [49] org.jitsi.jibri.statsd.JibriStatsDClient.incrementCounter() Incrementing statsd counter: stop:recording
2019-04-28 10:47:01.491 INFO: [49] org.jitsi.jibri.JibriManager.stopService() Stopping the current service
2019-04-28 10:47:01.492 INFO: [49] org.jitsi.jibri.service.impl.FileRecordingJibriService.stop() Stopping capturer
2019-04-28 10:47:01.498 INFO: [49] org.jitsi.jibri.util.JibriSubprocess.ffmpeg.stop() Stopping ffmpeg process
2019-04-28 10:47:01.499 INFO: [49] org.jitsi.jibri.util.JibriSubprocess.ffmpeg.stop() ffmpeg exited with value null
2019-04-28 10:47:01.500 INFO: [49] org.jitsi.jibri.service.impl.FileRecordingJibriService.stop() Quitting selenium

When im gooing to start a new record, i have BUy service error

JIcofo log:
Jicofo 2019-04-28 08:54:39.980 SEVERE: [108] org.jitsi.jicofo.recording.jibri.JibriSession.log() Unable to find an available Jibri, can’t start
Jicofo 2019-04-28 08:54:39.980 INFO: [108] org.jitsi.jicofo.recording.jibri.JibriRecorder.log() Failed to start a Jibri session, all Jibris were busy

2019-04-28 10:48:03.282 INFO: [49] org.jitsi.jibri.service.impl.FileRecordingJibriService.stop() Participants in this recording:
2019-04-28 10:48:42.437 INFO: [49] org.jitsi.jibri.selenium.JibriSelenium.leaveCallAndQuitBrowser() Got 8 log entries for type browser
2019-04-28 10:48:46.115 INFO: [49] org.jitsi.jibri.selenium.JibriSelenium.leaveCallAndQuitBrowser() Got 216 log entries for type driver
2019-04-28 10:48:59.967 INFO: [49] org.jitsi.jibri.selenium.JibriSelenium.leaveCallAndQuitBrowser() Got 0 log entries for type client
2019-04-28 10:48:59.993 INFO: [49] org.jitsi.jibri.selenium.JibriSelenium.leaveCallAndQuitBrowser() Leaving web call
2019-04-28 10:49:36.356 INFO: [49] org.jitsi.jibri.selenium.JibriSelenium.leaveCallAndQuitBrowser() Quitting chrome driver
2019-04-28 10:49:37.735 INFO: [49] org.jitsi.jibri.selenium.JibriSelenium.leaveCallAndQuitBrowser() Chrome driver quit
2019-04-28 10:49:37.737 INFO: [49] org.jitsi.jibri.service.impl.FileRecordingJibriService.stop() Finalizing the recording

My jibri setup run on ubuntu 18.04.2
Java 8
chromedriver 2.46.628388
gloogle-chrome 74.0.3729.108

I know the recommeded setup would be
cromedriver 2.5 and google-chrome 71.
No repository found to get google-chrome 71 because google not maintaining old versions to download.
BTW if you have idea where should I get crome 71 repo would be welcome.

please advise how to fix all above

thanks
George

Some addtional info how streamig failed.

All around ffmpeg issues

jibri log:
2019-04-28 11:30:02.699 INFO: [27] org.jitsi.jibri.api.xmpp.XmppApi.handleStartJibriIq() Received start request
2019-04-28 11:30:02.706 INFO: [27] org.jitsi.jibri.api.xmpp.XmppApi.handleStartJibriIq() Sending ‘pending’ response to start IQ
2019-04-28 11:30:02.707 INFO: [40] org.jitsi.jibri.api.xmpp.XmppApi.run() Starting service
2019-04-28 11:30:02.728 INFO: [40] org.jitsi.jibri.api.xmpp.XmppApi.handleStartService() Parsed call url info: CallUrlInfo(baseUrl=https://webconf.globolearning.eu, callName=test, urlParams=)
2019-04-28 11:30:02.741 INFO: [40] org.jitsi.jibri.JibriManager.startStreaming() Starting a stream with params: ServiceParams(usageTimeoutMinutes=0, appData=null) StreamingParams(callParams=CallParams(callUrlInfo=CallUrlInfo(baseUrl=https://webconf.globolearning.eu, callName=test, urlParams=)), sessionId=boctmsvsdzqtqhla, callLoginParams=XmppCredentials(domain=recorder.webconf.globolearning.eu, username=recorder, password=jibrirecorderpass), youTubeStreamKey=0cw7-62yc-80p4-2wf9, youTubeBroadcastId=null)
2019-04-28 11:30:02.774 FINE: [40] org.jitsi.jibri.capture.ffmpeg.FfmpegCapturer.() Detected os as OS: LINUX
2019-04-28 11:30:07.862 INFO: [40] org.openqa.selenium.remote.ProtocolHandshake.createSession() Detected dialect: OSS
2019-04-28 11:30:07.963 FINE: [40] org.jitsi.jibri.statsd.JibriStatsDClient.incrementCounter() Incrementing statsd counter: start:live_stream
2019-04-28 11:30:07.968 INFO: [40] org.jitsi.jibri.status.JibriStatusManager.log() Busy status has changed: IDLE -> BUSY
2019-04-28 11:30:07.969 INFO: [40] org.jitsi.jibri.api.xmpp.XmppApi.invoke() Jibri reports its status is now JibriStatus(busyStatus=BUSY, health=OverallHealth(healthStatus=HEALTHY, details={})), publishing presence to connection prod environment
2019-04-28 11:30:38.868 FINE: [47] org.jitsi.jibri.selenium.pageobjects.CallPage.visit() Visiting url https://webconf.globolearning.eu/test#config.iAmRecorder=true&config.externalConnectUrl=null&config.startWithAudioMuted=true&config.startWithVideoMuted=true&interfaceConfig.APP_NAME=“Jibri”
2019-04-28 11:30:58.044 INFO: [47] org.jitsi.jibri.selenium.pageobjects.CallPage.visit() Waited 1900 milliseconds for call page to load
2019-04-28 11:30:58.267 INFO: [47] org.jitsi.jibri.selenium.JibriSelenium.onSeleniumStateChange() Transitioning from state Starting up to Running
2019-04-28 11:30:58.276 INFO: [47] org.jitsi.jibri.service.impl.StreamingJibriService.invoke() Selenium joined the call, starting capturer
2019-04-28 11:31:00.294 INFO: [47] org.jitsi.jibri.util.JibriSubprocess.ffmpeg.launch() Starting ffmpeg with command ffmpeg -y -v info -f x11grab -draw_mouse 0 -r 30 -s 1280x720 -thread_queue_size 4096 -i :0.0+0,0 -f alsa -thread_queue_size 4096 -i hw:0,1,0 -acodec aac -strict -2 -ar 44100 -c:v libx264 -preset veryfast -maxrate 2976k -bufsize 5952k -pix_fmt yuv420p -r 30 -crf 25 -g 60 -tune zerolatency -f flv rtmp://a.rtmp.youtube.com/live2/0cw7-62yc-80p4-2wf9 ([ffmpeg, -y, -v, info, -f, x11grab, -draw_mouse, 0, -r, 30, -s, 1280x720, -thread_queue_size, 4096, -i, :0.0+0,0, -f, alsa, -thread_queue_size, 4096, -i, hw:0,1,0, -acodec, aac, -strict, -2, -ar, 44100, -c:v, libx264, -preset, veryfast, -maxrate, 2976k, -bufsize, 5952k, -pix_fmt, yuv420p, -r, 30, -crf, 25, -g, 60, -tune, zerolatency, -f, flv, rtmp://a.rtmp.youtube.com/live2/0cw7-62yc-80p4-2wf9])
2019-04-28 11:31:05.541 FINE: [48] org.jitsi.jibri.util.ProcessStatePublisher.ffmpeg.invoke() Process ffmpeg hasn’t written in 2 seconds, publishing periodic update
2019-04-28 11:31:08.409 FINE: [48] org.jitsi.jibri.util.ProcessStatePublisher.ffmpeg.invoke() Process ffmpeg hasn’t written in 2 seconds, publishing periodic update
2019-04-28 11:31:09.448 FINE: [48] org.jitsi.jibri.util.ProcessStatePublisher.ffmpeg.invoke() Process ffmpeg hasn’t written in 2 seconds, publishing periodic update
2019-04-28 11:31:11.518 FINE: [48] org.jitsi.jibri.util.ProcessStatePublisher.ffmpeg.invoke() Process ffmpeg hasn’t written in 2 seconds, publishing periodic update
2019-04-28 11:31:33.559 INFO: [27] org.jitsi.jibri.api.xmpp.XmppApi.handleJibriIq() Received JibriIq from environment prod environment
2019-04-28 11:31:35.555 FINE: [27] org.jitsi.jibri.statsd.JibriStatsDClient.incrementCounter() Incrementing statsd counter: stop:live_stream
2019-04-28 11:31:36.513 INFO: [27] org.jitsi.jibri.JibriManager.stopService() Stopping the current service
2019-04-28 11:31:36.715 INFO: [27] org.jitsi.jibri.service.impl.StreamingJibriService.stop() Stopping capturer
2019-04-28 11:31:36.856 INFO: [27] org.jitsi.jibri.util.JibriSubprocess.ffmpeg.stop() Stopping ffmpeg process

Partial solution:
There a post in which a proper booting order described. Additinallly latest update fixed some issues regarding above.

do u mind sharing the post?

Sure

– update /etc/prosody/config.lua (NOT /etc/prosody/conf.d/yourdomainname.cfg.lua ),
– add “consider_bosh_secure = true” after the original “c2s_require_encryption = false”
(if set true, change to false )
– stop jibri, stop jvb, stop jicofo, restart prosody, start jicofo, start jvb, start jibr

Started to work…

1 Like