Video can not be received when using AV modertaion

1

With jitsi latest 2.0.8319 having video issues when AV moderation is on. If AV moderation is not in use there is no issue.

  • Participant raises hand
  • Moderator allows and asks to unmute
  • Participant starts camera
  • Local video appears
  • there is no video on any of other participants.
    here are console logs from both end:
    Sender who started camera:
Logger.js:154 2023-02-27T03:21:13.994Z [features/video-quality] <pO.register.deepEquals [as listener]>:  Video quality level for thumbnail height: 150, is: 180, override: false, max full res N: 2
Logger.js:154 2023-02-27T03:21:14.005Z [modules/RTC/BridgeChannel.js] <ba.sendReceiverVideoConstraintsMessage>:  Sending ReceiverVideoConstraints with {"constraints":{"76fc75a7-v0":{"maxHeight":180},"bea34952-v0":{"maxHeight":180}},"defaultConstraints":{"maxHeight":0},"lastN":15,"onStageSources":[],"selectedSources":[]}
Logger.js:154 2023-02-27T03:21:14.062Z [features/video-quality] <pO.register.deepEquals [as listener]>:  Video quality level for thumbnail height: 301.5, is: 180, override: false, max full res N: 2
Logger.js:154 2023-02-27T03:21:23.098Z [modules/RTC/JitsiLocalTrack.js] Mute LocalTrack[2,video]: false
Logger.js:154 2023-02-27T03:21:23.098Z [modules/RTC/RTCUtils.js] <Yi.<anonymous>>:  Got media constraints:  {"video":{"deviceId":"9759a4f9766a2e39e9e0f3456ed821ee3134c597c532ef039d047f5f03da9770","height":{"max":720,"min":180,"ideal":720},"width":{"max":1280,"min":320,"ideal":1280}},"audio":false}
Logger.js:154 2023-02-27T03:21:24.620Z [modules/RTC/RTCUtils.js] onUserMediaSuccess
Logger.js:154 2023-02-27T03:21:24.627Z [modules/RTC/TraceablePeerConnection.js] <Xd.addTrackToPc>:  TPC[id=1,type=JVB] Adding track=LocalTrack[2,video] to PC
Logger.js:154 2023-02-27T03:21:24.629Z [modules/RTC/BridgeChannel.js] <ba.sendSourceVideoTypeMessage>:  Sending SourceVideoTypeMessage with video type 17982dc9-v0: camera
Logger.js:154 2023-02-27T03:21:27.746Z [features/video-quality] <pO.register.deepEquals [as listener]>:  Video quality level for thumbnail height: 150, is: 180, override: false, max full res N: 2
Logger.js:154 2023-02-27T03:21:28.475Z [features/video-quality] <pO.register.deepEquals [as listener]>:  Video quality level for thumbnail height: 566.5, is: 360, override: false, max full res N: 2
Logger.js:154 2023-02-27T03:21:28.484Z [modules/RTC/BridgeChannel.js] <ba.sendReceiverVideoConstraintsMessage>:  Sending ReceiverVideoConstraints with {"constraints":{"76fc75a7-v0":{"maxHeight":360},"bea34952-v0":{"maxHeight":360}},"defaultConstraints":{"maxHeight":0},"lastN":15,"onStageSources":[],"selectedSources":[]}
DevTools failed to load source map: Could not parse content for https://vcsrv1.myjitsi.vc/external_api.min.js.map: Unexpected token '<', "<html item"... is not valid JSON
Logger.js:154 2023-02-27T03:21:45.757Z [modules/statistics/AudioOutputProblemDetector.js] A potential problem is detected with the audio output for participant 8f0621cc, local audio levels: [null,null], remote audio levels: undefined
r @ Logger.js:154
(anonymous) @ AudioOutputProblemDetector.js:122
_onLocalAudioLevelsReport @ AudioOutputProblemDetector.js:111
r.emit @ events.js:158
Ci._processAndEmitReport @ RTPStatsCollector.js:400
Ci.processStatsReport @ RTPStatsCollector.js:677
(anonymous) @ RTPStatsCollector.js:247
Promise.then (async)
t @ RTPStatsCollector.js:241

Receiver’s Logs shows video track frozen & interrupted

Logger.js:154 2023-02-27T03:26:12.094Z [modules/RTC/BridgeChannel.js] <e.onmessage>:  New forwarded sources: 17982dc9-v0
Logger.js:154 2023-02-27T03:26:12.094Z [modules/RTC/RTC.js] <il._onForwardedSourcesChanged>:  Fowarded sources changed leaving=, entering=17982dc9-v0 at 1677468372094
Logger.js:154 2023-02-27T03:26:12.095Z [modules/connectivity/TrackStreamingStatus.ts] <xd.figureOutStreamingStatus>:  Figure out conn status for 17982dc9-v0, is video muted: true video track frozen: true p2p mode: false is in forwarded sources: true currentStatus => newStatus: active => active
Logger.js:154 2023-02-27T03:26:12.260Z [modules/connectivity/TrackStreamingStatus.ts] <xd.onSignallingMuteChanged>:  Detector on track signalling mute changed: 17982dc9-v0 false
Logger.js:154 2023-02-27T03:26:12.261Z [modules/connectivity/TrackStreamingStatus.ts] <xd.figureOutStreamingStatus>:  Figure out conn status for 17982dc9-v0, is video muted: false video track frozen: true p2p mode: false is in forwarded sources: true currentStatus => newStatus: active => restoring
Logger.js:154 2023-02-27T03:26:12.261Z [modules/connectivity/TrackStreamingStatus.ts] <xd._changeStreamingStatus>:  Emit track streaming status(1677468372261) 17982dc9-v0: restoring
Logger.js:154 2023-02-27T03:26:12.350Z [modules/UI/videolayout/LargeVideoManager.js] Scheduled large video update for 17982dc9
Logger.js:154 2023-02-27T03:26:22.262Z [modules/connectivity/TrackStreamingStatus.ts] <xd.figureOutStreamingStatus>:  Figure out conn status for 17982dc9-v0, is video muted: false video track frozen: true p2p mode: false is in forwarded sources: true currentStatus => newStatus: restoring => interrupted
Logger.js:154 2023-02-27T03:26:22.262Z [modules/connectivity/TrackStreamingStatus.ts] <xd._changeStreamingStatus>:  Emit track streaming status(1677468382262) 17982dc9-v0: interrupted
lib-jitsi-meet.min.js?v=6991:2 [Violation] 'setTimeout' handler took 66ms
Logger.js:154 2023-02-27T03:26:22.329Z [modules/UI/videolayout/LargeVideoManager.js] Scheduled large video update for 17982dc9
2

Can you reproduce it on meet.jit.si(you need to use https://moderated.jitsi.net/) or alpha.jitsi.net?

3

Yes, I can reproduce it on https://moderated.jitsi.net/
It does not work for participants who join after AV moderation has started.
Those who join before av moderation was started does not have this issue.

4

@kkd Can you describe the steps you use to reproduce it? I’m not able to reproduce it.

I enter with one moderator and 2 guests, then enable audio and video moderation (uncheck both) on the moderator side and then enter with a third guest which requests audio unmuting, the moderator approves it and the guest is successfully unmuting himself and the rest are hearing it.

5

Issue is not with audio.
Issue is with only video.
I will try to capture it and will revert

6

I do not see this error, but I think I can repro the case where video is allowed for the user that joined and after unmuting the rest are not seeing it.
I see the following error:

2023-02-28T15:19:03.267Z [modules/RTC/TraceablePeerConnection.js] <Xd._assertTrackBelongs>:  TPC[id=1,type=JVB] removeTrack: track=LocalTrack[2,video] does not belong to pc
r @ Logger.js:154
Logger.js:154 2023-02-28T15:19:03.267Z [modules/xmpp/JingleSessionPC.js] <Object.callback>:  JingleSessionPC[session=JVB,initiator=false,sid=c1067cucjh9c1] removeTrack failed
r @ Logger.js:154

Thanks we will look at that.

7

Not sure why that error. May be I used iframe API on my server