Android Video rendering stuck when hardware decoding

Developers
1

android Video rendering stuck when hardware decoding.Render Discard Critical in p2p mode.
Where except for the problem?

Set hardware acceleration and still render stuck.
surfaceViewRenderer.setEnableHardwareScaler(true);

android logcat
2022-12-03 17:56:43.154 12930-14629/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007de0058a00 OMX.qcom.video.decoder.avc 640x368 inputFps=24 outputFps=24 renderFps=5, discardFps=19
2022-12-03 17:56:44.155 12930-14629/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007de0058a00 OMX.qcom.video.decoder.avc 640x368 inputFps=24 outputFps=24 renderFps=6, discardFps=18
2022-12-03 17:56:45.156 12930-14629/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007de0058a00 OMX.qcom.video.decoder.avc 640x368 inputFps=24 outputFps=24 renderFps=5, discardFps=19
2022-12-03 17:56:46.156 12930-14629/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007de0058a00 OMX.qcom.video.decoder.avc 640x368 inputFps=24 outputFps=24 renderFps=5, discardFps=19
2022-12-03 17:56:47.157 12930-14629/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007de0058a00 OMX.qcom.video.decoder.avc 640x368 inputFps=24 outputFps=24 renderFps=6, discardFps=18
2022-12-03 17:56:48.157 12930-14629/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007de0058a00 OMX.qcom.video.decoder.avc 640x368 inputFps=24 outputFps=24 renderFps=5, discardFps=19
2022-12-03 17:56:49.158 12930-14629/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007de0058a00 OMX.qcom.video.decoder.avc 640x368 inputFps=24 outputFps=24 renderFps=5, discardFps=19
2022-12-03 17:56:50.158 12930-14629/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007de0058a00 OMX.qcom.video.decoder.avc 640x368 inputFps=24 outputFps=24 renderFps=6, discardFps=18
2022-12-03 17:56:51.159 12930-14629/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007de0058a00 OMX.qcom.video.decoder.avc 640x368 inputFps=24 outputFps=24 renderFps=5, discardFps=19
2022-12-03 17:56:52.159 12930-14629/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007de0058a00 OMX.qcom.video.decoder.avc 640x368 inputFps=24 outputFps=24 renderFps=5, discardFps=19

2

What SDK version are you using? We disabled p2p in version 7.0.0 because there is an issue receiving video in an android to android setup.

3

My git clone jitsi meet version is 8044
then:

npm install 
npx react-native run-android 
npx react-native start

Where to check the sdk version?

appVersion=99.0.0
sdkVersion=99.0.0

H264 hardware decoding is also stuck in sfu mode.

EglRenderer: Duration: 4002 ms. Frames received: 60. Dropped: 0. Rendered: 60. Render fps: 15.0. Average render time: 2306 us. Average swapBuffer time: 1454 us.
OplusFeedbackInfo: 0xb400007dd3563400 OMX.qcom.video.decoder.avc 1280x720 inputFps=30 outputFps=30 renderFps=15, discardFps=15

logcat:

2022-12-04 17:19:44.186 24179-27437/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: Release on output thread done
2022-12-04 17:19:44.186 24179-27219/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: initDecodeInternal name: OMX.qcom.video.decoder.avc type: H264 width: 1280 height: 720
2022-12-04 17:19:44.189 24179-27219/org.jitsi.meet D/MediaCodec: MediaCodec::reclaim(0xb400007d3aef6000) OMX.qcom.video.decoder.avc
2022-12-04 17:19:44.196 24179-27219/org.jitsi.meet D/MediaCodec: MediaCodec looper is gone, skip reclaim
2022-12-04 17:19:44.196 24179-27219/org.jitsi.meet D/OplusACodec: ~OplusACodec [212]: 
2022-12-04 17:19:44.196 24179-27219/org.jitsi.meet D/AtlasEventUploadUtils: setEvent event:atlas_event_video_monitor_network_switch
2022-12-04 17:19:44.200 24179-27219/org.jitsi.meet D/OplusACodec: OplusACodec [147]: 
2022-12-04 17:19:44.201 24179-27219/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:44.201 24179-27219/org.jitsi.meet D/OplusACodec: ACodec() ro.oplus.audio.effect.type = dolby ro.oplus.audio.dolby.type = none
2022-12-04 17:19:44.201 24179-27219/org.jitsi.meet D/MULTIMEDIAConfig: [getInt32:L85] Config name: oplus.software.video.hqv_support value: 1
2022-12-04 17:19:44.203 24179-27219/org.jitsi.meet D/ListServiceUtils: checkInListByUid module:HQV-effect uid:10594 cost 752us return 0
2022-12-04 17:19:44.203 24179-27219/org.jitsi.meet E/MULTIMEDIAConfig: [getInt32:L80] Not find config, Returning default
2022-12-04 17:19:44.203 24179-27219/org.jitsi.meet E/MULTIMEDIAConfig: [getInt32:L80] Not find config, Returning default
2022-12-04 17:19:44.203 24179-27219/org.jitsi.meet E/OplusACodec: [OplusACodec:204] mSrOsieMMListCheckResult:0x0 mOsieVersion:1
2022-12-04 17:19:44.203 24179-27219/org.jitsi.meet D/OplusACodec: getBufferChannel: New
2022-12-04 17:19:44.206 24179-27456/org.jitsi.meet I/OMXClient: IOmx service obtained
2022-12-04 17:19:44.219 24179-27219/org.jitsi.meet I/MediaCodec: [OMX.qcom.video.decoder.avc] configure, format : AMessage(what = 0x00000000) = {
      string mime = "video/avc"
      int32_t width = 1280
      int32_t height = 720
    }
2022-12-04 17:19:44.219 24179-27455/org.jitsi.meet D/SurfaceUtils: connecting to surface 0xb400007d3aff3010, reason connectToSurface
2022-12-04 17:19:44.220 24179-27455/org.jitsi.meet I/MediaCodec: [OMX.qcom.video.decoder.avc] setting surface generation to 24759324
2022-12-04 17:19:44.220 24179-27455/org.jitsi.meet D/SurfaceUtils: disconnecting from surface 0xb400007d3aff3010, reason connectToSurface(reconnect)
2022-12-04 17:19:44.220 24179-27455/org.jitsi.meet D/SurfaceUtils: connecting to surface 0xb400007d3aff3010, reason connectToSurface(reconnect)
2022-12-04 17:19:44.221 24179-27456/org.jitsi.meet D/OplusACodec: [configureCodec:L1494] OplusFeedbackInfo  mFeedbackID:-5476376606465642496
2022-12-04 17:19:44.221 24179-27456/org.jitsi.meet D/AtlasEventUploadUtils: setEvent event:atlas_event_video_monitor_network_switch
2022-12-04 17:19:44.222 24179-27456/org.jitsi.meet D/ListServiceUtils: checkInListByUid module:check-first-IRAP uid:10594 cost 178us return 0
2022-12-04 17:19:44.222 24179-27456/org.jitsi.meet D/ListServiceUtils: checkInListByUid module:notify-network-optimize uid:10594 cost 168us return 0
2022-12-04 17:19:44.222 24179-27456/org.jitsi.meet D/ListServiceUtils: checkInListByUid module:video-statistics uid:10594 cost 229us return 0
2022-12-04 17:19:44.223 24179-27456/org.jitsi.meet D/OplusUtils: ACodec getComponentRole [92]: mime:video/avc
2022-12-04 17:19:44.223 24179-27456/org.jitsi.meet I/ExtendedACodec: setupVideoDecoder()
2022-12-04 17:19:44.223 24179-27456/org.jitsi.meet E/OplusACodec: [GetVideoCodingTypeFromMime:L1162] mime:video/avc
2022-12-04 17:19:44.225 24179-27456/org.jitsi.meet I/ExtendedACodec: Decoder will be in frame by frame mode
2022-12-04 17:19:44.225 24179-27456/org.jitsi.meet W/ExtendedACodec: Failed to set frame packing format on component
2022-12-04 17:19:44.248 24179-27456/org.jitsi.meet D/SurfaceUtils: set up nativeWindow 0xb400007d3aff3010 for 1280x720, color 0x7fa30c06, rotation 0, usage 0x20402900
2022-12-04 17:19:44.255 24179-27219/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: initDecodeInternal done
2022-12-04 17:19:44.280 24179-27460/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: Decoder format changed: {crop-right=1279, color-format=2141391878, slice-height=736, mime=video/raw, hdr-static-info=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25], stride=1280, color-standard=1, color-transfer=3, crop-bottom=719, crop-left=0, width=1280, color-range=2, crop-top=0, height=720}
2022-12-04 17:19:44.280 24179-27460/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: Frame stride and slice height: 1280 x 736
2022-12-04 17:19:44.283 24179-27220/org.jitsi.meet I/org.webrtc.Logging: SurfaceEglRenderer: : Reporting frame resolution changed to 1280x720 with rotation 0
2022-12-04 17:19:44.964 24179-27243/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007d7bc8b800 OMX.qcom.video.decoder.avc 1920x1088 inputFps=30 outputFps=30 renderFps=30, discardFps=0
2022-12-04 17:19:44.964 24179-27243/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:45.257 24179-27456/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007dd3563400 OMX.qcom.video.decoder.avc 1280x720 inputFps=36 outputFps=35 renderFps=21, discardFps=14
2022-12-04 17:19:45.257 24179-27456/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:45.322 24179-27268/org.jitsi.meet I/org.webrtc.Logging: EglRenderer: Duration: 4004 ms. Frames received: 120. Dropped: 0. Rendered: 120. Render fps: 30.0. Average render time: 3192 us. Average swapBuffer time: 2221 us.
2022-12-04 17:19:45.965 24179-27243/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007d7bc8b800 OMX.qcom.video.decoder.avc 1920x1088 inputFps=30 outputFps=30 renderFps=30, discardFps=0
2022-12-04 17:19:45.965 24179-27243/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:46.115 24179-27390/org.jitsi.meet I/org.webrtc.Logging: EglRenderer: Duration: 4002 ms. Frames received: 74. Dropped: 0. Rendered: 74. Render fps: 18.5. Average render time: 2071 us. Average swapBuffer time: 1449 us.
2022-12-04 17:19:46.257 24179-27456/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007dd3563400 OMX.qcom.video.decoder.avc 1280x720 inputFps=29 outputFps=29 renderFps=16, discardFps=13
2022-12-04 17:19:46.257 24179-27456/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:46.461 24179-27269/org.jitsi.meet I/org.webrtc.Logging: EglRenderer: Duration: 4002 ms. Frames received: 120. Dropped: 0. Rendered: 120. Render fps: 30.0. Average render time: 2693 us. Average swapBuffer time: 1813 us.
2022-12-04 17:19:46.965 24179-27243/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007d7bc8b800 OMX.qcom.video.decoder.avc 1920x1088 inputFps=30 outputFps=30 renderFps=30, discardFps=0
2022-12-04 17:19:46.965 24179-27243/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:47.258 24179-27456/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007dd3563400 OMX.qcom.video.decoder.avc 1280x720 inputFps=30 outputFps=30 renderFps=15, discardFps=15
2022-12-04 17:19:47.258 24179-27456/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:47.965 24179-27243/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007d7bc8b800 OMX.qcom.video.decoder.avc 1920x1088 inputFps=30 outputFps=30 renderFps=30, discardFps=0
2022-12-04 17:19:47.965 24179-27243/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:48.258 24179-27456/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007dd3563400 OMX.qcom.video.decoder.avc 1280x720 inputFps=30 outputFps=30 renderFps=15, discardFps=15
2022-12-04 17:19:48.258 24179-27456/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:48.966 24179-27243/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007d7bc8b800 OMX.qcom.video.decoder.avc 1920x1088 inputFps=30 outputFps=30 renderFps=30, discardFps=0
2022-12-04 17:19:48.966 24179-27243/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:49.259 24179-27456/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007dd3563400 OMX.qcom.video.decoder.avc 1280x720 inputFps=30 outputFps=30 renderFps=15, discardFps=15
2022-12-04 17:19:49.259 24179-27456/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:49.326 24179-27268/org.jitsi.meet I/org.webrtc.Logging: EglRenderer: Duration: 4002 ms. Frames received: 121. Dropped: 0. Rendered: 120. Render fps: 30.0. Average render time: 3038 us. Average swapBuffer time: 2093 us.
2022-12-04 17:19:49.966 24179-27243/org.jitsi.meet I/OplusFeedbackInfo: 0xb400007d7bc8b800 OMX.qcom.video.decoder.avc 1920x1088 inputFps=30 outputFps=30 renderFps=30, discardFps=0
2022-12-04 17:19:49.966 24179-27243/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-04 17:19:50.120 24179-27390/org.jitsi.meet I/org.webrtc.Logging: EglRenderer: Duration: 4002 ms. Frames received: 60. Dropped: 0. Rendered: 60. Render fps: 15.0. Average render time: 2306 us. Average swapBuffer time: 1454 us.
2022-12-04 17:19:50.203 24179-27460/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: Releasing MediaCodec on output thread
2022-12-04 17:19:50.204 24179-27455/org.jitsi.meet I/OplusFeedbackInfo: [sendFeedbackInfo:L303]  send:MM_FB_EventID#21001#ClientPid#24179#ReportLevel#0#isHDRVideo#false#timeUsage#6#videoComponent#OMX.qcom.video.decoder.avc#videoHeight#720#videoMime#video/avc#videoWidth#1280
2022-12-04 17:19:50.204 24179-27455/org.jitsi.meet D/AtlasEventUploadUtils: setEvent event:atlas_event_atlasserver_feedback
2022-12-04 17:19:50.226 24179-27455/org.jitsi.meet D/SurfaceUtils: disconnecting from surface 0xb400007d3aff3010, reason disconnectFromSurface
2022-12-04 17:19:50.229 24179-27460/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: Release on output thread done
4

huawei phone

E/ACodec: [OMX.hisi.video.decoder.avc] setPortMode on output to DynamicANWBuffer failed w/ err -2147483648

local camera:
EglRenderer: Duration: 4005 ms. Frames received: 120. Dropped: 0. Rendered: 120. Render fps: 30.0. Average render time: 4966 us. Average swapBuffer time: 2468 us.

remote video 1
EglRenderer: Duration: 4002 ms. Frames received: 5. Dropped: 0. Rendered: 5. Render fps: 1.2. Average render time: 5886 us. Average swapBuffer time: 2557 us.

remote video 2
EglRenderer: Duration: 4002 ms. Frames received: 6. Dropped: 0. Rendered: 6. Render fps: 1.5. Average render time: 4277 us. Average swapBuffer time: 2291 us.

logcat:

2022-12-04 20:10:23.079 7885-11592/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: Releasing MediaCodec on output thread
2022-12-04 20:10:23.080 7885-11588/org.jitsi.meet W/ACodec: forcing OMX state to Idle when received shutdown in ExecutingState
2022-12-04 20:10:23.096 7885-11587/org.jitsi.meet I/MediaCodec: start process kWhatStopCompleted
2022-12-04 20:10:23.096 7885-11587/org.jitsi.meet D/SurfaceUtils: disconnecting from surface 0x7402a45010, reason disconnectFromSurface
2022-12-04 20:10:23.113 7885-11592/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: Release on output thread done
2022-12-04 20:10:23.114 7885-11429/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: initDecodeInternal name: OMX.hisi.video.decoder.avc type: H264 width: 1280 height: 720
2022-12-04 20:10:23.121 7885-11605/org.jitsi.meet I/OMXClient: IOmx service obtained
2022-12-04 20:10:23.122 7885-11605/org.jitsi.meet I/ACodec: In onAllocateComponent create compenent, codec name: OMX.hisi.video.decoder.avc
2022-12-04 20:10:23.123 7885-11604/org.jitsi.meet D/SurfaceUtils: connecting to surface 0x7402096010, reason connectToSurface
2022-12-04 20:10:23.123 7885-11604/org.jitsi.meet I/MediaCodec: [OMX.hisi.video.decoder.avc] setting surface generation to 8074249
2022-12-04 20:10:23.123 7885-11604/org.jitsi.meet D/SurfaceUtils: disconnecting from surface 0x7402096010, reason connectToSurface(reconnect)
2022-12-04 20:10:23.123 7885-11604/org.jitsi.meet D/SurfaceUtils: connecting to surface 0x7402096010, reason connectToSurface(reconnect)
2022-12-04 20:10:23.123 7885-11605/org.jitsi.meet E/ACodec: [OMX.hisi.video.decoder.avc] setPortMode on output to DynamicANWBuffer failed w/ err -2147483648
2022-12-04 20:10:23.126 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] got color aspects (R:2(Limited), P:1(BT709_5), M:1(BT709_5), T:3(SMPTE170M)) err=0(NO_ERROR)
2022-12-04 20:10:23.126 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] got color aspects (R:2(Limited), P:1(BT709_5), M:1(BT709_5), T:3(SMPTE170M)) err=0(NO_ERROR)
2022-12-04 20:10:23.126 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] using color aspects (R:2(Limited), P:1(BT709_5), M:1(BT709_5), T:3(SMPTE170M)) and dataspace 0x104
2022-12-04 20:10:23.127 7885-11605/org.jitsi.meet I/ACodec: onStart
2022-12-04 20:10:23.143 7885-11605/org.jitsi.meet I/HwExtendedUtils: Set to window composer mode as 2
2022-12-04 20:10:23.144 7885-11605/org.jitsi.meet I/ACodec: gralloc usage: 0(OMX) => 0x2900(ACodec)
2022-12-04 20:10:23.144 7885-11605/org.jitsi.meet D/SurfaceUtils: disconnecting from surface 0x7402096010, reason setNativeWindowSizeFormatAndUsage
2022-12-04 20:10:23.144 7885-11605/org.jitsi.meet D/SurfaceUtils: connecting to surface 0x7402096010, reason setNativeWindowSizeFormatAndUsage
2022-12-04 20:10:23.144 7885-11605/org.jitsi.meet D/SurfaceUtils: set up nativeWindow 0x7402096010 for 1280x720, color 0x30d, rotation 0, usage 0x2900
2022-12-04 20:10:23.145 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] Allocating 6 buffers from a native window of size 1554432 on output port
2022-12-04 20:10:23.165 7885-11429/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: initDecodeInternal done
2022-12-04 20:10:23.167 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] got color aspects (R:2(Limited), P:1(BT709_5), M:1(BT709_5), T:3(SMPTE170M)) err=0(NO_ERROR)
2022-12-04 20:10:23.167 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] got color aspects (R:2(Limited), P:1(BT709_5), M:1(BT709_5), T:3(SMPTE170M)) err=0(NO_ERROR)
2022-12-04 20:10:23.167 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] using color aspects (R:2(Limited), P:1(BT709_5), M:1(BT709_5), T:3(SMPTE170M)) and dataspace 0x104
2022-12-04 20:10:23.169 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] got color aspects (R:2(Limited), P:1(BT709_5), M:1(BT709_5), T:3(SMPTE170M)) err=0(NO_ERROR)
2022-12-04 20:10:23.169 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] got color aspects (R:2(Limited), P:1(BT709_5), M:1(BT709_5), T:3(SMPTE170M)) err=0(NO_ERROR)
2022-12-04 20:10:23.169 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] using color aspects (R:2(Limited), P:1(BT709_5), M:1(BT709_5), T:3(SMPTE170M)) and dataspace 0x104
2022-12-04 20:10:23.171 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] Now handling output port settings change
2022-12-04 20:10:23.172 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] Output port now disabled.
2022-12-04 20:10:23.172 7885-11605/org.jitsi.meet I/HwExtendedUtils: Set to window composer mode as 2
2022-12-04 20:10:23.173 7885-11605/org.jitsi.meet I/ACodec: gralloc usage: 0(OMX) => 0x2900(ACodec)
2022-12-04 20:10:23.173 7885-11605/org.jitsi.meet D/SurfaceUtils: disconnecting from surface 0x7402096010, reason setNativeWindowSizeFormatAndUsage
2022-12-04 20:10:23.174 7885-11605/org.jitsi.meet D/SurfaceUtils: connecting to surface 0x7402096010, reason setNativeWindowSizeFormatAndUsage
2022-12-04 20:10:23.174 7885-11605/org.jitsi.meet D/SurfaceUtils: set up nativeWindow 0x7402096010 for 1280x720, color 0x30d, rotation 0, usage 0x2900
2022-12-04 20:10:23.174 7885-11605/org.jitsi.meet W/ACodec: [OMX.hisi.video.decoder.avc] setting nBufferCountActual to 11 failed: -1010
2022-12-04 20:10:23.175 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] Allocating 10 buffers from a native window of size 1413120 on output port
2022-12-04 20:10:23.199 7885-11605/org.jitsi.meet I/ACodec: [OMX.hisi.video.decoder.avc] Output port now reenabled.
2022-12-04 20:10:23.208 7885-11609/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: Decoder format changed: {crop-right=1279, color-format=781, slice-height=720, mime=video/raw, stride=1280, color-standard=1, color-transfer=3, crop-bottom=719, crop-left=0, width=1280, color-range=2, crop-top=0, height=720}
2022-12-04 20:10:23.208 7885-11609/org.jitsi.meet I/org.webrtc.Logging: AndroidVideoDecoder: Frame stride and slice height: 1280 x 720
2022-12-04 20:10:23.267 7885-11605/org.jitsi.meet D/ACodec: sendVideoFpsDataToiAware time:22516000 fps:60 msg:60
2022-12-04 20:10:23.561 7885-11398/org.jitsi.meet I/org.webrtc.Logging: EglRenderer: Duration: 4005 ms. Frames received: 120. Dropped: 0. Rendered: 120. Render fps: 30.0. Average render time: 4966 us. Average swapBuffer time: 2468 us.
2022-12-04 20:10:23.949 7885-11417/org.jitsi.meet I/org.webrtc.Logging: EglRenderer: Duration: 4002 ms. Frames received: 5. Dropped: 0. Rendered: 5. Render fps: 1.2. Average render time: 5886 us. Average swapBuffer time: 2557 us.
2022-12-04 20:10:23.996 7885-11418/org.jitsi.meet I/org.webrtc.Logging: EglRenderer: Duration: 4002 ms. Frames received: 6. Dropped: 0. Rendered: 6. Render fps: 1.5. Average render time: 4277 us. Average swapBuffer time: 2291 us.
2022-12-04 20:10:24.050 7885-11430/org.jitsi.meet I/org.webrtc.Logging: SurfaceEglRenderer: : Reporting frame resolution changed to 1280x720 with rotation 0
2022-12-04 20:10:24.591 7885-11307/org.jitsi.meet I/org.webrtc.Logging: CameraStatistics: Camera fps: 30.
2022-12-04 20:10:26.591 7885-11307/org.jitsi.meet I/org.webrtc.Logging: CameraStatistics: Camera fps: 30.
2022-12-04 20:10:27.563 7885-11398/org.jitsi.meet I/org.webrtc.Logging: EglRenderer: Duration: 4001 ms. Frames received: 120. Dropped: 0. Rendered: 120. Render fps: 30.0. Average render time: 5441 us. Average swapBuffer time: 2996 us.
2022-12-04 20:10:27.951 7885-11417/org.jitsi.meet I/org.webrtc.Logging: EglRenderer: Duration: 4001 ms. Frames received: 5. Dropped: 0. Rendered: 5. Render fps: 1.2. Average render time: 4624 us. Average swapBuffer time: 1907 us.
2022-12-04 20:10:27.997 7885-11418/org.jitsi.meet I/org.webrtc.Logging: EglRenderer: Duration: 4000 ms. Frames received: 4. Dropped: 0. Rendered: 4. Render fps: 1.0. Average render time: 4059 us. Average swapBuffer time: 2709 us.
2022-12-04 20:10:28.591 7885-11307/org.jitsi.meet I/org.webrtc.Logging: CameraStatistics: Camera fps: 30.
5

Your device seems to have an encoder WebRTC doesn’t work well with I’m afraid.

6

I found that the problem of frame loss is here：
webrtc/build_webrtc/webrtc/android/src/sdk/android/src/java/org/webrtc/AndroidVideoDecoder.java
renderedTextureMetadata != null then codec.releaseOutputBuffer(index, false);

Frame loss occurs on Huawei mobile phones and onplus mobile phones. Hik chips and Qualcomm chips.

How can I improve the fps of decoding and rendering? What went wrong?

private void deliverTextureFrame(final int index, final MediaCodec.BufferInfo info,
      final int rotation, final Integer decodeTimeMs) {
    // Load dimensions from shared memory under the dimension lock.
    final int width;
    final int height;
    synchronized (dimensionLock) {
      width = this.width;
      height = this.height;
    }

    synchronized (renderedTextureMetadataLock) {
      if (renderedTextureMetadata != null) {
        codec.releaseOutputBuffer(index, false);
        Logging.e(TAG, "2-->renderedTextureMetadata!= null,drop this frame"); //by aphero
        return; // We are still waiting for texture for the previous frame, drop this one.
      }
      surfaceTextureHelper.setTextureSize(width, height);
      surfaceTextureHelper.setFrameRotation(rotation);
      renderedTextureMetadata = new DecodedTextureMetadata(info.presentationTimeUs, decodeTimeMs);
      codec.releaseOutputBuffer(index, /* render= */ true);
    }
  }

logcat:

2022-12-07 12:46:53.848 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:53.948 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:54.046 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:54.145 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:54.247 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:54.345 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:54.360 3244-3552/org.jitsi.meet D/JitsiMeetSDK: [modules/RTC/BridgeChannel.js] Dominant speaker: 6a39ff2f, previous speakers: 01d1d71f
2022-12-07 12:46:54.445 3244-3514/org.jitsi.meet I/connection.cc: (line 1410): Conn[f2981800:audio:Net[wlan0:192.168.1.x/24:Wifi:id=4]:jBms5a9y:1:0:local:udp:192.168.1.x:47322->u/v4Eu7a:1:2130706431:local:udp:192.200.253.x:10000|C--I|-|0|0|9114756780671369215|-]: Sent STUN BINDING request, id=493358337a462b7859707355, use_candidate=0, nomination=0
2022-12-07 12:46:54.446 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:54.546 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:54.646 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:54.748 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:54.843 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:54.844 3244-9672/org.jitsi.meet I/OplusFeedbackInfo: 0xb4000070626be800 OMX.qcom.video.decoder.avc 432x240 inputFps=30 outputFps=31 renderFps=20, discardFps=11
2022-12-07 12:46:54.844 3244-9672/org.jitsi.meet W/libc: Access denied finding property "vendor.oplus.media.vpp.stutter"
2022-12-07 12:46:54.945 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:54.945 3244-3514/org.jitsi.meet I/connection.cc: (line 1410): Conn[f2981800:audio:Net[wlan0:192.168.1.x/24:Wifi:id=4]:jBms5a9y:1:0:local:udp:192.168.1.x:47322->u/v4Eu7a:1:2130706431:local:udp:192.200.253.x:10000|C--I|-|0|0|9114756780671369215|-]: Sent STUN BINDING request, id=6b712f31754c653559547256, use_candidate=0, nomination=0
2022-12-07 12:46:55.044 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:55.145 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:55.195 3244-3514/org.jitsi.meet I/connection.cc: (line 878): Conn[f2981800:audio:Net[wlan0:192.168.1.x/24:Wifi:id=4]:jBms5a9y:1:0:local:udp:192.168.1.x:47322->u/v4Eu7a:1:2130706431:local:udp:192.200.253.x:10000|C--I|-|0|0|9114756780671369215|-]: Timed out after 15100 ms without a response, rtt=6000
2022-12-07 12:46:55.195 3244-3514/org.jitsi.meet I/p2p_transport_channel.cc: (line 2177): Channel[audio|1|RW]: Removed connection f2981800 (1 remaining)
2022-12-07 12:46:55.195 3244-3514/org.jitsi.meet I/p2p_transport_channel.cc: (line 1963): Channel[audio|1|RW]: Transport channel state changed from 1 to 2
2022-12-07 12:46:55.195 3244-3514/org.jitsi.meet I/jsep_transport_controller.cc: (line 1222): audio Transport 1 state changed. Check if state is complete.
2022-12-07 12:46:55.245 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:55.345 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:55.444 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:55.544 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:55.644 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:55.741 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:55.842 3244-9677/org.jitsi.meet E/org.webrtc.Logging: AndroidVideoDecoder: 2-->renderedTextureMetadata!= null,drop this frame
2022-12-07 12:46:55.845 3244-9672/org.jitsi.meet I/OplusFeedbackInfo: 0xb4000070626be800 OMX.qcom.video.decoder.avc 432x240 inputFps=30 outputFps=30 renderFps=20, discardFps=10
7

Solid digging! I don’t know why that could happen. I’d recommend you open an issue on the WebRTC bugtracker.

8

Thank you! I’m studying webrtc.
Doesn’t anyone else have this problem? :innocent: