Combining Web Audio API with Jitsi Audio Tracks

Hi there everyone :slight_smile:

we’re using jitsi in one of our projects and after a lot of trial and error, I’m stuck and I would love to have someone that could push me the right way.

The scenario is the following:
A person (sort of moderator) is lecturing the other participants. The video signal (webcam i.e.) from the lecturer should be send to aximmetry (for rendering him into a virtual studio) and then it should be returned to jitsi (rendered). The audio signal’s still sent via jitsi, so the video and audio signal aren’t sync anymore.

The current approach is, to add a delay to the audio (on the receiving client side). I don’t know if this is the best possible way, but at the moment, it’s all I have.

I want to add the delay via Web Audio API, but I can’t get it to work, the stream seems to be muted.

Here’s the code:

function _onTrackAdded(track) {

const _streamContainer = document.querySelector(#${_streamName});

  const _audioContext = new AudioContext();
  const _streamSource = _audioContext.createMediaStreamSource(track.stream);
  const _streamDelay = _audioContext.createDelay(2);
  const _streamDestination = _audioContext.createMediaStreamDestination();

  _streamDelay.delayTime.value = 2;

  _streamSource.connect(_streamDelay);
  _streamDelay.connect(_streamDestination);

… HOW TO ADD TO JitsiTrack?..

}

Hi @damencho , I am using the latest jitsi code on web and trying to call on an earlier sdk version in apps, but I am not able to view thw video stream.So, I wanted to know if this issue is because of the version mismatch on apps and web. I am using my own jitsi deployment

@Gunika_Gupta please do not tag people in your requests for help unless they’re already helping you with the issue at hand. Also, you’d do best to create a new topic for your issue rather than hijacking an existing one.