[jitsi-dev] Opus incoming audio broken with PLC addition


#1

Hi Jitsi devs,

Jitsi to CsipSimple fails with Opus today, with no audio heard on the Jitsi
side. SILK and PCMA still work. Jitsi to Jitsi all three codecs work.

I'm guessing this broke about when PLC was added, as it was working
yesterday. Would a PLC option in the GUI help, and do you want logs?

Details: The Jitsi is running on Linux 32bit, Ubuntu 10.04,
sipgate.co.ukonly UDP. We use Jitsi daily with OPUS and with PCMA to
POTS via sipgate.
(We previously used SILK before OPUS).

--------offtopic other issues-------
We sometimes use video between Jitsis and CsipSimples working on H.264
(mainline was the important option, as well as setting Jitsi to a lower
video resolution on these old machines). I couldn't get VP8 to always work,
it often fails to display the video.

Another independent bug, which crashes CsipSimple so I will take up with
him, is that ZRTP works great Jitsi to Jitsi, but crashes the CsipSimple
between tens of seconds to a few minutes. I can get the CsipSimple to
CsipSimple to do SRTP with no ZRTP which doesn't crash, but I can't do
CsipSimple to Jitsi SRTP without ZRTP.

Also, I've tried Jitsi with Java 8 and it fails to load, both 32-bit and
64-bit Windows.

Regards to everyone on such a good project, Johnathon

Johnathon Weare


#2

Confirm that this Opus regression also affects Jitsi 64-bit on Windows,
packets are being sent, received and everything appears as normal but with
no sound output, and nothing on the sound level indicator. This is
2.3.4608.9624 with Portaudio (no change with WASAPI, echo cancellation off,
noise suppression off).

Johnathon

Johnathon Weare, Managing Director, GreenGeek Ltd
GreenGeek.org.uk <http://greengeek.org.uk/> a not-for-profit organisation.
t: 01926 678330 m: 07733 611368

GreenGeek * community computers * buy * repair * recycle
                  * business * support * security * install * network * WEEE

"GreenGeek sell recycled computers, get people online and protect the
environment."

Funded by Warwick District Council, Royal Leamington Spa Town Council.

GreenGeek Ltd is a Company Limited by Guarantee registered in England and
Wales No. 6879827

···

On 1 May 2013 21:19, Johnathon Weare <jrweare@gmail.com> wrote:

Hi Jitsi devs,

Jitsi to CsipSimple fails with Opus today, with no audio heard on the
Jitsi side. SILK and PCMA still work. Jitsi to Jitsi all three codecs work.

I'm guessing this broke about when PLC was added, as it was working
yesterday. Would a PLC option in the GUI help, and do you want logs?

Details: The Jitsi is running on Linux 32bit, Ubuntu 10.04, sipgate.co.ukonly UDP. We use Jitsi daily with OPUS and with PCMA to POTS via sipgate.
(We previously used SILK before OPUS).

--------offtopic other issues-------
We sometimes use video between Jitsis and CsipSimples working on H.264
(mainline was the important option, as well as setting Jitsi to a lower
video resolution on these old machines). I couldn't get VP8 to always work,
it often fails to display the video.

Another independent bug, which crashes CsipSimple so I will take up with
him, is that ZRTP works great Jitsi to Jitsi, but crashes the CsipSimple
between tens of seconds to a few minutes. I can get the CsipSimple to
CsipSimple to do SRTP with no ZRTP which doesn't crash, but I can't do
CsipSimple to Jitsi SRTP without ZRTP.

Also, I've tried Jitsi with Java 8 and it fails to load, both 32-bit and
64-bit Windows.

Regards to everyone on such a good project, Johnathon

Johnathon Weare


#3

Hey Jonathon,

Hi Jitsi devs,

Jitsi to CsipSimple fails with Opus today, with no audio heard on the
Jitsi side. SILK and PCMA still work. Jitsi to Jitsi all three codecs work.

I just downloaded it for Android but the version I have doesn't seem to
have Opus. It did have SILK though but I still couldn't get it to send
media to Jitsi. I also tried with a Gigaset hardphone that I have but
didn't have any luck there either.

The only way I could talk to it was through a PSTN call and that worked
but was using PSTN.

I'm guessing this broke about when PLC was added, as it was working
yesterday. Would a PLC option in the GUI help,

Actually PLC only changes local behaviour so if that really was the
problem then it shouldn't have impacted remote reception and you should
have been able to hear Jitsi's media on CSipSimple.

I also just tried a Jitsi call to Jitsi r10783 (from April 18) and that
worked too, so we seem to at least be backward compatible with ourselves.

and do you want logs?

This could help. I noticed that CSipSimple was sending a syntactically
wrong SDP in at least one occasion (when the offer contained video) so
maybe there other things that it is doing wrong.

Details: The Jitsi is running on Linux 32bit, Ubuntu 10.04,
sipgate.co.uk <http://sipgate.co.uk> only UDP. We use Jitsi daily
with OPUS and with PCMA to POTS via sipgate. (We previously used SILK
before OPUS).

--------offtopic other issues-------
We sometimes use video between Jitsis and CsipSimples working on H.264
(mainline was the important option, as well as setting Jitsi to a lower
video resolution on these old machines). I couldn't get VP8 to always
work, it often fails to display the video.

Yup. That's still a work in progress (well ... rather on standby
actually).

Another independent bug, which crashes CsipSimple so I will take up with
him, is that ZRTP works great Jitsi to Jitsi, but crashes the CsipSimple
between tens of seconds to a few minutes.

Both SDES and ZRTP negotiate keys only in the beginning of the call.
Once you have your key everything else is just plain SRTP. In other
words this sounds like a problem with the SRTP engine there.

I can get the CsipSimple to
CsipSimple to do SRTP with no ZRTP
which doesn't crash, but I can't do
CsipSimple to Jitsi SRTP without ZRTP.

Why, what happens?

Also, I've tried Jitsi with Java 8 and it fails to load, both 32-bit and
64-bit Windows.

OK, interesting. I think it will be a while before we start worrying
about Java 8 though.

Regards to everyone on such a good project, Johnathon

Thanks for your kind words Jonathon!

Cheers,
Emil

···

On 01.05.13, 22:19, Johnathon Weare wrote:

Johnathon Weare

--
https://jitsi.org


#4

Thanks - confirm 2.3.4609.9625 fixes the Opus issue.

Hey Jonathon,

>
> Hi Jitsi devs,
>
> Jitsi to CsipSimple fails with Opus today, with no audio heard on the
> Jitsi side. SILK and PCMA still work. Jitsi to Jitsi all three codecs
work.

I just downloaded it for Android but the version I have doesn't seem to
have Opus. It did have SILK though but I still couldn't get it to send
media to Jitsi. I also tried with a Gigaset hardphone that I have but
didn't have any luck there either.

Yes, you'll need the optional codec plugin
http://nightlies.csipsimple.com/plugins/CSipSimpleCodecPack.apk , the
nightly build
http://nightlies.csipsimple.com/trunk/CSipSimple-latest-trunk.apk and for
video http://nightlies.csipsimple.com/plugins/CSipSimpleVideoPlugin.apk

I have CSipSimple working more reliably than Skype on Samsung Galaxy Note
and S3 for audio, and the wide codec selection and ZRTP is an excellent
match for Jitsi. I can post full settings if needed but here's several
crucial ones (at least for sipgate's UDP only service) - use compact SIP:
on, disable TCP switch: on, STUN: on, new STUN format: on, ICE: normally
off / sometimes on depending on network used. Enabled codecs: Opus, PCMA
and H.264

The only way I could talk to it was through a PSTN call and that worked
but was using PSTN.

> I'm guessing this broke about when PLC was added, as it was working
> yesterday. Would a PLC option in the GUI help,

Actually PLC only changes local behaviour so if that really was the
problem then it shouldn't have impacted remote reception and you should
have been able to hear Jitsi's media on CSipSimple.

Yes that was exactly the issue (fixed now with 2.3.4609.9625) - audio was
heard successfully at the CsipSimple end, it was only muted at the
Jitsi regression is around when PLC was added.

I also just tried a Jitsi call to Jitsi r10783 (from April 18) and that
worked too, so we seem to at least be backward compatible with ourselves.

I didn't test that.

> and do you want logs?

This could help. I noticed that CSipSimple was sending a syntactically
wrong SDP in at least one occasion (when the offer contained video) so
maybe there other things that it is doing wrong.

Interesting. The CSipSimple video is very alpha.

> Details: The Jitsi is running on Linux 32bit, Ubuntu 10.04,
> sipgate.co.uk <http://sipgate.co.uk> only UDP. We use Jitsi daily
> with OPUS and with PCMA to POTS via sipgate. (We previously used SILK
> before OPUS).
>
> --------offtopic other issues-------
> We sometimes use video between Jitsis and CsipSimples working on H.264
> (mainline was the important option, as well as setting Jitsi to a lower
> video resolution on these old machines). I couldn't get VP8 to always
> work, it often fails to display the video.

Yup. That's still a work in progress (well ... rather on standby
actually).

OK, good to know, I'll stick with H.264.

> Another independent bug, which crashes CsipSimple so I will take up with
> him, is that ZRTP works great Jitsi to Jitsi, but crashes the CsipSimple
> between tens of seconds to a few minutes.

Both SDES and ZRTP negotiate keys only in the beginning of the call.
Once you have your key everything else is just plain SRTP. In other
words this sounds like a problem with the SRTP engine there.

...

> I can get the CsipSimple to
> CsipSimple to do SRTP with no ZRTP
> which doesn't crash, but I can't do
> CsipSimple to Jitsi SRTP without ZRTP.

Why, what happens?

Yes, that's the curious thing (and any crash is always the fault of the
side that crashes, so not looking to Jitsi for a solution here, just
thought you'd like to know)...
CSipSimple to CSipSimple with ZRTP off but SRTP on doesn't crash, encrypted.
Same settings (ZRTP off, SRTP "optional" on CSipSimple) to Jitsi no SRTP is
setup, unencrypted call works great. If I set SRTP to mandatory Jitsi gets
the call but on answering no connection is established. If I dial the other
way CSipSimple doesn't ring.

> Also, I've tried Jitsi with Java 8 and it fails to load, both 32-bit and
> 64-bit Windows.

OK, interesting. I think it will be a while before we start worrying
about Java 8 though.

OK

> Regards to everyone on such a good project, Johnathon

Thanks for your kind words Jonathon!

Cheers,
Emil
>
> Johnathon Weare

--
https://jitsi.org

Thanks for such a great project, really.

OK, found the Opus pack and disabled STUN. Traffic is now properly
flowing in both directions. Jitsi hears CSipSimple but CSipSimple does
not render audio from Jitsi.

I Confirm: Opus is working for me now.

Johnathon Weare

···

On 2 May 2013 02:33, Emil Ivov <emcho@jitsi.org> wrote:

On 01.05.13, 22:19, Johnathon Weare wrote:


#5

OK, found the Opus pack and disabled STUN. Traffic is now properly
flowing in both directions. Jitsi hears CSipSimple but CSipSimple does
not render audio from Jitsi.

Can't do much more at this point.

···

On 02.05.13, 03:33, Emil Ivov wrote:

Hey Jonathon,

On 01.05.13, 22:19, Johnathon Weare wrote:

Hi Jitsi devs,

Jitsi to CsipSimple fails with Opus today, with no audio heard on the
Jitsi side. SILK and PCMA still work. Jitsi to Jitsi all three codecs work.

I just downloaded it for Android but the version I have doesn't seem to
have Opus. It did have SILK though but I still couldn't get it to send
media to Jitsi. I also tried with a Gigaset hardphone that I have but
didn't have any luck there either.

The only way I could talk to it was through a PSTN call and that worked
but was using PSTN.

I'm guessing this broke about when PLC was added, as it was working
yesterday. Would a PLC option in the GUI help,

Actually PLC only changes local behaviour so if that really was the
problem then it shouldn't have impacted remote reception and you should
have been able to hear Jitsi's media on CSipSimple.

I also just tried a Jitsi call to Jitsi r10783 (from April 18) and that
worked too, so we seem to at least be backward compatible with ourselves.

and do you want logs?

This could help. I noticed that CSipSimple was sending a syntactically
wrong SDP in at least one occasion (when the offer contained video) so
maybe there other things that it is doing wrong.

Details: The Jitsi is running on Linux 32bit, Ubuntu 10.04,
sipgate.co.uk <http://sipgate.co.uk> only UDP. We use Jitsi daily
with OPUS and with PCMA to POTS via sipgate. (We previously used SILK
before OPUS).

--------offtopic other issues-------
We sometimes use video between Jitsis and CsipSimples working on H.264
(mainline was the important option, as well as setting Jitsi to a lower
video resolution on these old machines). I couldn't get VP8 to always
work, it often fails to display the video.

Yup. That's still a work in progress (well ... rather on standby
actually).

Another independent bug, which crashes CsipSimple so I will take up with
him, is that ZRTP works great Jitsi to Jitsi, but crashes the CsipSimple
between tens of seconds to a few minutes.

Both SDES and ZRTP negotiate keys only in the beginning of the call.
Once you have your key everything else is just plain SRTP. In other
words this sounds like a problem with the SRTP engine there.

I can get the CsipSimple to
CsipSimple to do SRTP with no ZRTP
which doesn't crash, but I can't do
CsipSimple to Jitsi SRTP without ZRTP.

Why, what happens?

Also, I've tried Jitsi with Java 8 and it fails to load, both 32-bit and
64-bit Windows.

OK, interesting. I think it will be a while before we start worrying
about Java 8 though.

Regards to everyone on such a good project, Johnathon

Thanks for your kind words Jonathon!

Cheers,
Emil

Johnathon Weare

--
https://jitsi.org