Jitsi torture problem with MaxUsersTest

hi @damencho
I dont know if you mantain the torture tool too… I want to test MaxUsersTest but its fails

I run ;
mvn test -Djitsi-meet.instance.url=“https://xxxxxxxl” -Djitsi-meet.tests.toRun=“MaxUsersTest”

I see the first 3 participants joining but then…

[11] Closing web.participant4
[11] TestFailure:
org.openqa.selenium.InvalidArgumentException: invalid argument
(Session info: chrome=84.0.4147.125)
Build info: version: ‘3.141.59’, revision: ‘e82be7d358’, time: ‘2018-11-14T08:17:03’
System info: host: ‘Spiderman’, ip: ‘127.0.1.1’, os.name: ‘Linux’, os.arch: ‘amd64’, os.version: ‘4.15.0-112-generic’, java.version: ‘1.8.0_265’
Driver info: org.openqa.selenium.chrome.ChromeDriver
Capabilities {acceptInsecureCerts: false, browserName: chrome, browserVersion: 84.0.4147.125, chrome: {chromedriverVersion: 84.0.4147.30 (48b3e868b4cc0…, userDataDir: /tmp/.com.google.Chrome.RvjFQk}, goog:chromeOptions: {debuggerAddress: localhost:41297}, javascriptEnabled: true, networkConnectionEnabled: false, pageLoadStrategy: normal, platform: LINUX, platformName: LINUX, proxy: Proxy(), setWindowRect: true, strictFileInteractability: false, timeouts: {implicit: 0, pageLoad: 300000, script: 30000}, unhandledPromptBehavior: dismiss and notify, webauthn:virtualAuthenticators: true}
Session ID: 85bc31cbc39ab30687a250854e2d048a
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.openqa.selenium.remote.http.W3CHttpResponseCodec.createException(W3CHttpResponseCodec.java:187)
at org.openqa.selenium.remote.http.W3CHttpResponseCodec.decode(W3CHttpResponseCodec.java:122)
at org.openqa.selenium.remote.http.W3CHttpResponseCodec.decode(W3CHttpResponseCodec.java:49)
at org.openqa.selenium.remote.HttpCommandExecutor.execute(HttpCommandExecutor.java:158)
at org.openqa.selenium.remote.service.DriverCommandExecutor.execute(DriverCommandExecutor.java:83)
at org.openqa.selenium.remote.RemoteWebDriver.execute(RemoteWebDriver.java:552)
at org.openqa.selenium.remote.RemoteWebDriver.get(RemoteWebDriver.java:277)
at org.jitsi.meet.test.web.WebParticipant.doJoinConference(WebParticipant.java:140)
at org.jitsi.meet.test.base.Participant.joinConference(Participant.java:152)
at org.jitsi.meet.test.base.Participant.joinConference(Participant.java:122)
at org.jitsi.meet.test.MaxUsersTest.enterWithMaxParticipantsAndCheckDialog(MaxUsersTest.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:571)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:707)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:979)
at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)
at org.testng.TestRunner.privateRun(TestRunner.java:648)
at org.testng.TestRunner.run(TestRunner.java:505)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:455)
at org.testng.SuiteRunner.access$000(SuiteRunner.java:40)
at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:489)
at org.testng.internal.thread.ThreadUtil$1.call(ThreadUtil.java:52)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
org.openqa.selenium.NoSuchSessionException: Session ID is null. Using WebDriver after calling quit()?
Build info: version: ‘3.141.59’, revision: ‘e82be7d358’, time: ‘2018-11-14T08:17:03’
System info: host: ‘Spiderman’, ip: ‘127.0.1.1’, os.name: ‘Linux’, os.arch: ‘amd64’, os.version: ‘4.15.0-112-generic’, java.version: ‘1.8.0_265’
Driver info: driver.version: RemoteWebDriver
at org.openqa.selenium.remote.HttpCommandExecutor.execute(HttpCommandExecutor.java:125)
at org.openqa.selenium.remote.service.DriverCommandExecutor.execute(DriverCommandExecutor.java:83)
at org.openqa.selenium.remote.RemoteWebDriver.execute(RemoteWebDriver.java:552)
at org.openqa.selenium.remote.RemoteWebDriver.execute(RemoteWebDriver.java:609)
at org.openqa.selenium.remote.RemoteWebDriver.getScreenshotAs(RemoteWebDriver.java:295)
at org.jitsi.meet.test.base.Participant.takeScreenshot(Participant.java:472)
at org.jitsi.meet.test.base.FailureListener.lambda$takeScreenshots$0(FailureListener.java:257)
at java.lang.Iterable.forEach(Iterable.java:75)
at org.jitsi.meet.test.base.FailureListener.takeScreenshots(FailureListener.java:256)
at org.jitsi.meet.test.base.FailureListener.onTestFailure(FailureListener.java:198)
at org.testng.internal.TestListenerHelper.runTestListeners(TestListenerHelper.java:67)
at org.testng.internal.Invoker.runTestListeners(Invoker.java:1379)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:624)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:707)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:979)
at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)
at org.testng.TestRunner.privateRun(TestRunner.java:648)
at org.testng.TestRunner.run(TestRunner.java:505)
at org.testng.SuiteRunner.runTest(SuiteRunner.java:455)
at org.testng.SuiteRunner.access$000(SuiteRunner.java:40)
at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:489)
at org.testng.internal.thread.ThreadUtil$1.call(ThreadUtil.java:52)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[11] End enterWithMaxParticipantsAndCheckDialog.
[11] Closing web.participant1
[11] Closing web.participant2
[11] Closing web.participant4
[ERROR] Tests run: 319, Failures: 1, Errors: 0, Skipped: 318, Time elapsed: 14.453 s <<< FAILURE! - in TestSuite
[ERROR] enterWithMaxParticipantsAndCheckDialog(org.jitsi.meet.test.MaxUsersTest) Time elapsed: 2.308 s <<< FAILURE!
org.openqa.selenium.InvalidArgumentException:
invalid argument
(Session info: chrome=84.0.4147.125)
Build info: version: ‘3.141.59’, revision: ‘e82be7d358’, time: ‘2018-11-14T08:17:03’
System info: host: ‘Spiderman’, ip: ‘127.0.1.1’, os.name: ‘Linux’, os.arch: ‘amd64’, os.version: ‘4.15.0-112-generic’, java.version: ‘1.8.0_265’
Driver info: org.openqa.selenium.chrome.ChromeDriver
Capabilities {acceptInsecureCerts: false, browserName: chrome, browserVersion: 84.0.4147.125, chrome: {chromedriverVersion: 84.0.4147.30 (48b3e868b4cc0…, userDataDir: /tmp/.com.google.Chrome.RvjFQk}, goog:chromeOptions: {debuggerAddress: localhost:41297}, javascriptEnabled: true, networkConnectionEnabled: false, pageLoadStrategy: normal, platform: LINUX, platformName: LINUX, proxy: Proxy(), setWindowRect: true, strictFileInteractability: false, timeouts: {implicit: 0, pageLoad: 300000, script: 30000}, unhandledPromptBehavior: dismiss and notify, webauthn:virtualAuthenticators: true}
Session ID: 85bc31cbc39ab30687a250854e2d048a
at org.jitsi.meet.test.MaxUsersTest.enterWithMaxParticipantsAndCheckDialog(MaxUsersTest.java:92)

[INFO]
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] MaxUsersTest.enterWithMaxParticipantsAndCheckDialog:92 » InvalidArgument inval…
[INFO]
[ERROR] Tests run: 319, Failures: 1, Errors: 0, Skipped: 318
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 16.504 s
[INFO] Finished at: 2020-08-13T18:06:20+02:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.20:test (default-test) on project jitsi-meet-torture: There are test failures.
[ERROR]
[ERROR] Please refer to /home/jsmadeu/jitsi/jitsi-meet-torture/target/surefire-reports for the individual test results.
[ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

I see that when participant4 start it start without the domain see… But I dont know if is it the dafault beabohur…

[26] ChromeDriver created for:486 ms.
[11] Started chrome driver for prefix: web.participant2
[11] web.participant2 is opening URL: **https://XXXXXXX/**torture602401#config.testing.testMode=true&config.disableNS=true&config.disableAEC=true&config.analytics.disabled=true&config.prejoinPageEnabled=false&interfaceConfig.SHOW_CHROME_EXTENSION_BANNER=false&config.disable1On1Mode=true&config.alwaysVisibleToolbar=true&config.p2p.useStunTurn=false&config.p2p.enabled=false&config.requireDisplayName=false&config.gatherStats=true&config.pcStatsInterval=1500&config.debug=true&config.enableTalkWhileMuted=false&config.callStatsID=false&interfaceConfig.DISABLE_FOCUS_INDICATOR=true
[11] web.participant2 lib-jitsi-meet version: development sessionID: 4da39329f270ec43c9a39cbb3b522b85
[11] Start enterWithMaxParticipantsAndCheckDialog.
[11] No participant type specified for prefix: web.participant4, will use Chrome…
Starting ChromeDriver 84.0.4147.30 (48b3e868b4cc0aa7e8149519690b6f6949e110a8-refs/branch-heads/4147@{#310}) on port 7345
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully.
Aug 13, 2020 7:59:33 PM org.openqa.selenium.remote.ProtocolHandshake createSession
INFO: Detected dialect: W3C
[33] ChromeDriver created for:822 ms.
[11] Started chrome driver for prefix: web.participant4
[11] web.participant4 is opening URL: null/torture602401#config.testing.testMode=true&config.disableNS=true&config.disableAEC=true&config.analytics.disabled=true&config.prejoinPageEnabled=false&interfaceConfig.SHOW_CHROME_EXTENSION_BANNER=false&config.disable1On1Mode=true&config.alwaysVisibleToolbar=true&config.p2p.useStunTurn=false&config.p2p.enabled=false&config.requireDisplayName=false&config.gatherStats=true&config.pcStatsInterval=1500&config.debug=true&config.enableTalkWhileMuted=false&config.callStatsID=false&interfaceConfig.DISABLE_FOCUS_INDICATOR=true
[11] Closing web.participant4
[11] TestFailure:
org.openqa.selenium.InvalidArgumentException: invalid argument

Then the specific client logs “chrome-console-web.participant4.log” says the same. and adds this error at the end. but I dont think its the real problem

[0813/204400.318731:ERROR:nacl_helper_linux.cc(308)] NaCl helper process running without a sandbox!
Most likely you need to configure your SUID sandbox correctly
[0813/204400.321218:ERROR:nacl_helper_linux.cc(308)] NaCl helper process running without a sandbox!
Most likely you need to configure your SUID sandbox correctly
[1597344240.346][INFO]: [add7c5035b0c74b9659d01f62f79c50a] RESPONSE Quit
[1597344240.346][DEBUG]: Log type ‘driver’ lost 0 entries on destruction
[1597344240.346][DEBUG]: Log type ‘browser’ lost 0 entries on destruction
“chrome-console-web.participant4.log” [readonly] 427L, 18936C

If I run all test, not all of them fails only 10 fails, but one of them is MAxUser test, and I think is the most imortant. My implementation use no auth for test and use multiple docker jvb and octo but I dont think that could be the problem.