Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Accessibility] - Test for elements not in viewport contained within content-visibility: auto CSS property #50004

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Update comp_content_visibility.tentative.html

874e6d3
Select commit
Loading
Failed to load commit list.
Open

[Accessibility] - Test for elements not in viewport contained within content-visibility: auto CSS property #50004

Update comp_content_visibility.tentative.html
874e6d3
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-firefox-nightly-results succeeded Jan 31, 2025 in 3m 32s

Community-TC (pull_request)

Collect results for all tests affected by a pull request in firefox.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-01-31T01:32:59.412Z
Resolved: 2025-01-31T01:35:24.160Z
Task Execution Time: 2 minutes, 24 seconds, 748 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wpt_report.json.gz
- public/results/wpt_screenshot.txt.gz

WPT Command: python3 ./wpt run --channel=nightly --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --binary=/home/test/build/firefox/firefox firefox

[taskcluster 2025-01-31 01:32:59.618Z] Task ID: KjoF-1czSA6JqY3DHh10fQ
[taskcluster 2025-01-31 01:32:59.618Z] Worker ID: 9089297278538192609
[taskcluster 2025-01-31 01:32:59.618Z] Worker Group: us-east1-d
[taskcluster 2025-01-31 01:32:59.618Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2025-01-31 01:32:59.618Z] Worker Pool: proj-wpt/ci
[taskcluster 2025-01-31 01:32:59.618Z] Worker Version: 46.1.0
[taskcluster 2025-01-31 01:32:59.618Z] Public IP: 34.148.18.196
[taskcluster 2025-01-31 01:32:59.618Z] Hostname: proj-wpt-ci-y7ngibvtqr65tsx8gemjyg

ff2b96c8f8ff - Started downloading
ff2b96c8f8ff - Downloaded in 0.011 seconds
72ebe8ecf66d - Started downloading
560c024910be - Started downloading
430011f338a2 - Started downloading
430011f338a2 - Downloaded in 0.037 seconds
560c024910be - Downloaded in 0.187 seconds
79df10d18997 - Started downloading
4f4fb700ef54 - Started downloading
4f4fb700ef54 - Downloaded in 0.002 seconds
7e274023cae9 - Started downloading

...(324 lines hidden)...

Setting default value
Failed to read: session.screen0.slit.maxOver
Setting default value
Failed to read: session.screen0.slit.placement
Setting default value
Failed to read: session.screen0.slit.alpha
Setting default value
Failed to read: session.screen0.slit.onhead
Setting default value
Failed to read: session.screen0.slit.layer
Setting default value
Failed to read: session.screen0.toolbar.autoHide
Setting default value
Failed to read: session.screen0.toolbar.maxOver
Setting default value
Failed to read: session.screen0.toolbar.visible
Setting default value
Failed to read: session.screen0.toolbar.alpha
Setting default value
Failed to read: session.screen0.toolbar.layer
Setting default value
Failed to read: session.screen0.toolbar.onhead
Setting default value
Failed to read: session.screen0.toolbar.placement
Setting default value
Failed to read: session.screen0.toolbar.height
Setting default value
Failed to read: session.screen0.iconbar.mode
Setting default value
Failed to read: session.screen0.iconbar.alignment
Setting default value
Failed to read: session.screen0.iconbar.iconWidth
Setting default value
Failed to read: session.screen0.iconbar.iconTextPadding
Setting default value
Failed to read: session.screen0.iconbar.usePixmap
Setting default value
  ERROR: Command errored out with exit status 1:
   command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-y_u89h88/mozdebug/setup.py'"'"'; __file__='"'"'/tmp/pip-install-y_u89h88/mozdebug/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-4o8r8ug_
       cwd: /tmp/pip-install-y_u89h88/mozdebug/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help
  
  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for mozdebug
  ERROR: Command errored out with exit status 1:
   command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-y_u89h88/mozlog/setup.py'"'"'; __file__='"'"'/tmp/pip-install-y_u89h88/mozlog/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-scj1f3z5
       cwd: /tmp/pip-install-y_u89h88/mozlog/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help
  
  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for mozlog
 0:00.00 INFO Set tests_root to /home/test/web-platform-tests
 0:00.00 INFO Set metadata_root to /home/test/web-platform-tests
 0:00.00 INFO Set manifest_update to True
 0:00.00 INFO Set manifest_download to True
  ERROR: Command errored out with exit status 1:
   command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-y_j7y9w_/mozprofile/setup.py'"'"'; __file__='"'"'/tmp/pip-install-y_j7y9w_/mozprofile/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-78ubtup6
       cwd: /tmp/pip-install-y_j7y9w_/mozprofile/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help
  
  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for mozprofile
 0:12.33 INFO Identified 1 affected tests
 0:12.33 INFO Using certutil /usr/bin/certutil
 0:12.33 INFO Downloading geckodriver
 0:12.33 INFO Attempting to install webdriver from nightly
 0:12.77 INFO Extracted geckodriver to /home/test/web-platform-tests/_venv3/bin/geckodriver
 0:12.78 INFO Installed b'geckodriver 0.35.0 (9c18ffcb71e3 2025-01-10 05:38 +0000)'
 0:12.80 INFO Downloading test prefs from https://hg.mozilla.org/mozilla-central/archive/tip.zip/testing/profiles/
 0:16.61 INFO Test prefs downloaded to /home/test/web-platform-tests/_venv3/profiles/nightly/136.0
 0:16.77 mozversion INFO application_buildid: 20250130214004
 0:16.77 mozversion INFO application_changeset: e4c015c9c9be931884cdceb895d0b693f6e1679d
 0:16.77 mozversion INFO application_display_name: Firefox Nightly
 0:16.77 mozversion INFO application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
 0:16.77 mozversion INFO application_name: Firefox
 0:16.77 mozversion INFO application_remotingname: firefox-nightly
 0:16.77 mozversion INFO application_repository: https://hg.mozilla.org/mozilla-central
 0:16.77 mozversion INFO application_vendor: Mozilla
 0:16.77 mozversion INFO application_version: 136.0a1
 0:16.77 mozversion INFO platform_buildid: 20250130214004
 0:16.77 mozversion INFO platform_changeset: e4c015c9c9be931884cdceb895d0b693f6e1679d
 0:16.77 mozversion INFO platform_repository: https://hg.mozilla.org/mozilla-central
 0:16.77 mozversion INFO platform_version: 136.0a1
 0:22.63 INFO Installed font: Ahem.ttf
 0:23.46 wptserve INFO Starting http server on http://127.0.0.1:8002
 0:23.54 wptserve INFO Starting http server on http://127.0.0.1:8000
 0:23.58 wptserve INFO Starting https server on https://127.0.0.1:8444
 0:23.60 wptserve INFO Starting http server on http://127.0.0.1:8001
 0:23.60 wptserve INFO Starting https server on https://127.0.0.1:8445
 0:23.63 wptserve INFO Starting https server on https://127.0.0.1:8446
 0:23.64 wptserve INFO Starting http server on http://127.0.0.1:8003
 0:23.67 wptserve INFO Starting https server on https://127.0.0.1:8443
 0:23.67 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:23.67 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:23.67 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:23.68 wptserve INFO Starting http2 server on https://127.0.0.1:9000
 0:23.69 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:23.70 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:23.70 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:23.76 wptserve INFO Starting WebTransport over HTTP/3 server on 127.0.0.1:11000
 0:24.11 SUITE_START: web-platform-test - running 1 tests
 0:29.37 INFO Using 1 child processes
 0:29.39 INFO Setting up ssl
 0:29.43 certutil Full command: /usr/bin/certutil -N -d /tmp/tmpqe7jsw5n.mozrunner -f /tmp/tmpqe7jsw5n.mozrunner/.crtdbpw
certutil b''
 0:29.46 certutil b''
 0:29.47 certutil b'\nCertificate Nickname                                         Trust Attributes\n                                                             SSL,S/MIME,JAR/XPI\n\nweb-platform-tests                                           CT,, \n'
 0:29.48 INFO Application command: /home/test/build/firefox/firefox --marionette about:blank -profile /tmp/tmp86eby2xb
 0:29.48 INFO Starting runner
 0:30.02 pid:1375 Full command: /home/test/build/firefox/firefox --marionette about:blank
pid:1375 [GFX1-]: glxtest: libpci missing
 0:30.02 pid:1375 ATTENTION: default value of option mesa_glthread overridden by environment.
 0:30.11 pid:1375 1738287316115	Marionette	INFO	Marionette enabled
 0:30.19 pid:1375 1738287316201	Marionette	INFO	Listening on port 44809
Failed to read: session.screen0.titlebar.left
Setting default value
Failed to read: session.screen0.titlebar.right
Setting default value
 0:32.23 pid:1375 console.error: ({})
 0:33.00 TEST_START: /accname/name/comp_content_visibility.tentative.html
 0:33.38 pid:1375 [Parent 1375, Main Thread] WARNING: g_type_add_interface_static: assertion 'g_type_parent (interface_type) == G_TYPE_INTERFACE' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:201
 0:33.38 pid:1375 [Parent 1375, Main Thread] WARNING: g_type_add_interface_static: assertion 'g_type_parent (interface_type) == G_TYPE_INTERFACE' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:201
 0:33.46 TEST_END: Test OK. Subtests passed 0/6. Unexpected 6
FAIL Label: HTML heading element under content-visibility auto condition - assert_equals: <h2 class="ex ex-label-only ex-role-only" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML heading element under content-visibility auto condition">test heading</h2> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got ""
verifyLabelsBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:161:22
FAIL Label: HTML button element under content-visibility auto condition - assert_equals: <button class="ex ex-label-only ex-role-only" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML button element under content-visibility auto condition">test button</button> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got ""
verifyLabelsBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:161:22
FAIL Label: HTML link element under content-visibility auto condition - assert_equals: <a class="ex ex-label-only ex-role-only" href="#" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML link element under content-visibility auto condition">test link</a> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got ""
verifyLabelsBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:161:22
FAIL Role: HTML heading element under content-visibility auto condition - assert_equals: <h2 class="ex ex-label-only ex-role-only" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML heading element under content-visibility auto condition">test heading</h2> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got "heading"
verifyRolesBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:55:22
FAIL Role: HTML button element under content-visibility auto condition - assert_equals: <button class="ex ex-label-only ex-role-only" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML button element under content-visibility auto condition">test button</button> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got "button"
verifyRolesBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:55:22
FAIL Role: HTML link element under content-visibility auto condition - assert_equals: <a class="ex ex-label-only ex-role-only" href="#" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML link element under content-visibility auto condition">test link</a> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got "link"
verifyRolesBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:55:22

 0:33.46 INFO No more tests
 0:33.46 pid:1375 1738287319468	Marionette	INFO	Stopped listening on port 44809
 0:34.03 INFO Browser exited with return code -15
 0:33.91 INFO Closing logging queue
 0:33.91 INFO queue closed
 0:34.04 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 7 checks (6 subtests, 1 tests)
Expected results: 1
Unexpected results: 6
  subtest: 6 (6 fail)

Unexpected Results
------------------
/accname/name/comp_content_visibility.tentative.html
  FAIL Label: HTML heading element under content-visibility auto condition - assert_equals: <h2 class="ex ex-label-only ex-role-only" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML heading element under content-visibility auto condition">test heading</h2> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got ""
verifyLabelsBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:161:22
  FAIL Label: HTML button element under content-visibility auto condition - assert_equals: <button class="ex ex-label-only ex-role-only" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML button element under content-visibility auto condition">test button</button> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got ""
verifyLabelsBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:161:22
  FAIL Label: HTML link element under content-visibility auto condition - assert_equals: <a class="ex ex-label-only ex-role-only" href="#" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML link element under content-visibility auto condition">test link</a> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got ""
verifyLabelsBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:161:22
  FAIL Role: HTML heading element under content-visibility auto condition - assert_equals: <h2 class="ex ex-label-only ex-role-only" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML heading element under content-visibility auto condition">test heading</h2> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got "heading"
verifyRolesBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:55:22
  FAIL Role: HTML button element under content-visibility auto condition - assert_equals: <button class="ex ex-label-only ex-role-only" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML button element under content-visibility auto condition">test button</button> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got "button"
verifyRolesBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:55:22
  FAIL Role: HTML link element under content-visibility auto condition - assert_equals: <a class="ex ex-label-only ex-role-only" href="#" data-expectedlabel="SPEC_AMBIGUOUS_LOG_VALUE" data-expectedrole="SPEC_AMBIGUOUS_LOG_VALUE" data-testname="HTML link element under content-visibility auto condition">test link</a> expected "SPEC_AMBIGUOUS_LOG_VALUE" but got "link"
verifyRolesBySelector/<@http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:55:22
 0:34.04 INFO Got 1 unexpected results, with 0 unexpected passes
 0:34.04 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 0:34.12 wptserve INFO Stopped http server on 127.0.0.1:8002
 0:34.12 wptserve INFO Stopped http server on 127.0.0.1:8444
 0:34.12 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:34.12 wptserve INFO Stopped http server on 127.0.0.1:9000
 0:34.13 wptserve INFO Stopped http server on 127.0.0.1:8446
 0:34.13 wptserve INFO Stopped http server on 127.0.0.1:8443
 0:34.13 wptserve INFO Stopped http server on 127.0.0.1:8445
 0:34.13 wptserve INFO Stopped http server on 127.0.0.1:8001
 0:34.13 wptserve INFO Stopped http server on 127.0.0.1:8003
 0:34.13 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:34.15 wptserve INFO Stopped http server on 127.0.0.1:8000
 0:34.27 INFO Removed font: Ahem.ttf
 0:34.29 INFO Closing logging queue
 0:34.29 INFO queue closed
 0:34.29 INFO Tolerating 1 unexpected results
[taskcluster 2025-01-31 01:35:22.577Z] === Task Finished ===
[taskcluster 2025-01-31 01:35:23.503Z] Successful task run with exit code: 0 completed in 143.888 seconds
View more details on Community-TC Integration