Improve reporting of harness errors in ShadowRealm tests #49387
Merged
Community-TC Integration / resources/ tests (Python 3.12)
succeeded
Nov 27, 2024 in 5m 9s
Community-TC (pull_request)
Tests for testharness.js and other files in resources/ under Python 3.12
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2024-11-27T19:32:49.078Z
Resolved: 2024-11-27T19:37:04.477Z
Task Execution Time: 4 minutes, 15 seconds, 399 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/logs/live_backing.log
- public/logs/live.log
[taskcluster 2024-11-27 19:32:49.148Z] Task ID: H9REEgjFQyCElPZI8xtGtw
[taskcluster 2024-11-27 19:32:49.148Z] Worker ID: 6931105207634545987
[taskcluster 2024-11-27 19:32:49.148Z] Worker Group: us-central1-f
[taskcluster 2024-11-27 19:32:49.148Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2024-11-27 19:32:49.148Z] Worker Pool: proj-wpt/ci
[taskcluster 2024-11-27 19:32:49.148Z] Worker Version: 46.1.0
[taskcluster 2024-11-27 19:32:49.148Z] Public IP: 34.56.242.199
[taskcluster 2024-11-27 19:32:49.148Z] Hostname: proj-wpt-ci-s8whn1oqqrqamheov1khcw
ff2b96c8f8ff - Started downloading
ff2b96c8f8ff - Downloaded in 0.011 seconds
560c024910be - Started downloading
72ebe8ecf66d - Started downloading
430011f338a2 - Started downloading
430011f338a2 - Downloaded in 0.044 seconds
560c024910be - Downloaded in 0.183 seconds
4f4fb700ef54 - Started downloading
4f4fb700ef54 - Downloaded in 0 seconds
79df10d18997 - Started downloading
7e274023cae9 - Started downloading
...(472 lines hidden)...
+ cd /home/test/web-platform-tests/tools/ci/../../resources/test
+ tox -- --binary=/home/test/browsers/nightly/firefox/firefox
py312: install_deps> python -I -m pip install -r /home/test/web-platform-tests/resources/test/../../tools/requirements_pytest.txt -r /home/test/web-platform-tests/resources/test/requirements.txt
py312: commands[0]> pytest -vv --binary=/home/test/browsers/nightly/firefox/firefox
1732736110530 geckodriver INFO Listening on 127.0.0.1:4444
/home/test/web-platform-tests/tools/wptserve/wptserve/request.py:4: DeprecationWarning: 'cgi' is deprecated and slated for removal in Python 3.13
import cgi
[2024-11-27 19:35:11,365 None on port 34211] INFO - Starting http server on http://web-platform.test:34211
[2024-11-27 19:35:12,679 None on port 34211] INFO - Stopped http server on web-platform.test:34211
[2024-11-27 19:35:14,123 http-private on port 50979] INFO - Starting http server on http://web-platform.test:50979
[2024-11-27 19:35:14,137 http on port 8000] INFO - Starting http server on http://web-platform.test:8000
[2024-11-27 19:35:14,178 https-public on port 42407] INFO - Starting https server on https://web-platform.test:42407
[2024-11-27 19:35:14,277 http on port 48133] INFO - Starting http server on http://web-platform.test:48133
[2024-11-27 19:35:14,309 https on port 8444] INFO - Starting https server on https://web-platform.test:8444
[2024-11-27 19:35:14,326 https-private on port 56843] INFO - Starting https server on https://web-platform.test:56843
[2024-11-27 19:35:14,352 https on port 8443] INFO - Starting https server on https://web-platform.test:8443
[2024-11-27 19:35:14,355 h2 on port 9000] INFO - Starting http2 server on https://web-platform.test:9000
[2024-11-27 19:35:14,387 http-public on port 49625] INFO - Starting http server on http://web-platform.test:49625
[2024-11-27 19:35:14,564 wss on port 44527] INFO - Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 44527))
[2024-11-27 19:35:14,565 wss on port 44527] INFO - Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 44527))
[2024-11-27 19:35:14,566 wss on port 44527] INFO - Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 44527))
[2024-11-27 19:35:14,716 ws on port 52549] INFO - Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 52549))
[2024-11-27 19:35:14,716 ws on port 52549] INFO - Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 52549))
[2024-11-27 19:35:14,716 ws on port 52549] INFO - Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 52549))
============================= test session starts ==============================
platform linux -- Python 3.12.7, pytest-8.3.2, pluggy-1.5.0 -- /home/test/web-platform-tests/resources/test/.tox/py312/bin/python
cachedir: .tox/py312/.pytest_cache
hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase(PosixPath('/home/test/web-platform-tests/resources/test/.hypothesis/examples'))
rootdir: /home/test/web-platform-tests/resources/test
plugins: hypothesis-6.112.0, cov-5.0.0
collecting ...
collected 88 items
tests/functional/abortsignal.html::Test#get_signal 1732736118597 mozrunner::runner INFO Running command: MOZ_CRASHREPORTER="1" MOZ_CRASHREPORTER_NO_REPORT="1" MOZ_CRASHREPORTER_SHUTDOWN="1" "/home/test/browsers/nightly/firefox/firefox" "--marionette" "-no-remote" "-profile" "/tmp/rust_mozprofileU20sGn"
[GFX1-]: glxtest: libpci missing
1732736119112 Marionette INFO Marionette enabled
1732736119208 Marionette INFO Listening on port 36003
Read port: 36003
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
1732736119363 RemoteAgent WARN TLS certificate errors will be ignored for this session
Failed to read: session.screen0.titlebar.left
Setting default value
Failed to read: session.screen0.titlebar.right
Setting default value
console.error: ({})
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.warn: services.settings: #fetchAttachment: Forcing fallbackToDump to false due to Utils.LOAD_DUMPS being false
console.error: (new NotFoundError("Could not find fa0fc42c-d91d-fca7-34eb-806ff46062dc in cache or dump", "resource://services-settings/Attachments.sys.mjs", 48))
console.warn: "Unable to find the attachment for" "fa0fc42c-d91d-fca7-34eb-806ff46062dc"
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
PASSED [ 1%]
tests/functional/add_cleanup.html::Test#add_cleanup PASSED [ 2%]
tests/functional/add_cleanup_async.html::Test#add_cleanup with Promise-returning functions PASSED [ 3%]
tests/functional/add_cleanup_async_bad_return.html::Test#add_cleanup with non-thenable-returning function PASSED [ 4%]
tests/functional/add_cleanup_async_rejection.html::Test#add_cleanup with Promise-returning functions (rejection handling) PASSED [ 5%]
tests/functional/add_cleanup_async_rejection_after_load.html::Test#add_cleanup with Promise-returning functions (rejection handling following "load" event) PASSED [ 6%]
tests/functional/add_cleanup_async_timeout.html::Test#add_cleanup with Promise-returning functions (timeout handling) PASSED [ 7%]
tests/functional/add_cleanup_bad_return.html::Test#add_cleanup with value-returning function PASSED [ 9%]
tests/functional/add_cleanup_count.html::Test#add_cleanup reported count PASSED [ 10%]
tests/functional/add_cleanup_err.html::Test#add_cleanup: error PASSED [ 11%]
tests/functional/add_cleanup_err_multi.html::Test#add_cleanup: multiple functions with one in error PASSED [ 12%]
tests/functional/add_cleanup_sync_queue.html::Test#add_cleanup: queuing tests PASSED [ 13%]
tests/functional/api-tests-1.html::Sample HTML5 API Tests JavaScript error: resource:///modules/backup/BackupService.sys.mjs, line 108: NS_ERROR_FAILURE: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get]
PASSED [ 14%]
tests/functional/api-tests-2.html::Sample HTML5 API Tests PASSED [ 15%]
tests/functional/api-tests-3.html::Sample HTML5 API Tests PASSED [ 17%]
tests/functional/assert-array-equals.html::assert_array_equals PASSED [ 18%]
tests/functional/assert-throws-dom.html::assert_throws_dom PASSED [ 19%]
tests/functional/force_timeout.html::Test#force_timeout PASSED [ 20%]
tests/functional/generate-callback.html::Sample for using generate_tests to create a series of tests that share the same callback. PASSED [ 21%]
tests/functional/idlharness/IdlDictionary/test_partial_interface_of.html::idlharness: Partial dictionary PASSED [ 22%]
tests/functional/idlharness/IdlInterface/test_exposed_wildcard.html::idlharness: Exposed=* PASSED [ 23%]
tests/functional/idlharness/IdlInterface/test_immutable_prototype.html::idlharness: Immutable prototypes PASSED [ 25%]
tests/functional/idlharness/IdlInterface/test_interface_mixin.html::idlharness: interface mixins PASSED [ 26%]
tests/functional/idlharness/IdlInterface/test_partial_interface_of.html::idlharness: Partial interface PASSED [ 27%]
tests/functional/idlharness/IdlInterface/test_primary_interface_of.html::idlharness: Primary interface PASSED [ 28%]
tests/functional/idlharness/IdlInterface/test_to_json_operation.html::IdlInterface.prototype.test_to_json_operation() PASSED [ 29%]
tests/functional/idlharness/IdlNamespace/test_attribute.html::idlharness: namespace attribute PASSED [ 30%]
tests/functional/idlharness/IdlNamespace/test_operation.html::idlharness: namespace operation PASSED [ 31%]
tests/functional/idlharness/IdlNamespace/test_partial_namespace.html::idlharness: Partial namespace PASSED [ 32%]
tests/functional/iframe-callback.html::Example with iframe that notifies containing document via callbacks PASSED [ 34%]
JavaScript error: https://web-platform.test:8443/resources/test/tests/functional/uncaught-exception-handle.html, line 13: Error: Example Error
tests/functional/iframe-consolidate-errors.html::Example with iframe that consolidates errors via fetch_tests_from_window console.error: (new Error("Polling for changes failed: Unexpected content-type \"text/plain;charset=US-ASCII\".", "resource://services-settings/remote-settings.sys.mjs", 324))
console.error: (new Error("Unexpected content-type \"text/plain;charset=US-ASCII\"", "resource://services-settings/Utils.sys.mjs", 441))
console.error: "Could not download new icon" (new ServerInfoError("Server response is invalid SyntaxError: JSON.parse: unexpected end of data at line 1 column 1 of the JSON data", "resource://services-settings/Attachments.sys.mjs", 40))
PASSED [ 35%]
tests/functional/iframe-consolidate-tests.html::Example with iframe that consolidates tests via fetch_tests_from_window PASSED [ 36%]
tests/functional/iframe-msg.html::Example with iframe that notifies containing document via cross document messaging PASSED [ 37%]
tests/functional/log-insertion.html::Log insertion PASSED [ 38%]
tests/functional/no-title.html::Tests with no title PASSED [ 39%]
tests/functional/order.html::Ordering PASSED [ 40%]
tests/functional/promise-async.html::Async Tests and Promises PASSED [ 42%]
tests/functional/promise-with-sync.html::Promise Tests and Synchronous Tests PASSED [ 43%]
tests/functional/promise.html::Promise Tests PASSED [ 44%]
tests/functional/queue.html::Test queuing synchronous tests PASSED [ 45%]
tests/functional/setup-worker-service.html::Setup function in a service worker PASSED [ 46%]
JavaScript error: https://web-platform.test:8443/resources/testharness.js, line 1469: uncaught exception: Error: assert_true: expected true got false
tests/functional/single-page-test-fail.html::Example with file_is_test (should fail) PASSED [ 47%]
tests/functional/single-page-test-no-assertions.html::Example single page test with no asserts PASSED [ 48%]
tests/functional/single-page-test-no-body.html::Example single page test with no body PASSED [ 50%]
tests/functional/single-page-test-pass.html::Example with file_is_test PASSED [ 51%]
tests/functional/step_wait.html::Tests for step_wait PASSED [ 52%]
tests/functional/step_wait_func.html::Tests for step_wait_func and step_wait_func_done PASSED [ 53%]
tests/functional/task-scheduling-promise-test.html::testharness.js - task scheduling PASSED [ 54%]
tests/functional/task-scheduling-test.html::testharness.js - task scheduling PASSED [ 55%]
JavaScript error: https://web-platform.test:8443/resources/test/tests/functional/uncaught-exception-handle.html, line 13: Error: Example Error
tests/functional/uncaught-exception-handle.html::Harness Handling Uncaught Exception PASSED [ 56%]
JavaScript error: https://web-platform.test:8443/resources/test/tests/functional/uncaught-exception-ignore.html, line 15: Error: Example Error
tests/functional/uncaught-exception-ignore.html::Harness Ignoring Uncaught Exception PASSED [ 57%]
tests/functional/worker-dedicated-uncaught-allow.html::Dedicated Worker Tests - Allowed Uncaught Exception PASSED [ 59%]
tests/functional/worker-dedicated-uncaught-single.html::Dedicated Worker Tests - Uncaught Exception in Single-Page Test PASSED [ 60%]
tests/functional/worker-dedicated.sub.html::Dedicated Worker Tests PASSED [ 61%]
tests/functional/worker-service.html::Example with a service worker PASSED [ 62%]
tests/functional/worker-shared.html::Example with a shared worker PASSED [ 63%]
tests/unit/IdlArray/is_json_type.html::IdlArray.prototype.is_json_type() PASSED [ 64%]
tests/unit/IdlDictionary/get_reverse_inheritance_stack.html::IdlDictionary.prototype.get_reverse_inheritance_stack() PASSED [ 65%]
tests/unit/IdlDictionary/test_partial_dictionary.html::idlharness: partial dictionaries PASSED [ 67%]
tests/unit/IdlInterface/constructors.html::IdlInterface.prototype.constructors() PASSED [ 68%]
tests/unit/IdlInterface/default_to_json_operation.html::IdlDictionary.prototype.default_to_json_operation() PASSED [ 69%]
tests/unit/IdlInterface/do_member_unscopable_asserts.html::IdlDictionary.prototype.do_member_unscopable_asserts() PASSED [ 70%]
tests/unit/IdlInterface/get_interface_object.html::IdlInterface.prototype.get_interface_object() PASSED [ 71%]
tests/unit/IdlInterface/get_interface_object_owner.html::IdlInterface.prototype.get_interface_object_owner() PASSED [ 72%]
tests/unit/IdlInterface/get_legacy_namespace.html::IdlInterface.prototype.get_legacy_namespace() PASSED [ 73%]
tests/unit/IdlInterface/get_qualified_name.html::IdlInterface.prototype.get_qualified_name() PASSED [ 75%]
tests/unit/IdlInterface/get_reverse_inheritance_stack.html::IdlInterface.prototype.get_reverse_inheritance_stack() PASSED [ 76%]
tests/unit/IdlInterface/has_default_to_json_regular_operation.html::IdlInterface.prototype.has_default_to_json_regular_operation() PASSED [ 77%]
tests/unit/IdlInterface/has_to_json_regular_operation.html::IdlInterface.prototype.has_to_json_regular_operation() PASSED [ 78%]
tests/unit/IdlInterface/should_have_interface_object.html::IdlInterface.prototype.should_have_interface_object() PASSED [ 79%]
tests/unit/IdlInterface/test_primary_interface_of_undefined.html::idlharness test_primary_interface_of_undefined PASSED [ 80%]
tests/unit/IdlInterfaceMember/is_to_json_regular_operation.html::IdlInterfaceMember.prototype.is_to_json_regular_operation() PASSED [ 81%]
tests/unit/IdlInterfaceMember/toString.html::IdlInterfaceMember.prototype.toString() PASSED [ 82%]
tests/unit/assert_implements.html::assert_implements unittests PASSED [ 84%]
tests/unit/assert_implements_optional.html::assert_implements_optional unittests PASSED [ 85%]
tests/unit/assert_object_equals.html::Assertion functions PASSED [ 86%]
tests/unit/async-test-return-restrictions.html::Restrictions on return value from `async_test` PASSED [ 87%]
tests/unit/basic.html::idlharness basic PASSED [ 88%]
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases-timeouts.html, line 15: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases-timeouts.html, line 15: Error: this error is expected
tests/unit/exceptional-cases-timeouts.html::Exceptional cases - timeouts PASSED [ 89%]
tests/unit/exceptional-cases.html::Exceptional cases JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.04178603039884543, line 1469: uncaught exception: Error: assert_false: expected false got true
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 13: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 16: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 17: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 11: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 13: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 19: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/exceptional-cases.html, line 14: Error: this error is expected
PASSED [ 90%]
tests/unit/format-value.html::format_value utility function PASSED [ 92%]
tests/unit/late-test.html::Test declared after harness completion PASSED [ 93%]
tests/unit/promise_setup-timeout.html::promise_setup - timeout PASSED [ 94%]
tests/unit/promise_setup.html::promise_setup JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 15: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 18: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 20: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/promise_setup.html, line 17: Error: this error is expected
PASSED [ 95%]
tests/unit/single_test.html::single_test JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/single_test.html, line 13: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/test/tests/unit/single_test.html, line 13: Error: this error is expected
JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.0643237212100296, line 2493: Error: Tried to create a test with file_is_test
JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.37006574019796556, line 2493: Error: Tried to create a test with file_is_test
JavaScript error: https://web-platform.test:8443/resources/testharness.js?0.811913428230625, line 2493: Error: Tried to create a test with file_is_test
PASSED [ 96%]
tests/unit/test-return-restrictions.html::Restrictions on return value from `test` PASSED [ 97%]
tests/unit/throwing-assertions.html::Test the methods that make assertions about exceptions PASSED [ 98%]
tests/unit/unpaired-surrogates.html::Restrictions on return value from `test` PASSED [100%]
=============================== warnings summary ===============================
conftest.py:32
/home/test/web-platform-tests/resources/test/conftest.py:32: PytestRemovedIn9Warning: The (path: py.path.local) argument is deprecated, please use (file_path: pathlib.Path)
see https://docs.pytest.org/en/latest/deprecations.html#py-path-local-arguments-for-hooks-replaced-with-pathlib-path
def pytest_collect_file(file_path, path, parent):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
================== 88 passed, 1 warning in 104.78s (0:01:44) ===================
1732736222514 Marionette INFO Stopped listening on port 36003
[GFX1-]: RenderCompositorSWGL failed mapping default framebuffer, no dt
py312: OK (116.37=setup[3.37]+cmd[113.01] seconds)
congratulations :) (116.43 seconds)
[taskcluster 2024-11-27 19:37:03.769Z] === Task Finished ===
[taskcluster 2024-11-27 19:37:03.832Z] Successful task run with exit code: 0 completed in 254.686 seconds
Loading