Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test(ast/estree): ESTree conformance runner skip tests we cannot pass #9073

Conversation

overlookmotel
Copy link
Contributor

@overlookmotel overlookmotel commented Feb 12, 2025

ESTree conformance tester ignore tests which we cannot parse at present due to #3526 and #9029.

I've have checked all these tests one-by-one and made sure that their failures are all due to either #3526 and #9029.

Ignoring these tests results in 100% passing.

Really we shouldn't skip these tests because they should pass and they don't. But I intend to break everything again shortly by making the conformance tester stricter - e.g. make it insist fields be in same order as Acorn - so it'll be helpful to be able to see when we've fixed all those failures again, without having to filter out these "known bad" tests.

@github-actions github-actions bot added the C-test Category - Testing. Code is missing test cases, or a PR is adding them label Feb 12, 2025
Copy link
Contributor Author


How to use the Graphite Merge Queue

Add either label to this PR to merge it via the merge queue:

  • 0-merge - adds this PR to the back of the merge queue
  • hotfix - for urgent hot fixes, skip the queue and merge this PR next

You must have a Graphite account in order to use the merge queue. Sign up using this link.

An organization admin has enabled the Graphite Merge Queue in this repository.

Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue.

This stack of pull requests is managed by Graphite. Learn more about stacking.

@overlookmotel overlookmotel marked this pull request as ready for review February 12, 2025 15:10
@overlookmotel overlookmotel added A-ast Area - AST 0-merge Merge with Graphite Merge Queue labels Feb 12, 2025
Copy link
Contributor Author

overlookmotel commented Feb 12, 2025

Merge activity

  • Feb 12, 10:10 AM EST: The merge label '0-merge' was detected. This PR will be added to the Graphite merge queue once it meets the requirements.
  • Feb 12, 10:10 AM EST: A user added this pull request to the Graphite merge queue.
  • Feb 12, 10:16 AM EST: A user merged this pull request with the Graphite merge queue.

…#9073)

ESTree conformance tester ignore tests which we cannot parse at present due to #3526 and #9029.

I've have checked all these tests one-by-one and made sure that their failures are all due to either #3526 and #9029.

Ignoring these tests results in 100% passing.

Really we shouldn't skip these tests because they should pass and they don't. But I intend to break everything again shortly by making the conformance tester stricter - e.g. make it insist fields be in same order as Acorn - so it'll be helpful to be able to see when we've fixed all those failures again, without having to filter out these "known bad" tests.
@graphite-app graphite-app bot force-pushed the 02-12-test_ast_estree_estree_conformance_runner_skip_tests_we_cannot_pass branch from ea45855 to c240141 Compare February 12, 2025 15:11
@graphite-app graphite-app bot merged commit c240141 into main Feb 12, 2025
15 checks passed
@graphite-app graphite-app bot deleted the 02-12-test_ast_estree_estree_conformance_runner_skip_tests_we_cannot_pass branch February 12, 2025 15:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0-merge Merge with Graphite Merge Queue A-ast Area - AST C-test Category - Testing. Code is missing test cases, or a PR is adding them
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant