Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TRACKER] Up-to-date Conformance Tracker #1433

Closed
wants to merge 8 commits into from

Conversation

johnedquinn
Copy link
Member

@johnedquinn johnedquinn commented Apr 17, 2024

DO NOT MERGE

Description

As there are multiple PRs out with conformance additions, this is merely a PR that holds all unmerged PRs for the sake of determining which tests remain.

This PR merges the following PLK PRs:

This PR also merges the following TEST PRs:

With this, here is the up-to-date conformance tracker:

Conformance comparison report-Cross Engine

Base (legacy) eval +/-
% Passing 92.55% 93.01% 0.46%
✅ Passing 5418 5446 28
❌ Failing 436 409 -27
🔶 Ignored 0 0 0
Total Tests 5854 5855 1

Conformance comparison report-Cross Commit-EVAL

Base (41c00fd) deaa9c0 +/-
% Passing 85.70% 93.01% 7.31%
✅ Passing 4986 5446 460
❌ Failing 832 409 -423
🔶 Ignored 0 0 0
Total Tests 5818 5855 37

License Information

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@johnedquinn johnedquinn deleted the v1-conformance-tracker branch July 15, 2024 17:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant