Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix native_batch_norm_legit on cuda | fix(torchlib) #1292

Merged
merged 3 commits into from
Mar 9, 2024

Conversation

justinchuby
Copy link
Collaborator

@justinchuby justinchuby commented Mar 8, 2024

Adjusted output dtypes for the op to match the that in the graph exported with GPU.

In float16, output 4 of native_batch_norm_legit_functional (new_running_var), when training=True, does not match the gpu output in 4/12 cases, and only in Eager mode. I am marking it as xfail-fixme for the time being because I couldn't see what went wrong.

Fixes #1256

@justinchuby
Copy link
Collaborator Author

justinchuby commented Mar 8, 2024

Thanks @titaiwangms for helping with the environment!

@justinchuby justinchuby added the topic: torch_lib Related to the torch/aten function lib in development label Mar 8, 2024
@justinchuby justinchuby added the merge at lgtm Reviewers can merge when they approve label Mar 8, 2024
Copy link

github-actions bot commented Mar 8, 2024

Test Results

     24 files  ±0      24 suites  ±0   1h 26m 12s ⏱️ - 6m 2s
 11 408 tests ±0   8 439 ✅ ±0    2 957 💤  - 1   12 ❌ +1 
258 570 runs  +2  59 145 ✅ ±0  199 248 💤 ±0  177 ❌ +2 

For more details on these failures, see this check.

Results for commit 7836931. ± Comparison against base commit 3b59a74.

@justinchuby justinchuby merged commit f5535b6 into main Mar 9, 2024
30 of 35 checks passed
@justinchuby justinchuby deleted the justinchu/batch-norm-2 branch March 9, 2024 00:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
merge at lgtm Reviewers can merge when they approve topic: torch_lib Related to the torch/aten function lib in development
Projects
Development

Successfully merging this pull request may close these issues.

Wrong shape of mean and variance in _aten_native_batch_norm_inference_onnx
2 participants