Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(25335): fix flaky test "Unlock wallet should send first three Page metric events upon fullscreen page load" #25351

Merged
merged 1 commit into from
Jun 18, 2024

Conversation

DDDDDanica
Copy link
Contributor

@DDDDDanica DDDDDanica commented Jun 15, 2024

Description

The flakyness comes from unordered events from time to time.
Based on the log of events when unlock wallet:

截屏2024-06-14 22 33 12

The events array is not sorted, and there is nothing wrong with metrics itself and the order of sending, which can be validated by timestamp.

Therefore the fix is to order events by timestamp and assert the value.

Open in GitHub Codespaces

Related issues

Fixes: #25335

Manual testing steps

  1. Go to this page...

Screenshots/Recordings

Before

After

Pre-merge author checklist

Pre-merge reviewer checklist

  • I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
  • I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

@DDDDDanica DDDDDanica self-assigned this Jun 15, 2024
@DDDDDanica DDDDDanica requested a review from a team as a code owner June 15, 2024 05:41
Copy link
Contributor

CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes.

Copy link

codecov bot commented Jun 15, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 65.68%. Comparing base (743f5ec) to head (1127308).
Report is 4 commits behind head on develop.

Additional details and impacted files
@@           Coverage Diff            @@
##           develop   #25351   +/-   ##
========================================
  Coverage    65.68%   65.68%           
========================================
  Files         1377     1377           
  Lines        54623    54623           
  Branches     14320    14320           
========================================
  Hits         35879    35879           
  Misses       18744    18744           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@metamaskbot
Copy link
Collaborator

Builds ready [1127308]
Page Load Metrics (383 ± 306 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint73133101189
domContentLoaded9271442
load481782383638306
domInteractive9271442
Bundle size diffs
  • background: 0 Bytes (0.00%)
  • ui: 0 Bytes (0.00%)
  • common: 0 Bytes (0.00%)

Copy link
Contributor

@chloeYue chloeYue left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM !

Copy link
Contributor

@seaona seaona left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice 😍

@DDDDDanica DDDDDanica merged commit f6890a7 into develop Jun 18, 2024
74 checks passed
@DDDDDanica DDDDDanica deleted the fix/25335 branch June 18, 2024 13:14
@github-actions github-actions bot locked and limited conversation to collaborators Jun 18, 2024
@metamaskbot metamaskbot added the release-12.1.0 Issue or pull request that will be included in release 12.1.0 label Jun 18, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
release-12.1.0 Issue or pull request that will be included in release 12.1.0 team-extension-platform
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Flaky test: Unlock wallet should send first three Page metric events upon fullscreen page load
5 participants