Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve parallel/sharded CLI output #1862

Open
simon-gilmurray opened this issue Jul 31, 2024 · 2 comments
Open

Improve parallel/sharded CLI output #1862

simon-gilmurray opened this issue Jul 31, 2024 · 2 comments
Labels
enhancement New feature request or improvement of an existing feature maestro cli Related to the command-line Maestro tool

Comments

@simon-gilmurray
Copy link

Is your feature request related to a problem? Please describe.
Parallel/sharded CLI output is currently quite garbled, it doesn't display which flows ran/failed against which device
Debug logs/folder/output is also not mentioned like previous single test suite runs

Example:
Screenshot 2024-07-30 at 12 47 24

Describe the solution you'd like

  • A clearer view on which flows ran/failed against which device, rather than mixed up
  • Debug folder/logs/screenshot path output at the end

Describe alternatives you've considered

Additional context

@simon-gilmurray simon-gilmurray added the enhancement New feature request or improvement of an existing feature label Jul 31, 2024
@bartekpacia
Copy link
Contributor

Thanks a ton Simon, I totally agree there's a lot of area of improvement here.

Gonna mark this issue as a child of epic #1818

@bartekpacia bartekpacia added the maestro cli Related to the command-line Maestro tool label Jul 31, 2024
@tokou
Copy link
Contributor

tokou commented Sep 7, 2024

This has been addressed in #1953 at least partially

Here's an example output

Will split 5 flows across 2 shards (approx. 3 flows per shard)

[shard 2] Waiting for flows to complete...

[shard 1] Waiting for flows to complete...
[shard 2] [Passed] Bookmarks2 (8s)
[shard 1] [Passed] Bookmarks (10s)
[shard 2] [Passed] Bookmarks4 (7s)

[shard 2] 2/2 Flows Passed in 15s

[shard 1] [Passed] Bookmarks3 (8s)
[shard 1] [Passed] Bookmarks5 (7s)

[shard 1] 3/3 Flows Passed in 25s


╭─────────────────────────────╮
│                             │
│   Passed: 5/5               │
│   [ emulator-5554 ] - 3/3   │
│   [ emulator-5556 ] - 2/2   │
│                             │
╰─────────────────────────────╯

a further improvement could be to make this output sorted by shards but this would be more involved

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature request or improvement of an existing feature maestro cli Related to the command-line Maestro tool
Projects
None yet
Development

No branches or pull requests

3 participants