Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feedback system #282

Merged
merged 3 commits into from
Jul 2, 2024
Merged

Feedback system #282

merged 3 commits into from
Jul 2, 2024

Conversation

nerfZael
Copy link
Contributor

@nerfZael nerfZael commented Jul 2, 2024

No description provided.

@nerfZael nerfZael requested review from dOrgJelli and cbrzn July 2, 2024 11:45
@nerfZael
Copy link
Contributor Author

nerfZael commented Jul 2, 2024

/workflows/benchmarks agents/token 3

Copy link

github-actions bot commented Jul 2, 2024

Finished benchmarks
Download artifacts

Test Run Summary

  • Run from: ./autotx/tests/agents/token
  • Base path: autotx/tests/agents/token/
  • Iterations: 3
  • Total Cost: $15.06
  • Total Success Rate (%): ${\color{red} \LARGE \texttt {66.67} \large \texttt { (67/-29)} }$

Detailed Results

Test Name Success Rate (%) Passes Fails Avg Time Avg Cost
research/test_advanced.py::test_research_and_swap_many_tokens_subjective_complex ${\color{lightgreen} \large \texttt {67} \normalsize \texttt {(+57)} }$ ${\color{lightgreen} \large \texttt {2}}$ ${\color{lightgreen} \large \texttt {1}}$ 4.83m $1.72
research/test_advanced.py::test_research_and_swap_many_tokens_subjective_simple ${\color{red} \large \texttt {0} \normalsize \texttt {(-90)} }$ ${\color{red} \large \texttt {0}}$ ${\color{red} \large \texttt {3}}$ 1.39m $0.54
research/test_research.py::test_get_top_5_memecoins ${\color{lightgreen} \large \texttt {100} \normalsize \texttt {(+10)} }$ ${\color{lightgreen} \large \texttt {3}}$ ${\color{lightgreen} \large \texttt {0}}$ 43s $0.29
research/test_research.py::test_get_top_5_memecoins_in_optimism ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 49s $0.35
research/test_research.py::test_get_top_5_most_traded_tokens_from_l1 ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 46s $0.32
research/test_research.py::test_get_top_5_tokens_from_base ${\color{red} \large \texttt {67} \normalsize \texttt {(-33)} }$ ${\color{red} \large \texttt {2}}$ ${\color{red} \large \texttt {1}}$ 1.16m $0.19
research/test_research.py::test_price_change_information ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 25s $0.04
research/test_research_and_swap.py::test_research_and_buy_multiple ${\color{red} \large \texttt {0} \normalsize \texttt {(-100)} }$ ${\color{red} \large \texttt {0}}$ ${\color{red} \large \texttt {3}}$ 51s $0.38
research/test_research_and_swap.py::test_research_and_buy_one ${\color{red} \large \texttt {0} \normalsize \texttt {(-100)} }$ ${\color{red} \large \texttt {0}}$ ${\color{red} \large \texttt {3}}$ 54s $0.19
research/test_research_swap_and_send.py::test_research_buy_multiple_send_multiple ${\color{red} \large \texttt {0} \normalsize \texttt {(-100)} }$ ${\color{red} \large \texttt {0}}$ ${\color{red} \large \texttt {3}}$ 1.01m $0.28
research/test_research_swap_and_send.py::test_research_buy_one_send_multiple ${\color{red} \large \texttt {67} \normalsize \texttt {(-33)} }$ ${\color{red} \large \texttt {2}}$ ${\color{red} \large \texttt {1}}$ 44s $0.15
research/test_research_swap_and_send.py::test_research_buy_one_send_one ${\color{red} \large \texttt {0} \normalsize \texttt {(-100)} }$ ${\color{red} \large \texttt {0}}$ ${\color{red} \large \texttt {3}}$ 49s $0.16
send/test_send.py::test_send_erc20 ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 19s $0.00
send/test_send.py::test_send_erc20_parallel ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 22s $0.01
send/test_send.py::test_send_eth_multiple ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 31s $0.01
send/test_send.py::test_send_native ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 15s $0.00
send/test_send.py::test_send_native_sequential ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 20s $0.01
test_swap.py::test_swap_complex_1 ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 35s $0.03
test_swap.py::test_swap_complex_2 ${\color{red} \large \texttt {67} \normalsize \texttt {(-33)} }$ ${\color{red} \large \texttt {2}}$ ${\color{red} \large \texttt {1}}$ 60s $0.13
test_swap.py::test_swap_multiple_1 ${\color{red} \large \texttt {0} \normalsize \texttt {(-100)} }$ ${\color{red} \large \texttt {0}}$ ${\color{red} \large \texttt {3}}$ 1.24m $0.11
test_swap.py::test_swap_multiple_2 ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 28s $0.00
test_swap.py::test_swap_native ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 23s $0.00
test_swap.py::test_swap_triple ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 48s $0.00
test_swap.py::test_swap_with_non_default_token ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 22s $0.00
test_swap_and_send.py::test_send_and_swap_complex ${\color{red} \large \texttt {0} \normalsize \texttt {(-100)} }$ ${\color{red} \large \texttt {0}}$ ${\color{red} \large \texttt {3}}$ 46s $0.05
test_swap_and_send.py::test_send_and_swap_simple ${\color{red} \large \texttt {33} \normalsize \texttt {(-67)} }$ ${\color{red} \large \texttt {1}}$ ${\color{red} \large \texttt {2}}$ 29s $0.02
test_swap_and_send.py::test_swap_and_send_complex ${\color{red} \large \texttt {67} \normalsize \texttt {(-33)} }$ ${\color{red} \large \texttt {2}}$ ${\color{red} \large \texttt {1}}$ 42s $0.02
test_swap_and_send.py::test_swap_and_send_simple ${\color{none} \large \texttt {100} \normalsize \texttt {} }$ ${\color{none} \large \texttt {3}}$ ${\color{none} \large \texttt {0}}$ 26s $0.01

Total run time: 70.16 minutes

@nerfZael nerfZael merged commit 5b6553c into dev Jul 2, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants