Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add extra binaries in the setup command #1208

Merged
merged 17 commits into from
Sep 21, 2023
Merged

Conversation

wirednkod
Copy link
Contributor

@wirednkod wirednkod commented Jul 31, 2023

Missing task: When first time binaries are created during release - these binaries should be investigated and added to the setup process

Fixes #1202
Fixes #1209

Copy link
Contributor

@mrcnski mrcnski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! I wonder if there could be some option/way to install all the binaries without specifying them? Otherwise users have to type all this:

node dist/cli.js setup polkadot polkadot-parachain polkadot-prepare-worker polkadot-execute-worker

Just a suggestion, not sure if it makes sense.

@wirednkod
Copy link
Contributor Author

there could be some option/way to install all the binaries without specifying them

I'm not sure that this is a very famous option (install all possibilities for a test) 🤔
We could always add it as an option. Added an issue for tracking

@pepoviola
Copy link
Collaborator

there could be some option/way to install all the binaries without specifying them

I'm not sure that this is a very famous option (install all possibilities for a test) 🤔 We could always add it as an option. Added an issue for tracking

Thanks @wirednkod, I think we should download all the polkadot binaries since the are part of the release. I think most of the people will expect that the setup command download all the required binaries to run a network.
@wirednkod / @mrcnski wdyt?

@mrcnski
Copy link
Contributor

mrcnski commented Aug 1, 2023

@pepoviola Yeah, actually the worker binaries should always be downloaded along with polkadot because the versions must stay in sync. Maybe if no params are given, setup can download all the binaries by default?

@pepoviola
Copy link
Collaborator

@pepoviola Yeah, actually the worker binaries should always be downloaded along with polkadot because the versions must stay in sync. Maybe if no params are given, setup can download all the binaries by default?

Great, @wirednkod can you update the pr so we always download the workers as part of polkadot ?
Thanks!

Copy link
Contributor

@mrcnski mrcnski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very cool, I love the way you did it. setup polkadot polkadot-parachain will continue to grab all the binaries so nothing breaks for anyone. 😀

javascript/packages/cli/src/actions/setup.ts Outdated Show resolved Hide resolved
javascript/packages/cli/src/actions/setup.ts Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
@wirednkod wirednkod requested a review from mrcnski August 2, 2023 08:20
Copy link
Contributor

@mrcnski mrcnski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! Just one comment, and I think one of my earlier comments was missed

javascript/packages/cli/src/actions/setup.ts Show resolved Hide resolved
@wirednkod wirednkod requested a review from mrcnski August 7, 2023 06:30
@wirednkod wirednkod marked this pull request as ready for review August 7, 2023 06:30
@wirednkod
Copy link
Contributor Author

@pepoviola I made this ready for review but it should not be merged, until the worker binaries are added to at least 1 release and I run some more tests against those;

Copy link
Contributor

@mrcnski mrcnski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🥳

@@ -209,6 +263,12 @@ const latestPolkadotReleaseURL = async (
return Boolean(obj);
});

if (!release) {
console.log(
`In repo '${repo}', there is no release for: '${name}'! Exiting...`,
Copy link
Collaborator

@pepoviola pepoviola Aug 7, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to throw here, since the next line
const { tag_name } = release;
will generate an error.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah - good catch. I meant to throw error here - but I never did. Thank you

@@ -126,7 +126,7 @@ program
"<binaries...>",
`the binaries that you want to be downloaded, provided in a row without any separators;\nThey are downloaded in current directory and appropriate executable permissions are assigned.\nPossible options: 'polkadot', 'polkadot-parachain'\n${decorators.blue(
"zombienet setup polkadot polkadot-parachain",
)}`,
)}\nNote: Downloading 'polkadot' downloads also 'polkadot-prepare-worker' and 'polkadot-execute-worker'`,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

package polkadot into npm. inventing own package manager is dead end.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dzmitry-lahoda can you elaborate a bit more on this - what exactly you mean?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe he means that zombienet setup is doing a job that can already be done by a package manager?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If that is the case then i think it is not correct; Cause not everyone is using zombienet by cloning the repo; There are cases of using it as a release - and thus the release can help setting up the binaries;

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes. just ask user to use apt npm nix curl dpkg etc.

adhoc pm is dead end. let start that it is not secure nor it will work on proxyvpnedfirewalled envs.

parity to release apt or and npm.

parity already releases nix polkadot. waiting for nix common good nodes;

Copy link
Contributor

@dzmitry-lahoda dzmitry-lahoda Sep 6, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just ask user to install, like you ask to install k8s, podman, etc.

on windows can use scoop or winget.

on mac brew or nix.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was created as an easy way for non-advanced linux users to crash-test zombienet; It retrieves these from the release packages of gitlab and its not the "mandatory way to go";

I am fine for removing it if @pepoviola agrees - I do not see any value though on removing this;

@pepoviola
Copy link
Collaborator

ping @wirednkod this is ready to review/merge? would be good to include in the next release
Thx!

@wirednkod
Copy link
Contributor Author

wirednkod commented Sep 21, 2023

ping @wirednkod this is ready to review/merge? would be good to include in the next release Thx!

Just tested and make some minor changes. Everything works as expected.

Thank you @mrcnski @pepoviola

@wirednkod wirednkod merged commit 285460f into main Sep 21, 2023
9 checks passed
@wirednkod wirednkod deleted the nik-extra-setup-binaries branch September 21, 2023 15:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add a flag on setup to download all binaries Add support for new binaries (polkadot)
4 participants