Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

if i not the root ,can this workflow run without docker #89

Open
wangjiaxuan666 opened this issue Jan 27, 2022 · 3 comments
Open

if i not the root ,can this workflow run without docker #89

wangjiaxuan666 opened this issue Jan 27, 2022 · 3 comments

Comments

@wangjiaxuan666
Copy link

Thank you very much for sharing the software.
I don't have root permission, and I can't run docker.
If not docker image, can I run it successfully?

@hailiangmei
Copy link
Member

Hi Jiaxuan,

Sure! If you want to run WDL pipelines on a local HPC, you can use cromwell as the execution engine. It has support to convert docker image to singularity container: https://cromwell.readthedocs.io/en/stable/tutorials/Containers/#singularity

We use cromwell and singularity on our local Slurm HPC which works smoothly.

Cheers,
Leon

@maringa780
Copy link

Hi Leon,

I have two questions related to the original question on this thread. I hope to use this workflow on our local HPC where we don't have docker, just singularity.

  1. Do I need to create singularity containers using docker images or this workflow automatically does that? If the former, do I need to edit the lines in the recommended docker images file dockerImages.yml?
  2. Do I need to change or add any parameter in the code below to run this workflow in singularity?
    java -jar cromwell-77.jar run -o options.json -i inputs.json --imports RNA-seq_v5.0.0.zip RNA-seq_v5.0.0.wdl

Thanks again for your help and for sharing this workflow.

Regards,

-John

@DavyCats
Copy link
Contributor

Hi John,

  1. Singularity will automatically convert docker images into singularity images, so there's no need to create those yourself.
  2. In order to properly run cromwell on an HPC, you'll need to give it a backend configuration informing cromwell how to submit the jobs to the scheduler. As part of this configuration you'll specify that singularity gets used instead of docker. The link provided by Leon shows how to set that up. You can then run cromwell with the following command:
java -Dconfig.file=/path/to/your/config -jar cromwell-77.jar run \
  -o options.json -i inputs.json --imports RNA-seq_v5.0.0.zip RNA-seq_v5.0.0.wdl

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants