Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed parallel singularity pulls #44

Open
rsuchecki opened this issue Sep 3, 2019 · 3 comments
Open

Failed parallel singularity pulls #44

rsuchecki opened this issue Sep 3, 2019 · 3 comments
Labels

Comments

@rsuchecki
Copy link
Collaborator

First run of the workflow (e.g. new system or user) with singularity involves pulling multiple container images from docker hub. This can fail likely due to race conditions in singularity.

nextflow-io/nextflow#1210
https://github.com/sylabs/singularity/issues/3634

Until that is fixed a separate script could be used to pull all the containers sequentially prior to main workflow execution.

@rsuchecki
Copy link
Collaborator Author

Run once to pull (most of) the images sequentially if encountering this issue

nextflow run csiro-crop-informatics/biokanga-manuscript/pull_containers.nf

@rsuchecki
Copy link
Collaborator Author

Updated Singularity issue https://github.com/sylabs/singularity/issues/5020 with a fix in the upcoming release (3.6)

@rsuchecki
Copy link
Collaborator Author

Based on a failed GitHub Actions run (for a77bb96) I don't think this has been fixed in singularity 3.6

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant