Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

version 3.0.0 fails to create environments (stops at the RNAseq) #1062

Open
sunta3iouxos opened this issue Sep 26, 2024 · 5 comments
Open

version 3.0.0 fails to create environments (stops at the RNAseq) #1062

sunta3iouxos opened this issue Sep 26, 2024 · 5 comments

Comments

@sunta3iouxos
Copy link

the envs/shared.yaml and envs/createIndices.yaml are created without issues.
but the whole process just fails in the next level

Creating environment (3/24) from envs/rna_seq.yaml with hash 7b098b94bad80d0be19669458b1d7ef9
Channels:
 - conda-forge
 - bioconda
Platform: linux-64
Collecting package metadata (repodata.json): ...working... done
Solving environment: ...working... done
Preparing transaction: ...working... done
Verifying transaction: ...working... done
Executing transaction: ...working... There was an error when creating the environments!
@WardDeb
Copy link
Member

WardDeb commented Sep 26, 2024

Is this something reproducible ? I.e. does re-running createEnvs keep resulting in the same behavior ?

@sunta3iouxos
Copy link
Author

got it again today the same error. it stalls at the exucuting transaction and then I got the fail.

@katsikora
Copy link
Contributor

Did you run snakePipes config --condaEnvDir and provide a path with sufficient storage? The default currently points to /tmp and I wonder if the disk space becomes an issue at some point?

@sunta3iouxos
Copy link
Author

sunta3iouxos commented Sep 30, 2024

Did you run snakePipes config --condaEnvDir and provide a path with sufficient storage? The default currently points to /tmp and I wonder if the disk space becomes an issue at some point?

all environments are set up in /scratch, so that no restrictions will apply, I touch the folders monthly to not be wiped out and also taking backup of them in case they do.

$snakePipes info
------------------------- Info -------------------------

The global configuration file is:
    /scratch/tgeorgom/mamba/snakePipes/lib/python3.12/site-packages/snakePipes/shared/defaults.yaml
    --> tempDir in the global configuration = /scratch/tgeorgom/temp
    --> The snakemake profile used =  /scratch/tgeorgom/mamba/snakePipes/lib/python3.12/site-packages/snakePipes/shared/profiles/snakepipes_genericprofile

and defaults.yalm looks like:

condaEnvDir: /scratch/tgeorgom/mamba/snakePipes/env
configMode: manual
emailSender: null
max_thread: 100
oldConfig: null
onlySSL: false
organismsDir: shared/organisms
smtpPassword: null
smtpPort: 0
smtpServer: null
smtpUsername: null
snakemakeOptions: ''
#snakemakeProfile: shared/profiles/local
snakemakeProfile: shared/profiles/snakepipes_genericprofile
tempDir: /scratch/tgeorgom/temp
toolsVersion: true

those are the limits for /scratch

               +-------------------------------------------------------------------------------------------------------
                |                     Used: |            Soft Limit: |            Hard Limit: |            Grace Time: |
    Block Quota |                      26GB |                   30TB |                   40TB |                      - |
     File Quota |                   267,087 |              1,048,576 |              2,097,152 |                      - |
                +-------------------------------------------------------------------------------------------------------

@WardDeb
Copy link
Member

WardDeb commented Oct 7, 2024

If you try the --only flag to install other environments aside from the rna-seq one, do these get installed properly ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants