Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Workflows update #54

Merged
merged 12 commits into from
Nov 9, 2023
Merged

Workflows update #54

merged 12 commits into from
Nov 9, 2023

Conversation

enryH
Copy link
Member

@enryH enryH commented Nov 8, 2023

  • create a new version of the basic workflow allowing to run models twice with different configurations (e.g. different number of neighbours in KNN)
  • ... while not breaking everything else

For now only a new workflow is added, and the default switch will be done later.

Henry Webel added 12 commits October 18, 2023 19:08
- managed to include more models for comparison
- query torque cluster execution status changed, updated and moved
- v2 of workflow now creates config files automatically which can still be used with version one
- use pre-created conda environment with rule
- can create the configs needed for current workflow  in Snakefile

Next: Test and swap + document
-> Snakefile in project folder
- document relationship between updated and old workflow's
  configuration files (-> how to specify models and parameters)
- `testNotebooks.smk` can do it.
- set kernel to current environement (generic "Python 3")
for base workflow configuration (Snakefile vs Snakefile_v2)
- msImpute and trKNN failed
@enryH
Copy link
Member Author

enryH commented Nov 8, 2023

  • update workflow for testing all misc_* scripts
  • execution scripts for cluster move to separate folder (and adapted to time-out after 24h)
    • collect cluster scripts in project/bin
  • format all Snakemake files using snakefmt

@enryH enryH merged commit 089cc8e into dev Nov 9, 2023
5 of 6 checks passed
@enryH enryH deleted the workflow_config branch November 9, 2023 09:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant