Unit test 4 dev (#113)

* Define a step for pytest execution

* Fix: use v1 of step action

* Print result of step composition

* Rename step

* Use step previous definition in the assessment

* Rename input: workflow -> steps

* Avoid caching by using 1.0.0

* Set container image

* Bump to v1

* Bump to sqaaas-assessment-action@v2

* Remove 'id' property

* Adapt inputs to v2

* Remove current branch

* Disable test_cyclones_train_tf

* ADD marker

* ADD skip memory heavy

* Disable for PRs

---------

Co-authored-by: Matteo Bunino <[email protected]>

.github/workflows/sqaaas.yml

@@ -7,13 +7,28 @@ name: SQAaaS
 on:
   push:
     branches: [main, dev]
-  pull_request:
-    branches: [main, dev]
+  # pull_request:
+  #   branches: [main, dev]
 
 jobs:
   sqaaas_job:
     runs-on: ubuntu-latest
     name: Job that triggers SQAaaS platform
     steps:
-      - name: SQAaaS assessment step
+      - name: Step definition for validating the workflow
+        uses: eosc-synergy/sqaaas-step-action@v1
+        with:
+          name: workflow_validation_step
+          tool: commands
+          commands: |
+            make torch-cpu
+            make tf-2.13
+            micromamba run -p ./.venv-pytorch pip install .[dev]
+            micromamba run -p ./.venv-pytorch pytest -v ./tests/ -m "not slurm and not memory_heavy"
+          container: eoscsynergy/sqaaas-micromamba:1.5.3-1
+      - name: Print out payload
+        run: cat workflow_validation_step.json
+      - name: SQAaaS assessment with unit testing (QC.Uni) step
         uses: eosc-synergy/sqaaas-assessment-action@v2
+        with:
+          qc_uni_steps: workflow_validation_step

pyproject.toml

@@ -75,4 +75,5 @@ markers = [
     "integration: integration tests (deselect with '-m \"not integration\"')",
     "slurm: needs SLURM and HPC resources (multiple GPUs/nodes). (deselect with '-m \"not slurm\"')",
     "functional: functional tests. (deselect with '-m \"not functional\"')",
+    "memory_heavy: high memory footprint. (deselect with '-m \"not heavy_memory\"')",
 ]

tests/use-cases/test_cyclones.py

@@ -17,6 +17,7 @@ def test_structure_cyclones(check_folder_structure):
 
 
 @pytest.mark.functional
+@pytest.mark.memory_heavy
 def test_cyclones_train_tf(install_requirements):
     """
     Test Cyclones tensorflow trainer by running it end-to-end.