STAC hooks #386

Nazim-crim · 2023-09-28T20:08:02Z

Overview

Add hooks for STAC requests to dynamically create Magpie resources.

Changes

Non-breaking changes

Add a Magpie Webhook to create the Magpie resources corresponding to the STAC-API path elements when a STAC-API
POST /collections/{collection_id} or POST /collections/{collection_id}/items/{item_id} request is accomplished.
- When creating the STAC Item, the source entry in links corresponding to a THREDDS file on the same instance
  is used to define the Magpie resource_display_name corresponding to a file to be mapped later on
  (eg: a NetCDF birdhouse/test-data/tc_Anon[...].nc).
- Checking same instance source path is necessary because STAC could refer to external assets, and we do not want to
  inject Magpie resource that are not part of the active instance where the hook is running.

Related Issue / Discussion

relates to DAC-578

…posted and adding validation

… into stac-hooks

…reating item resource

…sed import

Nazim-crim · 2023-09-28T20:48:15Z

run tests

crim-jenkins-bot · 2023-09-28T21:08:59Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2117/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-154.rdext.crim.ca

Infrastructure deployment failed. Instance has not been destroyed. @matprov

birdhouse/components/stac/config/magpie/config.yml.template

CHANGES.md

birdhouse/components/stac/config/magpie/stac_hooks.py

birdhouse/components/stac/config/twitcher/docker-compose-extra.yml

birdhouse/components/stac/config/magpie/stac_hooks.py

tlvu

I approuve the spirit of this PR. Francis knows more about Magpie so I defer the actual approuval to him.

CHANGES.md

birdhouse/components/stac/config/magpie/stac_hooks.py

mishaschwartz

Ok! LGTM (pending suggested changes from @fmigneault)

… session if error is catch, updated changelog

…tion message

… into stac-hooks

crim-jenkins-bot · 2023-10-02T21:16:17Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2134/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-154.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1351/

NOTEBOOK TEST RESULTS

    
[2023-10-02T20:31:23.635Z] ============================= test session starts ==============================
[2023-10-02T20:31:23.635Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-10-02T20:31:23.635Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-10-02T20:31:23.635Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-10-02T20:31:23.635Z] collected 254 items
[2023-10-02T20:31:23.635Z] 
[2023-10-02T20:31:30.094Z] notebooks-auth/geoserver.ipynb ..........F..FFF.                         [  6%]
[2023-10-02T20:31:38.798Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-10-02T20:31:46.999Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 13%]
[2023-10-02T20:31:56.071Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-10-02T20:32:03.689Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb .F......       [ 19%]
[2023-10-02T20:39:55.428Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-10-02T20:39:55.428Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-10-02T20:39:56.754Z] ...............                                                          [ 30%]
[2023-10-02T20:40:06.149Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb F.F..    [ 32%]
[2023-10-02T20:40:15.103Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-10-02T20:40:31.356Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-10-02T20:40:33.003Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-10-02T20:40:37.665Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-10-02T20:40:42.692Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-10-02T20:44:07.151Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-10-02T20:45:36.317Z] .............                                                            [ 53%]
[2023-10-02T20:45:41.023Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-10-02T20:45:43.761Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 57%]
[2023-10-02T20:46:07.819Z] .................                                                        [ 64%]
[2023-10-02T20:46:15.648Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 66%]
[2023-10-02T20:46:17.026Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-10-02T20:46:25.861Z] .........                                                                [ 70%]
[2023-10-02T20:46:37.229Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-10-02T20:46:46.842Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-10-02T20:46:48.750Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 77%]
[2023-10-02T20:46:54.856Z] ......                                                                   [ 80%]
[2023-10-02T20:47:33.713Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-10-02T20:48:29.911Z] .............                                                            [ 85%]
[2023-10-02T20:48:48.014Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-10-02T20:50:58.177Z] ....s.                                                                   [ 88%]
[2023-10-02T20:51:06.320Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 88%]
[2023-10-02T20:51:21.842Z] ...                                                                      [ 90%]
[2023-10-02T20:51:36.743Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-10-02T20:52:00.086Z] ......                                                                   [ 92%]
[2023-10-02T20:52:01.955Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-10-02T20:54:36.282Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-10-02T20:54:36.282Z] 
[2023-10-02T20:54:36.282Z] =================================== FAILURES ===================================

crim-jenkins-bot · 2023-10-02T21:24:50Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2135/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-46.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1352/

NOTEBOOK TEST RESULTS

    
[2023-10-02T20:43:33.395Z] ============================= test session starts ==============================
[2023-10-02T20:43:33.395Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-10-02T20:43:33.395Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master@2
[2023-10-02T20:43:33.395Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-10-02T20:43:33.395Z] collected 254 items
[2023-10-02T20:43:33.395Z] 
[2023-10-02T20:43:38.855Z] notebooks-auth/geoserver.ipynb ..........F..FFF.                         [  6%]
[2023-10-02T20:43:47.126Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-10-02T20:43:55.699Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 13%]
[2023-10-02T20:44:04.128Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-10-02T20:44:12.076Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb .F......       [ 19%]
[2023-10-02T20:52:17.542Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-10-02T20:52:18.917Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-10-02T20:52:26.339Z] ...............                                                          [ 30%]
[2023-10-02T20:52:35.599Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb F.F..    [ 32%]
[2023-10-02T20:52:42.516Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-10-02T20:52:58.859Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-10-02T20:53:00.241Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-10-02T20:53:06.798Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-10-02T20:53:11.035Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-10-02T20:55:54.477Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-10-02T20:57:29.823Z] .............                                                            [ 53%]
[2023-10-02T20:57:34.902Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-10-02T20:57:37.467Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 57%]
[2023-10-02T20:58:01.891Z] .................                                                        [ 64%]
[2023-10-02T20:58:10.496Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 66%]
[2023-10-02T20:58:11.874Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-10-02T20:58:21.149Z] .........                                                                [ 70%]
[2023-10-02T20:58:31.953Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-10-02T20:58:42.311Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-10-02T20:58:44.213Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 77%]
[2023-10-02T20:58:50.338Z] ......                                                                   [ 80%]
[2023-10-02T20:59:29.062Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-10-02T20:59:59.658Z] .............                                                            [ 85%]
[2023-10-02T21:00:11.905Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-10-02T21:00:52.666Z] ....s.                                                                   [ 88%]
[2023-10-02T21:01:00.813Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 88%]
[2023-10-02T21:01:15.572Z] ...                                                                      [ 90%]
[2023-10-02T21:01:30.485Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-10-02T21:01:54.367Z] ......                                                                   [ 92%]
[2023-10-02T21:01:56.855Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-10-02T21:04:31.253Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-10-02T21:04:31.253Z] 
[2023-10-02T21:04:31.253Z] =================================== FAILURES ===================================

Nazim-crim · 2023-10-31T15:58:14Z

run tests

crim-jenkins-bot · 2023-10-31T16:19:09Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2195/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-67.rdext.crim.ca

Infrastructure deployment failed. Instance has not been destroyed. @matprov

Nazim-crim · 2023-11-01T12:47:55Z

run tests

crim-jenkins-bot · 2023-11-01T13:17:30Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2201/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-67.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1389/

NOTEBOOK TEST RESULTS

    
[2023-11-01T12:56:04.855Z] ============================= test session starts ==============================
[2023-11-01T12:56:04.855Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-01T12:56:04.855Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-01T12:56:04.855Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-01T12:56:04.855Z] collected 254 items
[2023-11-01T12:56:04.855Z] 
[2023-11-01T12:56:10.486Z] notebooks-auth/geoserver.ipynb ..........F..FFF.                         [  6%]
[2023-11-01T12:56:18.779Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-01T12:56:26.982Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 13%]
[2023-11-01T12:56:37.051Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-01T12:56:42.950Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb .F......       [ 19%]
[2023-11-01T13:04:06.527Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-01T13:04:06.527Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-01T13:04:16.675Z] ...............                                                          [ 30%]
[2023-11-01T13:04:25.835Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb F.F..    [ 32%]
[2023-11-01T13:04:33.179Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-01T13:04:49.423Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-01T13:04:51.085Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-01T13:05:00.177Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-01T13:05:04.613Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-01T13:09:30.680Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-01T13:10:43.496Z] .............                                                            [ 53%]
[2023-11-01T13:10:46.530Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-01T13:10:48.751Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 57%]
[2023-11-01T13:11:04.678Z] .................                                                        [ 64%]
[2023-11-01T13:11:13.327Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 66%]
[2023-11-01T13:11:15.241Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-01T13:11:39.136Z] ........F                                                                [ 70%]
[2023-11-01T13:11:47.979Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-01T13:11:57.311Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-01T13:11:58.692Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 77%]
[2023-11-01T13:12:02.046Z] ......                                                                   [ 80%]
[2023-11-01T13:12:08.632Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-01T13:12:22.908Z] .............                                                            [ 85%]
[2023-11-01T13:12:32.921Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-01T13:13:17.581Z] ....s.                                                                   [ 88%]
[2023-11-01T13:13:25.781Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 88%]
[2023-11-01T13:13:38.627Z] ...                                                                      [ 90%]
[2023-11-01T13:13:53.524Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-01T13:14:16.866Z] ......                                                                   [ 92%]
[2023-11-01T13:14:17.905Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-01T13:16:51.980Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-01T13:16:51.980Z] 
[2023-11-01T13:16:51.980Z] =================================== FAILURES ===================================

… into stac-hooks

crim-jenkins-bot · 2023-11-01T14:27:57Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2203/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-154.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1391/

NOTEBOOK TEST RESULTS

    
[2023-11-01T14:07:30.680Z] ============================= test session starts ==============================
[2023-11-01T14:07:30.680Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-01T14:07:30.680Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-01T14:07:30.680Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-01T14:07:30.680Z] collected 254 items
[2023-11-01T14:07:30.680Z] 
[2023-11-01T14:07:37.240Z] notebooks-auth/geoserver.ipynb ..........F..FFF.                         [  6%]
[2023-11-01T14:07:45.487Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-01T14:07:53.378Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 13%]
[2023-11-01T14:08:03.059Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-01T14:08:11.368Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb .F......       [ 19%]
[2023-11-01T14:15:40.859Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-01T14:15:42.243Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-01T14:15:50.872Z] ...............                                                          [ 30%]
[2023-11-01T14:16:00.583Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb F.F..    [ 32%]
[2023-11-01T14:16:07.401Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-01T14:16:23.537Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-01T14:16:24.926Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-01T14:16:33.793Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-01T14:16:38.465Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-01T14:20:04.374Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-01T14:21:13.398Z] .............                                                            [ 53%]
[2023-11-01T14:21:15.040Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-01T14:21:17.248Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 57%]
[2023-11-01T14:21:33.137Z] .................                                                        [ 64%]
[2023-11-01T14:21:40.991Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 66%]
[2023-11-01T14:21:42.385Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-01T14:22:00.722Z] ........F                                                                [ 70%]
[2023-11-01T14:22:10.155Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-01T14:22:19.646Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-01T14:22:21.033Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 77%]
[2023-11-01T14:22:23.839Z] ......                                                                   [ 80%]
[2023-11-01T14:22:30.415Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-01T14:22:45.484Z] .............                                                            [ 85%]
[2023-11-01T14:22:55.495Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-01T14:23:32.062Z] ....s.                                                                   [ 88%]
[2023-11-01T14:23:38.659Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 88%]
[2023-11-01T14:23:54.163Z] ...                                                                      [ 90%]
[2023-11-01T14:24:06.401Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-01T14:24:27.805Z] ......                                                                   [ 92%]
[2023-11-01T14:24:30.235Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-01T14:27:10.066Z] notebooks/stress-tests.ipynb ....F.                                      [100%]
[2023-11-01T14:27:10.066Z] 
[2023-11-01T14:27:10.066Z] =================================== FAILURES ===================================

… into stac-hooks

crim-jenkins-bot · 2023-11-09T15:41:19Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2221/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-46.rdext.crim.ca

Infrastructure deployment failed. Instance has not been destroyed. @matprov

Nazim-crim · 2023-11-09T18:43:51Z

run tests

crim-jenkins-bot · 2023-11-09T19:23:14Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2223/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-46.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1404/

NOTEBOOK TEST RESULTS

    
[2023-11-09T19:03:38.135Z] ============================= test session starts ==============================
[2023-11-09T19:03:38.135Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-09T19:03:38.135Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-09T19:03:38.135Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-09T19:03:38.135Z] collected 255 items
[2023-11-09T19:03:38.135Z] 
[2023-11-09T19:03:48.891Z] notebooks-auth/geoserver.ipynb ..................                        [  7%]
[2023-11-09T19:03:56.758Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-09T19:04:04.577Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-09T19:04:14.914Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-09T19:04:22.233Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 19%]
[2023-11-09T19:11:50.118Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-09T19:11:50.118Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-09T19:11:52.273Z] ...............                                                          [ 30%]
[2023-11-09T19:12:01.316Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-09T19:12:08.620Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-09T19:12:25.049Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-09T19:12:26.699Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-09T19:12:33.643Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-09T19:12:38.395Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-09T19:15:24.628Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-09T19:16:37.229Z] .............                                                            [ 53%]
[2023-11-09T19:16:41.681Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-09T19:16:43.892Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-09T19:17:00.469Z] .................                                                        [ 64%]
[2023-11-09T19:17:07.408Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-09T19:17:08.791Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-09T19:17:31.935Z] ........F                                                                [ 70%]
[2023-11-09T19:17:40.823Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-09T19:17:49.075Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-09T19:17:50.454Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-09T19:17:53.536Z] ......                                                                   [ 80%]
[2023-11-09T19:18:01.663Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-09T19:18:14.926Z] .............                                                            [ 85%]
[2023-11-09T19:18:24.934Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-09T19:18:58.262Z] ....s.                                                                   [ 88%]
[2023-11-09T19:19:06.415Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-09T19:19:19.222Z] ...                                                                      [ 90%]
[2023-11-09T19:19:34.146Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-09T19:19:57.483Z] ......                                                                   [ 92%]
[2023-11-09T19:19:58.588Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-09T19:22:32.710Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-09T19:22:32.710Z] 
[2023-11-09T19:22:32.710Z] =================================== FAILURES ===================================

birdhouse/components/stac/config/magpie/stac_hooks.py

…ide try block

crim-jenkins-bot · 2023-11-13T15:30:46Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2239/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-154.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1414/

NOTEBOOK TEST RESULTS

    
[2023-11-13T15:09:27.925Z] ============================= test session starts ==============================
[2023-11-13T15:09:27.925Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-13T15:09:27.925Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-13T15:09:27.925Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-13T15:09:27.925Z] collected 255 items
[2023-11-13T15:09:27.925Z] 
[2023-11-13T15:09:38.248Z] notebooks-auth/geoserver.ipynb ..................                        [  7%]
[2023-11-13T15:09:46.702Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-13T15:09:55.560Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-13T15:10:05.639Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-13T15:10:12.435Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 19%]
[2023-11-13T15:17:39.375Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-13T15:17:39.375Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-13T15:17:48.368Z] ...............                                                          [ 30%]
[2023-11-13T15:17:58.053Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-13T15:18:04.697Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-13T15:18:20.426Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-13T15:18:21.813Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-13T15:18:30.162Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-13T15:18:34.416Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-13T15:23:00.917Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-13T15:24:14.832Z] .............                                                            [ 53%]
[2023-11-13T15:24:17.317Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-13T15:24:19.921Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-13T15:24:36.270Z] .................                                                        [ 64%]
[2023-11-13T15:24:44.344Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-13T15:24:45.723Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-13T15:24:47.357Z] .FFFFFFFF                                                                [ 70%]
[2023-11-13T15:24:57.704Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-13T15:25:07.112Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-13T15:25:09.022Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-13T15:25:12.321Z] ......                                                                   [ 80%]
[2023-11-13T15:25:20.471Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-13T15:25:35.147Z] .............                                                            [ 85%]
[2023-11-13T15:25:45.161Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-13T15:26:22.335Z] ....s.                                                                   [ 88%]
[2023-11-13T15:26:30.467Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-13T15:26:44.017Z] ...                                                                      [ 90%]
[2023-11-13T15:26:58.941Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-13T15:27:23.723Z] ......                                                                   [ 92%]
[2023-11-13T15:27:26.831Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-13T15:30:01.062Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-13T15:30:01.062Z] 
[2023-11-13T15:30:01.062Z] =================================== FAILURES ===================================

tlvu

I approuve the spirit of this PR. Francis knows more about Magpie so I defer the actual approuval to him.

… into stac-hooks

crim-jenkins-bot · 2023-11-13T20:12:17Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2240/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-154.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1415/

NOTEBOOK TEST RESULTS

    
[2023-11-13T19:49:58.211Z] ============================= test session starts ==============================
[2023-11-13T19:49:58.211Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-13T19:49:58.211Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-13T19:49:58.211Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-13T19:49:58.211Z] collected 255 items
[2023-11-13T19:49:58.211Z] 
[2023-11-13T19:50:09.965Z] notebooks-auth/geoserver.ipynb ..................                        [  7%]
[2023-11-13T19:50:17.704Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-13T19:50:26.164Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-13T19:50:35.199Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-13T19:50:45.114Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 19%]
[2023-11-13T19:58:01.492Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-13T19:58:01.492Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-13T19:58:08.686Z] ...............                                                          [ 30%]
[2023-11-13T19:58:18.397Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-13T20:00:29.723Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ...FFF            [ 34%]
[2023-11-13T20:00:43.367Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-13T20:00:44.755Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-13T20:00:49.763Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-13T20:00:54.268Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-13T20:04:35.425Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-13T20:05:44.848Z] .............                                                            [ 53%]
[2023-11-13T20:05:47.024Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-13T20:05:49.368Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-13T20:06:06.972Z] .................                                                        [ 64%]
[2023-11-13T20:06:14.145Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-13T20:06:15.538Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-13T20:06:33.850Z] .........                                                                [ 70%]
[2023-11-13T20:06:43.232Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-13T20:06:52.279Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-13T20:06:53.658Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-13T20:06:56.727Z] ......                                                                   [ 80%]
[2023-11-13T20:07:04.869Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-13T20:07:19.622Z] .............                                                            [ 85%]
[2023-11-13T20:07:29.639Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-13T20:08:04.862Z] ....s.                                                                   [ 88%]
[2023-11-13T20:08:13.003Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-13T20:08:28.516Z] ...                                                                      [ 90%]
[2023-11-13T20:08:40.754Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-13T20:09:05.260Z] ......                                                                   [ 92%]
[2023-11-13T20:09:07.564Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-13T20:11:32.146Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-13T20:11:32.146Z] 
[2023-11-13T20:11:32.146Z] =================================== FAILURES ===================================

… into stac-hooks

crim-jenkins-bot · 2023-11-27T16:30:26Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2306/
Result : success

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-154.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1436/

NOTEBOOK TEST RESULTS

    
[2023-11-27T16:10:48.062Z] ============================= test session starts ==============================
[2023-11-27T16:10:48.062Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-27T16:10:48.062Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-27T16:10:48.062Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-27T16:10:48.062Z] collected 255 items
[2023-11-27T16:10:48.062Z] 
[2023-11-27T16:11:00.473Z] notebooks-auth/geoserver.ipynb ..................                        [  7%]
[2023-11-27T16:11:08.603Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-27T16:11:17.172Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-27T16:11:26.872Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-27T16:11:32.696Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 19%]
[2023-11-27T16:18:56.278Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-27T16:18:56.279Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-27T16:19:00.999Z] ...............                                                          [ 30%]
[2023-11-27T16:19:10.024Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-27T16:19:16.745Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-27T16:19:32.662Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-27T16:19:34.054Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-27T16:19:38.752Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-27T16:19:43.264Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-27T16:22:39.206Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-27T16:23:52.402Z] .............                                                            [ 53%]
[2023-11-27T16:23:53.809Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-27T16:23:56.129Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-27T16:24:12.210Z] .................                                                        [ 64%]
[2023-11-27T16:24:19.348Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-27T16:24:20.733Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-27T16:24:38.502Z] .........                                                                [ 70%]
[2023-11-27T16:24:47.000Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-27T16:24:55.987Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-27T16:24:57.371Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-27T16:25:00.179Z] ......                                                                   [ 80%]
[2023-11-27T16:25:08.314Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-27T16:25:27.352Z] .............                                                            [ 85%]
[2023-11-27T16:25:37.354Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-27T16:26:12.316Z] ....s.                                                                   [ 88%]
[2023-11-27T16:26:20.483Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-27T16:26:36.001Z] ...                                                                      [ 90%]
[2023-11-27T16:26:48.241Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-27T16:27:12.749Z] ......                                                                   [ 92%]
[2023-11-27T16:27:14.410Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-27T16:29:48.509Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-27T16:29:48.509Z] 
[2023-11-27T16:29:48.509Z] ================= 254 passed, 1 skipped in 1134.23s (0:18:54) ==================

crim-jenkins-bot · 2023-11-27T18:33:45Z

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2307/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : stac-hooks
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-154.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1437/

NOTEBOOK TEST RESULTS

    
[2023-11-27T18:12:51.025Z] ============================= test session starts ==============================
[2023-11-27T18:12:51.025Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-27T18:12:51.025Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-27T18:12:51.025Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-27T18:12:51.025Z] collected 255 items
[2023-11-27T18:12:51.025Z] 
[2023-11-27T18:13:01.692Z] notebooks-auth/geoserver.ipynb ..................                        [  7%]
[2023-11-27T18:13:09.890Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-27T18:13:17.766Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-27T18:13:27.469Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-27T18:13:33.428Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 19%]
[2023-11-27T18:20:59.395Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-27T18:21:00.775Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-27T18:21:13.001Z] ...............                                                          [ 30%]
[2023-11-27T18:21:22.537Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-27T18:21:30.726Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-27T18:21:47.819Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-27T18:21:49.207Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-27T18:21:54.176Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-27T18:21:58.946Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-27T18:25:55.993Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-27T18:27:12.395Z] .............                                                            [ 53%]
[2023-11-27T18:27:14.302Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-27T18:27:16.617Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-27T18:27:32.595Z] .................                                                        [ 64%]
[2023-11-27T18:27:40.664Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-27T18:27:42.051Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-27T18:27:43.783Z] .FFFFFFFF                                                                [ 70%]
[2023-11-27T18:27:54.901Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-27T18:28:05.487Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-27T18:28:06.869Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-27T18:28:10.441Z] ......                                                                   [ 80%]
[2023-11-27T18:28:17.013Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-27T18:28:32.464Z] .............                                                            [ 85%]
[2023-11-27T18:28:42.466Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-27T18:29:20.189Z] ....s.                                                                   [ 88%]
[2023-11-27T18:29:28.343Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-27T18:29:43.891Z] ...                                                                      [ 90%]
[2023-11-27T18:29:58.802Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-27T18:30:21.991Z] ......                                                                   [ 92%]
[2023-11-27T18:30:24.607Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-27T18:33:04.250Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-27T18:33:04.250Z] 
[2023-11-27T18:33:04.250Z] =================================== FAILURES ===================================

Nazim-crim added 5 commits September 26, 2023 18:39

Adding stac hooks for creating collection resource

64a8fb7

Adding create item rhook to create magpie resource when stac item is …

ab9c678

…posted and adding validation

Merge branch 'master' of https://github.com/bird-house/birdhouse-deploy…

85cd4ab

… into stac-hooks

Adding exception handling and using collection id from request when c…

5e91536

…reating item resource

Adding method to extract thredd path from STAC links and removing unu…

4d8dc44

…sed import

Nazim-crim self-assigned this Sep 28, 2023

github-actions bot added component/magpie Related to https://github.com/Ouranosinc/Magpie component/twitcher Related to https://github.com/bird-house/twitcher documentation Improvements or additions to documentation labels Sep 28, 2023

Nazim-crim requested review from fmigneault and mishaschwartz September 28, 2023 20:08

bird-house deleted a comment from crim-jenkins-bot Sep 28, 2023

fmigneault requested changes Sep 29, 2023

View reviewed changes

fmigneault requested a review from tlvu September 29, 2023 14:16

tlvu reviewed Sep 29, 2023

View reviewed changes

mishaschwartz reviewed Sep 29, 2023

View reviewed changes

CHANGES.md Show resolved Hide resolved

birdhouse/components/stac/config/magpie/stac_hooks.py Outdated Show resolved Hide resolved

Changing single quote by double quote and fixing spacing

19813f0

mishaschwartz approved these changes Oct 2, 2023

View reviewed changes

fixing regex and comments

a826050

github-actions bot added component/weaver Related to https://github.com/crim-ca/weaver feature/WPS Feature or service related to Web Processing Service labels Oct 2, 2023

Nazim-crim added 3 commits October 2, 2023 17:49

Adding recursive function to create resource tree, adding rollback of…

f298434

… session if error is catch, updated changelog

Adding error handling for extract_display_name and fixing other excep…

b054e25

…tion message

Merge branch 'master' of https://github.com/bird-house/birdhouse-deploy…

afc39e0

… into stac-hooks

Nazim-crim requested a review from fmigneault October 2, 2023 20:26

Fixing comments

b63a9d7

bird-house deleted a comment from crim-jenkins-bot Oct 31, 2023

Merge branch 'master' of https://github.com/bird-house/birdhouse-deploy…

5c18430

… into stac-hooks

Merge branch 'master' of https://github.com/bird-house/birdhouse-deploy…

b3be1c5

… into stac-hooks

mishaschwartz requested changes Nov 10, 2023

View reviewed changes

Fixing import, removing redundant returns and moving get session outs…

f2efe27

…ide try block

Nazim-crim requested review from mishaschwartz and fmigneault November 13, 2023 15:40

fmigneault approved these changes Nov 13, 2023

View reviewed changes

tlvu approved these changes Nov 13, 2023

View reviewed changes

Merge branch 'master' of https://github.com/bird-house/birdhouse-deploy…

9b760c1

… into stac-hooks

fmigneault mentioned this pull request Nov 24, 2023

add optional-components/stac-data-proxy #403

Merged

mishaschwartz approved these changes Nov 27, 2023

View reviewed changes

Merge branch 'master' of https://github.com/bird-house/birdhouse-deploy…

3d883ef

… into stac-hooks

Bump version: 1.38.0 → 1.39.0

cb740de

github-actions bot added the ci/operations Continuous Integration components label Nov 27, 2023

Nazim-crim merged commit 44d217f into master Nov 27, 2023
2 of 3 checks passed

Nazim-crim deleted the stac-hooks branch November 27, 2023 18:52

mishaschwartz mentioned this pull request Nov 28, 2023

Update DEFAULT_CONF_DIRS to the minimal components required to deploy the stack #399

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

STAC hooks #386

STAC hooks #386

Nazim-crim commented Sep 28, 2023 •

edited

Loading

Nazim-crim commented Sep 28, 2023

crim-jenkins-bot commented Sep 28, 2023

tlvu left a comment

mishaschwartz left a comment

crim-jenkins-bot commented Oct 2, 2023

crim-jenkins-bot commented Oct 2, 2023

Nazim-crim commented Oct 31, 2023

crim-jenkins-bot commented Oct 31, 2023

Nazim-crim commented Nov 1, 2023

crim-jenkins-bot commented Nov 1, 2023

crim-jenkins-bot commented Nov 1, 2023

crim-jenkins-bot commented Nov 9, 2023

Nazim-crim commented Nov 9, 2023

crim-jenkins-bot commented Nov 9, 2023

crim-jenkins-bot commented Nov 13, 2023

tlvu left a comment

crim-jenkins-bot commented Nov 13, 2023

crim-jenkins-bot commented Nov 27, 2023

crim-jenkins-bot commented Nov 27, 2023

STAC hooks #386

STAC hooks #386

Conversation

Nazim-crim commented Sep 28, 2023 • edited Loading

Overview

Changes

Related Issue / Discussion

Nazim-crim commented Sep 28, 2023

crim-jenkins-bot commented Sep 28, 2023

E2E Test Results

DACCS-iac Pipeline Results

tlvu left a comment

Choose a reason for hiding this comment

mishaschwartz left a comment

Choose a reason for hiding this comment

crim-jenkins-bot commented Oct 2, 2023

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results

crim-jenkins-bot commented Oct 2, 2023

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results

Nazim-crim commented Oct 31, 2023

crim-jenkins-bot commented Oct 31, 2023

E2E Test Results

DACCS-iac Pipeline Results

Nazim-crim commented Nov 1, 2023

crim-jenkins-bot commented Nov 1, 2023

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results

crim-jenkins-bot commented Nov 1, 2023

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results

crim-jenkins-bot commented Nov 9, 2023

E2E Test Results

DACCS-iac Pipeline Results

Nazim-crim commented Nov 9, 2023

crim-jenkins-bot commented Nov 9, 2023

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results

crim-jenkins-bot commented Nov 13, 2023

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results

tlvu left a comment

Choose a reason for hiding this comment

crim-jenkins-bot commented Nov 13, 2023

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results

crim-jenkins-bot commented Nov 27, 2023

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results

crim-jenkins-bot commented Nov 27, 2023

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results

Nazim-crim commented Sep 28, 2023 •

edited

Loading