Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Round 5 Submission #98

Merged
merged 3 commits into from
Aug 26, 2024
Merged

Round 5 Submission #98

merged 3 commits into from
Aug 26, 2024

Conversation

jessica-davis
Copy link
Contributor

No description provided.

Copy link

Run validation on files: 2024-08-11-MOBS_NEU-GLEAM_FLU.gz.parquet

Required values:

❌ Error 006: The submission is missing some required values, please check:
origin_date: 2024-08-11
scenario_id: c("A-2024-08-01", "C-2024-08-01", "E-2024-08-01", "B-2024-08-01", "D-2024-08-01", "F-2024-08-01")
target: inc death
horizon: c("1", "2", "3", "4", "5", "6", "7", "8", "9", "10", "11", "12", "13", "14", "15", "16", "17", "18", "19", "20", "21", "22", "23", "24", "25", "26", "27", "28", "29", "30", "31", "32", "33", "34", "35", "36", "37", "38", "39", "40", "41", "42", "43")
age_group: 0-130
location: US

Columns:

No errors or warnings found on the column names and numbers

Scenarios:

No errors or warnings found on scenario name and scenario id columns

Origin Date Column:

No errors or warnings found on the column 'origin_date'

Value and Type Columns:

No errors or warnings found on Value and Type columns

Target Columns:

❌ Error 601: At least one of the target_names is misspelled. Please verify, the target_names should be (optional target(s) inluded): 'inc hosp, inc death, cum death, cum hosp, peak size hosp, peak time hosp'. The data frame contains: 'inc hosp, inc deaths', as targets names.
❌ Error 602: The data frame does not contain projections for 'inc death' target(s).
🟡 Warning 602: No value found associated with the targets: inc death (optional), cum death (optional); output_type: quantile.
🟡 Warning 602: No value found associated with the targets: peak size hosp (optional); output_type: quantile.
🟡 Warning 602: No value found associated with the targets: peak time hosp (optional); output_type: cdf.

Locations:

No errors or warnings found on Location

Sample:

Column Pairing information:

Run grouping pairing:
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (A-2024-08-01, C-2024-08-01, E-2024-08-01)"),
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (B-2024-08-01, D-2024-08-01, F-2024-08-01)")
Stochastic run pairing:
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (A-2024-08-01, C-2024-08-01, E-2024-08-01)"),
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (B-2024-08-01, D-2024-08-01, F-2024-08-01)")
Number of Samples: 300

Quantiles:

No errors or warnings found on quantiles values and format

Age Group:

No errors or warnings found on Age_group

Copy link

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission is available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

Copy link

Run validation on files: 2024-08-11-MOBS_NEU-GLEAM_FLU.gz.parquet

Required values:

No missing required value found

Columns:

No errors or warnings found on the column names and numbers

Scenarios:

No errors or warnings found on scenario name and scenario id columns

Origin Date Column:

No errors or warnings found on the column 'origin_date'

Value and Type Columns:

No errors or warnings found on Value and Type columns

Target Columns:

🟡 Warning 602: No value found associated with the targets: peak size hosp (optional); output_type: quantile.
🟡 Warning 602: No value found associated with the targets: peak time hosp (optional); output_type: cdf.

Locations:

No errors or warnings found on Location

Sample:

Column Pairing information:

Run grouping pairing:
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (A-2024-08-01, C-2024-08-01, E-2024-08-01)"),
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (B-2024-08-01, D-2024-08-01, F-2024-08-01)")
Stochastic run pairing:
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (A-2024-08-01, C-2024-08-01, E-2024-08-01)"),
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (B-2024-08-01, D-2024-08-01, F-2024-08-01)")
Number of Samples: 300
❌ Error 902: The minimal accepted grouping includes the column(s): horizon, age_group, scenario_id, the column(s): age_group seem to be missing (or is missing a sub-group), please verify.

Column Pairing information:

Run grouping pairing:
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (A-2024-08-01, C-2024-08-01, E-2024-08-01)"),
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (B-2024-08-01, D-2024-08-01, F-2024-08-01)"),
c("horizon", "scenario_id (A-2024-08-01, C-2024-08-01, E-2024-08-01)"),
c("horizon", "scenario_id (B-2024-08-01, D-2024-08-01, F-2024-08-01)")
Stochastic run pairing:
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (A-2024-08-01, C-2024-08-01, E-2024-08-01)"),
c("horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)", "scenario_id (B-2024-08-01, D-2024-08-01, F-2024-08-01)"),
c("horizon", "scenario_id (A-2024-08-01, C-2024-08-01, E-2024-08-01)"),
c("horizon", "scenario_id (B-2024-08-01, D-2024-08-01, F-2024-08-01)")
Number of Samples: 300

Quantiles:

No errors or warnings found on quantiles values and format

Age Group:

No errors or warnings found on Age_group

Copy link

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission is available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

@LucieContamin
Copy link
Collaborator

HI @jessica-davis ,

Thank you very much for your submission. I apologize if the validation report output is confusing, I am still working on it. I just want to be sure I understand correctly your projections and the sample ID, if that's ok:

So you are providing 300 samples + quantiles for inc hosp: all location, 6 age groups (including "0-130") and for inc death: US, overall population. Is that correct?

For the sample ID:

  • run grouping: paired (grouped) by age group, horizon, sub group of scenario (2 groups: ACE and BDF)
  • stochastic run: paired (grouped) by age group, horizon, sub group of scenario (2 groups: ACE and BDF)
    (The validation returns an error because inc hosp and inc death are checked together and inc death as no optional age group, I can ignore it, sorry for the confusion)

Is that correct?

Please let me know if any questions or issues,
Best, Lucie

@jessica-davis
Copy link
Contributor Author

Yes, that is correct. Thanks for you help @LucieContamin!

@LucieContamin LucieContamin merged commit 78308dd into midas-network:main Aug 26, 2024
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants