SIMSBIOHUB-633: Revamp CSV Imports - Critter

[MacQSL]

Links to Jira Tickets

• SIMSBIOHUB-633: Revamp CSV Imports

Description of Changes

• Revamps the existing CSV import services to an improved structure
• New CSVConfig concept - Static / Dynamic header configs
• Supports ALL data types
• New validation utils / functions for validating CSVConfigs
• New ImportCrittersService for importing Critter CSVs
• Util files for cellValidator and cellSetter functions
• CSV validation now returns CSVErrors

Testing Notes

• Should be able to import a Critter CSV with Postman
• Should see validation errors when issues exist in the CSV
• Correcting the issues and re-importing will succeed

[github-actions]

Openshift URLs for the PR Deployment:

• App Route: https://biohubbc-app-1438-af2668-dev.apps.silver.devops.gov.bc.ca/
• Api Route: https://biohubbc-api-1438-af2668-dev.apps.silver.devops.gov.bc.ca/
• Pods: https://console.apps.silver.devops.gov.bc.ca/k8s/ns/af2668-dev/pods?name=1438

[codecov]

Codecov Report

Attention: Patch coverage is 87.20539% with 38 lines in your changes missing coverage. Please review.

Project coverage is 45.94%. Comparing base (1c83bb7) to head (77bac9c).
Report is 1 commits behind head on dev.

Files with missing lines	Patch %	Lines
...import-services/critter/import-critters-service.ts	80.00%	12 Missing and 4 partials ⚠️
api/src/utils/csv-utils/csv-config-validation.ts	81.15%	4 Missing and 9 partials ⚠️
.../import-services/critter/critter-header-configs.ts	91.30%	3 Missing and 3 partials ⚠️
api/src/openapi/schemas/csv.ts	0.00%	1 Missing ⚠️
api/src/utils/csv-utils/csv-header-configs.ts	94.11%	0 Missing and 1 partial ⚠️
api/src/utils/nested-record.ts	92.85%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##              dev    #1438      +/-   ##
==========================================
+ Coverage   45.65%   45.94%   +0.28%     
==========================================
  Files         842      848       +6     
  Lines       22268    22444     +176     
  Branches     3300     3331      +31     
==========================================
+ Hits        10167    10312     +145     
- Misses      11504    11522      +18     
- Partials      597      610      +13     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[mauberti-bc]

Looks great! It's just missing the ability to make headers optional - wildlife health ID and description should be optional when adding animals

• Add ability to make certain headers optional
• Sex should be nullable and optional (able to be omitted as a header)

[mauberti-bc]

👍

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud