Fully unit tested utility functions for data engineering. Python 3 only.
-
Updated
Aug 22, 2024 - Python
Fully unit tested utility functions for data engineering. Python 3 only.
Python version of dbtools
Conforms pandas to "correct" datatypes to ensure data in/out using CSV, JSONL and Parquet is read the same (using arrow).
Docker image used to automatically validate data
Schema definitions and management of our metadata used by the Data Engineering Team at MoJ
Little helper to write IAM policies
Add a description, image, and links to the dmet-python-packages topic page so that developers can more easily learn about it.
To associate your repository with the dmet-python-packages topic, visit your repo's landing page and select "manage topics."