Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revamp of the Intro Notebooks #10

Open
wants to merge 26 commits into
base: main
Choose a base branch
from
Open

Revamp of the Intro Notebooks #10

wants to merge 26 commits into from

Conversation

kjdoore
Copy link
Collaborator

@kjdoore kjdoore commented Oct 31, 2024

This is a major update to the introductory (101) notebooks. It breaks the contents down into five parts:

  1. Introduction to chunking overall with toy example
  2. How to read existing data sets and determine their chunking
  3. Basics on selecting chunk shape and size
  4. How to write chunked data to zarr
  5. How to rechunk existing data using rechunker

I was thinking that these notebooks cover the basics to help someone understand chunking and how to perform it in a basic way. Other more complex topics (rechunking on the cloud, optimizing chunk shape, etc) would be placed in a different "Advanced Topics" (201) section of this juypter book.
Let me know your thoughts and if you think I may have missed a topic you would consider "introductory" to chunking.

@kjdoore
Copy link
Collaborator Author

kjdoore commented Nov 7, 2024

To view the notebooks in a JupyterBook view, first switch to the kjdoore-updates branch. You will then create the conda environment from the env.yml file:

conda env create -f env.yml
conda activate chunking

The book can then be created with

jupyter-book build ./

To view the book, open the following file: _build/html/index.html

@kjdoore
Copy link
Collaborator Author

kjdoore commented Jan 7, 2025

@amsnyder these should be the last updates. Should be ready for a review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants