Rewrite cell/swath xarray readers as MultiFileHandlers#64

Draft

claytharrison wants to merge 58 commits intoTUW-GEO:masterfrom claytharrison:xarr_refactor

+5,249-16

Commits on May 11, 2024

Add MultiFileHandler cell file readers

Clay Harrison
authored and
sebhahn
committed
Fix sneaky syntax error

Clay Harrison
authored and
sebhahn
committed
Add util for getting various gpi-sets from grid

Clay Harrison
authored and
sebhahn
committed
Rename cell read method to extract

Clay Harrison
authored and
sebhahn
committed
Reformat test data generator and add swaths

Clay Harrison
authored and
sebhahn
committed
Add ChronFiles-based swath reader + tests

Clay Harrison
authored and
sebhahn
committed
add pyresample to dependencies
sebhahn
committed
add numba
sebhahn
committed

Commits on May 16, 2024

Remove numba
Clay Harrison
committed

Commits on May 28, 2024

add extra options to get_grid_gpis
Clay Harrison
committed
add grid cache and ASCAT products to product_info
Clay Harrison
committed
Add spatial functionality to swath_collection
Clay Harrison
committed
adapt aggregators to use new swath_collection
Clay Harrison
committed
ignore profiling
Clay Harrison
committed
Start adding spatial funcs to cell_collection
Clay Harrison
committed
Start on swath/cell xarray accessors
Clay Harrison
committed

Commits on May 29, 2024

Fix orthomulti tests
Clay Harrison
committed
Fix swath tests
Clay Harrison
committed

Commits on May 31, 2024

Resolve conflict with master
Clay Harrison
committed

Commits on Jul 12, 2024

Allow passing kwargs to _fmt functions
Clay Harrison
committed
Decapitalize np.Inf -> np.inf
Clay Harrison
committed
Option for "sat" on extract
Clay Harrison
committed
Parallelize swath merge/extract
Clay Harrison
committed
Add stacking SwathGridFiles to cell files
Clay Harrison
committed
Some more tests
Clay Harrison
committed

Commits on Jul 16, 2024

Passing tests
Clay Harrison
committed

Commits on Jul 31, 2024

Fix encoding error
Clay Harrison
committed
Cleanup
Clay Harrison
committed
Add reprocess method to CellGridFiles
Clay Harrison
committed
Use reprocess method for conv. dir to contig.
Clay Harrison
committed
Test converting to contig
Clay Harrison
committed

Commits on Aug 1, 2024

Fix kwargs in cell reprocess functions
Clay Harrison
committed
Modify cell test data
Clay Harrison
committed
fn_kwargs -> func_kwargs in cell reprocess
Clay Harrison
committed

Commits on Aug 2, 2024

Add geom search to cells/swaths
Clay Harrison
committed
Harmonizing cell/swath reader access syntax
Clay Harrison
committed
Cleanup
Clay Harrison
committed

Commits on Aug 8, 2024

Allow for fmt_kwargs in extract and downstream
Clay Harrison
committed

Commits on Aug 14, 2024

Fix dtype_to_nan
Clay Harrison
committed
Add cell merging
Clay Harrison
committed

Commits on Aug 19, 2024

Fix pool closing in merge
Clay Harrison
committed

Commits on Aug 27, 2024

Allow passing filehandling kwargs: from_product_id
Clay Harrison
committed

Commits on Aug 28, 2024

Add read_kwargs to enable cell preprocessor
Clay Harrison
committed
Allow passing optional write_func to preprocess
Clay Harrison
committed
Enable trimming data gpis before ensure_indexed
Clay Harrison
committed
Add grid info to ERS readers
Clay Harrison
committed
Add progress bar to reprocess, single-proc merge
Clay Harrison
committed
Change reprocess to unordered imap
Clay Harrison
committed

Commits on Aug 29, 2024

Fix ERSNCell resolution bug
Clay Harrison
committed

Commits on Sep 2, 2024

Fix original dtype encoding passthrough on write
Clay Harrison
committed
Load merged data before writing to save time
Clay Harrison
committed
Remove unnecessary dask-array and .compute calls
Clay Harrison
committed
Remove another unnecessary da.*.compute() call
Clay Harrison
committed
Bug fixes for last commits
Clay Harrison
committed

Commits on Sep 3, 2024

Allow numpy arrs as cells arg to merge_out
Clay Harrison
committed

Commits on Sep 5, 2024

Fix contiguous gpi trimming for lookup_vector
Clay Harrison
committed

Commits on Sep 9, 2024

Use fetch or store for ERS grids
Clay Harrison
committed
Fix bugs in gpi readers
Clay Harrison
committed