fix(rust): properly read/write fixed-sized lists from/to parquet files

[coastalwhite]

This PR rewrites many of the parts that relate to Parquet reading and writing of nested fields. This PR is quite large, and I tried my best to extensively test the new implementation, but I am also confident that there are still bugs in it. My view at the moment that these bugs are fringe enough for the moment.

Specifically, this PR merges the RepLevelIter and DefLevelIter into a BufferedDremelIter that properly follows the Parquet specification when it comes to repetition and definition levels. It is also buffered and thus should be faster (although I don't have numbers to back this up). For the reader side, most of the code is adjusted to skip add elements that are implied by invalid higher-level nestings.

This PR also does many, many drive-by refactors in the Parquet code.

Fixes #16608.

[codecov]

Codecov Report

Attention: Patch coverage is 88.55302% with 231 lines in your changes missing coverage. Please review.

Project coverage is 81.53%. Comparing base (2dba716) to head (4829f54).

Files	Patch %	Lines
crates/polars-parquet/src/parquet/error.rs	21.73%	18 Missing ⚠️
...quet/src/parquet/schema/io_message/from_message.rs	71.92%	16 Missing ⚠️
...tes/polars-parquet/src/parquet/read/page/reader.rs	25.00%	15 Missing ⚠️
crates/polars-parquet/src/parquet/compression.rs	46.15%	14 Missing ⚠️
...olars-parquet/src/arrow/write/nested/dremel/mod.rs	94.88%	13 Missing ⚠️
crates/polars-parquet/src/parquet/page/mod.rs	61.76%	13 Missing ⚠️
...es/polars-parquet/src/parquet/schema/types/spec.rs	27.77%	13 Missing ⚠️
crates/polars-parquet/src/arrow/write/pages.rs	86.74%	11 Missing ⚠️
...rates/polars-parquet/src/parquet/parquet_bridge.rs	46.66%	8 Missing ⚠️
crates/polars-parquet/src/parquet/write/stream.rs	0.00%	8 Missing ⚠️
... and 37 more

Additional details and impacted files

@@            Coverage Diff             @@
##             main   #16747      +/-   ##
==========================================
+ Coverage   81.43%   81.53%   +0.09%     
==========================================
  Files        1425     1422       -3     
  Lines      187987   188429     +442     
  Branches     2704     2704              
==========================================
+ Hits       153093   153633     +540     
+ Misses      34397    34299      -98     
  Partials      497      497              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.