- Add the possibility to change sources and sinks
-
PartitionsConfiguration
should allow for optional columns -
PartitionsConfiguration
should have an optional parameterforce
that should force the use ofrepartition
instead ofcoalesce
in theFileDataSink
- Move to Spark 3.3 and cross compile
- Move
TypesafeConfigBuilder
tospark-utils-io-pureconfig