Skip to content

Latest commit

 

History

History
7 lines (6 loc) · 398 Bytes

TODOs.md

File metadata and controls

7 lines (6 loc) · 398 Bytes

TODOs

  • Add the possibility to change sources and sinks
  • PartitionsConfiguration should allow for optional columns
  • PartitionsConfiguration should have an optional parameter force that should force the use of repartition instead of coalesce in the FileDataSink
  • Move to Spark 3.3 and cross compile
  • Move TypesafeConfigBuilder to spark-utils-io-pureconfig