Releases: procter-gamble-oss/octopufs
Releases · procter-gamble-oss/octopufs
Execution optimization
Tail recursion is now used to list the fs elements which should be safer for bigger volumes.
Memory optimization resulting in 50% improvement
Spark3 scala 2.12
Move to spark 3.0.1 and scala 2.12
Fixed modify Table Acls (Runtime 6.4- scala_2.11)
modifyTableAcls is now setting requested permission on parent folder as well
Fixed modify Table Acls (Runtime 6.4-6.6 scala_2.11)
1.0.2_2.11_dbr6.4 SBT modified to read spark jars from databricks connect
Fixed issues with SerializedConfiguration
Due to inconsistency between spark version in databricks and actual spark version in maven, copyFolder function was failing. This version fixes this problem. Additionally, sbt now reads spark jars from local, databricks-connect folder to make sure there is full consistency. As of spark 3.0 and scala 2.12 I will go back to maven sources
1.0.0: Merge pull request #2 from procter-gamble-tech/overwriteAcls
First public release!