Skip to content

Releases: procter-gamble-oss/octopufs

Execution optimization

16 Apr 08:02
c830ab9
Compare
Choose a tag to compare

Tail recursion is now used to list the fs elements which should be safer for bigger volumes.
Memory optimization resulting in 50% improvement

Spark3 scala 2.12

28 Dec 10:26
0257a53
Compare
Choose a tag to compare

Move to spark 3.0.1 and scala 2.12

Fixed modify Table Acls (Runtime 6.4- scala_2.11)

29 Jul 17:45
Compare
Choose a tag to compare

modifyTableAcls is now setting requested permission on parent folder as well

Fixed modify Table Acls (Runtime 6.4-6.6 scala_2.11)

29 Jul 18:02
Compare
Choose a tag to compare
1.0.2_2.11_dbr6.4

SBT modified to read spark jars from databricks connect

Fixed issues with SerializedConfiguration

10 Jul 14:35
5be3407
Compare
Choose a tag to compare

Due to inconsistency between spark version in databricks and actual spark version in maven, copyFolder function was failing. This version fixes this problem. Additionally, sbt now reads spark jars from local, databricks-connect folder to make sure there is full consistency. As of spark 3.0 and scala 2.12 I will go back to maven sources

1.0.0: Merge pull request #2 from procter-gamble-tech/overwriteAcls

25 Jun 20:14
002a41d
Compare
Choose a tag to compare