Code

Spark 2.0.0 support#115

Code

Open

a-roberts wants to merge 22 commits intodatabricks:masterdatabricks/spark-perf:masterfrom a-roberts:masterCopy head branch name to clipboard

+2,428-28

Commits

Commits on Jun 20, 2016

• Spark 2.0.0 support

  Show description for 5f090fc
  a-roberts

  committed
  5f090fc

• Fix dependency for mllib

  a-roberts

  authored
  a6c3403

• Add 1.6 target folder back in

  a-roberts

  authored
  27e640f

Commits on Jun 30, 2016

• Add ML changes for Spark 2, note requires Spark in lib folder currently!

  a-roberts

  committed
  5473506

• Add config file template back in

  a-roberts

  committed
  b1d1947

• Add ability to override scala version and cleanup in mllib project file

  a-roberts

  committed
  cd7eb12

• Add QA 1.6 fixes code back in

  a-roberts

  committed
  95d31d3

• Remove .rej file too

  a-roberts

  committed
  8cb9e62

• Comment dep on 2.0.0 preview

  a-roberts

  committed
  9e26cfc

Commits on Jul 1, 2016

• Use original config.py but with SPARK_HOME recognised, default local cluster

  a-roberts

  committed
  9cc8cae

• Back to 3.2.9 for json native

  a-roberts

  committed
  44f7a5f

• Tidying up

  a-roberts

  committed
  cf6d671

• Add default to 2.0 for spark mllib version

  a-roberts

  committed
  9e171d4

Commits on Aug 15, 2016

• Use GA Spark 2 not preview

  a-roberts

  committed
  b35c294

• Ensure we can override Spark version for all projects

  a-roberts

  committed
  533f6a6

• Add a missing comma for ml project file

  a-roberts

  committed
  1eb427c

Commits on Aug 26, 2016

• Just use mllib provided artifact and remove core part

  a-roberts

  committed
  70963cf

• Use 2.0.0 to resolve artifacts for mllib

  a-roberts

  authored
  1d1441b

• Remove feature-noise from glm regression so we can build and run

  a-roberts

  committed
  c873532

• Remove sparkVersion statement in SparkTestsBuild.scala

  a-roberts

  committed
  e15a40e

• Remove spark version from streaming project file also

  a-roberts

  committed
  0ad07c7

Commits on Sep 27, 2016

• Lower defaults, feature-noise if Spark 1.x only

  a-roberts

  committed
  e6cbaf9