Build #26

Cloudera Manager CSD Build

Build: #26 was successful Changes by albertshau <albert@cask.co> and Albert Shau <albert@cask.co>

Build result summary

Details

Completed
Duration
21 minutes
Labels
None
Agent
bamboo-agent06
Revisions
CDAP CSD
d7dcb3412a8b5d4ee4870d5ef61d1beb7d6f8e95 d7dcb3412a8b5d4ee4870d5ef61d1beb7d6f8e95
Cloudera cm_ext/master
90d8785c3bfcf819012159dffaa4af74faa5da9e 90d8785c3bfcf819012159dffaa4af74faa5da9e
Total tests
272
Successful since
#3 ()
  • 0 New failures
  • 0 Existing failures
  • 0 Fixed

Code commits

CDAP CSD
Author Commit Message Commit date
albertshau &lt;albert@cask.co&gt; albertshau <albert@cask.co> d7dcb3412a8b5d4ee4870d5ef61d1beb7d6f8e95 d7dcb3412a8b5d4ee4870d5ef61d1beb7d6f8e95 Merge pull request #156 from caskdata/feature/update-script-for-spark2
CDAP-11586 update start script to handle spark2
Albert Shau &lt;albert@cask.co&gt; Albert Shau <albert@cask.co> a47db681562714ff541a61cd334c1a3dac5e208f a47db681562714ff541a61cd334c1a3dac5e208f add a warning if spark2-conf exists but major version is not 2
Albert Shau &lt;albert@cask.co&gt; Albert Shau <albert@cask.co> b00f003fba217fb309906a360cba251a62b0a66e b00f003fba217fb309906a360cba251a62b0a66e CDAP-11586 update start script to handle spark2
The assumption is that the environment will contain
SPARK_MAJOR_VERSION=2 when CDAP should be using spark2. This is
the same as how HDP does it.

Modified the script to set SPARK_COMPAT, and to set java system
property app.program.spark.compat, which CDAP uses to decide
which spark runtime to use, and which pipeline artifacts to
load.

JIRA issues

IssueDescriptionStatus
Unknown Issue TypeCDAP-11586Could not obtain issue details from JIRA

Shared artifacts

Artifact File size
CSD JAR 22 KB
XMLs 2 KB