Build #3,367

License check with RAT and Checkstyle

Build: #3367 was successful Changes by albertshau <>

Build result summary


4 minutes
130acea7edefdf250492e3d5fb96339edbac536f 130acea7edefdf250492e3d5fb96339edbac536f
Successful since
#3284 ()

Code commits

Author Commit Message Commit date
albertshau <> albertshau <> 130acea7edefdf250492e3d5fb96339edbac536f 130acea7edefdf250492e3d5fb96339edbac536f Merge pull request #8830 from caskdata/feature/CDAP-9476-spark2-pipeline-jars
CDAP-9476 create spark2 pipeline jars
Albert Shau <> Albert Shau <> 6b477641c874b8d9185a396c61d7e9de0a03c095 m 6b477641c874b8d9185a396c61d7e9de0a03c095 CDAP-9476 reintroduce env variable
Add back the env variable and place the spark jar in a pre-defined
place in the local data dir.
Albert Shau <> Albert Shau <> bfbddbafb2a1b1504c06e708df1a844110be10db m bfbddbafb2a1b1504c06e708df1a844110be10db CDAP-9476 fix spark streaming in local mode
Spark2 streaming with checkpointing expects the job jar to be in
the same place in between runs, which means we can never delete
the jar. So in local mode, create the job jar in the app temp dir,
but not in the job specific temp dir.

Also some minor fixes to get preview tests to work.
Albert Shau <> Albert Shau <> 083cd8f1918dedb854ba8a9df17369084df03b04 m 083cd8f1918dedb854ba8a9df17369084df03b04 CDAP-9476 fix units tests for data-pipeline spark2
Albert Shau <> Albert Shau <> f9fa4d140e23a5461290a36ae08b223ae36b598f m f9fa4d140e23a5461290a36ae08b223ae36b598f CDAP-9476 create spark2 pipeline jars
Creating spark2 versions of cdap-data-pipeline and cdap-data-streams.
These will be packaged in separate directories within the artifacts
directory, and only one will be picked up as a system artifact at
runtime. The new jars just use the existing source code as source,
with different dependencies.

JIRA issues

Unknown Issue TypeCDAP-9476Could not obtain issue details from JIRA