Build #5,052

License check with RAT and Checkstyle

Build: #5052 was successful Changes by albertshau <ashau@google.com>

Build result summary

Details

Completed
Duration
5 minutes
Labels
None
Agent
bamboo-agent12
Revision
02c948c47cbed52b1ca8ea678d2a9a2e089f0457 02c948c47cbed52b1ca8ea678d2a9a2e089f0457
Successful since
#4616 ()

Code commits

Author Commit Message Commit date
albertshau <ashau@google.com> albertshau <ashau@google.com> 02c948c47cbed52b1ca8ea678d2a9a2e089f0457 02c948c47cbed52b1ca8ea678d2a9a2e089f0457 Merge pull request #12656 from cdapio/feature/CDAP-17202-multi-commit-parallel
CDAP-17202 perform MultiOutputCommitter duties in parallel
albertshau <ashau@google.com> albertshau <ashau@google.com> 664bc3d6338be4a394149e628cc2b8d6ca84fad7 m 664bc3d6338be4a394149e628cc2b8d6ca84fad7 CDAP-17202 perform MultiOutputCommitter duties in parallel
setup, abort, recover, and commit jobs and tasks in parallel in
the MultiOutputCommitter.

Also added a tiny performance gain and debuggability improvement
by avoiding a union with an empty RDD in sources. This is mostly
useful for avoiding confusiong when looking at DAGs in the Spark
UI, where jobs would always start with a union between an empty
RDD and the real input RDD.

JIRA issues

IssueDescriptionStatus
Unknown Issue TypeCDAP-17202Could not obtain issue details from JIRA