Build #1,225

Build: #1225 was successful Child of CDAP-DRC-5052

Build result summary

Details

Completed
Duration
143 minutes
Labels
None
Agent
bamboo-agent07
Revision
02c948c47cbed52b1ca8ea678d2a9a2e089f0457 02c948c47cbed52b1ca8ea678d2a9a2e089f0457
Total tests
2853
Successful since
#1220 ()

Code commits

Author Commit Message Commit date
albertshau <ashau@google.com> albertshau <ashau@google.com> 02c948c47cbed52b1ca8ea678d2a9a2e089f0457 02c948c47cbed52b1ca8ea678d2a9a2e089f0457 Merge pull request #12656 from cdapio/feature/CDAP-17202-multi-commit-parallel
CDAP-17202 perform MultiOutputCommitter duties in parallel
albertshau <ashau@google.com> albertshau <ashau@google.com> 664bc3d6338be4a394149e628cc2b8d6ca84fad7 m 664bc3d6338be4a394149e628cc2b8d6ca84fad7 CDAP-17202 perform MultiOutputCommitter duties in parallel
setup, abort, recover, and commit jobs and tasks in parallel in
the MultiOutputCommitter.

Also added a tiny performance gain and debuggability improvement
by avoiding a union with an empty RDD in sources. This is mostly
useful for avoiding confusiong when looking at DAGs in the Spark
UI, where jobs would always start with a union between an empty
RDD and the real input RDD.
Terence Yim <885032+chtyim@users.noreply.github.com> Terence Yim <885032+chtyim@users.noreply.github.com> 85772139669094a4eb1b59d44fcf57e185d6e066 85772139669094a4eb1b59d44fcf57e185d6e066 Merge pull request #12652 from cdapio/feature/CDAP-17207-fix-flaky-metadata-test
(CDAP-17207) Fix the flaky metadata test
Terence Yim Terence Yim cea51c35df426da6201da9fc53022f3bce556325 m cea51c35df426da6201da9fc53022f3bce556325 (CDAP-17207) Fix the flaky metadata test
- The unit-test itself was wrong. It was passing for most of the time was due to async writing of metadata

JIRA issues

IssueDescriptionStatus
Unknown Issue TypeCDAP-17202Could not obtain issue details from JIRA
Unknown Issue TypeCDAP-17207Could not obtain issue details from JIRA