Build #1,254

Builds the CDAP Security Extensions

Build: #1254 was successful Changes by albertshau <ashau@google.com>

Build result summary

Details

Completed
Duration
3 minutes
Labels
None
Agent
bamboo-agent17
Revisions
CDAP Security Extensions
ddfcc807ba722707c404185fabd2d4db533fd8ed ddfcc807ba722707c404185fabd2d4db533fd8ed
Apache Sentry 1.7.0
e98bc77ca150c1e38a84384cec62a3c6a97837e2 e98bc77ca150c1e38a84384cec62a3c6a97837e2
CDAP
4494b2ac00f01e681898352d20eec26f0ff61b45 4494b2ac00f01e681898352d20eec26f0ff61b45
CDAP Release 3.5
b41130051e271074f9ff5d8690832d1bd186cba9 b41130051e271074f9ff5d8690832d1bd186cba9
Total tests
55
Successful since
#1220 ()
  • 0 New failures
  • 0 Existing failures
  • 0 Fixed

Code commits

CDAP
Author Commit Message Commit date
albertshau <ashau@google.com> albertshau <ashau@google.com> 4494b2ac00f01e681898352d20eec26f0ff61b45 4494b2ac00f01e681898352d20eec26f0ff61b45 Merge pull request #10121 from caskdata/feature/CDAP-13246-provisioner-failure-handling
CDAP-13246 provisioner failure handling
Albert Shau <albert@cask.co> Albert Shau <albert@cask.co> 4e7e05a90c82b704c9c7edac788c1dfad6a36cba m 4e7e05a90c82b704c9c7edac788c1dfad6a36cba CDAP-13246 provisioner failure handling
Adding logic to handle failures during provisioning.

When a RetryableProvisionException is thrown, the method will
be retried up to a time limit. The time limit is hardcoded today,
but will be configurable per profile later.
Also added handling for scenarios where a cluster is request to
be created, but when polling for status, the cluster returns a
non-running status. In these scenarios, the cluster is usually
deleted, then the create is retried.

Also added logic to pick up tasks that were being executed while
CDAP was shut down. Each task will store state about what it is
about to do. If CDAP is shut down in the middle of a task, when
it comes back up, it will scan the state store and re-create
tasks that were in progress.

Also some cleanup to state transition logic by moving it out of
AppMetadataStore and into the respective ProgramRunStatus and
ProgramRunClusterStatus enums.

Fixing a bad test that relied on an invalid state transition, and
adding a test to make sure we can't go from pending to completed.

JIRA issues

IssueDescriptionStatus
Unknown Issue TypeCDAP-13246Could not obtain issue details from JIRA

Shared artifacts

Artifact File size
Apache Sentry Master Binary 119 MB
CDAP Security Extensions Binaries 105 MB