Build #738

Build: #738 failed

Job: Cloudera Manager - 5.12 failed

Stages & jobs

  1. Variables

  2. Spinup and Test

Build log

The build generated 868 lines of output. Download or view full build log

18-Mar-2020 10:02:41 Build Integration Tests - Cloudera Manager - Cloudera Manager - 5.12 #738 (IT-ITC-CM512-738) started building on agent bamboo-agent06.prod.continuuity.net
18-Mar-2020 10:02:41 Remote Agent
18-Mar-2020 10:02:41 Build working directory is /var/bamboo/xml-data/build-dir/IT-ITC-CM512
18-Mar-2020 10:02:41 Executing build Integration Tests - Cloudera Manager - Cloudera Manager - 5.12 #738 (IT-ITC-CM512-738)
18-Mar-2020 10:02:41 Starting task 'Checkout Default Repository' of type 'com.atlassian.bamboo.plugins.vcs:task.vcs.checkout'
18-Mar-2020 10:02:41 Build always requires a clean checkout
18-Mar-2020 10:02:41 Cleaning build directory '/var/bamboo/xml-data/build-dir/IT-ITC-CM512/cdap-integration-tests'
18-Mar-2020 10:02:42 Checking out into /var/bamboo/xml-data/build-dir/IT-ITC-CM512/cdap-integration-tests
18-Mar-2020 10:02:42 Updating source code to revision: 7e19abdd205b4a52461c1e10822afff44b877b75
18-Mar-2020 10:02:42 /usr/local/bin/git version
18-Mar-2020 10:02:42 /usr/local/bin/git log -1 --encoding=UTF-8 --format=%H HEAD
18-Mar-2020 10:02:42 /usr/local/bin/git -c credential.helper= -c 'credential.helper=store --file=/tmp/gitCredentials7527225990999544752.tmp' ls-remote https://github.com/cdapio/cdap-integration-tests
18-Mar-2020 10:02:42 Fetching 'refs/heads/develop' from 'https://github.com/cdapio/cdap-integration-tests'.
18-Mar-2020 10:02:42 /usr/local/bin/git -c credential.helper= -c 'credential.helper=store --file=/tmp/gitCredentials7527225990999544752.tmp' fetch https://github.com/cdapio/cdap-integration-tests +refs/heads/develop:refs/heads/develop --update-head-ok --progress --verbose
18-Mar-2020 10:02:42 From https://github.com/cdapio/cdap-integration-tests
18-Mar-2020 10:02:42 = [up to date]      develop    -> develop
18-Mar-2020 10:02:42 /usr/local/bin/git log -1 --encoding=UTF-8 --format=%H 7e19abdd205b4a52461c1e10822afff44b877b75
18-Mar-2020 10:02:42 Checking out revision 7e19abdd205b4a52461c1e10822afff44b877b75.
18-Mar-2020 10:02:42 Creating local git repository in '/var/bamboo/xml-data/build-dir/IT-ITC-CM512/cdap-integration-tests/.git'.
18-Mar-2020 10:02:42 /usr/local/bin/git clone /var/bamboo/xml-data/build-dir/_git-repositories-cache/33e2d558e083e10088411e5f723ad31086756b8d --shared --no-checkout '-c filter.lfs.smudge=' '-c filter.lfs.required=false' /var/bamboo/xml-data/build-dir/IT-ITC-CM512/cdap-integration-tests
18-Mar-2020 10:02:42 Cloning into '/var/bamboo/xml-data/build-dir/IT-ITC-CM512/cdap-integration-tests'...
18-Mar-2020 10:02:42 done.
18-Mar-2020 10:02:42 /usr/local/bin/git show-ref develop
18-Mar-2020 10:02:42 /usr/local/bin/git checkout -f develop
18-Mar-2020 10:02:42 Switched to a new branch 'develop'
18-Mar-2020 10:02:42 Branch develop set up to track remote branch develop from origin.
18-Mar-2020 10:02:42 /usr/local/bin/git remote set-url origin file:///var/bamboo/xml-data/build-dir/_git-repositories-cache/33e2d558e083e10088411e5f723ad31086756b8d
18-Mar-2020 10:02:42 Updated source code to revision: 7e19abdd205b4a52461c1e10822afff44b877b75
18-Mar-2020 10:02:42 Finished task 'Checkout Default Repository' with result: Success
18-Mar-2020 10:02:42 Starting task 'Checkout coopr-internal Repository (develop branch)' of type 'com.atlassian.bamboo.plugins.vcs:task.vcs.checkout'
18-Mar-2020 10:02:42 Checking out into /var/bamboo/xml-data/build-dir/IT-ITC-CM512/coopr-internal
18-Mar-2020 10:02:42 Updating source code to revision: 8c2797da17295a6737c5c746943af521cf6bb43f
18-Mar-2020 10:02:44 Fetching 'refs/heads/develop' from 'https://github.com/cdapio/coopr-internal'.
18-Mar-2020 10:02:44 git: 'credential-' is not a git command. See 'git --help'.
18-Mar-2020 10:02:44
18-Mar-2020 10:02:44 Did you mean this?
18-Mar-2020 10:02:44         credential
18-Mar-2020 10:02:44 git: 'credential-' is not a git command. See 'git --help'.
18-Mar-2020 10:02:44
18-Mar-2020 10:02:44 Did you mean this?
18-Mar-2020 10:02:44         credential
18-Mar-2020 10:02:44 Checking out revision 8c2797da17295a6737c5c746943af521cf6bb43f.
18-Mar-2020 10:02:45 Already on 'develop'
18-Mar-2020 10:02:45 Your branch is up-to-date with 'origin/develop'.
18-Mar-2020 10:02:45 Updated source code to revision: 8c2797da17295a6737c5c746943af521cf6bb43f
18-Mar-2020 10:02:45 Finished task 'Checkout coopr-internal Repository (develop branch)' with result: Success
18-Mar-2020 10:02:45 Running pre-build action: VCS Version Collector
18-Mar-2020 10:02:45 Starting task 'Clean artifacts directory' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
18-Mar-2020 10:02:45
Beginning to execute external process for build 'Integration Tests - Cloudera Manager - Cloudera Manager - 5.12 #738 (IT-ITC-CM512-738)'
... running command line:
/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-4369925693106494379.sh
... in: /var/bamboo/xml-data/build-dir/IT-ITC-CM512
... using extra environment variables:
bamboo_planRepository_1_branch=develop
bamboo_planRepository_2_branch=develop
bamboo_inject_delta_maven_version=0.1.0-SNAPSHOT
bamboo_planRepository_1_branchDisplayName=develop
bamboo_inject_buildNumber=2265
bamboo_repository_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_inject_sql_pipelines_maven_version=6.2.0-SNAPSHOT
bamboo_capability_system_builder_command_s3cmd=/usr/bin/s3cmd
bamboo_docs_s3_bucket=docs.cask.co
bamboo_buildKey=IT-ITC-CM512
bamboo_repository_77005182_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_itn_kdc_admin_user_password=********
bamboo_gpg_password=********
bamboo_ops_gpg_password=********
bamboo_planRepository_2_branchDisplayName=develop
bamboo_shortJobName=Cloudera Manager - 5.12
bamboo_buildResultsUrl=https://builds.cask.co/browse/IT-ITC-CM512-738
bamboo_capability_system_builder_mvn3_Maven_3_1=/opt/maven
bamboo_planRepository_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_s3_bucket=repository.cask.co
bamboo_aws_secret_access_key_password=********
bamboo_capability_system_builder_mvn3_Maven_3_6=/opt/maven
bamboo_agentId=32243718
bamboo_inject_package_full_version=6.2.0.1584500997615-1
bamboo_inject_dre_maven_version=1.4.0-SNAPSHOT
bamboo_inject_docker_repo=caskdata/cdap-sandbox
bamboo_capability_Swapfile=true
bamboo_inject_cdap_maven_version=6.2.0-SNAPSHOT
bamboo_planRepository_revision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_planRepository_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_RHEL=rhel
bamboo_capability_freight=true
bamboo_repository_branch_name=develop
bamboo_itn_uri_password=********
bamboo_kdc_address_password=********
bamboo_capability_GPG=GPG
bamboo_capability_system_jdk_Oracle_JDK_8=/usr/lib/jvm/jdk8
bamboo_capability_system_jdk_Oracle_JDK_7=/usr/lib/jvm/jdk7
bamboo_inject_cdap_version=6.2.0-SNAPSHOT
bamboo_downloads_s3_bucket=downloads.cask.co
bamboo_planRepository_branch=develop
bamboo_itn_provider=gce-audi
bamboo_inject_vm_artifact_name=cdap-sandbox
bamboo_capability_system_jdk_OpenJDK_1_8=/usr/lib/jvm/java-1.8.0
bamboo_inject_package_version=6.2.0.1584500997615
bamboo_inject_database_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_repository_77005182_git_branch=develop
bamboo_market_s3_access_key_password=********
bamboo_repository_77005183_name=cdapio/coopr-internal
bamboo_planRepository_1_type=gitv2
bamboo_planRepository_branchName=develop
bamboo_capability_SPHINX=Sphinx
bamboo_capability_rsync=true
bamboo_market_cloudfront_secret_key_password=********
bamboo_repository_77005182_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_system_jdk_JDK=/usr/lib/jvm/jdk1.7.0_75
bamboo_repository_77005183_git_branch=develop
bamboo_hg_cache_directory=/var/bamboo/xml-data/build-dir/_hg-repositories-cache
bamboo_planRepository_1_username=
bamboo_planRepository_type=gitv2
bamboo_capability_expect=true
bamboo_repository_77005183_git_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_itn_cdap_username=bob
bamboo_git_cache_directory=/var/bamboo/xml-data/build-dir/_git-repositories-cache
bamboo_planRepository_2_branchName=develop
bamboo_capability_RSYNC=rsync
bamboo_capability_system_builder_node_Node_js=/usr/bin/node
bamboo_capability_system_builder_mvn3_Maven_3=/opt/maven
bamboo_tmp_directory=/var/bamboo/temp
bamboo_planKey=IT-ITC
bamboo_hide_jdk_mirror_password=********
bamboo_planRepository_username=
bamboo_capability_s3cmd=true
bamboo_planRepository_1_branchName=develop
bamboo_inject_cdap_version_stripped=6.2.0
bamboo_itn_tenant_password=********
bamboo_resultsUrl=https://builds.cask.co/browse/IT-ITC-CM512-738
bamboo_inject_cdap_version_maj_min=6.2
bamboo_capability_Sphinx=true
bamboo_build_working_directory=/var/bamboo/xml-data/build-dir/IT-ITC-CM512
bamboo_planRepository_1_name=cdapio/cdap-integration-tests
bamboo_repository_77005182_git_username=
bamboo_inject_mmds_maven_version=1.4.0-SNAPSHOT
bamboo_shortPlanName=Cloudera Manager
bamboo_planRepository_2_username=caskdata-ro
bamboo_planRepository_name=cdapio/cdap-integration-tests
bamboo_capability_git_lfs=true
bamboo_buildNumber=738
bamboo_itn_hardwaretype=standard-2xlarge
bamboo_inject_cdap_security_extn_maven_version=0.11.0-SNAPSHOT
bamboo_planName=Integration Tests - Cloudera Manager
bamboo_shortPlanKey=ITC
bamboo_shortJobKey=CM512
bamboo_planRepository_2_name=cdapio/coopr-internal
bamboo_itn_cdap_password=********
bamboo_buildTimeStamp=2020-03-18T10:02:36.527Z
bamboo_repository_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_s3_bucket=repository.cask.co
bamboo_capability_system_builder_command_Docker=/usr/bin/docker
bamboo_repository_git_branch=develop
bamboo_buildResultKey=IT-ITC-CM512-738
bamboo_market_s3_secret_key_password=********
bamboo_buildPlanName=Integration Tests - Cloudera Manager - Cloudera Manager - 5.12
bamboo_capability_system_jdk_JDK_1_8_0_101=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_system_builder_command_fpm=/opt/rbenv/shims/fpm
bamboo_capability_Platform=rhel
bamboo_planRepository_1_revision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_itn_imagetype=centos6
bamboo_repository_77005182_branch_name=develop
bamboo_repository_77005183_branch_name=develop
bamboo_itn_kdc_admin_password=********
bamboo_repository_name=cdapio/coopr-internal
bamboo_inject_standalone_artifact=cdap-sandbox-6.2.0-SNAPSHOT.zip
bamboo_repository_77005182_name=cdapio/cdap-integration-tests
bamboo_repository_77005183_git_username=caskdata-ro
bamboo_planRepository_2_previousRevision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_buildFailed=false
bamboo_capability_system_docker_executable=/usr/bin/docker
bamboo_agentWorkingDirectory=/var/bamboo/xml-data/build-dir
bamboo_planRepository_2_revision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_system_git_executable=/usr/local/bin/git
bamboo_repository_git_username=
bamboo_capability_system_jdk_JDK_1_8_0_232=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64
bamboo_planRepository_1_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_repository_77005183_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_system_builder_command_Ruby=/opt/rbenv/shims/ruby
bamboo_itn_user=bamboo
bamboo_planRepository_branchDisplayName=develop
bamboo_inject_bigquery_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_inject_package_iteration=1
bamboo_aws_access_key_password=********
bamboo_planRepository_2_type=gitv2
bamboo_capability_system_builder_mvn3_Maven_3_x=/opt/maven
bamboo_inject_standalone_artifact_name=cdap-sandbox
bamboo_plan_storageTag=plan-68523427
bamboo_planRepository_2_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_repository_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_market_cloudfront_access_key_password=********
bamboo_working_directory=/var/bamboo/xml-data/build-dir/IT-ITC-CM512
bamboo_planRepository_1_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_77005183_previous_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_createrepo=true
bamboo_capability_system_jdk_JDK_1_8=/usr/lib/jvm/jdk1.8.0_101
bamboo_repository_77005182_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_rpm_build=true
bamboo_capability_system_jdk_JDK_1_7=/usr/lib/jvm/jdk1.7.0_75
bamboo_inject_hydrator_plugins_maven_version=2.4.0-SNAPSHOT
18-Mar-2020 10:02:46 Finished task 'Clean artifacts directory' with result: Success
18-Mar-2020 10:02:46 Starting task 'Download BUT Parcels, Manifest' of type 'com.atlassian.bamboo.plugins.bamboo-artifact-downloader-plugin:artifactdownloadertask'
18-Mar-2020 10:02:46 Preparing to download plan result CDAP-BUT-2265 artifact: Shared artifact: [Parcel Repo Manifest], pattern: [manifest.json] anchored at: [cdap/cdap-distributions/target]
18-Mar-2020 10:02:46 Artifact [Parcel Repo Manifest] downloaded successfully in 47.39 ms to artifacts/
18-Mar-2020 10:02:46 Preparing to download plan result CDAP-BUT-2265 artifact: Shared artifact: [Parcels], pattern: [**/target/*.parcel]
18-Mar-2020 10:03:42 Artifact [Parcels] downloaded successfully in 55.78 s to artifacts/
18-Mar-2020 10:03:42 Finished task 'Download BUT Parcels, Manifest' with result: Success
18-Mar-2020 10:03:42 Starting task 'Download CSD JAR Artifact' of type 'com.atlassian.bamboo.plugins.bamboo-artifact-downloader-plugin:artifactdownloadertask'
18-Mar-2020 10:03:42 Preparing to download plan result CDAP-CSD-60 artifact: Shared artifact: [CSD JAR], pattern: [CDAP-*.jar] anchored at: [cm_csd/target]
18-Mar-2020 10:03:42 Artifact [CSD JAR] downloaded successfully in 24.08 ms to artifacts/
18-Mar-2020 10:03:42 Finished task 'Download CSD JAR Artifact' with result: Success
18-Mar-2020 10:03:42
Substituting variable: ${bamboo.buildKey} with IT-ITC-CM512
18-Mar-2020 10:03:42
Substituting variable: ${bamboo.buildNumber} with 738
18-Mar-2020 10:03:42
Substituting password variable: ${bamboo.itn.uri.password}
18-Mar-2020 10:03:42
Substituting password variable: ${bamboo.itn.tenant.password}
18-Mar-2020 10:03:42
Substituting variable: ${bamboo.itn.user} with bamboo
18-Mar-2020 10:03:42
Substituting variable: ${bamboo.inject.cdap-security-extn.maven.version} with 0.11.0-SNAPSHOT
18-Mar-2020 10:03:42
Substituting variable: ${bamboo.itn.provider} with gce-audi
18-Mar-2020 10:03:42
Substituting variable: ${bamboo.itn.hardwaretype} with standard-2xlarge
18-Mar-2020 10:03:42
Substituting variable: ${bamboo.itn.imagetype} with centos6
18-Mar-2020 10:03:42 Starting task 'Execute coopr-runner-wrapper to spin up cloudera-manager' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.command'
18-Mar-2020 10:03:42
Beginning to execute external process for build 'Integration Tests - Cloudera Manager - Cloudera Manager - 5.12 #738 (IT-ITC-CM512-738)'
... running command line:
/opt/rbenv/shims/ruby cdap-integration-tests/bin/coopr-runner-wrapper.rb --num-machines 6 --name IT-ITC-CM512-738- --uri ******** --tenant ******** --user bamboo --cluster-service-to-check cloudera-manager --cluster-service-ip-file cloudera-manager-ip.txt --config { "cloudera_manager": { "services": { "cdap": { "serviceConfigs": { "security_authorization_extension_jar_path":"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar" } } } } } --services cloudera-manager-agent,generic-users
... in: /var/bamboo/xml-data/build-dir/IT-ITC-CM512
... using extra environment variables:
bamboo_planRepository_1_branch=develop
bamboo_planRepository_2_branch=develop
bamboo_inject_delta_maven_version=0.1.0-SNAPSHOT
bamboo_planRepository_1_branchDisplayName=develop
bamboo_inject_buildNumber=2265
bamboo_repository_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_inject_sql_pipelines_maven_version=6.2.0-SNAPSHOT
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_18=/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-4369925693106494379.sh
bamboo_capability_system_builder_command_s3cmd=/usr/bin/s3cmd
bamboo_docs_s3_bucket=docs.cask.co
bamboo_buildKey=IT-ITC-CM512
bamboo_repository_77005182_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_itn_kdc_admin_user_password=********
bamboo_gpg_password=********
bamboo_ops_gpg_password=********
bamboo_planRepository_2_branchDisplayName=develop
bamboo_shortJobName=Cloudera Manager - 5.12
bamboo_buildResultsUrl=https://builds.cask.co/browse/IT-ITC-CM512-738
bamboo_capability_system_builder_mvn3_Maven_3_1=/opt/maven
bamboo_planRepository_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_s3_bucket=repository.cask.co
bamboo_aws_secret_access_key_password=********
bamboo_capability_system_builder_mvn3_Maven_3_6=/opt/maven
bamboo_agentId=32243718
COOPR_DRIVER_HARDWARETYPE=standard-2xlarge
bamboo_inject_package_full_version=6.2.0.1584500997615-1
bamboo_inject_dre_maven_version=1.4.0-SNAPSHOT
bamboo_inject_docker_repo=caskdata/cdap-sandbox
bamboo_capability_Swapfile=true
bamboo_inject_cdap_maven_version=6.2.0-SNAPSHOT
bamboo_planRepository_revision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_planRepository_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_RHEL=rhel
COOPR_DRIVER_CLUSTER_ID_FILE=cdap-auto-clusterid.txt
bamboo_capability_freight=true
bamboo_repository_branch_name=develop
bamboo_itn_uri_password=********
bamboo_kdc_address_password=********
bamboo_capability_GPG=GPG
bamboo_capability_system_jdk_Oracle_JDK_8=/usr/lib/jvm/jdk8
bamboo_capability_system_jdk_Oracle_JDK_7=/usr/lib/jvm/jdk7
bamboo_inject_cdap_version=6.2.0-SNAPSHOT
bamboo_downloads_s3_bucket=downloads.cask.co
bamboo_planRepository_branch=develop
bamboo_itn_provider=gce-audi
bamboo_inject_vm_artifact_name=cdap-sandbox
bamboo_capability_system_jdk_OpenJDK_1_8=/usr/lib/jvm/java-1.8.0
bamboo_inject_package_version=6.2.0.1584500997615
bamboo_inject_database_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_repository_77005182_git_branch=develop
bamboo_market_s3_access_key_password=********
COOPR_DRIVER_IMAGETYPE=centos6
bamboo_repository_77005183_name=cdapio/coopr-internal
bamboo_planRepository_1_type=gitv2
bamboo_planRepository_branchName=develop
bamboo_capability_SPHINX=Sphinx
bamboo_capability_rsync=true
bamboo_market_cloudfront_secret_key_password=********
bamboo_repository_77005182_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_system_jdk_JDK=/usr/lib/jvm/jdk1.7.0_75
bamboo_repository_77005183_git_branch=develop
bamboo_hg_cache_directory=/var/bamboo/xml-data/build-dir/_hg-repositories-cache
bamboo_planRepository_1_username=
bamboo_planRepository_type=gitv2
bamboo_capability_expect=true
bamboo_repository_77005183_git_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_itn_cdap_username=bob
bamboo_git_cache_directory=/var/bamboo/xml-data/build-dir/_git-repositories-cache
bamboo_planRepository_2_branchName=develop
bamboo_capability_RSYNC=rsync
bamboo_capability_system_builder_node_Node_js=/usr/bin/node
bamboo_capability_system_builder_mvn3_Maven_3=/opt/maven
bamboo_tmp_directory=/var/bamboo/temp
bamboo_planKey=IT-ITC
bamboo_hide_jdk_mirror_password=********
bamboo_planRepository_username=
bamboo_capability_s3cmd=true
bamboo_planRepository_1_branchName=develop
bamboo_inject_cdap_version_stripped=6.2.0
bamboo_itn_tenant_password=********
bamboo_resultsUrl=https://builds.cask.co/browse/IT-ITC-CM512-738
bamboo_inject_cdap_version_maj_min=6.2
bamboo_capability_Sphinx=true
bamboo_build_working_directory=/var/bamboo/xml-data/build-dir/IT-ITC-CM512
bamboo_planRepository_1_name=cdapio/cdap-integration-tests
bamboo_repository_77005182_git_username=
bamboo_inject_mmds_maven_version=1.4.0-SNAPSHOT
bamboo_shortPlanName=Cloudera Manager
bamboo_planRepository_2_username=caskdata-ro
bamboo_planRepository_name=cdapio/cdap-integration-tests
bamboo_capability_git_lfs=true
COOPR_DRIVER_CLUSTERTEMPLATE=cloudera-manager
bamboo_buildNumber=738
bamboo_itn_hardwaretype=standard-2xlarge
bamboo_inject_cdap_security_extn_maven_version=0.11.0-SNAPSHOT
bamboo_planName=Integration Tests - Cloudera Manager
bamboo_shortPlanKey=ITC
bamboo_shortJobKey=CM512
bamboo_planRepository_2_name=cdapio/coopr-internal
bamboo_itn_cdap_password=********
bamboo_buildTimeStamp=2020-03-18T10:02:36.527Z
bamboo_repository_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_s3_bucket=repository.cask.co
bamboo_capability_system_builder_command_Docker=/usr/bin/docker
bamboo_repository_git_branch=develop
bamboo_buildResultKey=IT-ITC-CM512-738
bamboo_market_s3_secret_key_password=********
bamboo_buildPlanName=Integration Tests - Cloudera Manager - Cloudera Manager - 5.12
bamboo_capability_system_jdk_JDK_1_8_0_101=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_system_builder_command_fpm=/opt/rbenv/shims/fpm
bamboo_capability_Platform=rhel
bamboo_planRepository_1_revision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_itn_imagetype=centos6
bamboo_repository_77005182_branch_name=develop
bamboo_repository_77005183_branch_name=develop
bamboo_itn_kdc_admin_password=********
bamboo_repository_name=cdapio/coopr-internal
bamboo_inject_standalone_artifact=cdap-sandbox-6.2.0-SNAPSHOT.zip
bamboo_repository_77005182_name=cdapio/cdap-integration-tests
bamboo_repository_77005183_git_username=caskdata-ro
bamboo_planRepository_2_previousRevision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_buildFailed=false
bamboo_capability_system_docker_executable=/usr/bin/docker
bamboo_agentWorkingDirectory=/var/bamboo/xml-data/build-dir
bamboo_planRepository_2_revision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_system_git_executable=/usr/local/bin/git
bamboo_repository_git_username=
bamboo_capability_system_jdk_JDK_1_8_0_232=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64
bamboo_planRepository_1_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_repository_77005183_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_system_builder_command_Ruby=/opt/rbenv/shims/ruby
bamboo_itn_user=bamboo
bamboo_planRepository_branchDisplayName=develop
bamboo_inject_bigquery_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_inject_package_iteration=1
bamboo_aws_access_key_password=********
bamboo_planRepository_2_type=gitv2
bamboo_capability_system_builder_mvn3_Maven_3_x=/opt/maven
bamboo_inject_standalone_artifact_name=cdap-sandbox
bamboo_plan_storageTag=plan-68523427
COOPR_DRIVER_PROVIDER=gce-audi
bamboo_planRepository_2_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_repository_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_market_cloudfront_access_key_password=********
bamboo_working_directory=/var/bamboo/xml-data/build-dir/IT-ITC-CM512
bamboo_planRepository_1_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_77005183_previous_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_createrepo=true
bamboo_capability_system_jdk_JDK_1_8=/usr/lib/jvm/jdk1.8.0_101
bamboo_repository_77005182_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_rpm_build=true
bamboo_capability_system_jdk_JDK_1_7=/usr/lib/jvm/jdk1.7.0_75
bamboo_inject_hydrator_plugins_maven_version=2.4.0-SNAPSHOT
18-Mar-2020 10:03:42 Inserting configuration from /var/bamboo/xml-data/build-dir/IT-ITC-CM512/cdap-integration-tests/bin/../conf/all.json
18-Mar-2020 10:03:42 Inserting configuration from /var/bamboo/xml-data/build-dir/IT-ITC-CM512/cdap-integration-tests/bin/../conf/cloudera_manager.json
18-Mar-2020 10:03:42 Inserting configuration from /var/bamboo/xml-data/build-dir/IT-ITC-CM512/cdap-integration-tests/bin/../conf/cm512.json
18-Mar-2020 10:03:42 Running coopr-runner.rb with additional args: ["--provider-fields", "{\"bootstrap_interface\":\"bind_v4\",\"zone_name\":\"us-east1-c\"}", "--config", "{\"cloudera_manager\":{\"services\":{\"cdap\":{\"serviceConfigs\":{\"csd_compatibility_check_enabled\":\"false\"}},\"hdfs\":{\"serviceConfigs\":{\"hdfs_service_config_safety_valve\":\"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>\"},\"roleConfigGroups\":{\"gateway-base\":{\"configs\":{\"hdfs_client_config_safety_valve\":\"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>\"}}}},\"hbase\":{\"serviceConfigs\":{\"hbase_service_config_safety_valve\":\"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>\"},\"roleConfigGroups\":{\"gateway-base\":{\"configs\":{\"hbase_client_config_safety_valve\":\"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>\"}}}},\"yarn\":{\"serviceConfigs\":{\"yarn_service_config_safety_valve\":\"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>\"},\"roleConfigGroups\":{\"resourcemanager-base\":{\"configs\":{\"yarn_scheduler_minimum_allocation_mb\":\"768\"}},\"gateway-base\":{\"configs\":{\"yarn_client_config_safety_valve\":\"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>\"}}}}}}}", "--provider-fields", "{\"bootstrap_interface\":\"bind_v4\",\"zone_name\":\"us-central1-c\"}", "--initial-lease-duration", "82800000", "--services", "generic-users", "--config", "{\"cloudera_manager\":{\"distribution_version\":\"5.12\"}}"]
18-Mar-2020 10:03:42 2020-03-18T10:03:42Z Creating cluster of spec {"name":"IT-ITC-CM512-738-","numMachines":"6","provider":"gce-audi","hardwaretype":"standard-2xlarge","imagetype":"centos6","clusterTemplate":"cloudera-manager","services":["base","cdap-realm-file","cloudera-manager","cloudera-manager-agent","cloudera-manager-db","continuuity-sensu-monitoring","kerberos-client","mgr-deploy-cluster","generic-users"],"initialLeaseDuration":"82800000","config":{"cloudera_manager":{"distribution_version":"5.12","use_embedded_db":"true","csd":{"comment":"### CUSTOMIZE THE SPARK2 VERSION BELOW, per https://www.cloudera.com/documentation/spark2/latest/topics/spark2_admin.html","install":{"CDAP":"http://downloads.cask.co/cdap-csd/CDAP-5.1.0.jar","SPARK2":"http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.1.0.cloudera2.jar"}},"services":{"cdap":{"serviceConfigs":{"enable_unrecoverable_reset":"true","security_authorization_extension_jar_path":"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar","cdap-site.xml_service_safety_valve":"<property><name>security.authorization.extension.config.sentry.site.url</name><value>/etc/sentry/conf/sentry-site.xml</value></property><property><name>cdap.ugi.cache.expiration.ms</name><value>60000</value></property><property><name>cdap.http.client.read.timeout.ms</name><value>120000</value></property>","security_authorization_cache_ttl_secs":"3","csd_compatibility_check_enabled":"false"},"roles":{"cdap_auth_server":{"configs":{"security.authentication.handler.debug":"true","security.authentication.handler.hostname":"10.240.24.141","security.authentication.handler.port":"389","security.authentication.handler.userBaseDn":"ou=people,dc=continuuity,dc=com","security.authentication.handler.userObjectClass":"inetorgperson","security.authentication.handler.userRdnAttribute":"cn","security.authentication.loginmodule.className":"co.cask.cdap.security.server.LDAPLoginModule","security.authentication.handlerClassName":"co.cask.cdap.security.server.BasicAuthenticationHandler","security.authentication.basic.realmfile":"/etc/security/realmfile"}},"cdap_master":{"configs":{"security.keytab.path":"/etc/security/keytabs/${name}.headless.keytab"}}}},"sentry":{"serviceConfigs":{"SENTRY_service_env_safety_valve":"HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/data/cloudera/parcels/CDAP/master/ext/security/*","sentry.service.admin.group":"hive,impala,hue,solr,cdap,cdapitn","sentry.service.allow.connect":"hive,impala,hue,solr,cdap,cdapitn","sentry_server_config_safety_valve":"<property><name>sentry.cdap.action.factory</name><value>co.cask.cdap.security.authorization.sentry.model.ActionFactory</value></property>"}},"yarn":{"roleConfigGroups":{"nodemanager-base":{"configs":{"container_executor_min_user_id":"500"}},"resourcemanager-base":{"configs":{"yarn_scheduler_minimum_allocation_mb":"768"}},"gateway-base":{"configs":{"yarn_client_config_safety_valve":"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}}},"serviceConfigs":{"yarn_service_config_safety_valve":"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}},"hdfs":{"serviceConfigs":{"hdfs_service_config_safety_valve":"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>"},"roleConfigGroups":{"gateway-base":{"configs":{"hdfs_client_config_safety_valve":"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>"}}}},"hbase":{"serviceConfigs":{"hbase_service_config_safety_valve":"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"},"roleConfigGroups":{"gateway-base":{"configs":{"hbase_client_config_safety_valve":"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"}}}}},"agent":{"General":{"server_host":"%host.service.cloudera-manager%","parcel_dir":"/data/cloudera/parcels","host_dns_resolution_enabled":"false","java_home":"/usr/lib/jvm/java"}}},"coopr_mysql":{"mysql_service":{"clouderadb":{"bind_address":"0.0.0.0","data_dir":"/data/mysql","initial_root_password":"somedefaultpassword","mysqld_options":{"transaction-isolation":"READ-COMMITTED","key_buffer_size":"32M","max_allowed_packet":"32M","thread_stack":"256K","thread_cache_size":"64","query_cache_limit":"8M","query_cache_size":"64M","max_connections":"800","log_bin":"/data/mysql/mysql_binary_log","binlog_format":"mixed","read_buffer_size":"2M","read_rnd_buffer_size":"16M","sort_buffer_size":"8M","join_buffer_size":"8M","innodb_file_per_table":true,"innodb_flush_log_at_trx_commit":"2","innodb_log_buffer_size":"64M","innodb_buffer_pool_size":"4G","innodb_flush_method":"O_DIRECT","innodb_log_file_size":"512M","wait_timeout":"28800"},"port":"3306"}}},"java":{"install_flavor":"oracle","jdk_version":8,"jdk":{"7":{"x86_64":{"url":"https://********/jdk-7u75-linux-x64.tar.gz","checksum":"460959219b534dc23e34d77abc306e180b364069b9fc2b2265d964fa2c281610"}},"8":{"x86_64":{"url":"https://********/jdk-8u181-linux-x64.tar.gz","checksum":"1845567095bfbfebd42ed0d09397939796d05456290fb20a83c476ba09f991d3"}}},"oracle":{"accept_oracle_download_terms":true,"jce":{"7":{"url":"https://********/UnlimitedJCEPolicyJDK7.zip","checksum":"7a8d790e7bd9c2f82a83baddfae765797a4a56ea603c9150c87b7cdb7800194d"},"8":{"url":"https://********/jce_policy-8.zip","checksum":"f3020a3922efd6626c2fff45695d527f34a8020e938a49292561f18ad1320b59"}}}},"krb5":{"krb5_conf":{"libdefaults":{"default_realm":"CONTINUUITY.NET","ticket_lifetime":"1h","renew_lifetime":"2h"},"realms":{"default_realm_kdcs":["10.240.209.207"],"default_realm_admin_server":"10.240.209.207","realms":["CONTINUUITY.NET"]}}},"mysql":{"server_root_password":"somedefaultpassword"},"sensu_wrapper":{"additional_client_attributes":{"mail_to":"%cluster.owner%@cask.co"}},"cdap":{"cdap_site":{"security.authentication.basic.realmfile":"/etc/security/realmfile","security.authentication.handlerClassName":"co.cask.cdap.security.server.BasicAuthenticationHandler"},"security":{"manage_realmfile":"true","realmfile":{"cdapitn":"cdapitn","alice":"alicepassword","bob":"********","eve":"evepassword","carol":"carolpassword","systemadmin":"systemadmin"}}}},"providerFields":{"bootstrap_interface":"bind_v4","zone_name":"us-central1-c"}}
18-Mar-2020 10:03:42 2020-03-18T10:03:42Z Obtained cluster id: 00053450
18-Mar-2020 10:03:48 2020-03-18T10:03:48Z progress: 0 / 120
18-Mar-2020 10:04:18 2020-03-18T10:04:18Z progress: 6 / 120
18-Mar-2020 10:04:48 2020-03-18T10:04:48Z progress: 6 / 120
18-Mar-2020 10:05:18 2020-03-18T10:05:18Z progress: 10 / 120
18-Mar-2020 10:05:48 2020-03-18T10:05:48Z progress: 12 / 120
18-Mar-2020 10:06:18 2020-03-18T10:06:18Z progress: 12 / 120
18-Mar-2020 10:06:48 2020-03-18T10:06:48Z progress: 18 / 120
18-Mar-2020 10:07:18 2020-03-18T10:07:18Z progress: 19 / 120
18-Mar-2020 10:07:48 2020-03-18T10:07:48Z progress: 22 / 120
18-Mar-2020 10:08:18 2020-03-18T10:08:18Z progress: 22 / 120
18-Mar-2020 10:08:48 2020-03-18T10:08:48Z progress: 22 / 120
18-Mar-2020 10:09:18 2020-03-18T10:09:18Z progress: 22 / 120
18-Mar-2020 10:09:48 2020-03-18T10:09:48Z progress: 22 / 120
18-Mar-2020 10:10:18 2020-03-18T10:10:18Z progress: 24 / 120
18-Mar-2020 10:10:48 2020-03-18T10:10:48Z progress: 24 / 120
18-Mar-2020 10:11:18 2020-03-18T10:11:18Z progress: 26 / 120
18-Mar-2020 10:11:48 2020-03-18T10:11:48Z progress: 27 / 120
18-Mar-2020 10:12:18 2020-03-18T10:12:18Z progress: 27 / 120
18-Mar-2020 10:12:48 2020-03-18T10:12:48Z progress: 27 / 120
18-Mar-2020 10:13:18 2020-03-18T10:13:18Z progress: 27 / 120
18-Mar-2020 10:13:48 2020-03-18T10:13:48Z progress: 28 / 120
18-Mar-2020 10:14:18 2020-03-18T10:14:18Z progress: 30 / 120
18-Mar-2020 10:14:48 2020-03-18T10:14:48Z progress: 32 / 120
18-Mar-2020 10:15:18 2020-03-18T10:15:18Z progress: 35 / 120
18-Mar-2020 10:15:48 2020-03-18T10:15:48Z progress: 35 / 120
18-Mar-2020 10:16:18 2020-03-18T10:16:18Z progress: 35 / 120
18-Mar-2020 10:16:48 2020-03-18T10:16:48Z progress: 35 / 120
18-Mar-2020 10:17:18 2020-03-18T10:17:18Z progress: 35 / 120
18-Mar-2020 10:17:48 2020-03-18T10:17:48Z progress: 40 / 120
18-Mar-2020 10:18:18 2020-03-18T10:18:18Z progress: 42 / 120
18-Mar-2020 10:18:48 2020-03-18T10:18:48Z progress: 46 / 120
18-Mar-2020 10:19:18 2020-03-18T10:19:18Z progress: 46 / 120
18-Mar-2020 10:19:48 2020-03-18T10:19:48Z progress: 46 / 120
18-Mar-2020 10:20:18 2020-03-18T10:20:18Z progress: 46 / 120
18-Mar-2020 10:20:48 2020-03-18T10:20:48Z progress: 48 / 120
18-Mar-2020 10:21:18 2020-03-18T10:21:18Z progress: 52 / 120
18-Mar-2020 10:21:48 2020-03-18T10:21:48Z progress: 53 / 120
18-Mar-2020 10:22:18 2020-03-18T10:22:18Z progress: 53 / 120
18-Mar-2020 10:22:48 2020-03-18T10:22:48Z progress: 53 / 120
18-Mar-2020 10:23:18 2020-03-18T10:23:18Z progress: 53 / 120
18-Mar-2020 10:23:48 2020-03-18T10:23:48Z progress: 57 / 120
18-Mar-2020 10:24:18 2020-03-18T10:24:18Z progress: 58 / 120
18-Mar-2020 10:24:48 2020-03-18T10:24:48Z progress: 58 / 120
18-Mar-2020 10:25:18 2020-03-18T10:25:18Z progress: 58 / 120
18-Mar-2020 10:25:48 2020-03-18T10:25:48Z progress: 59 / 120
18-Mar-2020 10:26:18 2020-03-18T10:26:18Z progress: 62 / 120
18-Mar-2020 10:26:48 2020-03-18T10:26:48Z progress: 65 / 120
18-Mar-2020 10:27:18 2020-03-18T10:27:18Z progress: 68 / 120
18-Mar-2020 10:27:48 2020-03-18T10:27:48Z progress: 72 / 120
18-Mar-2020 10:28:18 2020-03-18T10:28:18Z progress: 76 / 120
18-Mar-2020 10:28:48 2020-03-18T10:28:48Z progress: 77 / 120
18-Mar-2020 10:29:18 2020-03-18T10:29:18Z progress: 77 / 120
18-Mar-2020 10:29:48 2020-03-18T10:29:48Z progress: 77 / 120
18-Mar-2020 10:30:18 2020-03-18T10:30:18Z progress: 78 / 120
18-Mar-2020 10:30:48 2020-03-18T10:30:48Z progress: 90 / 120
18-Mar-2020 10:31:18 2020-03-18T10:31:18Z progress: 91 / 120
18-Mar-2020 10:31:48 2020-03-18T10:31:48Z progress: 99 / 120
18-Mar-2020 10:32:18 2020-03-18T10:32:18Z progress: 104 / 120
18-Mar-2020 10:32:48 2020-03-18T10:32:48Z progress: 109 / 120
18-Mar-2020 10:33:19 2020-03-18T10:33:19Z progress: 111 / 120
18-Mar-2020 10:33:49 2020-03-18T10:33:49Z progress: 112 / 120
18-Mar-2020 10:34:19 2020-03-18T10:34:19Z progress: 114 / 120
18-Mar-2020 10:34:49 2020-03-18T10:34:49Z Cluster 00053450 is complete and active
18-Mar-2020 10:34:49 Searching for Coopr service: cloudera-manager
18-Mar-2020 10:34:49 2020-03-18T10:34:49Z found IP 10.210.0.124 for service cloudera-manager on cluster 00053450
18-Mar-2020 10:34:49 Finished task 'Execute coopr-runner-wrapper to spin up cloudera-manager' with result: Success
18-Mar-2020 10:34:49 Starting task 'Extract cluster id' of type 'com.atlassian.bamboo.plugins.variable.updater.variable-updater-generic:variable-file-reader'
18-Mar-2020 10:34:49 Variable wasn't found in the Build context. It possibly doesn't exist.
18-Mar-2020 10:34:49 Changing variable remote-cluster-id of type JOB from null to 00053450
18-Mar-2020 10:34:49 Finished task 'Extract cluster id' with result: Success
18-Mar-2020 10:34:49 Starting task 'Extract Cloudera Manager IP' of type 'com.atlassian.bamboo.plugins.variable.updater.variable-updater-generic:variable-file-reader'
18-Mar-2020 10:34:49 Variable wasn't found in the Build context. It possibly doesn't exist.
18-Mar-2020 10:34:49 Changing variable cloudera-manager-ip of type JOB from null to 10.210.0.124
18-Mar-2020 10:34:49 Finished task 'Extract Cloudera Manager IP' with result: Success
18-Mar-2020 10:34:49
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.124
18-Mar-2020 10:34:49
Substituting variable: ${bamboo.inject.package.version} with 6.2.0.1584500997615
18-Mar-2020 10:34:49
Substituting variable: ${bamboo.inject.package.iteration} with 1
18-Mar-2020 10:34:49
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.124
18-Mar-2020 10:34:49
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.124
18-Mar-2020 10:34:49
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.124
18-Mar-2020 10:34:49
Substituting variable: ${bamboo.inject.package.version} with 6.2.0.1584500997615
18-Mar-2020 10:34:49
Substituting variable: ${bamboo.inject.package.iteration} with 1
18-Mar-2020 10:34:49
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.124
18-Mar-2020 10:34:49 Starting task 'Copy Parcel to remote CM host and instantiate Parcel Repo' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
18-Mar-2020 10:34:49
Beginning to execute external process for build 'Integration Tests - Cloudera Manager - Cloudera Manager - 5.12 #738 (IT-ITC-CM512-738)'
... running command line:
/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-7344331878117958390.sh
... in: /var/bamboo/xml-data/build-dir/IT-ITC-CM512
... using extra environment variables:
bamboo_planRepository_1_branch=develop
bamboo_planRepository_2_branch=develop
bamboo_inject_delta_maven_version=0.1.0-SNAPSHOT
bamboo_planRepository_1_branchDisplayName=develop
bamboo_inject_buildNumber=2265
bamboo_repository_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_inject_sql_pipelines_maven_version=6.2.0-SNAPSHOT
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_18=/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-4369925693106494379.sh
bamboo_capability_system_builder_command_s3cmd=/usr/bin/s3cmd
bamboo_docs_s3_bucket=docs.cask.co
bamboo_buildKey=IT-ITC-CM512
bamboo_repository_77005182_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_itn_kdc_admin_user_password=********
bamboo_gpg_password=********
bamboo_ops_gpg_password=********
bamboo_planRepository_2_branchDisplayName=develop
bamboo_shortJobName=Cloudera Manager - 5.12
bamboo_buildResultsUrl=https://builds.cask.co/browse/IT-ITC-CM512-738
bamboo_capability_system_builder_mvn3_Maven_3_1=/opt/maven
bamboo_planRepository_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_s3_bucket=repository.cask.co
bamboo_aws_secret_access_key_password=********
bamboo_capability_system_builder_mvn3_Maven_3_6=/opt/maven
bamboo_agentId=32243718
bamboo_inject_package_full_version=6.2.0.1584500997615-1
bamboo_inject_dre_maven_version=1.4.0-SNAPSHOT
bamboo_inject_docker_repo=caskdata/cdap-sandbox
bamboo_capability_Swapfile=true
bamboo_inject_cdap_maven_version=6.2.0-SNAPSHOT
bamboo_planRepository_revision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_planRepository_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_RHEL=rhel
bamboo_capability_freight=true
bamboo_repository_branch_name=develop
bamboo_itn_uri_password=********
bamboo_kdc_address_password=********
bamboo_capability_GPG=GPG
bamboo_capability_system_jdk_Oracle_JDK_8=/usr/lib/jvm/jdk8
bamboo_capability_system_jdk_Oracle_JDK_7=/usr/lib/jvm/jdk7
bamboo_inject_cdap_version=6.2.0-SNAPSHOT
bamboo_downloads_s3_bucket=downloads.cask.co
bamboo_planRepository_branch=develop
bamboo_itn_provider=gce-audi
bamboo_inject_vm_artifact_name=cdap-sandbox
bamboo_capability_system_jdk_OpenJDK_1_8=/usr/lib/jvm/java-1.8.0
bamboo_inject_package_version=6.2.0.1584500997615
bamboo_inject_database_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_repository_77005182_git_branch=develop
bamboo_market_s3_access_key_password=********
bamboo_repository_77005183_name=cdapio/coopr-internal
bamboo_planRepository_1_type=gitv2
bamboo_planRepository_branchName=develop
bamboo_capability_SPHINX=Sphinx
bamboo_capability_rsync=true
bamboo_market_cloudfront_secret_key_password=********
bamboo_repository_77005182_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_system_jdk_JDK=/usr/lib/jvm/jdk1.7.0_75
bamboo_repository_77005183_git_branch=develop
bamboo_hg_cache_directory=/var/bamboo/xml-data/build-dir/_hg-repositories-cache
bamboo_planRepository_1_username=
bamboo_planRepository_type=gitv2
bamboo_capability_expect=true
bamboo_repository_77005183_git_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_itn_cdap_username=bob
bamboo_git_cache_directory=/var/bamboo/xml-data/build-dir/_git-repositories-cache
bamboo_planRepository_2_branchName=develop
bamboo_capability_RSYNC=rsync
bamboo_capability_system_builder_node_Node_js=/usr/bin/node
bamboo_capability_system_builder_mvn3_Maven_3=/opt/maven
bamboo_tmp_directory=/var/bamboo/temp
bamboo_planKey=IT-ITC
bamboo_hide_jdk_mirror_password=********
bamboo_planRepository_username=
bamboo_capability_s3cmd=true
bamboo_planRepository_1_branchName=develop
bamboo_inject_cdap_version_stripped=6.2.0
bamboo_itn_tenant_password=********
bamboo_resultsUrl=https://builds.cask.co/browse/IT-ITC-CM512-738
bamboo_inject_cdap_version_maj_min=6.2
bamboo_capability_Sphinx=true
bamboo_build_working_directory=/var/bamboo/xml-data/build-dir/IT-ITC-CM512
bamboo_planRepository_1_name=cdapio/cdap-integration-tests
bamboo_repository_77005182_git_username=
bamboo_inject_mmds_maven_version=1.4.0-SNAPSHOT
bamboo_shortPlanName=Cloudera Manager
bamboo_planRepository_2_username=caskdata-ro
bamboo_planRepository_name=cdapio/cdap-integration-tests
bamboo_capability_git_lfs=true
bamboo_buildNumber=738
bamboo_itn_hardwaretype=standard-2xlarge
bamboo_inject_cdap_security_extn_maven_version=0.11.0-SNAPSHOT
bamboo_planName=Integration Tests - Cloudera Manager
bamboo_shortPlanKey=ITC
bamboo_shortJobKey=CM512
bamboo_planRepository_2_name=cdapio/coopr-internal
bamboo_itn_cdap_password=********
bamboo_buildTimeStamp=2020-03-18T10:02:36.527Z
bamboo_repository_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_s3_bucket=repository.cask.co
bamboo_capability_system_builder_command_Docker=/usr/bin/docker
bamboo_repository_git_branch=develop
bamboo_buildResultKey=IT-ITC-CM512-738
bamboo_market_s3_secret_key_password=********
bamboo_buildPlanName=Integration Tests - Cloudera Manager - Cloudera Manager - 5.12
bamboo_capability_system_jdk_JDK_1_8_0_101=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_system_builder_command_fpm=/opt/rbenv/shims/fpm
bamboo_capability_Platform=rhel
bamboo_planRepository_1_revision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_itn_imagetype=centos6
bamboo_repository_77005182_branch_name=develop
bamboo_repository_77005183_branch_name=develop
bamboo_itn_kdc_admin_password=********
bamboo_repository_name=cdapio/coopr-internal
bamboo_inject_standalone_artifact=cdap-sandbox-6.2.0-SNAPSHOT.zip
bamboo_repository_77005182_name=cdapio/cdap-integration-tests
bamboo_repository_77005183_git_username=caskdata-ro
bamboo_planRepository_2_previousRevision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_buildFailed=false
bamboo_capability_system_docker_executable=/usr/bin/docker
bamboo_cloudera_manager_ip=10.210.0.124
bamboo_agentWorkingDirectory=/var/bamboo/xml-data/build-dir
bamboo_planRepository_2_revision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_system_git_executable=/usr/local/bin/git
bamboo_repository_git_username=
bamboo_capability_system_jdk_JDK_1_8_0_232=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64
bamboo_planRepository_1_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_repository_77005183_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_system_builder_command_Ruby=/opt/rbenv/shims/ruby
bamboo_itn_user=bamboo
bamboo_planRepository_branchDisplayName=develop
bamboo_inject_bigquery_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_inject_package_iteration=1
bamboo_aws_access_key_password=********
bamboo_planRepository_2_type=gitv2
bamboo_capability_system_builder_mvn3_Maven_3_x=/opt/maven
bamboo_inject_standalone_artifact_name=cdap-sandbox
bamboo_plan_storageTag=plan-68523427
bamboo_planRepository_2_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_repository_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_remote_cluster_id=00053450
bamboo_market_cloudfront_access_key_password=********
bamboo_working_directory=/var/bamboo/xml-data/build-dir/IT-ITC-CM512
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_command_3=/opt/rbenv/shims/ruby cdap-integration-tests/bin/coopr-runner-wrapper.rb --num-machines 6 --name IT-ITC-CM512-738- --uri ******** --tenant ******** --user bamboo --cluster-service-to-check cloudera-manager --cluster-service-ip-file cloudera-manager-ip.txt --config { "cloudera_manager": { "services": { "cdap": { "serviceConfigs": { "security_authorization_extension_jar_path":"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar" } } } } } --services cloudera-manager-agent,generic-users
bamboo_planRepository_1_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_77005183_previous_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_createrepo=true
bamboo_capability_system_jdk_JDK_1_8=/usr/lib/jvm/jdk1.8.0_101
bamboo_repository_77005182_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_rpm_build=true
bamboo_capability_system_jdk_JDK_1_7=/usr/lib/jvm/jdk1.7.0_75
bamboo_inject_hydrator_plugins_maven_version=2.4.0-SNAPSHOT
18-Mar-2020 10:34:49 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:34:49 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:34:57 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:34:57 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:34:57 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:34:58 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:34:58 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:34:59 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:34:59 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:34:59 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:35:00 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:35:00 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:35:00 Finished task 'Copy Parcel to remote CM host and instantiate Parcel Repo' with result: Success
18-Mar-2020 10:35:00
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.124
18-Mar-2020 10:35:00
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.124
18-Mar-2020 10:35:00
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.124
18-Mar-2020 10:35:00
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.124
18-Mar-2020 10:35:00 Starting task 'Replace CSD on remote' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
18-Mar-2020 10:35:00
Beginning to execute external process for build 'Integration Tests - Cloudera Manager - Cloudera Manager - 5.12 #738 (IT-ITC-CM512-738)'
... running command line:
/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-4142287909579469834.sh
... in: /var/bamboo/xml-data/build-dir/IT-ITC-CM512
... using extra environment variables:
bamboo_planRepository_1_branch=develop
bamboo_planRepository_2_branch=develop
bamboo_inject_delta_maven_version=0.1.0-SNAPSHOT
bamboo_planRepository_1_branchDisplayName=develop
bamboo_inject_buildNumber=2265
bamboo_repository_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_inject_sql_pipelines_maven_version=6.2.0-SNAPSHOT
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_18=/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-4369925693106494379.sh
bamboo_capability_system_builder_command_s3cmd=/usr/bin/s3cmd
bamboo_docs_s3_bucket=docs.cask.co
bamboo_buildKey=IT-ITC-CM512
bamboo_repository_77005182_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_itn_kdc_admin_user_password=********
bamboo_gpg_password=********
bamboo_ops_gpg_password=********
bamboo_planRepository_2_branchDisplayName=develop
bamboo_shortJobName=Cloudera Manager - 5.12
bamboo_buildResultsUrl=https://builds.cask.co/browse/IT-ITC-CM512-738
bamboo_capability_system_builder_mvn3_Maven_3_1=/opt/maven
bamboo_planRepository_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_s3_bucket=repository.cask.co
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_20=/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-7344331878117958390.sh
bamboo_aws_secret_access_key_password=********
bamboo_capability_system_builder_mvn3_Maven_3_6=/opt/maven
bamboo_agentId=32243718
bamboo_inject_package_full_version=6.2.0.1584500997615-1
bamboo_inject_dre_maven_version=1.4.0-SNAPSHOT
bamboo_inject_docker_repo=caskdata/cdap-sandbox
bamboo_capability_Swapfile=true
bamboo_inject_cdap_maven_version=6.2.0-SNAPSHOT
bamboo_planRepository_revision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_planRepository_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_RHEL=rhel
bamboo_capability_freight=true
bamboo_repository_branch_name=develop
bamboo_itn_uri_password=********
bamboo_kdc_address_password=********
bamboo_capability_GPG=GPG
bamboo_capability_system_jdk_Oracle_JDK_8=/usr/lib/jvm/jdk8
bamboo_capability_system_jdk_Oracle_JDK_7=/usr/lib/jvm/jdk7
bamboo_inject_cdap_version=6.2.0-SNAPSHOT
bamboo_downloads_s3_bucket=downloads.cask.co
bamboo_planRepository_branch=develop
bamboo_itn_provider=gce-audi
bamboo_inject_vm_artifact_name=cdap-sandbox
bamboo_capability_system_jdk_OpenJDK_1_8=/usr/lib/jvm/java-1.8.0
bamboo_inject_package_version=6.2.0.1584500997615
bamboo_inject_database_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_repository_77005182_git_branch=develop
bamboo_market_s3_access_key_password=********
bamboo_repository_77005183_name=cdapio/coopr-internal
bamboo_planRepository_1_type=gitv2
bamboo_planRepository_branchName=develop
bamboo_capability_SPHINX=Sphinx
bamboo_capability_rsync=true
bamboo_market_cloudfront_secret_key_password=********
bamboo_repository_77005182_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_system_jdk_JDK=/usr/lib/jvm/jdk1.7.0_75
bamboo_repository_77005183_git_branch=develop
bamboo_hg_cache_directory=/var/bamboo/xml-data/build-dir/_hg-repositories-cache
bamboo_planRepository_1_username=
bamboo_planRepository_type=gitv2
bamboo_capability_expect=true
bamboo_repository_77005183_git_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_itn_cdap_username=bob
bamboo_git_cache_directory=/var/bamboo/xml-data/build-dir/_git-repositories-cache
bamboo_planRepository_2_branchName=develop
bamboo_capability_RSYNC=rsync
bamboo_capability_system_builder_node_Node_js=/usr/bin/node
bamboo_capability_system_builder_mvn3_Maven_3=/opt/maven
bamboo_tmp_directory=/var/bamboo/temp
bamboo_planKey=IT-ITC
bamboo_hide_jdk_mirror_password=********
bamboo_planRepository_username=
bamboo_capability_s3cmd=true
bamboo_planRepository_1_branchName=develop
bamboo_inject_cdap_version_stripped=6.2.0
bamboo_itn_tenant_password=********
bamboo_resultsUrl=https://builds.cask.co/browse/IT-ITC-CM512-738
bamboo_inject_cdap_version_maj_min=6.2
bamboo_capability_Sphinx=true
bamboo_build_working_directory=/var/bamboo/xml-data/build-dir/IT-ITC-CM512
bamboo_planRepository_1_name=cdapio/cdap-integration-tests
bamboo_repository_77005182_git_username=
bamboo_inject_mmds_maven_version=1.4.0-SNAPSHOT
bamboo_shortPlanName=Cloudera Manager
bamboo_planRepository_2_username=caskdata-ro
bamboo_planRepository_name=cdapio/cdap-integration-tests
bamboo_capability_git_lfs=true
bamboo_buildNumber=738
bamboo_itn_hardwaretype=standard-2xlarge
bamboo_inject_cdap_security_extn_maven_version=0.11.0-SNAPSHOT
bamboo_planName=Integration Tests - Cloudera Manager
bamboo_shortPlanKey=ITC
bamboo_shortJobKey=CM512
bamboo_planRepository_2_name=cdapio/coopr-internal
bamboo_itn_cdap_password=********
bamboo_buildTimeStamp=2020-03-18T10:02:36.527Z
bamboo_repository_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_s3_bucket=repository.cask.co
bamboo_capability_system_builder_command_Docker=/usr/bin/docker
bamboo_repository_git_branch=develop
bamboo_buildResultKey=IT-ITC-CM512-738
bamboo_market_s3_secret_key_password=********
bamboo_buildPlanName=Integration Tests - Cloudera Manager - Cloudera Manager - 5.12
bamboo_capability_system_jdk_JDK_1_8_0_101=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_system_builder_command_fpm=/opt/rbenv/shims/fpm
bamboo_capability_Platform=rhel
bamboo_planRepository_1_revision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_itn_imagetype=centos6
bamboo_repository_77005182_branch_name=develop
bamboo_repository_77005183_branch_name=develop
bamboo_itn_kdc_admin_password=********
bamboo_repository_name=cdapio/coopr-internal
bamboo_inject_standalone_artifact=cdap-sandbox-6.2.0-SNAPSHOT.zip
bamboo_repository_77005182_name=cdapio/cdap-integration-tests
bamboo_repository_77005183_git_username=caskdata-ro
bamboo_planRepository_2_previousRevision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_buildFailed=false
bamboo_capability_system_docker_executable=/usr/bin/docker
bamboo_cloudera_manager_ip=10.210.0.124
bamboo_agentWorkingDirectory=/var/bamboo/xml-data/build-dir
bamboo_planRepository_2_revision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_system_git_executable=/usr/local/bin/git
bamboo_repository_git_username=
bamboo_capability_system_jdk_JDK_1_8_0_232=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64
bamboo_planRepository_1_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_repository_77005183_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_system_builder_command_Ruby=/opt/rbenv/shims/ruby
bamboo_itn_user=bamboo
bamboo_planRepository_branchDisplayName=develop
bamboo_inject_bigquery_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_inject_package_iteration=1
bamboo_aws_access_key_password=********
bamboo_planRepository_2_type=gitv2
bamboo_capability_system_builder_mvn3_Maven_3_x=/opt/maven
bamboo_inject_standalone_artifact_name=cdap-sandbox
bamboo_plan_storageTag=plan-68523427
bamboo_planRepository_2_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_repository_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_remote_cluster_id=00053450
bamboo_market_cloudfront_access_key_password=********
bamboo_working_directory=/var/bamboo/xml-data/build-dir/IT-ITC-CM512
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_command_3=/opt/rbenv/shims/ruby cdap-integration-tests/bin/coopr-runner-wrapper.rb --num-machines 6 --name IT-ITC-CM512-738- --uri ******** --tenant ******** --user bamboo --cluster-service-to-check cloudera-manager --cluster-service-ip-file cloudera-manager-ip.txt --config { "cloudera_manager": { "services": { "cdap": { "serviceConfigs": { "security_authorization_extension_jar_path":"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar" } } } } } --services cloudera-manager-agent,generic-users
bamboo_planRepository_1_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_77005183_previous_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_createrepo=true
bamboo_capability_system_jdk_JDK_1_8=/usr/lib/jvm/jdk1.8.0_101
bamboo_repository_77005182_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_rpm_build=true
bamboo_capability_system_jdk_JDK_1_7=/usr/lib/jvm/jdk1.7.0_75
bamboo_inject_hydrator_plugins_maven_version=2.4.0-SNAPSHOT
18-Mar-2020 10:35:00 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:35:01 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:35:01 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:35:02 Warning: Permanently added '10.210.0.124' (RSA) to the list of known hosts.
18-Mar-2020 10:35:04 Stopping cloudera-scm-server: [  OK  ]
18-Mar-2020 10:35:09 Starting cloudera-scm-server: [  OK  ]
18-Mar-2020 10:35:09 Finished task 'Replace CSD on remote' with result: Success
18-Mar-2020 10:35:09 Starting task 'debug' of type 'com.atlassian.bamboo.plugins.bamboo-variable-inject-plugin:dump'
18-Mar-2020 10:35:09 ---- DUMPING VARIABLES TO LOG ---
18-Mar-2020 10:35:09 key: [agentId] value: [32243718] type: CUSTOM
18-Mar-2020 10:35:09 key: [agentWorkingDirectory] value: [/var/bamboo/xml-data/build-dir] type: CUSTOM
18-Mar-2020 10:35:09 key: [aws_access_key.password] value: [**********] type: GLOBAL
18-Mar-2020 10:35:09 key: [aws_secret_access_key.password] value: [**********] type: GLOBAL
18-Mar-2020 10:35:09 key: [build.commandline.com.atlassian.bamboo.plugins.scripttask:task.builder.command.3] value: [/opt/rbenv/shims/ruby cdap-integration-tests/bin/coopr-runner-wrapper.rb --num-machines 6 --name IT-ITC-CM512-738- --uri ******** --tenant ******** --user bamboo --cluster-service-to-check cloudera-manager --cluster-service-ip-file cloudera-manager-ip.txt --config { "cloudera_manager": { "services": { "cdap": { "serviceConfigs": { "security_authorization_extension_jar_path":"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar" } } } } } --services cloudera-manager-agent,generic-users] type: CUSTOM
18-Mar-2020 10:35:09 key: [build.commandline.com.atlassian.bamboo.plugins.scripttask:task.builder.script.17] value: [/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-4142287909579469834.sh] type: CUSTOM
18-Mar-2020 10:35:09 key: [build.commandline.com.atlassian.bamboo.plugins.scripttask:task.builder.script.18] value: [/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-4369925693106494379.sh] type: CUSTOM
18-Mar-2020 10:35:09 key: [build.commandline.com.atlassian.bamboo.plugins.scripttask:task.builder.script.20] value: [/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-7344331878117958390.sh] type: CUSTOM
18-Mar-2020 10:35:09 key: [build.working.directory] value: [/var/bamboo/xml-data/build-dir/IT-ITC-CM512] type: CUSTOM
18-Mar-2020 10:35:09 key: [buildFailed] value: [false] type: CUSTOM
18-Mar-2020 10:35:09 key: [buildKey] value: [IT-ITC-CM512] type: CUSTOM
18-Mar-2020 10:35:09 key: [buildNumber] value: [738] type: CUSTOM
18-Mar-2020 10:35:09 key: [buildPlanName] value: [Integration Tests - Cloudera Manager - Cloudera Manager - 5.12] type: CUSTOM
18-Mar-2020 10:35:09 key: [buildResultKey] value: [IT-ITC-CM512-738] type: CUSTOM
18-Mar-2020 10:35:09 key: [buildResultsUrl] value: [https://builds.cask.co/browse/IT-ITC-CM512-738] type: CUSTOM
18-Mar-2020 10:35:09 key: [buildTimeStamp] value: [2020-03-18T10:02:36.527Z] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.GPG] value: [GPG] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.Platform] value: [rhel] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.RHEL] value: [rhel] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.RSYNC] value: [rsync] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.SPHINX] value: [Sphinx] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.Sphinx] value: [true] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.Swapfile] value: [true] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.createrepo] value: [true] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.expect] value: [true] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.freight] value: [true] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.git-lfs] value: [true] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.rpm-build] value: [true] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.rsync] value: [true] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.s3cmd] value: [true] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.builder.command.Docker] value: [/usr/bin/docker] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.builder.command.Ruby] value: [/opt/rbenv/shims/ruby] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.builder.command.fpm] value: [/opt/rbenv/shims/fpm] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.builder.command.s3cmd] value: [/usr/bin/s3cmd] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.builder.mvn3.Maven 3] value: [/opt/maven] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.builder.mvn3.Maven 3.1] value: [/opt/maven] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.builder.mvn3.Maven 3.6] value: [/opt/maven] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.builder.mvn3.Maven 3.x] value: [/opt/maven] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.builder.node.Node.js] value: [/usr/bin/node] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.docker.executable] value: [/usr/bin/docker] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.git.executable] value: [/usr/local/bin/git] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.jdk.JDK] value: [/usr/lib/jvm/jdk1.7.0_75] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.jdk.JDK 1.7] value: [/usr/lib/jvm/jdk1.7.0_75] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.jdk.JDK 1.8] value: [/usr/lib/jvm/jdk1.8.0_101] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.jdk.JDK 1.8.0_101] value: [/usr/lib/jvm/jdk1.8.0_101] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.jdk.JDK 1.8.0_232] value: [/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.jdk.OpenJDK 1.8] value: [/usr/lib/jvm/java-1.8.0] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.jdk.Oracle JDK 7] value: [/usr/lib/jvm/jdk7] type: CUSTOM
18-Mar-2020 10:35:09 key: [capability.system.jdk.Oracle JDK 8] value: [/usr/lib/jvm/jdk8] type: CUSTOM
18-Mar-2020 10:35:09 key: [cloudera-manager-ip] value: [10.210.0.124] type: CUSTOM
18-Mar-2020 10:35:09 key: [docs_s3_bucket] value: [docs.cask.co] type: GLOBAL
18-Mar-2020 10:35:09 key: [downloads_s3_bucket] value: [downloads.cask.co] type: GLOBAL
18-Mar-2020 10:35:09 key: [git.cache.directory] value: [/var/bamboo/xml-data/build-dir/_git-repositories-cache] type: CUSTOM
18-Mar-2020 10:35:09 key: [gpg.password] value: [**********] type: GLOBAL
18-Mar-2020 10:35:09 key: [hg.cache.directory] value: [/var/bamboo/xml-data/build-dir/_hg-repositories-cache] type: CUSTOM
18-Mar-2020 10:35:09 key: [hide.jdk.mirror.password] value: [**********] type: GLOBAL
18-Mar-2020 10:35:09 key: [inject.bigquery-delta-plugins.maven.version] value: [0.1.0-SNAPSHOT] type: RESULT
18-Mar-2020 10:35:09 key: [inject.buildNumber] value: [2265] type: RESULT
18-Mar-2020 10:35:09 key: [inject.cdap-security-extn.maven.version] value: [0.11.0-SNAPSHOT] type: RESULT
18-Mar-2020 10:35:09 key: [inject.cdap.maven.version] value: [6.2.0-SNAPSHOT] type: RESULT
18-Mar-2020 10:35:09 key: [inject.cdap.version] value: [6.2.0-SNAPSHOT] type: RESULT
18-Mar-2020 10:35:09 key: [inject.cdap.version.maj_min] value: [6.2] type: RESULT
18-Mar-2020 10:35:09 key: [inject.cdap.version.stripped] value: [6.2.0] type: RESULT
18-Mar-2020 10:35:09 key: [inject.database-delta-plugins.maven.version] value: [0.1.0-SNAPSHOT] type: RESULT
18-Mar-2020 10:35:09 key: [inject.delta.maven.version] value: [0.1.0-SNAPSHOT] type: RESULT
18-Mar-2020 10:35:09 key: [inject.docker.repo] value: [caskdata/cdap-sandbox] type: RESULT
18-Mar-2020 10:35:09 key: [inject.dre.maven.version] value: [1.4.0-SNAPSHOT] type: RESULT
18-Mar-2020 10:35:09 key: [inject.hydrator-plugins.maven.version] value: [2.4.0-SNAPSHOT] type: RESULT
18-Mar-2020 10:35:09 key: [inject.mmds.maven.version] value: [1.4.0-SNAPSHOT] type: RESULT
18-Mar-2020 10:35:09 key: [inject.package.full.version] value: [6.2.0.1584500997615-1] type: RESULT
18-Mar-2020 10:35:09 key: [inject.package.iteration] value: [1] type: RESULT
18-Mar-2020 10:35:09 key: [inject.package.version] value: [6.2.0.1584500997615] type: RESULT
18-Mar-2020 10:35:09 key: [inject.sql-pipelines.maven.version] value: [6.2.0-SNAPSHOT] type: RESULT
18-Mar-2020 10:35:09 key: [inject.standalone.artifact] value: [cdap-sandbox-6.2.0-SNAPSHOT.zip] type: RESULT
18-Mar-2020 10:35:09 key: [inject.standalone.artifact.name] value: [cdap-sandbox] type: RESULT
18-Mar-2020 10:35:09 key: [inject.vm.artifact.name] value: [cdap-sandbox] type: RESULT
18-Mar-2020 10:35:09 key: [itn.cdap.password] value: [**********] type: PLAN
18-Mar-2020 10:35:09 key: [itn.cdap.username] value: [bob] type: PLAN
18-Mar-2020 10:35:09 key: [itn.hardwaretype] value: [standard-2xlarge] type: PLAN
18-Mar-2020 10:35:09 key: [itn.imagetype] value: [centos6] type: PLAN
18-Mar-2020 10:35:09 key: [itn.kdc.admin.password] value: [**********] type: PLAN
18-Mar-2020 10:35:09 key: [itn.kdc.admin.user.password] value: [**********] type: PLAN
18-Mar-2020 10:35:09 key: [itn.provider] value: [gce-audi] type: PLAN
18-Mar-2020 10:35:09 key: [itn.tenant.password] value: [**********] type: PLAN
18-Mar-2020 10:35:09 key: [itn.uri.password] value: [**********] type: PLAN
18-Mar-2020 10:35:09 key: [itn.user] value: [bamboo] type: PLAN
18-Mar-2020 10:35:09 key: [kdc.address.password] value: [**********] type: GLOBAL
18-Mar-2020 10:35:09 key: [market.cloudfront.access_key.password] value: [**********] type: GLOBAL
18-Mar-2020 10:35:09 key: [market.cloudfront.secret_key.password] value: [**********] type: GLOBAL
18-Mar-2020 10:35:09 key: [market.s3.access_key.password] value: [**********] type: GLOBAL
18-Mar-2020 10:35:09 key: [market.s3.secret_key.password] value: [**********] type: GLOBAL
18-Mar-2020 10:35:09 key: [ops.gpg.password] value: [**********] type: GLOBAL
18-Mar-2020 10:35:09 key: [plan.storageTag] value: [plan-68523427] type: CUSTOM
18-Mar-2020 10:35:09 key: [planKey] value: [IT-ITC] type: CUSTOM
18-Mar-2020 10:35:09 key: [planName] value: [Integration Tests - Cloudera Manager] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.1.branch] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.1.branchDisplayName] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.1.branchName] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.1.name] value: [cdapio/cdap-integration-tests] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.1.previousRevision] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.1.repositoryUrl] value: [https://github.com/cdapio/cdap-integration-tests] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.1.revision] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.1.type] value: [gitv2] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.1.username] value: [] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.2.branch] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.2.branchDisplayName] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.2.branchName] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.2.name] value: [cdapio/coopr-internal] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.2.previousRevision] value: [8c2797da17295a6737c5c746943af521cf6bb43f] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.2.repositoryUrl] value: [https://github.com/cdapio/coopr-internal] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.2.revision] value: [8c2797da17295a6737c5c746943af521cf6bb43f] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.2.type] value: [gitv2] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.2.username] value: [caskdata-ro] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.branch] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.branchDisplayName] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.branchName] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.name] value: [cdapio/cdap-integration-tests] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.previousRevision] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.repositoryUrl] value: [https://github.com/cdapio/cdap-integration-tests] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.revision] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.type] value: [gitv2] type: CUSTOM
18-Mar-2020 10:35:09 key: [planRepository.username] value: [] type: CUSTOM
18-Mar-2020 10:35:09 key: [remote-cluster-id] value: [00053450] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005182.branch.name] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005182.git.branch] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005182.git.repositoryUrl] value: [https://github.com/cdapio/cdap-integration-tests] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005182.git.username] value: [] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005182.name] value: [cdapio/cdap-integration-tests] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005182.previous.revision.number] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005182.revision.number] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005183.branch.name] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005183.git.branch] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005183.git.repositoryUrl] value: [https://github.com/cdapio/coopr-internal] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005183.git.username] value: [caskdata-ro] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005183.name] value: [cdapio/coopr-internal] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005183.previous.revision.number] value: [8c2797da17295a6737c5c746943af521cf6bb43f] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.77005183.revision.number] value: [8c2797da17295a6737c5c746943af521cf6bb43f] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.branch.name] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.git.branch] value: [develop] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.git.repositoryUrl] value: [https://github.com/cdapio/cdap-integration-tests] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.git.username] value: [] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.name] value: [cdapio/coopr-internal] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.previous.revision.number] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository.revision.number] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
18-Mar-2020 10:35:09 key: [repository_s3_bucket] value: [repository.cask.co] type: GLOBAL
18-Mar-2020 10:35:09 key: [resultsUrl] value: [https://builds.cask.co/browse/IT-ITC-CM512-738] type: CUSTOM
18-Mar-2020 10:35:09 key: [s3_bucket] value: [repository.cask.co] type: GLOBAL
18-Mar-2020 10:35:09 key: [shortJobKey] value: [CM512] type: CUSTOM
18-Mar-2020 10:35:09 key: [shortJobName] value: [Cloudera Manager - 5.12] type: CUSTOM
18-Mar-2020 10:35:09 key: [shortPlanKey] value: [ITC] type: CUSTOM
18-Mar-2020 10:35:09 key: [shortPlanName] value: [Cloudera Manager] type: CUSTOM
18-Mar-2020 10:35:09 key: [tmp.directory] value: [/var/bamboo/temp] type: CUSTOM
18-Mar-2020 10:35:09 key: [working.directory] value: [/var/bamboo/xml-data/build-dir/IT-ITC-CM512] type: CUSTOM
18-Mar-2020 10:35:09 ---- END DUMPING VARIABLES TO LOG  ---
18-Mar-2020 10:35:09 Finished task 'debug' with result: Success
18-Mar-2020 10:35:09
Substituting password variable: ${bamboo.itn.uri.password}
18-Mar-2020 10:35:09
Substituting password variable: ${bamboo.itn.tenant.password}
18-Mar-2020 10:35:09
Substituting variable: ${bamboo.itn.user} with bamboo
18-Mar-2020 10:35:09
Substituting password variable: ${bamboo.itn.kdc.admin.user.password}
18-Mar-2020 10:35:09
Substituting password variable: ${bamboo.itn.kdc.admin.password}
18-Mar-2020 10:35:09
Substituting variable: ${bamboo.inject.package.version} with 6.2.0.1584500997615
18-Mar-2020 10:35:09
Substituting variable: ${bamboo.inject.package.iteration} with 1
18-Mar-2020 10:35:09
Substituting variable: ${bamboo.remote-cluster-id} with 00053450
18-Mar-2020 10:35:09 Starting task 'Execute coopr-base-to-cm' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.command'
18-Mar-2020 10:35:09
Beginning to execute external process for build 'Integration Tests - Cloudera Manager - Cloudera Manager - 5.12 #738 (IT-ITC-CM512-738)'
... running command line:
/opt/rbenv/shims/ruby coopr_base_to_cm.rb --coopr-uri ******** --coopr-tenant ******** --coopr-user bamboo --kdc-admin-user ******** --kdc-admin-password ******** --cdap-parcel-version 6.2.0.1584500997615-1 --remote-parcel-repo-url http://localhost:8080/itnparcelrepo --debug -i 00053450 --no-ha
... in: /var/bamboo/xml-data/build-dir/IT-ITC-CM512/coopr-internal/bin
... using extra environment variables:
bamboo_planRepository_1_branch=develop
bamboo_planRepository_2_branch=develop
bamboo_inject_delta_maven_version=0.1.0-SNAPSHOT
bamboo_planRepository_1_branchDisplayName=develop
bamboo_inject_buildNumber=2265
bamboo_repository_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_17=/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-4142287909579469834.sh
bamboo_inject_sql_pipelines_maven_version=6.2.0-SNAPSHOT
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_18=/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-4369925693106494379.sh
bamboo_capability_system_builder_command_s3cmd=/usr/bin/s3cmd
bamboo_docs_s3_bucket=docs.cask.co
bamboo_buildKey=IT-ITC-CM512
bamboo_repository_77005182_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_itn_kdc_admin_user_password=********
bamboo_gpg_password=********
bamboo_ops_gpg_password=********
bamboo_planRepository_2_branchDisplayName=develop
bamboo_shortJobName=Cloudera Manager - 5.12
bamboo_buildResultsUrl=https://builds.cask.co/browse/IT-ITC-CM512-738
bamboo_capability_system_builder_mvn3_Maven_3_1=/opt/maven
bamboo_planRepository_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_s3_bucket=repository.cask.co
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_20=/bin/sh /var/bamboo/temp/IT-ITC-CM512-738-ScriptBuildTask-7344331878117958390.sh
bamboo_aws_secret_access_key_password=********
bamboo_capability_system_builder_mvn3_Maven_3_6=/opt/maven
bamboo_agentId=32243718
bamboo_inject_package_full_version=6.2.0.1584500997615-1
bamboo_inject_dre_maven_version=1.4.0-SNAPSHOT
bamboo_inject_docker_repo=caskdata/cdap-sandbox
bamboo_capability_Swapfile=true
bamboo_inject_cdap_maven_version=6.2.0-SNAPSHOT
bamboo_planRepository_revision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_planRepository_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_RHEL=rhel
bamboo_capability_freight=true
bamboo_repository_branch_name=develop
bamboo_itn_uri_password=********
bamboo_kdc_address_password=********
bamboo_capability_GPG=GPG
bamboo_capability_system_jdk_Oracle_JDK_8=/usr/lib/jvm/jdk8
bamboo_capability_system_jdk_Oracle_JDK_7=/usr/lib/jvm/jdk7
bamboo_inject_cdap_version=6.2.0-SNAPSHOT
bamboo_downloads_s3_bucket=downloads.cask.co
bamboo_planRepository_branch=develop
bamboo_itn_provider=gce-audi
bamboo_inject_vm_artifact_name=cdap-sandbox
bamboo_capability_system_jdk_OpenJDK_1_8=/usr/lib/jvm/java-1.8.0
bamboo_inject_package_version=6.2.0.1584500997615
bamboo_inject_database_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_repository_77005182_git_branch=develop
bamboo_market_s3_access_key_password=********
bamboo_repository_77005183_name=cdapio/coopr-internal
bamboo_planRepository_1_type=gitv2
bamboo_planRepository_branchName=develop
bamboo_capability_SPHINX=Sphinx
bamboo_capability_rsync=true
bamboo_market_cloudfront_secret_key_password=********
bamboo_repository_77005182_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_system_jdk_JDK=/usr/lib/jvm/jdk1.7.0_75
bamboo_repository_77005183_git_branch=develop
bamboo_hg_cache_directory=/var/bamboo/xml-data/build-dir/_hg-repositories-cache
bamboo_planRepository_1_username=
bamboo_planRepository_type=gitv2
bamboo_capability_expect=true
bamboo_repository_77005183_git_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_itn_cdap_username=bob
bamboo_git_cache_directory=/var/bamboo/xml-data/build-dir/_git-repositories-cache
bamboo_planRepository_2_branchName=develop
bamboo_capability_RSYNC=rsync
bamboo_capability_system_builder_node_Node_js=/usr/bin/node
bamboo_capability_system_builder_mvn3_Maven_3=/opt/maven
bamboo_tmp_directory=/var/bamboo/temp
bamboo_planKey=IT-ITC
bamboo_hide_jdk_mirror_password=********
bamboo_planRepository_username=
bamboo_capability_s3cmd=true
bamboo_planRepository_1_branchName=develop
bamboo_inject_cdap_version_stripped=6.2.0
bamboo_itn_tenant_password=********
bamboo_resultsUrl=https://builds.cask.co/browse/IT-ITC-CM512-738
bamboo_inject_cdap_version_maj_min=6.2
bamboo_capability_Sphinx=true
bamboo_build_working_directory=/var/bamboo/xml-data/build-dir/IT-ITC-CM512
bamboo_planRepository_1_name=cdapio/cdap-integration-tests
bamboo_repository_77005182_git_username=
bamboo_inject_mmds_maven_version=1.4.0-SNAPSHOT
bamboo_shortPlanName=Cloudera Manager
bamboo_planRepository_2_username=caskdata-ro
bamboo_planRepository_name=cdapio/cdap-integration-tests
bamboo_capability_git_lfs=true
bamboo_buildNumber=738
bamboo_itn_hardwaretype=standard-2xlarge
bamboo_inject_cdap_security_extn_maven_version=0.11.0-SNAPSHOT
bamboo_planName=Integration Tests - Cloudera Manager
bamboo_shortPlanKey=ITC
bamboo_shortJobKey=CM512
bamboo_planRepository_2_name=cdapio/coopr-internal
bamboo_itn_cdap_password=********
bamboo_buildTimeStamp=2020-03-18T10:02:36.527Z
bamboo_repository_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_s3_bucket=repository.cask.co
bamboo_capability_system_builder_command_Docker=/usr/bin/docker
bamboo_repository_git_branch=develop
bamboo_buildResultKey=IT-ITC-CM512-738
bamboo_market_s3_secret_key_password=********
bamboo_buildPlanName=Integration Tests - Cloudera Manager - Cloudera Manager - 5.12
bamboo_capability_system_jdk_JDK_1_8_0_101=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_system_builder_command_fpm=/opt/rbenv/shims/fpm
bamboo_capability_Platform=rhel
bamboo_planRepository_1_revision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_itn_imagetype=centos6
bamboo_repository_77005182_branch_name=develop
bamboo_repository_77005183_branch_name=develop
bamboo_itn_kdc_admin_password=********
bamboo_repository_name=cdapio/coopr-internal
bamboo_inject_standalone_artifact=cdap-sandbox-6.2.0-SNAPSHOT.zip
bamboo_repository_77005182_name=cdapio/cdap-integration-tests
bamboo_repository_77005183_git_username=caskdata-ro
bamboo_planRepository_2_previousRevision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_buildFailed=false
bamboo_capability_system_docker_executable=/usr/bin/docker
bamboo_cloudera_manager_ip=10.210.0.124
bamboo_agentWorkingDirectory=/var/bamboo/xml-data/build-dir
bamboo_planRepository_2_revision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_system_git_executable=/usr/local/bin/git
bamboo_repository_git_username=
bamboo_capability_system_jdk_JDK_1_8_0_232=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64
bamboo_planRepository_1_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_repository_77005183_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_system_builder_command_Ruby=/opt/rbenv/shims/ruby
bamboo_itn_user=bamboo
bamboo_planRepository_branchDisplayName=develop
bamboo_inject_bigquery_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_inject_package_iteration=1
bamboo_aws_access_key_password=********
bamboo_planRepository_2_type=gitv2
bamboo_capability_system_builder_mvn3_Maven_3_x=/opt/maven
bamboo_inject_standalone_artifact_name=cdap-sandbox
bamboo_plan_storageTag=plan-68523427
bamboo_planRepository_2_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_repository_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
COOPR_DRIVER_CLUSTER_SERVICE_IP_FILE=cdap-auto-ip.txt
bamboo_remote_cluster_id=00053450
bamboo_market_cloudfront_access_key_password=********
bamboo_working_directory=/var/bamboo/xml-data/build-dir/IT-ITC-CM512
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_command_3=/opt/rbenv/shims/ruby cdap-integration-tests/bin/coopr-runner-wrapper.rb --num-machines 6 --name IT-ITC-CM512-738- --uri ******** --tenant ******** --user bamboo --cluster-service-to-check cloudera-manager --cluster-service-ip-file cloudera-manager-ip.txt --config { "cloudera_manager": { "services": { "cdap": { "serviceConfigs": { "security_authorization_extension_jar_path":"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar" } } } } } --services cloudera-manager-agent,generic-users
bamboo_planRepository_1_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_77005183_previous_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_capability_createrepo=true
bamboo_capability_system_jdk_JDK_1_8=/usr/lib/jvm/jdk1.8.0_101
bamboo_repository_77005182_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_rpm_build=true
bamboo_capability_system_jdk_JDK_1_7=/usr/lib/jvm/jdk1.7.0_75
bamboo_inject_hydrator_plugins_maven_version=2.4.0-SNAPSHOT
18-Mar-2020 10:35:10 2020-03-18 10:35:10 +0000 DEBUG: Found Cloudera Manager on host it-itc-cm512-738-53450-1000.coopr.sh. Configuring cluster to use it
18-Mar-2020 10:35:10 2020-03-18 10:35:10 +0000 INFO: Confirming CM API responsiveness
18-Mar-2020 10:35:35 #<Errno::ECONNREFUSED: Connection refused - connect(2)>
18-Mar-2020 10:35:42 .
18-Mar-2020 10:35:42 2020-03-18 10:35:42 +0000 INFO: ------------ Configure Hosts ----------------
18-Mar-2020 10:35:42 2020-03-18 10:35:42 +0000 DEBUG: Response: {"items"=>[{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e", "ipAddress"=>"10.210.0.124", "hostname"=>"it-itc-cm512-738-53450-1000.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/hostRedirect/ee294935-4fd1-430c-b3cf-b29ff7f6625e", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}, {"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e", "ipAddress"=>"10.210.0.125", "hostname"=>"it-itc-cm512-738-53450-1001.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/hostRedirect/4a3652ed-8c0a-41e9-858a-1f03cd24437e", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}, {"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb", "ipAddress"=>"10.210.0.127", "hostname"=>"it-itc-cm512-738-53450-1002.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/hostRedirect/a476f7ff-ebbc-42e2-b417-09e2296baafb", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}, {"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0", "ipAddress"=>"10.210.0.128", "hostname"=>"it-itc-cm512-738-53450-1003.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/hostRedirect/a44b8b01-a6ca-472b-b176-8921797ec3e0", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}, {"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a", "ipAddress"=>"10.210.0.126", "hostname"=>"it-itc-cm512-738-53450-1004.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/hostRedirect/6d43e6c5-4909-44da-97ec-a851157b5e6a", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}, {"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd", "ipAddress"=>"10.210.0.129", "hostname"=>"it-itc-cm512-738-53450-1005.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/hostRedirect/20419ca1-4bf3-448b-8a79-23c84562a8cd", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}]}
18-Mar-2020 10:35:42 2020-03-18 10:35:42 +0000 DEBUG: Request: {"items"=>[{"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}, {"name"=>"host_dns_resolution_enabled", "value"=>"false"}]}
18-Mar-2020 10:35:42 2020-03-18 10:35:42 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 INFO: ------------ Configure CM for Cask Internal --------------
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 DEBUG: Request: {"items"=>[{"name"=>"KRB_MANAGE_KRB5_CONF", "value"=>"true"}, {"name"=>"KDC_HOST", "value"=>"10.240.209.207"}, {"name"=>"KRB_ENC_TYPES", "value"=>"aes256-cts-hmac-sha1-96 aes128-cts-hmac-sha1-96 des3-cbc-sha1 arcfour-hmac"}, {"name"=>"SECURITY_REALM", "value"=>"CONTINUUITY.NET"}, {"name"=>"CUSTOM_BANNER_HTML", "value"=>"Cluster 00053450"}, {"name"=>"CUSTOM_HEADER_COLOR", "value"=>"GREEN"}, {"name"=>"SESSION_TIMEOUT", "value"=>"3600"}, {"name"=>"PARCEL_UPDATE_FREQ", "value"=>"1"}, {"name"=>"ENABLE_API_DEBUG", "value"=>"true"}, {"name"=>"REMOTE_PARCEL_REPO_URLS", "value"=>"https://archive.cloudera.com/cdh5/parcels/{latest_supported}/,https://archive.cloudera.com/cdh4/parcels/latest/,https://archive.cloudera.com/impala/parcels/latest/,https://archive.cloudera.com/search/parcels/latest/,http://repository.cask.co/parcels/cdap/5.1/,http://archive.cloudera.com/spark2/parcels/2.1.0.cloudera2/,https://archive.cloudera.com/accumulo/parcels/1.4/,https://archive.cloudera.com/accumulo-c5/parcels/latest/,https://archive.cloudera.com/kafka/parcels/latest/,http://archive.cloudera.com/kudu/parcels/5.12/,http://archive.cloudera.com/kudu/parcels/latest/,https://archive.cloudera.com/spark/parcels/latest/,https://archive.cloudera.com/sqoop-connectors/parcels/latest/,http://repository.cask.co/parcels/cdap/6.0/,http://localhost:8080/itnparcelrepo"}]}
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 DEBUG: Response: {"items"=>[{"name"=>"CLUSTER_STATS_START", "value"=>"10/21/2012 4:20"}, {"name"=>"CUSTOM_BANNER_HTML", "value"=>"Cluster 00053450"}, {"name"=>"CUSTOM_HEADER_COLOR", "value"=>"GREEN"}, {"name"=>"ENABLE_API_DEBUG", "value"=>"true"}, {"name"=>"KDC_HOST", "value"=>"10.240.209.207"}, {"name"=>"KRB_ENC_TYPES", "value"=>"aes256-cts-hmac-sha1-96 aes128-cts-hmac-sha1-96 des3-cbc-sha1 arcfour-hmac"}, {"name"=>"KRB_MANAGE_KRB5_CONF", "value"=>"true"}, {"name"=>"PARCEL_UPDATE_FREQ", "value"=>"1"}, {"name"=>"REMOTE_PARCEL_REPO_URLS", "value"=>"https://archive.cloudera.com/cdh5/parcels/{latest_supported}/,https://archive.cloudera.com/cdh4/parcels/latest/,https://archive.cloudera.com/impala/parcels/latest/,https://archive.cloudera.com/search/parcels/latest/,http://repository.cask.co/parcels/cdap/5.1/,http://archive.cloudera.com/spark2/parcels/2.1.0.cloudera2/,https://archive.cloudera.com/accumulo/parcels/1.4/,https://archive.cloudera.com/accumulo-c5/parcels/latest/,https://archive.cloudera.com/kafka/parcels/latest/,http://archive.cloudera.com/kudu/parcels/5.12/,http://archive.cloudera.com/kudu/parcels/latest/,https://archive.cloudera.com/spark/parcels/latest/,https://archive.cloudera.com/sqoop-connectors/parcels/latest/,http://repository.cask.co/parcels/cdap/6.0/,http://localhost:8080/itnparcelrepo"}, {"name"=>"SECURITY_REALM", "value"=>"CONTINUUITY.NET"}, {"name"=>"SESSION_TIMEOUT", "value"=>"3600"}]}
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 INFO: ------------ Import KDC admin credentials --------------
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 DEBUG: Request: cm/commands/importAdminCredentials?username=cloudera-scm%2Fadmin%40CONTINUUITY.NET&password=********
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 DEBUG: Response: {"id"=>30, "name"=>"ImportCredentials", "startTime"=>"2020-03-18T10:35:43.462Z", "active"=>true, "children"=>{"items"=>[]}}
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 INFO: ------------ Wait for import admin credentials --------------
18-Mar-2020 10:35:43 2020-03-18 10:35:43 +0000 INFO: Waiting for command 30 to complete
18-Mar-2020 10:35:49 ...
18-Mar-2020 10:35:49 2020-03-18 10:35:49 +0000 DEBUG: Response: {"id"=>30, "name"=>"ImportCredentials", "startTime"=>"2020-03-18T10:35:43.462Z", "endTime"=>"2020-03-18T10:35:48.487Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully imported KDC Account Manager credentials.", "children"=>{"items"=>[]}, "canRetry"=>false}
18-Mar-2020 10:35:49 2020-03-18 10:35:49 +0000 INFO: ------------ Create Cloudera Management Services --------------
18-Mar-2020 10:35:49 2020-03-18 10:35:49 +0000 DEBUG: Request: {"name"=>"mgmt", "type"=>"MGMT"}
18-Mar-2020 10:35:49 2020-03-18 10:35:49 +0000 DEBUG: Response: {"name"=>"mgmt", "type"=>"MGMT", "serviceUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/mgmt", "roleInstancesUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/mgmt/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"mgmt", "entityStatus"=>"UNKNOWN"}
18-Mar-2020 10:35:49 2020-03-18 10:35:49 +0000 INFO: ------------ AutoAssignRoles for Cloudera Management Services --------------
18-Mar-2020 10:35:49 2020-03-18 10:35:49 +0000 DEBUG: Request: cm/service/autoAssignRoles
18-Mar-2020 10:36:05 2020-03-18 10:36:05 +0000 DEBUG: Response:
18-Mar-2020 10:36:05 2020-03-18 10:36:05 +0000 INFO: ------------ Autoconfigure Cloudera Management Services--------------
18-Mar-2020 10:36:05 2020-03-18 10:36:05 +0000 DEBUG: Request: cm/service/autoConfigure
18-Mar-2020 10:36:05 2020-03-18 10:36:05 +0000 DEBUG: Response:
18-Mar-2020 10:36:05 2020-03-18 10:36:05 +0000 INFO: ------------ Configure Alert Publisher for Cask Internal --------------
18-Mar-2020 10:36:05 2020-03-18 10:36:05 +0000 DEBUG: Request: {"items"=>[{"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-alertpublisher"}]}
18-Mar-2020 10:36:05 2020-03-18 10:36:05 +0000 DEBUG: Response: {"items"=>[{"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-alertpublisher"}]}
18-Mar-2020 10:36:05 2020-03-18 10:36:05 +0000 INFO: ------------ Configure Event Server for Cask Internal --------------
18-Mar-2020 10:36:05 2020-03-18 10:36:05 +0000 DEBUG: Request: {"items"=>[{"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-eventserver"}, {"name"=>"eventserver_index_dir", "value"=>"/data/lib/cloudera-scm-eventserver"}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Response: {"items"=>[{"name"=>"event_server_heapsize", "value"=>"1073741824"}, {"name"=>"eventserver_index_dir", "value"=>"/data/lib/cloudera-scm-eventserver"}, {"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-eventserver"}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 INFO: ------------ Configure Host Monitor for Cask Internal --------------
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Request: {"items"=>[{"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-firehose"}, {"name"=>"firehose_storage_dir", "value"=>"/data/lib/cloudera-host-monitor"}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Response: {"items"=>[{"name"=>"firehose_heapsize", "value"=>"1073741824"}, {"name"=>"firehose_non_java_memory_bytes", "value"=>"1610612736"}, {"name"=>"firehose_storage_dir", "value"=>"/data/lib/cloudera-host-monitor"}, {"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-firehose"}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 INFO: ------------ Configure Service Monitor for Cask Internal --------------
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Request: {"items"=>[{"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-firehose"}, {"name"=>"firehose_storage_dir", "value"=>"/data/lib/cloudera-service-monitor"}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Response: {"items"=>[{"name"=>"firehose_heapsize", "value"=>"1073741824"}, {"name"=>"firehose_non_java_memory_bytes", "value"=>"1610612736"}, {"name"=>"firehose_storage_dir", "value"=>"/data/lib/cloudera-service-monitor"}, {"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-firehose"}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 INFO: ------------ Create Cluster --------------
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Request: {"items"=>[{"name"=>"00053450", "displayName"=>"IT-ITC-CM512-738--00053450", "fullVersion"=>5.12}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Response: {"items"=>[{"name"=>"00053450", "displayName"=>"IT-ITC-CM512-738--00053450", "version"=>"CDH5", "fullVersion"=>"5.12.0", "maintenanceMode"=>false, "maintenanceOwners"=>[], "clusterUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/clusterRedirect/00053450", "hostsUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/clusterRedirect/00053450/hosts"}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 INFO: ------------ Fetch Available Parcels --------------
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 INFO: ------------ Restore Default CM Parcel Update Frequency --------------
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Request: {"items"=>[{"name"=>"PARCEL_UPDATE_FREQ", "value"=>"60"}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Response: {"items"=>[{"name"=>"CLUSTER_STATS_START", "value"=>"10/21/2012 4:20"}, {"name"=>"CUSTOM_BANNER_HTML", "value"=>"Cluster 00053450"}, {"name"=>"CUSTOM_HEADER_COLOR", "value"=>"GREEN"}, {"name"=>"ENABLE_API_DEBUG", "value"=>"true"}, {"name"=>"KDC_HOST", "value"=>"10.240.209.207"}, {"name"=>"KRB_ENC_TYPES", "value"=>"aes256-cts-hmac-sha1-96 aes128-cts-hmac-sha1-96 des3-cbc-sha1 arcfour-hmac"}, {"name"=>"KRB_MANAGE_KRB5_CONF", "value"=>"true"}, {"name"=>"PARCEL_UPDATE_FREQ", "value"=>"60"}, {"name"=>"REMOTE_PARCEL_REPO_URLS", "value"=>"https://archive.cloudera.com/cdh5/parcels/{latest_supported}/,https://archive.cloudera.com/cdh4/parcels/latest/,https://archive.cloudera.com/impala/parcels/latest/,https://archive.cloudera.com/search/parcels/latest/,http://repository.cask.co/parcels/cdap/5.1/,http://archive.cloudera.com/spark2/parcels/2.1.0.cloudera2/,https://archive.cloudera.com/accumulo/parcels/1.4/,https://archive.cloudera.com/accumulo-c5/parcels/latest/,https://archive.cloudera.com/kafka/parcels/latest/,http://archive.cloudera.com/kudu/parcels/5.12/,http://archive.cloudera.com/kudu/parcels/latest/,https://archive.cloudera.com/spark/parcels/latest/,https://archive.cloudera.com/sqoop-connectors/parcels/latest/,http://repository.cask.co/parcels/cdap/6.0/,http://localhost:8080/itnparcelrepo"}, {"name"=>"SECURITY_REALM", "value"=>"CONTINUUITY.NET"}, {"name"=>"SESSION_TIMEOUT", "value"=>"3600"}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 INFO: ------------ Add Hosts to Cluster --------------
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Request: {"items"=>[{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Response: {"items"=>[{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}]}
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 INFO: ------------ Download CDH Parcel --------------
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Request: clusters/00053450/parcels/products/CDH/versions/5.12.2-1.cdh5.12.2.p0.4/commands/startDownload
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Response: {
18-Mar-2020 10:36:06   "id" : -1,
18-Mar-2020 10:36:06   "name" : "Start Parcel Download",
18-Mar-2020 10:36:06   "startTime" : "2020-03-18T10:36:06.496Z",
18-Mar-2020 10:36:06   "endTime" : "2020-03-18T10:36:06.496Z",
18-Mar-2020 10:36:06   "active" : false,
18-Mar-2020 10:36:06   "success" : true,
18-Mar-2020 10:36:06   "resultMessage" : "Synchronous command has finished",
18-Mar-2020 10:36:06   "clusterRef" : {
18-Mar-2020 10:36:06     "clusterName" : "00053450"
18-Mar-2020 10:36:06   },
18-Mar-2020 10:36:06   "canRetry" : false
18-Mar-2020 10:36:06 }
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 INFO: ------------ Download CDAP Parcel --------------
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Request: clusters/00053450/parcels/products/CDAP/versions/6.2.0.1584500997615-1/commands/startDownload
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 DEBUG: Response: {
18-Mar-2020 10:36:06   "id" : -1,
18-Mar-2020 10:36:06   "name" : "Start Parcel Download",
18-Mar-2020 10:36:06   "startTime" : "2020-03-18T10:36:06.553Z",
18-Mar-2020 10:36:06   "endTime" : "2020-03-18T10:36:06.553Z",
18-Mar-2020 10:36:06   "active" : false,
18-Mar-2020 10:36:06   "success" : true,
18-Mar-2020 10:36:06   "resultMessage" : "Synchronous command has finished",
18-Mar-2020 10:36:06   "clusterRef" : {
18-Mar-2020 10:36:06     "clusterName" : "00053450"
18-Mar-2020 10:36:06   },
18-Mar-2020 10:36:06   "canRetry" : false
18-Mar-2020 10:36:06 }
18-Mar-2020 10:36:06 2020-03-18 10:36:06 +0000 INFO: ------------ Confirm CDH Parcel Download --------------
18-Mar-2020 10:43:08 2020-03-18 10:43:08 +0000 DEBUG: Response: {"product"=>"CDH", "version"=>"5.12.2-1.cdh5.12.2.p0.4", "stage"=>"DOWNLOADED", "state"=>{"progress"=>100, "totalProgress"=>100, "count"=>1, "totalCount"=>1}, "clusterRef"=>{"clusterName"=>"00053450"}}
18-Mar-2020 10:43:08 2020-03-18 10:43:08 +0000 INFO: ------------ Confirm CDAP Parcel Download --------------
18-Mar-2020 10:43:08 2020-03-18 10:43:08 +0000 DEBUG: Response: {"product"=>"CDAP", "version"=>"6.2.0.1584500997615-1", "stage"=>"DOWNLOADED", "state"=>{"progress"=>100, "totalProgress"=>100, "count"=>1, "totalCount"=>1}, "clusterRef"=>{"clusterName"=>"00053450"}}
18-Mar-2020 10:43:08 2020-03-18 10:43:08 +0000 INFO: ------------ Distribute CDH Parcel --------------
18-Mar-2020 10:43:08 2020-03-18 10:43:08 +0000 DEBUG: Request: clusters/00053450/parcels/products/CDH/versions/5.12.2-1.cdh5.12.2.p0.4/commands/startDistribution
18-Mar-2020 10:43:08 2020-03-18 10:43:08 +0000 DEBUG: Response: {
18-Mar-2020 10:43:08   "id" : -1,
18-Mar-2020 10:43:08   "name" : "Start Parcel Distribution",
18-Mar-2020 10:43:08   "startTime" : "2020-03-18T10:43:08.792Z",
18-Mar-2020 10:43:08   "endTime" : "2020-03-18T10:43:08.792Z",
18-Mar-2020 10:43:08   "active" : false,
18-Mar-2020 10:43:08   "success" : true,
18-Mar-2020 10:43:08   "resultMessage" : "Synchronous command has finished",
18-Mar-2020 10:43:08   "clusterRef" : {
18-Mar-2020 10:43:08     "clusterName" : "00053450"
18-Mar-2020 10:43:08   },
18-Mar-2020 10:43:08   "canRetry" : false
18-Mar-2020 10:43:08 }
18-Mar-2020 10:43:08 2020-03-18 10:43:08 +0000 INFO: ------------ Distribute CDAP Parcel --------------
18-Mar-2020 10:43:08 2020-03-18 10:43:08 +0000 DEBUG: Request: clusters/00053450/parcels/products/CDAP/versions/6.2.0.1584500997615-1/commands/startDistribution
18-Mar-2020 10:43:08 2020-03-18 10:43:08 +0000 DEBUG: Response: {
18-Mar-2020 10:43:08   "id" : -1,
18-Mar-2020 10:43:08   "name" : "Start Parcel Distribution",
18-Mar-2020 10:43:08   "startTime" : "2020-03-18T10:43:08.826Z",
18-Mar-2020 10:43:08   "endTime" : "2020-03-18T10:43:08.826Z",
18-Mar-2020 10:43:08   "active" : false,
18-Mar-2020 10:43:08   "success" : true,
18-Mar-2020 10:43:08   "resultMessage" : "Synchronous command has finished",
18-Mar-2020 10:43:08   "clusterRef" : {
18-Mar-2020 10:43:08     "clusterName" : "00053450"
18-Mar-2020 10:43:08   },
18-Mar-2020 10:43:08   "canRetry" : false
18-Mar-2020 10:43:08 }
18-Mar-2020 10:43:08 2020-03-18 10:43:08 +0000 INFO: ------------ Confirm CDH Parcel Distribution --------------
18-Mar-2020 10:44:29 2020-03-18 10:44:29 +0000 DEBUG: Response: {"product"=>"CDH", "version"=>"5.12.2-1.cdh5.12.2.p0.4", "stage"=>"DISTRIBUTED", "state"=>{"progress"=>600, "totalProgress"=>600, "count"=>1, "totalCount"=>6}, "clusterRef"=>{"clusterName"=>"00053450"}}
18-Mar-2020 10:44:29 2020-03-18 10:44:29 +0000 INFO: ------------ Confirm CDAP Parcel Distribution --------------
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Response: {"product"=>"CDAP", "version"=>"6.2.0.1584500997615-1", "stage"=>"DISTRIBUTED", "state"=>{"progress"=>600, "totalProgress"=>600, "count"=>4, "totalCount"=>6}, "clusterRef"=>{"clusterName"=>"00053450"}}
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 INFO: ------------ ACTIVATE CDH Parcel --------------
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Request: clusters/00053450/parcels/products/CDH/versions/5.12.2-1.cdh5.12.2.p0.4/commands/activate
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Response {
18-Mar-2020 10:45:40   "id" : -1,
18-Mar-2020 10:45:40   "name" : "Activate Parcel",
18-Mar-2020 10:45:40   "startTime" : "2020-03-18T10:45:40.230Z",
18-Mar-2020 10:45:40   "endTime" : "2020-03-18T10:45:40.230Z",
18-Mar-2020 10:45:40   "active" : false,
18-Mar-2020 10:45:40   "success" : true,
18-Mar-2020 10:45:40   "resultMessage" : "Synchronous command has finished",
18-Mar-2020 10:45:40   "clusterRef" : {
18-Mar-2020 10:45:40     "clusterName" : "00053450"
18-Mar-2020 10:45:40   },
18-Mar-2020 10:45:40   "canRetry" : false
18-Mar-2020 10:45:40 }
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 INFO: ------------ ACTIVATE CDAP Parcel --------------
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Request: clusters/00053450/parcels/products/CDAP/versions/6.2.0.1584500997615-1/commands/activate
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Response: {
18-Mar-2020 10:45:40   "id" : -1,
18-Mar-2020 10:45:40   "name" : "Activate Parcel",
18-Mar-2020 10:45:40   "startTime" : "2020-03-18T10:45:40.300Z",
18-Mar-2020 10:45:40   "endTime" : "2020-03-18T10:45:40.300Z",
18-Mar-2020 10:45:40   "active" : false,
18-Mar-2020 10:45:40   "success" : true,
18-Mar-2020 10:45:40   "resultMessage" : "Synchronous command has finished",
18-Mar-2020 10:45:40   "clusterRef" : {
18-Mar-2020 10:45:40     "clusterName" : "00053450"
18-Mar-2020 10:45:40   },
18-Mar-2020 10:45:40   "canRetry" : false
18-Mar-2020 10:45:40 }
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 INFO: ------------ Create HDFS Service --------------
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Request: {"items"=>[{"name"=>"hdfs-00053450", "type"=>"HDFS", "displayName"=>"hdfs-00053450", "config"=>{"items"=>[{"name"=>"hdfs_service_config_safety_valve", "value"=>"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}}]}
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Response: {"items"=>[{"name"=>"hdfs-00053450", "type"=>"HDFS", "clusterRef"=>{"clusterName"=>"00053450"}, "serviceUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/hdfs-00053450", "roleInstancesUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/hdfs-00053450/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"hdfs-00053450", "entityStatus"=>"UNKNOWN"}]}
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 INFO: ------------ Assign HDFS Roles --------------
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: processing roletype: DATANODE
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: No configuration found in cluster for service HDFS, role DATANODE
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: installing DATANODE on slave hosts
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: processing roletype: NAMENODE
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: No configuration found in cluster for service HDFS, role NAMENODE
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: installing NAMENODE on master host(s)
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: processing roletype: SECONDARYNAMENODE
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: No configuration found in cluster for service HDFS, role SECONDARYNAMENODE
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: installing SECONDARYNAMENODE on master host(s)
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: processing roletype: BALANCER
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: No configuration found in cluster for service HDFS, role BALANCER
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: installing BALANCER on master host(s)
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: processing roletype: GATEWAY
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: No configuration found in cluster for service HDFS, role GATEWAY
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: installing GATEWAY on all hosts
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: processing roletype: HTTPFS
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: No configuration found in cluster for service HDFS, role HTTPFS
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: processing roletype: FAILOVERCONTROLLER
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: No configuration found in cluster for service HDFS, role FAILOVERCONTROLLER
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: processing roletype: JOURNALNODE
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: No configuration found in cluster for service HDFS, role JOURNALNODE
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: processing roletype: NFSGATEWAY
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: No configuration found in cluster for service HDFS, role NFSGATEWAY
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Request: {"items"=>[{"type"=>"DATANODE", "hostRef"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"type"=>"DATANODE", "hostRef"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"type"=>"DATANODE", "hostRef"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"type"=>"DATANODE", "hostRef"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"type"=>"DATANODE", "hostRef"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, {"type"=>"NAMENODE", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"SECONDARYNAMENODE", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"BALANCER", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"GATEWAY", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"GATEWAY", "hostRef"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"type"=>"GATEWAY", "hostRef"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"type"=>"GATEWAY", "hostRef"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"type"=>"GATEWAY", "hostRef"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"type"=>"GATEWAY", "hostRef"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}]}
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Response: {"items"=>[{"name"=>"hdfs-00053450-DATANODE-5a6dce062bea4c299520ee2a01351eef", "type"=>"DATANODE", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-DATANODE-5a6dce062bea4c299520ee2a01351eef", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-DATANODE-BASE"}}, {"name"=>"hdfs-00053450-DATANODE-3e9b3375c7403224b94a4066bf32b5cf", "type"=>"DATANODE", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-DATANODE-3e9b3375c7403224b94a4066bf32b5cf", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-DATANODE-BASE"}}, {"name"=>"hdfs-00053450-DATANODE-6ed2a7a0ee32b950fade223c8139e0a6", "type"=>"DATANODE", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-DATANODE-6ed2a7a0ee32b950fade223c8139e0a6", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-DATANODE-BASE"}}, {"name"=>"hdfs-00053450-DATANODE-5d396519c75f9e0a944555cd9ff94471", "type"=>"DATANODE", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-DATANODE-5d396519c75f9e0a944555cd9ff94471", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-DATANODE-BASE"}}, {"name"=>"hdfs-00053450-DATANODE-9fbb277bb5e5c15e23ef1581a0dbd17e", "type"=>"DATANODE", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-DATANODE-9fbb277bb5e5c15e23ef1581a0dbd17e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-DATANODE-BASE"}}, {"name"=>"hdfs-00053450-NAMENODE-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"NAMENODE", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-NAMENODE-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-NAMENODE-BASE"}}, {"name"=>"hdfs-00053450-SECONDARYNAMENODE-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"SECONDARYNAMENODE", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-SECONDARYNAMENODE-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-SECONDARYNAMENODE-BASE"}}, {"name"=>"hdfs-00053450-BALANCER-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"BALANCER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-BALANCER-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-BALANCER-BASE"}}, {"name"=>"hdfs-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-GATEWAY-BASE"}}, {"name"=>"hdfs-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-GATEWAY-BASE"}}, {"name"=>"hdfs-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-GATEWAY-BASE"}}, {"name"=>"hdfs-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-GATEWAY-BASE"}}, {"name"=>"hdfs-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-GATEWAY-BASE"}}, {"name"=>"hdfs-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "hostRef"=>{"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053450-GATEWAY-BASE"}}]}
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 INFO: ------------ Create ZOOKEEPER Service --------------
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: No configuration found in cluster for service ZOOKEEPER
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Request: {"items"=>[{"name"=>"zookeeper-00053450", "type"=>"ZOOKEEPER", "displayName"=>"zookeeper-00053450"}]}
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Response: {"items"=>[{"name"=>"zookeeper-00053450", "type"=>"ZOOKEEPER", "clusterRef"=>{"clusterName"=>"00053450"}, "serviceUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/zookeeper-00053450", "roleInstancesUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/zookeeper-00053450/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"zookeeper-00053450", "entityStatus"=>"UNKNOWN"}]}
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 INFO: ------------ Assign ZOOKEEPER Roles --------------
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: processing roletype: SERVER
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: No configuration found in cluster for service ZOOKEEPER, role SERVER
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: installing SERVER on master host(s)
18-Mar-2020 10:45:40 2020-03-18 10:45:40 +0000 DEBUG: Request: {"items"=>[{"type"=>"SERVER", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Response: {"items"=>[{"name"=>"zookeeper-00053450-SERVER-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"SERVER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"zookeeper-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/zookeeper-00053450-SERVER-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"zookeeper-00053450-SERVER-BASE"}}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 INFO: ------------ Create YARN Service --------------
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Request: {"items"=>[{"name"=>"yarn-00053450", "type"=>"YARN", "displayName"=>"yarn-00053450", "config"=>{"items"=>[{"name"=>"yarn_service_config_safety_valve", "value"=>"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Response: {"items"=>[{"name"=>"yarn-00053450", "type"=>"YARN", "clusterRef"=>{"clusterName"=>"00053450"}, "serviceUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/yarn-00053450", "roleInstancesUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/yarn-00053450/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"yarn-00053450", "entityStatus"=>"UNKNOWN"}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 INFO: ------------ Assign YARN Roles --------------
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: RESOURCEMANAGER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service YARN, role RESOURCEMANAGER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: installing RESOURCEMANAGER on master host(s)
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: NODEMANAGER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service YARN, role NODEMANAGER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: installing NODEMANAGER on slave hosts
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: JOBHISTORY
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service YARN, role JOBHISTORY
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: installing JOBHISTORY on master host(s)
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: GATEWAY
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service YARN, role GATEWAY
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: installing GATEWAY on all hosts
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Request: {"items"=>[{"type"=>"RESOURCEMANAGER", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"NODEMANAGER", "hostRef"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"type"=>"NODEMANAGER", "hostRef"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"type"=>"NODEMANAGER", "hostRef"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"type"=>"NODEMANAGER", "hostRef"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"type"=>"NODEMANAGER", "hostRef"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, {"type"=>"JOBHISTORY", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"GATEWAY", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"GATEWAY", "hostRef"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"type"=>"GATEWAY", "hostRef"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"type"=>"GATEWAY", "hostRef"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"type"=>"GATEWAY", "hostRef"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"type"=>"GATEWAY", "hostRef"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Response: {"items"=>[{"name"=>"yarn-00053450-RESOURCEMANAGER-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"RESOURCEMANAGER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-RESOURCEMANAGER-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-RESOURCEMANAGER-BASE"}}, {"name"=>"yarn-00053450-NODEMANAGER-5a6dce062bea4c299520ee2a01351eef", "type"=>"NODEMANAGER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-NODEMANAGER-5a6dce062bea4c299520ee2a01351eef", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-NODEMANAGER-BASE"}}, {"name"=>"yarn-00053450-NODEMANAGER-3e9b3375c7403224b94a4066bf32b5cf", "type"=>"NODEMANAGER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-NODEMANAGER-3e9b3375c7403224b94a4066bf32b5cf", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-NODEMANAGER-BASE"}}, {"name"=>"yarn-00053450-NODEMANAGER-6ed2a7a0ee32b950fade223c8139e0a6", "type"=>"NODEMANAGER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-NODEMANAGER-6ed2a7a0ee32b950fade223c8139e0a6", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-NODEMANAGER-BASE"}}, {"name"=>"yarn-00053450-NODEMANAGER-5d396519c75f9e0a944555cd9ff94471", "type"=>"NODEMANAGER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-NODEMANAGER-5d396519c75f9e0a944555cd9ff94471", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-NODEMANAGER-BASE"}}, {"name"=>"yarn-00053450-NODEMANAGER-9fbb277bb5e5c15e23ef1581a0dbd17e", "type"=>"NODEMANAGER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-NODEMANAGER-9fbb277bb5e5c15e23ef1581a0dbd17e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-NODEMANAGER-BASE"}}, {"name"=>"yarn-00053450-JOBHISTORY-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"JOBHISTORY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-JOBHISTORY-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-JOBHISTORY-BASE"}}, {"name"=>"yarn-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-GATEWAY-BASE"}}, {"name"=>"yarn-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-GATEWAY-BASE"}}, {"name"=>"yarn-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-GATEWAY-BASE"}}, {"name"=>"yarn-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-GATEWAY-BASE"}}, {"name"=>"yarn-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-GATEWAY-BASE"}}, {"name"=>"yarn-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}, "hostRef"=>{"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053450-GATEWAY-BASE"}}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 INFO: ------------ Create HBASE Service --------------
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Request: {"items"=>[{"name"=>"hbase-00053450", "type"=>"HBASE", "displayName"=>"hbase-00053450", "config"=>{"items"=>[{"name"=>"hbase_service_config_safety_valve", "value"=>"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"}]}}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase-00053450", "type"=>"HBASE", "clusterRef"=>{"clusterName"=>"00053450"}, "serviceUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/hbase-00053450", "roleInstancesUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/hbase-00053450/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"hbase-00053450", "entityStatus"=>"UNKNOWN"}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 INFO: ------------ Assign HBASE Roles --------------
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: MASTER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service HBASE, role MASTER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: installing MASTER on master host(s)
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: REGIONSERVER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service HBASE, role REGIONSERVER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: installing REGIONSERVER on slave hosts
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: GATEWAY
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service HBASE, role GATEWAY
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: installing GATEWAY on all hosts
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: HBASERESTSERVER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service HBASE, role HBASERESTSERVER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: HBASETHRIFTSERVER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service HBASE, role HBASETHRIFTSERVER
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Request: {"items"=>[{"type"=>"MASTER", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"REGIONSERVER", "hostRef"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"type"=>"REGIONSERVER", "hostRef"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"type"=>"REGIONSERVER", "hostRef"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"type"=>"REGIONSERVER", "hostRef"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"type"=>"REGIONSERVER", "hostRef"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, {"type"=>"GATEWAY", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"GATEWAY", "hostRef"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"type"=>"GATEWAY", "hostRef"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"type"=>"GATEWAY", "hostRef"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"type"=>"GATEWAY", "hostRef"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"type"=>"GATEWAY", "hostRef"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase-00053450-MASTER-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"MASTER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-MASTER-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-MASTER-BASE"}}, {"name"=>"hbase-00053450-REGIONSERVER-5a6dce062bea4c299520ee2a01351eef", "type"=>"REGIONSERVER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-REGIONSERVER-5a6dce062bea4c299520ee2a01351eef", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-REGIONSERVER-BASE"}}, {"name"=>"hbase-00053450-REGIONSERVER-3e9b3375c7403224b94a4066bf32b5cf", "type"=>"REGIONSERVER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-REGIONSERVER-3e9b3375c7403224b94a4066bf32b5cf", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-REGIONSERVER-BASE"}}, {"name"=>"hbase-00053450-REGIONSERVER-6ed2a7a0ee32b950fade223c8139e0a6", "type"=>"REGIONSERVER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-REGIONSERVER-6ed2a7a0ee32b950fade223c8139e0a6", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-REGIONSERVER-BASE"}}, {"name"=>"hbase-00053450-REGIONSERVER-5d396519c75f9e0a944555cd9ff94471", "type"=>"REGIONSERVER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-REGIONSERVER-5d396519c75f9e0a944555cd9ff94471", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-REGIONSERVER-BASE"}}, {"name"=>"hbase-00053450-REGIONSERVER-9fbb277bb5e5c15e23ef1581a0dbd17e", "type"=>"REGIONSERVER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-REGIONSERVER-9fbb277bb5e5c15e23ef1581a0dbd17e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-REGIONSERVER-BASE"}}, {"name"=>"hbase-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-GATEWAY-BASE"}}, {"name"=>"hbase-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-GATEWAY-BASE"}}, {"name"=>"hbase-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-GATEWAY-BASE"}}, {"name"=>"hbase-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-GATEWAY-BASE"}}, {"name"=>"hbase-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-GATEWAY-BASE"}}, {"name"=>"hbase-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}, "hostRef"=>{"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053450-GATEWAY-BASE"}}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 INFO: ------------ Create HIVE Service --------------
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service HIVE
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Request: {"items"=>[{"name"=>"hive-00053450", "type"=>"HIVE", "displayName"=>"hive-00053450"}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Response: {"items"=>[{"name"=>"hive-00053450", "type"=>"HIVE", "clusterRef"=>{"clusterName"=>"00053450"}, "serviceUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/hive-00053450", "roleInstancesUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/hive-00053450/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"hive-00053450", "entityStatus"=>"UNKNOWN"}]}
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 INFO: ------------ Assign HIVE Roles --------------
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: GATEWAY
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service HIVE, role GATEWAY
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: installing GATEWAY on all hosts
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: HIVEMETASTORE
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service HIVE, role HIVEMETASTORE
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: installing HIVEMETASTORE on master host(s)
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: WEBHCAT
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service HIVE, role WEBHCAT
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: processing roletype: HIVESERVER2
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: No configuration found in cluster for service HIVE, role HIVESERVER2
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: installing HIVESERVER2 on master host(s)
18-Mar-2020 10:45:41 2020-03-18 10:45:41 +0000 DEBUG: Request: {"items"=>[{"type"=>"GATEWAY", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"GATEWAY", "hostRef"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"type"=>"GATEWAY", "hostRef"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"type"=>"GATEWAY", "hostRef"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"type"=>"GATEWAY", "hostRef"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"type"=>"GATEWAY", "hostRef"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, {"type"=>"HIVEMETASTORE", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"HIVESERVER2", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Response: {"items"=>[{"name"=>"hive-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053450-GATEWAY-BASE"}}, {"name"=>"hive-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "hostRef"=>{"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053450-GATEWAY-BASE"}}, {"name"=>"hive-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "hostRef"=>{"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053450-GATEWAY-BASE"}}, {"name"=>"hive-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "hostRef"=>{"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053450-GATEWAY-BASE"}}, {"name"=>"hive-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "hostRef"=>{"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053450-GATEWAY-BASE"}}, {"name"=>"hive-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "hostRef"=>{"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053450-GATEWAY-BASE"}}, {"name"=>"hive-00053450-HIVEMETASTORE-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"HIVEMETASTORE", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053450-HIVEMETASTORE-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053450-HIVEMETASTORE-BASE"}}, {"name"=>"hive-00053450-HIVESERVER2-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"HIVESERVER2", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053450-HIVESERVER2-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053450-HIVESERVER2-BASE"}}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 INFO: ------------ Create SPARK_ON_YARN Service --------------
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: No configuration found in cluster for service SPARK_ON_YARN
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Request: {"items"=>[{"name"=>"spark_on_yarn-00053450", "type"=>"SPARK_ON_YARN", "displayName"=>"spark_on_yarn-00053450"}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Response: {"items"=>[{"name"=>"spark_on_yarn-00053450", "type"=>"SPARK_ON_YARN", "clusterRef"=>{"clusterName"=>"00053450"}, "serviceUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/spark_on_yarn-00053450", "roleInstancesUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/spark_on_yarn-00053450/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"spark_on_yarn-00053450", "entityStatus"=>"UNKNOWN"}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 INFO: ------------ Assign SPARK_ON_YARN Roles --------------
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: processing roletype: SPARK_YARN_HISTORY_SERVER
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: No configuration found in cluster for service SPARK_ON_YARN, role SPARK_YARN_HISTORY_SERVER
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: installing SPARK_YARN_HISTORY_SERVER on master host(s)
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: processing roletype: GATEWAY
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: No configuration found in cluster for service SPARK_ON_YARN, role GATEWAY
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: installing GATEWAY on all hosts
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Request: {"items"=>[{"type"=>"SPARK_YARN_HISTORY_SERVER", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"GATEWAY", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"GATEWAY", "hostRef"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"type"=>"GATEWAY", "hostRef"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"type"=>"GATEWAY", "hostRef"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"type"=>"GATEWAY", "hostRef"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"type"=>"GATEWAY", "hostRef"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Response: {"items"=>[{"name"=>"spar862005b2-SPARK_YARN_HISTORY_SERVER-7a49a9c326c4e038f79aa74c9", "type"=>"SPARK_YARN_HISTORY_SERVER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"spark_on_yarn-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/spar862005b2-SPARK_YARN_HISTORY_SERVER-7a49a9c326c4e038f79aa74c9", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark_on_yarn-00053450-SPARK_YARN_HISTORY_SERVER-BASE"}}, {"name"=>"spark_on_yarn-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"spark_on_yarn-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/spark_on_yarn-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark_on_yarn-00053450-GATEWAY-BASE"}}, {"name"=>"spark_on_yarn-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"spark_on_yarn-00053450"}, "hostRef"=>{"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/spark_on_yarn-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark_on_yarn-00053450-GATEWAY-BASE"}}, {"name"=>"spark_on_yarn-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"spark_on_yarn-00053450"}, "hostRef"=>{"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/spark_on_yarn-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark_on_yarn-00053450-GATEWAY-BASE"}}, {"name"=>"spark_on_yarn-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"spark_on_yarn-00053450"}, "hostRef"=>{"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/spark_on_yarn-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark_on_yarn-00053450-GATEWAY-BASE"}}, {"name"=>"spark_on_yarn-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"spark_on_yarn-00053450"}, "hostRef"=>{"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/spark_on_yarn-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark_on_yarn-00053450-GATEWAY-BASE"}}, {"name"=>"spark_on_yarn-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"spark_on_yarn-00053450"}, "hostRef"=>{"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/spark_on_yarn-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark_on_yarn-00053450-GATEWAY-BASE"}}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 INFO: ------------ Create CDAP Service --------------
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Request: {"items"=>[{"name"=>"cdap-00053450", "type"=>"CDAP", "displayName"=>"cdap-00053450", "config"=>{"items"=>[{"name"=>"enable_unrecoverable_reset", "value"=>"true"}, {"name"=>"security_authorization_extension_jar_path", "value"=>"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar"}, {"name"=>"cdap-site.xml_service_safety_valve", "value"=>"<property><name>security.authorization.extension.config.sentry.site.url</name><value>/etc/sentry/conf/sentry-site.xml</value></property><property><name>cdap.ugi.cache.expiration.ms</name><value>60000</value></property><property><name>cdap.http.client.read.timeout.ms</name><value>120000</value></property>"}, {"name"=>"security_authorization_cache_ttl_secs", "value"=>"3"}, {"name"=>"csd_compatibility_check_enabled", "value"=>"false"}]}}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Response: {"items"=>[{"name"=>"cdap-00053450", "type"=>"CDAP", "clusterRef"=>{"clusterName"=>"00053450"}, "serviceUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/cdap-00053450", "roleInstancesUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/cdap-00053450/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"cdap-00053450", "entityStatus"=>"UNKNOWN"}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 INFO: ------------ Assign CDAP Roles --------------
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: processing roletype: CDAP_ROUTER
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: No configuration found in cluster for service CDAP, role CDAP_ROUTER
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: installing CDAP_ROUTER on master host(s)
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: processing roletype: CDAP_KAFKA
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: No configuration found in cluster for service CDAP, role CDAP_KAFKA
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: installing CDAP_KAFKA on master host(s)
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: processing roletype: CDAP_MASTER
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: installing CDAP_MASTER on master host(s)
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: processing roletype: CDAP_UI
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: No configuration found in cluster for service CDAP, role CDAP_UI
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: installing CDAP_UI on master host(s)
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: processing roletype: CDAP_AUTH_SERVER
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: installing CDAP_AUTH_SERVER on master host(s)
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: processing roletype: GATEWAY
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: No configuration found in cluster for service CDAP, role GATEWAY
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: installing GATEWAY on all hosts
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Request: {"items"=>[{"type"=>"CDAP_ROUTER", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"CDAP_KAFKA", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"CDAP_MASTER", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e", "config"=>{"items"=>[{"name"=>"security_keytab_path", "value"=>"/etc/security/keytabs/${name}.headless.keytab"}]}}, {"type"=>"CDAP_UI", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"CDAP_AUTH_SERVER", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e", "config"=>{"items"=>[{"name"=>"security_authentication_handler_debug", "value"=>"true"}, {"name"=>"security_authentication_handler_hostname", "value"=>"10.240.24.141"}, {"name"=>"security_authentication_handler_port", "value"=>"389"}, {"name"=>"security_authentication_handler_userBaseDn", "value"=>"ou=people,dc=continuuity,dc=com"}, {"name"=>"security_authentication_handler_userObjectClass", "value"=>"inetorgperson"}, {"name"=>"security_authentication_handler_userRdnAttribute", "value"=>"cn"}, {"name"=>"security_authentication_loginmodule_className", "value"=>"co.cask.cdap.security.server.LDAPLoginModule"}, {"name"=>"security_authentication_handlerClassName", "value"=>"co.cask.cdap.security.server.BasicAuthenticationHandler"}, {"name"=>"security_authentication_basic_realmfile", "value"=>"/etc/security/realmfile"}]}}, {"type"=>"GATEWAY", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"type"=>"GATEWAY", "hostRef"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"type"=>"GATEWAY", "hostRef"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"type"=>"GATEWAY", "hostRef"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"type"=>"GATEWAY", "hostRef"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"type"=>"GATEWAY", "hostRef"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Response: {"items"=>[{"name"=>"cdap-00053450-CDAP_ROUTER-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"CDAP_ROUTER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053450-CDAP_ROUTER-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053450-CDAP_ROUTER-BASE"}}, {"name"=>"cdap-00053450-CDAP_KAFKA-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"CDAP_KAFKA", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053450-CDAP_KAFKA-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053450-CDAP_KAFKA-BASE"}}, {"name"=>"cdap-00053450-CDAP_MASTER-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"CDAP_MASTER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053450-CDAP_MASTER-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053450-CDAP_MASTER-BASE"}}, {"name"=>"cdap-00053450-CDAP_UI-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"CDAP_UI", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053450-CDAP_UI-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053450-CDAP_UI-BASE"}}, {"name"=>"cdap-00053450-CDAP_AUTH_SERVER-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"CDAP_AUTH_SERVER", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053450-CDAP_AUTH_SERVER-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053450-CDAP_AUTH_SERVER-BASE"}}, {"name"=>"cdap-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053450-GATEWAY-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053450-GATEWAY-BASE"}}, {"name"=>"cdap-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}, "hostRef"=>{"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053450-GATEWAY-5a6dce062bea4c299520ee2a01351eef", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053450-GATEWAY-BASE"}}, {"name"=>"cdap-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}, "hostRef"=>{"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053450-GATEWAY-3e9b3375c7403224b94a4066bf32b5cf", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053450-GATEWAY-BASE"}}, {"name"=>"cdap-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}, "hostRef"=>{"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053450-GATEWAY-6ed2a7a0ee32b950fade223c8139e0a6", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053450-GATEWAY-BASE"}}, {"name"=>"cdap-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}, "hostRef"=>{"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053450-GATEWAY-5d396519c75f9e0a944555cd9ff94471", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053450-GATEWAY-BASE"}}, {"name"=>"cdap-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}, "hostRef"=>{"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053450-GATEWAY-9fbb277bb5e5c15e23ef1581a0dbd17e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053450-GATEWAY-BASE"}}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 INFO: ------------ Create KMS Service --------------
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: No configuration found in cluster for service KMS
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Request: {"items"=>[{"name"=>"kms-00053450", "type"=>"KMS", "displayName"=>"kms-00053450"}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Response: {"items"=>[{"name"=>"kms-00053450", "type"=>"KMS", "clusterRef"=>{"clusterName"=>"00053450"}, "serviceUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/kms-00053450", "roleInstancesUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/serviceRedirect/kms-00053450/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"kms-00053450", "entityStatus"=>"UNKNOWN"}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 INFO: ------------ Assign KMS Roles --------------
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: processing roletype: KMS
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: No configuration found in cluster for service KMS, role KMS
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: installing KMS on master host(s)
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Request: {"items"=>[{"type"=>"KMS", "hostRef"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Response: {"items"=>[{"name"=>"kms-00053450-KMS-7a49a9c326c4e038f79aa74c9bf756b5", "type"=>"KMS", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"kms-00053450"}, "hostRef"=>{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, "roleUrl"=>"http://it-itc-cm512-738-53450-1000.coopr.sh:7180/cmf/roleRedirect/kms-00053450-KMS-7a49a9c326c4e038f79aa74c9bf756b5", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"kms-00053450-KMS-BASE"}}]}
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 INFO: ------------ Autoconfigure --------------
18-Mar-2020 10:45:42 2020-03-18 10:45:42 +0000 DEBUG: Request: clusters/00053450/autoConfigure
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 DEBUG: Response:
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 INFO: ------------ Configure any user-defined roleConfigGroups --------------
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 INFO: ------------ Configure yarn-00053450-NODEMANAGER-BASE for Cask Internal --------------
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 DEBUG: Request: {"items"=>[{"name"=>"container_executor_min_user_id", "value"=>"500"}]}
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 DEBUG: Response: {"items"=>[{"name"=>"container_executor_min_user_id", "value"=>"500"}, {"name"=>"node_manager_java_heapsize", "value"=>"1073741824"}, {"name"=>"yarn_nodemanager_heartbeat_interval_ms", "value"=>"100"}, {"name"=>"yarn_nodemanager_local_dirs", "value"=>"/yarn/nm"}, {"name"=>"yarn_nodemanager_log_dirs", "value"=>"/yarn/container-logs"}, {"name"=>"yarn_nodemanager_resource_cpu_vcores", "value"=>"8"}, {"name"=>"yarn_nodemanager_resource_memory_mb", "value"=>"8197"}]}
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 INFO: ------------ Configure yarn-00053450-RESOURCEMANAGER-BASE for Cask Internal --------------
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 DEBUG: Request: {"items"=>[{"name"=>"yarn_scheduler_minimum_allocation_mb", "value"=>"768"}]}
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 DEBUG: Response: {"items"=>[{"name"=>"resource_manager_java_heapsize", "value"=>"1073741824"}, {"name"=>"yarn_scheduler_maximum_allocation_mb", "value"=>"8197"}, {"name"=>"yarn_scheduler_maximum_allocation_vcores", "value"=>"8"}, {"name"=>"yarn_scheduler_minimum_allocation_mb", "value"=>"768"}]}
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 INFO: ------------ Configure yarn-00053450-GATEWAY-BASE for Cask Internal --------------
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 DEBUG: Request: {"items"=>[{"name"=>"yarn_client_config_safety_valve", "value"=>"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 DEBUG: Response: {"items"=>[{"name"=>"mapred_submit_replication", "value"=>"3"}, {"name"=>"yarn_client_config_safety_valve", "value"=>"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 INFO: ------------ Configure hdfs-00053450-GATEWAY-BASE for Cask Internal --------------
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 DEBUG: Request: {"items"=>[{"name"=>"hdfs_client_config_safety_valve", "value"=>"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 DEBUG: Response: {"items"=>[{"name"=>"dfs_client_use_trash", "value"=>"true"}, {"name"=>"hdfs_client_config_safety_valve", "value"=>"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 INFO: ------------ Configure hbase-00053450-GATEWAY-BASE for Cask Internal --------------
18-Mar-2020 10:45:43 2020-03-18 10:45:43 +0000 DEBUG: Request: {"items"=>[{"name"=>"hbase_client_config_safety_valve", "value"=>"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"}]}
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase_client_config_safety_valve", "value"=>"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"}]}
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 INFO: ------------ Configure Hive Server 2 for Cask Internal --------------
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 DEBUG: Request: {"items"=>[{"name"=>"hive_log_dir", "value"=>"/data/log/hive"}]}
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 DEBUG: Response: {"items"=>[{"name"=>"hive_log_dir", "value"=>"/data/log/hive"}, {"name"=>"hiveserver2_java_heapsize", "value"=>"1391460352"}]}
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 INFO: ------------ Configure HiveMetastoreDatabase --------------
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 DEBUG: Request: {"items"=>[{"name"=>"hive_metastore_database_host", "value"=>"it-itc-cm512-738-53450-1000.coopr.sh"}, {"name"=>"hive_metastore_database_name", "value"=>"hive00053450"}, {"name"=>"hive_metastore_database_user", "value"=>"hive00053450"}, {"name"=>"hive_metastore_database_password", "value"=>"somedefaultpassword"}, {"name"=>"hive_metastore_database_port", "value"=>"7432"}, {"name"=>"hive_metastore_database_type", "value"=>"postgresql"}, {"name"=>"sentry_metastore_service_users", "value"=>"hive,impala,hue,hdfs,cdap,cdapitn"}]}
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase_service", "value"=>"hbase-00053450"}, {"name"=>"hive_metastore_database_host", "value"=>"it-itc-cm512-738-53450-1000.coopr.sh"}, {"name"=>"hive_metastore_database_name", "value"=>"hive00053450"}, {"name"=>"hive_metastore_database_password", "value"=>"somedefaultpassword"}, {"name"=>"hive_metastore_database_port", "value"=>"7432"}, {"name"=>"hive_metastore_database_type", "value"=>"postgresql"}, {"name"=>"hive_metastore_database_user", "value"=>"hive00053450"}, {"name"=>"mapreduce_yarn_service", "value"=>"yarn-00053450"}, {"name"=>"sentry_metastore_service_users", "value"=>"hive,impala,hue,hdfs,cdap,cdapitn"}, {"name"=>"spark_on_yarn_service", "value"=>"spark_on_yarn-00053450"}, {"name"=>"zookeeper_service", "value"=>"zookeeper-00053450"}]}
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 INFO: ------------ Configure Hive Metastore for Cask Internal --------------
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 DEBUG: Request: {"items"=>[{"name"=>"hive_log_dir", "value"=>"/data/log/hive"}]}
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 DEBUG: Response: {"items"=>[{"name"=>"hive_log_dir", "value"=>"/data/log/hive"}, {"name"=>"hive_metastore_java_heapsize", "value"=>"1391460352"}, {"name"=>"hive_metastore_server_max_message_size", "value"=>"139146035"}]}
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 INFO: ------------ Create HiveMetastoreDatabase --------------
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 DEBUG: Request: clusters/00053450/services/hive-00053450/commands/hiveCreateMetastoreDatabase
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 DEBUG: Response: {"id"=>65, "name"=>"CreateHiveDatabase", "startTime"=>"2020-03-18T10:45:44.709Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}}
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 INFO: ------------ Wait for create HiveMetastoreDatabase --------------
18-Mar-2020 10:45:44 2020-03-18 10:45:44 +0000 INFO: Waiting for command 65 to complete
18-Mar-2020 10:45:51 ...
18-Mar-2020 10:45:51 2020-03-18 10:45:51 +0000 DEBUG: Response: {"id"=>65, "name"=>"CreateHiveDatabase", "startTime"=>"2020-03-18T10:45:44.709Z", "endTime"=>"2020-03-18T10:45:50.311Z", "active"=>false, "success"=>true, "resultMessage"=>"Created Hive Metastore Database.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "children"=>{"items"=>[]}, "canRetry"=>false}
18-Mar-2020 10:45:51 2020-03-18 10:45:51 +0000 INFO: ------------ Create HiveMetastoreDatabaseTables --------------
18-Mar-2020 10:45:51 2020-03-18 10:45:51 +0000 DEBUG: Request: clusters/00053450/services/hive-00053450/commands/hiveCreateMetastoreDatabaseTables
18-Mar-2020 10:45:52 2020-03-18 10:45:52 +0000 DEBUG: Response: {"id"=>66, "name"=>"HiveCreateMetastoreTablesServiceCommand", "startTime"=>"2020-03-18T10:45:51.256Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}}
18-Mar-2020 10:45:52 2020-03-18 10:45:52 +0000 INFO: ------------ Wait for create HiveMetastoreDatabaseTables --------------
18-Mar-2020 10:45:52 2020-03-18 10:45:52 +0000 INFO: Waiting for command 66 to complete
18-Mar-2020 10:46:04 ......
18-Mar-2020 10:46:04 2020-03-18 10:46:04 +0000 DEBUG: Response: {"id"=>66, "name"=>"HiveCreateMetastoreTablesServiceCommand", "startTime"=>"2020-03-18T10:45:51.256Z", "endTime"=>"2020-03-18T10:46:03.174Z", "active"=>false, "success"=>true, "resultMessage"=>"Created Hive Metastore Database Tables successfully.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "children"=>{"items"=>[{"id"=>67, "name"=>"HiveCreateMetastoreTables", "startTime"=>"2020-03-18T10:45:51.294Z", "endTime"=>"2020-03-18T10:46:03.169Z", "active"=>false, "success"=>true, "resultMessage"=>"Created Hive Metastore Database Tables successfully.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "roleRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450", "roleName"=>"hive-00053450-HIVEMETASTORE-7a49a9c326c4e038f79aa74c9bf756b5"}}]}, "canRetry"=>false}
18-Mar-2020 10:46:04 2020-03-18 10:46:04 +0000 INFO: ------------ Deploy Krb5.conf --------------
18-Mar-2020 10:46:04 2020-03-18 10:46:04 +0000 DEBUG: Request: clusters/00053450/commands/deployClusterClientConfig
18-Mar-2020 10:46:04 2020-03-18 10:46:04 +0000 DEBUG: Request Data: {"items"=>[{"hostId"=>"ee294935-4fd1-430c-b3cf-b29ff7f6625e"}, {"hostId"=>"6d43e6c5-4909-44da-97ec-a851157b5e6a"}, {"hostId"=>"4a3652ed-8c0a-41e9-858a-1f03cd24437e"}, {"hostId"=>"a44b8b01-a6ca-472b-b176-8921797ec3e0"}, {"hostId"=>"a476f7ff-ebbc-42e2-b417-09e2296baafb"}, {"hostId"=>"20419ca1-4bf3-448b-8a79-23c84562a8cd"}]}
18-Mar-2020 10:46:04 2020-03-18 10:46:04 +0000 DEBUG: Response: {"id"=>68, "name"=>"DeployClientConfigsOfCluster", "startTime"=>"2020-03-18T10:46:04.756Z", "active"=>true, "clusterRef"=>{"clusterName"=>"00053450"}}
18-Mar-2020 10:46:04 2020-03-18 10:46:04 +0000 INFO: ------------ Wait for Krb5.conf deploy --------------
18-Mar-2020 10:46:04 2020-03-18 10:46:04 +0000 INFO: Waiting for command 68 to complete
18-Mar-2020 10:46:21 ........
18-Mar-2020 10:46:21 2020-03-18 10:46:21 +0000 DEBUG: Response: {"id"=>68, "name"=>"DeployClientConfigsOfCluster", "startTime"=>"2020-03-18T10:46:04.756Z", "endTime"=>"2020-03-18T10:46:20.041Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed krb5.conf.", "clusterRef"=>{"clusterName"=>"00053450"}, "children"=>{"items"=>[{"id"=>69, "name"=>"ProcessStalenessSuccessWaitCommand", "startTime"=>"2020-03-18T10:46:04.757Z", "endTime"=>"2020-03-18T10:46:04.778Z", "active"=>false, "success"=>true, "resultMessage"=>"Configuration staleness computation completed."}]}, "canRetry"=>false}
18-Mar-2020 10:46:21 2020-03-18 10:46:21 +0000 INFO: ------------ Import KDC admin credentials --------------
18-Mar-2020 10:46:21 2020-03-18 10:46:21 +0000 DEBUG: Request: cm/commands/importAdminCredentials?username=cloudera-scm%2Fadmin%40CONTINUUITY.NET&password=********
18-Mar-2020 10:46:21 2020-03-18 10:46:21 +0000 DEBUG: Response: {"id"=>70, "name"=>"ImportCredentials", "startTime"=>"2020-03-18T10:46:21.156Z", "active"=>true, "children"=>{"items"=>[]}}
18-Mar-2020 10:46:21 2020-03-18 10:46:21 +0000 INFO: ------------ Wait for import admin credentials --------------
18-Mar-2020 10:46:21 2020-03-18 10:46:21 +0000 INFO: Waiting for command 70 to complete
18-Mar-2020 10:46:27 ...
18-Mar-2020 10:46:27 2020-03-18 10:46:27 +0000 DEBUG: Response: {"id"=>70, "name"=>"ImportCredentials", "startTime"=>"2020-03-18T10:46:21.156Z", "endTime"=>"2020-03-18T10:46:26.172Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully imported KDC Account Manager credentials.", "children"=>{"items"=>[]}, "canRetry"=>false}
18-Mar-2020 10:46:27 2020-03-18 10:46:27 +0000 INFO: ------------ Configure Cluster for Kerberos --------------
18-Mar-2020 10:46:27 2020-03-18 10:46:27 +0000 DEBUG: Request: {"datanodeTransceiverPort"=>"1004", "datanodeWebPort"=>"1006"}
18-Mar-2020 10:46:27 2020-03-18 10:46:27 +0000 DEBUG: Response: {"id"=>72, "name"=>"ConfigureForKerberos", "startTime"=>"2020-03-18T10:46:27.307Z", "endTime"=>"2020-03-18T10:46:27.309Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully configured the cluster for Kerberos.", "clusterRef"=>{"clusterName"=>"00053450"}}
18-Mar-2020 10:46:27 2020-03-18 10:46:27 +0000 INFO: ------------ Wait for Configure Cluster for Kerberos --------------
18-Mar-2020 10:46:27 2020-03-18 10:46:27 +0000 INFO: Waiting for command 72 to complete
18-Mar-2020 10:46:27
18-Mar-2020 10:46:27 2020-03-18 10:46:27 +0000 DEBUG: Response: {"id"=>72, "name"=>"ConfigureForKerberos", "startTime"=>"2020-03-18T10:46:27.307Z", "endTime"=>"2020-03-18T10:46:27.309Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully configured the cluster for Kerberos.", "clusterRef"=>{"clusterName"=>"00053450"}, "children"=>{"items"=>[]}, "canRetry"=>false}
18-Mar-2020 10:46:27 2020-03-18 10:46:27 +0000 INFO: ------------ Wait for Commands --------------
18-Mar-2020 10:46:27 2020-03-18 10:46:27 +0000 INFO: Waiting for global active GenerateCredentials commands to complete
18-Mar-2020 10:46:27 2020-03-18 10:46:27 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:29 .2020-03-18 10:46:29 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:31 .2020-03-18 10:46:31 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:33 .2020-03-18 10:46:33 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:35 .2020-03-18 10:46:35 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:37 .2020-03-18 10:46:37 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:39 .2020-03-18 10:46:39 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:41 .2020-03-18 10:46:41 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:43 .2020-03-18 10:46:43 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:45 .2020-03-18 10:46:45 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:47 .2020-03-18 10:46:47 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:49 .2020-03-18 10:46:49 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:51 .2020-03-18 10:46:51 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:53 .2020-03-18 10:46:53 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:55 .2020-03-18 10:46:55 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:46:58 .2020-03-18 10:46:58 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:47:00 .2020-03-18 10:47:00 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:47:02 .2020-03-18 10:47:02 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:47:04 .2020-03-18 10:47:04 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:47:06 .2020-03-18 10:47:06 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:47:08 .2020-03-18 10:47:08 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:47:10 .2020-03-18 10:47:10 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:47:12 .2020-03-18 10:47:12 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:47:14 .2020-03-18 10:47:14 +0000 DEBUG: Command result: {"items"=>[{"id"=>73, "name"=>"GenerateCredentials", "startTime"=>"2020-03-18T10:46:27.325Z", "active"=>true}]}
18-Mar-2020 10:47:16 .2020-03-18 10:47:16 +0000 DEBUG: Command result: {"items"=>[]}
18-Mar-2020 10:47:16
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 INFO: ------------ Configure Yarn for Secure CDAP Requirements --------------
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 DEBUG: Request: {"items"=>[{"name"=>"container_executor_allowed_system_users", "value"=>"nobody,impala,hive,llama,cdap"}, {"name"=>"yarn_nodemanager_delete_debug_delay_sec", "value"=>"43200"}]}
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 DEBUG: Response: {"items"=>[{"name"=>"container_executor_allowed_system_users", "value"=>"nobody,impala,hive,llama,cdap"}, {"name"=>"container_executor_min_user_id", "value"=>"500"}, {"name"=>"node_manager_java_heapsize", "value"=>"1073741824"}, {"name"=>"yarn_nodemanager_delete_debug_delay_sec", "value"=>"43200"}, {"name"=>"yarn_nodemanager_heartbeat_interval_ms", "value"=>"100"}, {"name"=>"yarn_nodemanager_local_dirs", "value"=>"/yarn/nm"}, {"name"=>"yarn_nodemanager_log_dirs", "value"=>"/yarn/container-logs"}, {"name"=>"yarn_nodemanager_resource_cpu_vcores", "value"=>"8"}, {"name"=>"yarn_nodemanager_resource_memory_mb", "value"=>"8197"}]}
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 INFO: ------------ Configure HBase for Secure CDAP --------------
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 DEBUG: Request: {"items"=>[{"name"=>"hbase_superuser", "value"=>"cdap"}]}
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase_security_authentication", "value"=>"kerberos"}, {"name"=>"hbase_security_authorization", "value"=>"true"}, {"name"=>"hbase_service_config_safety_valve", "value"=>"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"}, {"name"=>"hbase_superuser", "value"=>"cdap"}, {"name"=>"hbase_thriftserver_security_authentication", "value"=>"auth-conf"}, {"name"=>"hdfs_service", "value"=>"hdfs-00053450"}, {"name"=>"zookeeper_service", "value"=>"zookeeper-00053450"}]}
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 INFO: ------------ Configure Zookeeper for Cask Internal --------------
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 DEBUG: Request: {"items"=>[{"name"=>"zk_server_log_dir", "value"=>"/data/log/zookeeper"}, {"name"=>"dataDir", "value"=>"/data/zookeeper"}, {"name"=>"dataLogDir", "value"=>"/data/zookeeper"}, {"name"=>"maxClientCnxns", "value"=>"0"}]}
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 DEBUG: Response: {"items"=>[{"name"=>"dataDir", "value"=>"/data/zookeeper"}, {"name"=>"dataLogDir", "value"=>"/data/zookeeper"}, {"name"=>"maxClientCnxns", "value"=>"0"}, {"name"=>"maxSessionTimeout", "value"=>"60000"}, {"name"=>"zk_server_log_dir", "value"=>"/data/log/zookeeper"}, {"name"=>"zookeeper_server_java_heapsize", "value"=>"1073741824"}]}
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 INFO: ------------ Start CM Management Services --------------
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 DEBUG: Request: cm/service/commands/start
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 DEBUG: Response: {"id"=>80, "name"=>"Start", "startTime"=>"2020-03-18T10:47:16.504Z", "active"=>true, "serviceRef"=>{"serviceName"=>"mgmt"}}
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 INFO: ------------ Wait for Management Services --------------
18-Mar-2020 10:47:16 2020-03-18 10:47:16 +0000 INFO: Waiting for command 80 to complete
18-Mar-2020 10:47:39 ...........
18-Mar-2020 10:47:39 2020-03-18 10:47:39 +0000 DEBUG: Response: {"id"=>80, "name"=>"Start", "startTime"=>"2020-03-18T10:47:16.504Z", "endTime"=>"2020-03-18T10:47:39.158Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"serviceName"=>"mgmt"}, "children"=>{"items"=>[{"id"=>82, "name"=>"Start", "startTime"=>"2020-03-18T10:47:16.660Z", "endTime"=>"2020-03-18T10:47:39.153Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"serviceName"=>"mgmt"}, "roleRef"=>{"serviceName"=>"mgmt", "roleName"=>"mgmt-ALERTPUBLISHER-7a49a9c326c4e038f79aa74c9bf756b5"}}, {"id"=>83, "name"=>"Start", "startTime"=>"2020-03-18T10:47:16.723Z", "endTime"=>"2020-03-18T10:47:39.153Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"serviceName"=>"mgmt"}, "roleRef"=>{"serviceName"=>"mgmt", "roleName"=>"mgmt-HOSTMONITOR-7a49a9c326c4e038f79aa74c9bf756b5"}}, {"id"=>81, "name"=>"Start", "startTime"=>"2020-03-18T10:47:16.513Z", "endTime"=>"2020-03-18T10:47:39.147Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"serviceName"=>"mgmt"}, "roleRef"=>{"serviceName"=>"mgmt", "roleName"=>"mgmt-SERVICEMONITOR-7a49a9c326c4e038f79aa74c9bf756b5"}}, {"id"=>84, "name"=>"Start", "startTime"=>"2020-03-18T10:47:16.813Z", "endTime"=>"2020-03-18T10:47:39.153Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"serviceName"=>"mgmt"}, "roleRef"=>{"serviceName"=>"mgmt", "roleName"=>"mgmt-EVENTSERVER-7a49a9c326c4e038f79aa74c9bf756b5"}}]}, "canRetry"=>false}
18-Mar-2020 10:47:39 2020-03-18 10:47:39 +0000 INFO: ------------ Start ZOOKEEPER FirstRun --------------
18-Mar-2020 10:47:39 2020-03-18 10:47:39 +0000 DEBUG: Request: clusters/00053450/services/zookeeper-00053450/commands/firstRun
18-Mar-2020 10:47:39 2020-03-18 10:47:39 +0000 DEBUG: Response: {"id"=>87, "name"=>"First Run", "startTime"=>"2020-03-18T10:47:39.478Z", "active"=>true, "children"=>{"items"=>[]}}
18-Mar-2020 10:47:39 2020-03-18 10:47:39 +0000 INFO: ------------ Wait for ZOOKEEPER FirstRun --------------
18-Mar-2020 10:47:39 2020-03-18 10:47:39 +0000 INFO: Waiting for command 87 to complete
18-Mar-2020 10:48:03 ............
18-Mar-2020 10:48:03 2020-03-18 10:48:03 +0000 DEBUG: Response: {"id"=>87, "name"=>"First Run", "startTime"=>"2020-03-18T10:47:39.478Z", "endTime"=>"2020-03-18T10:48:03.648Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished First Run of the following services successfully: zookeeper-00053450.", "children"=>{"items"=>[{"id"=>89, "name"=>"ServiceWaitCommand", "startTime"=>"2020-03-18T10:47:39.553Z", "endTime"=>"2020-03-18T10:47:39.587Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"zookeeper-00053450"}}, {"id"=>88, "name"=>"GlobalWait", "startTime"=>"2020-03-18T10:47:39.528Z", "endTime"=>"2020-03-18T10:47:39.541Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}, {"id"=>90, "name"=>"ZkInit", "startTime"=>"2020-03-18T10:47:39.604Z", "endTime"=>"2020-03-18T10:47:41.370Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully initialized ZooKeeper.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"zookeeper-00053450"}, "roleRef"=>{"clusterName"=>"00053450", "serviceName"=>"zookeeper-00053450", "roleName"=>"zookeeper-00053450-SERVER-7a49a9c326c4e038f79aa74c9bf756b5"}}, {"id"=>92, "name"=>"ZkStartPreservingDatastore", "startTime"=>"2020-03-18T10:47:41.403Z", "endTime"=>"2020-03-18T10:48:03.647Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully completed 1 steps.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"zookeeper-00053450"}}]}, "canRetry"=>false}
18-Mar-2020 10:48:03 2020-03-18 10:48:03 +0000 INFO: ------------ Configure HDFS hdfs-00053450-DATANODE-BASE for Cask Internal --------------
18-Mar-2020 10:48:03 2020-03-18 10:48:03 +0000 DEBUG: Request: {"items"=>[{"name"=>"datanode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
18-Mar-2020 10:48:03 2020-03-18 10:48:03 +0000 DEBUG: Response: {"items"=>[{"name"=>"datanode_java_heapsize", "value"=>"1073741824"}, {"name"=>"datanode_log_dir", "value"=>"/data/log/hadoop-hdfs"}, {"name"=>"dfs_data_dir_list", "value"=>"/dfs/dn"}, {"name"=>"dfs_datanode_data_dir_perm", "value"=>"700"}, {"name"=>"dfs_datanode_du_reserved", "value"=>"10737418240"}, {"name"=>"dfs_datanode_failed_volumes_tolerated", "value"=>"0"}, {"name"=>"dfs_datanode_http_port", "value"=>"1006"}, {"name"=>"dfs_datanode_max_locked_memory", "value"=>"4294967296"}, {"name"=>"dfs_datanode_port", "value"=>"1004"}]}
18-Mar-2020 10:48:03 2020-03-18 10:48:03 +0000 INFO: ------------ Configure HDFS hdfs-00053450-FAILOVERCONTROLLER-BASE for Cask Internal --------------
18-Mar-2020 10:48:03 2020-03-18 10:48:03 +0000 DEBUG: Request: {"items"=>[{"name"=>"failover_controller_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Response: {"items"=>[{"name"=>"failover_controller_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 INFO: ------------ Configure HDFS hdfs-00053450-HTTPFS-BASE for Cask Internal --------------
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Request: {"items"=>[{"name"=>"httpfs_log_dir", "value"=>"/data/log/hadoop-httpfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Response: {"items"=>[{"name"=>"httpfs_log_dir", "value"=>"/data/log/hadoop-httpfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 INFO: ------------ Configure HDFS hdfs-00053450-JOURNALNODE-BASE for Cask Internal --------------
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Request: {"items"=>[{"name"=>"journalnode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Response: {"items"=>[{"name"=>"journalnode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 INFO: ------------ Configure HDFS hdfs-00053450-NFSGATEWAY-BASE for Cask Internal --------------
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Request: {"items"=>[{"name"=>"nfsgateway_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Response: {"items"=>[{"name"=>"nfsgateway_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 INFO: ------------ Configure HDFS hdfs-00053450-NAMENODE-BASE for Cask Internal --------------
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Request: {"items"=>[{"name"=>"namenode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Response: {"items"=>[{"name"=>"dfs_name_dir_list", "value"=>"/dfs/nn"}, {"name"=>"dfs_namenode_handler_count", "value"=>"32"}, {"name"=>"dfs_namenode_service_handler_count", "value"=>"32"}, {"name"=>"dfs_namenode_servicerpc_address", "value"=>"8022"}, {"name"=>"namenode_java_heapsize", "value"=>"1391460352"}, {"name"=>"namenode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 INFO: ------------ Configure HDFS hdfs-00053450-SECONDARYNAMENODE-BASE for Cask Internal --------------
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Request: {"items"=>[{"name"=>"secondarynamenode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Response: {"items"=>[{"name"=>"fs_checkpoint_dir_list", "value"=>"/dfs/snn"}, {"name"=>"secondary_namenode_java_heapsize", "value"=>"1391460352"}, {"name"=>"secondarynamenode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 INFO: ------------ Start HDFS FirstRun --------------
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Request: clusters/00053450/services/hdfs-00053450/commands/firstRun
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 DEBUG: Response: {"id"=>104, "name"=>"First Run", "startTime"=>"2020-03-18T10:48:04.682Z", "active"=>true, "children"=>{"items"=>[]}}
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 INFO: ------------ Wait for HDFS FirstRun --------------
18-Mar-2020 10:48:04 2020-03-18 10:48:04 +0000 INFO: Waiting for command 104 to complete
18-Mar-2020 10:49:28 .........................................
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 DEBUG: Response: {"id"=>104, "name"=>"First Run", "startTime"=>"2020-03-18T10:48:04.682Z", "endTime"=>"2020-03-18T10:49:28.129Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished First Run of the following services successfully: hdfs-00053450.", "children"=>{"items"=>[{"id"=>112, "name"=>"GlobalWait", "startTime"=>"2020-03-18T10:48:22.156Z", "endTime"=>"2020-03-18T10:48:22.187Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}, {"id"=>116, "name"=>"Format", "startTime"=>"2020-03-18T10:48:44.552Z", "endTime"=>"2020-03-18T10:48:49.633Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully formatted NameNode.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "roleRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450", "roleName"=>"hdfs-00053450-NAMENODE-7a49a9c326c4e038f79aa74c9bf756b5"}}, {"id"=>118, "name"=>"HdfsStartWithFailovers", "startTime"=>"2020-03-18T10:48:49.650Z", "endTime"=>"2020-03-18T10:49:12.298Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started HDFS service", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}}, {"id"=>105, "name"=>"DeployClusterClientConfig", "startTime"=>"2020-03-18T10:48:04.854Z", "endTime"=>"2020-03-18T10:48:22.155Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed all client configurations.", "clusterRef"=>{"clusterName"=>"00053450"}}, {"id"=>113, "name"=>"Start", "startTime"=>"2020-03-18T10:48:22.195Z", "endTime"=>"2020-03-18T10:48:44.538Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"kms-00053450"}}, {"id"=>131, "name"=>"CreateTmp", "startTime"=>"2020-03-18T10:49:12.313Z", "endTime"=>"2020-03-18T10:49:28.123Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory /tmp.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450"}, "roleRef"=>{"clusterName"=>"00053450", "serviceName"=>"hdfs-00053450", "roleName"=>"hdfs-00053450-NAMENODE-7a49a9c326c4e038f79aa74c9bf756b5"}}]}, "canRetry"=>false}
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 INFO: ------------ Configure Yarn for Cask Internal --------------
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 DEBUG: Request: {"items"=>[{"name"=>"yarn_application_classpath", "value"=>"$HADOOP_CLIENT_CONF_DIR,$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*,$HADOOP_HDFS_HOME/*,$HADOOP_HDFS_HOME/lib/*,$HADOOP_YARN_HOME/*,$HADOOP_YARN_HOME/lib/*,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*,$MR2_CLASSPATH"}]}
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 DEBUG: Response: {"items"=>[{"name"=>"hdfs_service", "value"=>"hdfs-00053450"}, {"name"=>"yarn_application_classpath", "value"=>"$HADOOP_CLIENT_CONF_DIR,$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*,$HADOOP_HDFS_HOME/*,$HADOOP_HDFS_HOME/lib/*,$HADOOP_YARN_HOME/*,$HADOOP_YARN_HOME/lib/*,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*,$MR2_CLASSPATH"}, {"name"=>"yarn_service_config_safety_valve", "value"=>"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}, {"name"=>"zookeeper_service", "value"=>"zookeeper-00053450"}]}
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 INFO: ------------ Configure Yarn RM for Cask Internal --------------
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 DEBUG: Request: {"items"=>[{"name"=>"resource_manager_log_dir", "value"=>"/data/log/hadoop-yarn"}]}
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 DEBUG: Response: {"items"=>[{"name"=>"resource_manager_java_heapsize", "value"=>"1073741824"}, {"name"=>"resource_manager_log_dir", "value"=>"/data/log/hadoop-yarn"}, {"name"=>"yarn_scheduler_maximum_allocation_mb", "value"=>"8197"}, {"name"=>"yarn_scheduler_maximum_allocation_vcores", "value"=>"8"}, {"name"=>"yarn_scheduler_minimum_allocation_mb", "value"=>"768"}]}
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 INFO: ------------ Configure Yarn NM for Cask Internal --------------
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 DEBUG: Request: {"items"=>[{"name"=>"yarn_nodemanager_log_dirs", "value"=>"/data/log/hadoop-yarn/container"}, {"name"=>"yarn_nodemanager_recovery_dir", "value"=>"/data/yarn/yarn-nm-recovery"}, {"name"=>"node_manager_log_dir", "value"=>"/data/log/hadoop-yarn"}, {"name"=>"yarn_nodemanager_resource_cpu_vcores", "value"=>"32"}]}
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 DEBUG: Response: {"items"=>[{"name"=>"container_executor_allowed_system_users", "value"=>"nobody,impala,hive,llama,cdap"}, {"name"=>"container_executor_min_user_id", "value"=>"500"}, {"name"=>"node_manager_java_heapsize", "value"=>"1073741824"}, {"name"=>"node_manager_log_dir", "value"=>"/data/log/hadoop-yarn"}, {"name"=>"yarn_nodemanager_delete_debug_delay_sec", "value"=>"43200"}, {"name"=>"yarn_nodemanager_heartbeat_interval_ms", "value"=>"100"}, {"name"=>"yarn_nodemanager_local_dirs", "value"=>"/yarn/nm"}, {"name"=>"yarn_nodemanager_log_dirs", "value"=>"/data/log/hadoop-yarn/container"}, {"name"=>"yarn_nodemanager_recovery_dir", "value"=>"/data/yarn/yarn-nm-recovery"}, {"name"=>"yarn_nodemanager_resource_cpu_vcores", "value"=>"32"}, {"name"=>"yarn_nodemanager_resource_memory_mb", "value"=>"8197"}]}
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 INFO: ------------ Configure Yarn JHS for Cask Internal --------------
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 DEBUG: Request: {"items"=>[{"name"=>"mr2_jobhistory_log_dir", "value"=>"/data/log/hadoop-mapreduce"}]}
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 DEBUG: Response: {"items"=>[{"name"=>"mr2_jobhistory_java_heapsize", "value"=>"1073741824"}, {"name"=>"mr2_jobhistory_log_dir", "value"=>"/data/log/hadoop-mapreduce"}]}
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 INFO: ------------ Configure Yarn Gateway for Cask Internal --------------
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 DEBUG: Request: {"items"=>[{"name"=>"mapreduce_map_java_opts_max_heap", "value"=>"402653184"}, {"name"=>"mapreduce_reduce_java_opts_max_heap", "value"=>"402653184"}, {"name"=>"io_sort_mb", "value"=>"100"}]}
18-Mar-2020 10:49:28 2020-03-18 10:49:28 +0000 DEBUG: Response: {"items"=>[{"name"=>"io_sort_mb", "value"=>"100"}, {"name"=>"mapred_submit_replication", "value"=>"3"}, {"name"=>"mapreduce_map_java_opts_max_heap", "value"=>"402653184"}, {"name"=>"mapreduce_reduce_java_opts_max_heap", "value"=>"402653184"}, {"name"=>"yarn_client_config_safety_valve", "value"=>"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}
18-Mar-2020 10:49:30 2020-03-18 10:49:30 +0000 INFO: ------------ Start YARN FirstRun --------------
18-Mar-2020 10:49:30 2020-03-18 10:49:30 +0000 DEBUG: Request: clusters/00053450/services/yarn-00053450/commands/firstRun
18-Mar-2020 10:49:30 2020-03-18 10:49:30 +0000 DEBUG: Response: {"id"=>138, "name"=>"First Run", "startTime"=>"2020-03-18T10:49:30.610Z", "active"=>true, "children"=>{"items"=>[]}}
18-Mar-2020 10:49:30 2020-03-18 10:49:30 +0000 INFO: ------------ Wait for YARN FirstRun --------------
18-Mar-2020 10:49:30 2020-03-18 10:49:30 +0000 INFO: Waiting for command 138 to complete
18-Mar-2020 10:50:17 .......................
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 DEBUG: Response: {"id"=>138, "name"=>"First Run", "startTime"=>"2020-03-18T10:49:30.610Z", "endTime"=>"2020-03-18T10:50:16.170Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished First Run of the following services successfully: yarn-00053450.", "children"=>{"items"=>[{"id"=>151, "name"=>"Start", "startTime"=>"2020-03-18T10:49:53.331Z", "endTime"=>"2020-03-18T10:50:16.169Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}}, {"id"=>148, "name"=>"CreateHistoryDir", "startTime"=>"2020-03-18T10:49:47.720Z", "endTime"=>"2020-03-18T10:49:52.132Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}}, {"id"=>147, "name"=>"GlobalWait", "startTime"=>"2020-03-18T10:49:47.673Z", "endTime"=>"2020-03-18T10:49:47.690Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}, {"id"=>149, "name"=>"CreateLogDir", "startTime"=>"2020-03-18T10:49:47.809Z", "endTime"=>"2020-03-18T10:49:53.312Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"yarn-00053450"}}, {"id"=>139, "name"=>"DeployClusterClientConfig", "startTime"=>"2020-03-18T10:49:30.699Z", "endTime"=>"2020-03-18T10:49:47.673Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed all client configurations.", "clusterRef"=>{"clusterName"=>"00053450"}}]}, "canRetry"=>false}
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 INFO: ------------ Configure HBase Master for Cask Internal --------------
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 DEBUG: Request: {"items"=>[{"name"=>"hbase_master_log_dir", "value"=>"/data/log/hbase"}]}
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase_master_java_heapsize", "value"=>"1073741824"}, {"name"=>"hbase_master_log_dir", "value"=>"/data/log/hbase"}]}
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 INFO: ------------ Configure HBase Regionserver for Cask Internal --------------
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 DEBUG: Request: {"items"=>[{"name"=>"hbase_regionserver_log_dir", "value"=>"/data/log/hbase"}]}
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase_bucketcache_size", "value"=>"1024"}, {"name"=>"hbase_regionserver_java_heapsize", "value"=>"6611271680"}, {"name"=>"hbase_regionserver_log_dir", "value"=>"/data/log/hbase"}]}
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 INFO: ------------ Start HBASE FirstRun --------------
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 DEBUG: Request: clusters/00053450/services/hbase-00053450/commands/firstRun
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 DEBUG: Response: {"id"=>166, "name"=>"First Run", "startTime"=>"2020-03-18T10:50:17.810Z", "active"=>true, "children"=>{"items"=>[]}}
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 INFO: ------------ Wait for HBASE FirstRun --------------
18-Mar-2020 10:50:17 2020-03-18 10:50:17 +0000 INFO: Waiting for command 166 to complete
18-Mar-2020 10:50:48 ...............
18-Mar-2020 10:50:48 2020-03-18 10:50:48 +0000 DEBUG: Response: {"id"=>166, "name"=>"First Run", "startTime"=>"2020-03-18T10:50:17.810Z", "endTime"=>"2020-03-18T10:50:47.890Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished First Run of the following services successfully: hbase-00053450.", "children"=>{"items"=>[{"id"=>174, "name"=>"GlobalWait", "startTime"=>"2020-03-18T10:50:20.349Z", "endTime"=>"2020-03-18T10:50:20.368Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}, {"id"=>167, "name"=>"DeployClusterClientConfig", "startTime"=>"2020-03-18T10:50:18.047Z", "endTime"=>"2020-03-18T10:50:20.349Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed all client configurations.", "clusterRef"=>{"clusterName"=>"00053450"}}, {"id"=>177, "name"=>"Start", "startTime"=>"2020-03-18T10:50:25.228Z", "endTime"=>"2020-03-18T10:50:47.889Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}}, {"id"=>175, "name"=>"CreateRootDir", "startTime"=>"2020-03-18T10:50:20.386Z", "endTime"=>"2020-03-18T10:50:25.203Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hbase-00053450"}}]}, "canRetry"=>false}
18-Mar-2020 10:50:48 2020-03-18 10:50:48 +0000 INFO: ------------ Start SPARK_ON_YARN FirstRun --------------
18-Mar-2020 10:50:48 2020-03-18 10:50:48 +0000 DEBUG: Request: clusters/00053450/services/spark_on_yarn-00053450/commands/firstRun
18-Mar-2020 10:50:48 2020-03-18 10:50:48 +0000 DEBUG: Response: {"id"=>189, "name"=>"First Run", "startTime"=>"2020-03-18T10:50:48.457Z", "active"=>true, "children"=>{"items"=>[]}}
18-Mar-2020 10:50:48 2020-03-18 10:50:48 +0000 INFO: ------------ Wait for SPARK_ON_YARN FirstRun --------------
18-Mar-2020 10:50:48 2020-03-18 10:50:48 +0000 INFO: Waiting for command 189 to complete
18-Mar-2020 10:51:25 ..................
18-Mar-2020 10:51:25 2020-03-18 10:51:25 +0000 DEBUG: Response: {"id"=>189, "name"=>"First Run", "startTime"=>"2020-03-18T10:50:48.457Z", "endTime"=>"2020-03-18T10:51:24.349Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished First Run of the following services successfully: spark_on_yarn-00053450.", "children"=>{"items"=>[{"id"=>205, "name"=>"Start", "startTime"=>"2020-03-18T10:51:02.051Z", "endTime"=>"2020-03-18T10:51:24.348Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"spark_on_yarn-00053450"}}, {"id"=>198, "name"=>"CreateSparkUserDirCommand", "startTime"=>"2020-03-18T10:50:50.596Z", "endTime"=>"2020-03-18T10:50:55.282Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"spark_on_yarn-00053450"}}, {"id"=>200, "name"=>"CreateSparkHistoryDirCommand", "startTime"=>"2020-03-18T10:50:55.296Z", "endTime"=>"2020-03-18T10:50:59.975Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"spark_on_yarn-00053450"}}, {"id"=>190, "name"=>"DeployClusterClientConfig", "startTime"=>"2020-03-18T10:50:48.577Z", "endTime"=>"2020-03-18T10:50:50.555Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed all client configurations.", "clusterRef"=>{"clusterName"=>"00053450"}}, {"id"=>202, "name"=>"SparkUploadJarServiceCommand", "startTime"=>"2020-03-18T10:50:59.984Z", "endTime"=>"2020-03-18T10:51:02.022Z", "active"=>false, "success"=>true, "resultMessage"=>"Command Install Spark JAR finished successfully on service spark_on_yarn-00053450.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"spark_on_yarn-00053450"}}, {"id"=>197, "name"=>"GlobalWait", "startTime"=>"2020-03-18T10:50:50.556Z", "endTime"=>"2020-03-18T10:50:50.573Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}]}, "canRetry"=>false}
18-Mar-2020 10:51:25 2020-03-18 10:51:25 +0000 INFO: ------------ Start HIVE FirstRun --------------
18-Mar-2020 10:51:25 2020-03-18 10:51:25 +0000 DEBUG: Request: clusters/00053450/services/hive-00053450/commands/firstRun
18-Mar-2020 10:51:25 2020-03-18 10:51:25 +0000 DEBUG: Response: {"id"=>210, "name"=>"First Run", "startTime"=>"2020-03-18T10:51:25.303Z", "active"=>true, "children"=>{"items"=>[]}}
18-Mar-2020 10:51:25 2020-03-18 10:51:25 +0000 INFO: ------------ Wait for HIVE FirstRun --------------
18-Mar-2020 10:51:25 2020-03-18 10:51:25 +0000 INFO: Waiting for command 210 to complete
18-Mar-2020 10:52:14 ........................
18-Mar-2020 10:52:14 2020-03-18 10:52:14 +0000 DEBUG: Response: {"id"=>210, "name"=>"First Run", "startTime"=>"2020-03-18T10:51:25.303Z", "endTime"=>"2020-03-18T10:52:12.464Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished First Run of the following services successfully: hive-00053450.", "children"=>{"items"=>[{"id"=>219, "name"=>"HiveCreateMetastoreTables", "startTime"=>"2020-03-18T10:51:27.178Z", "endTime"=>"2020-03-18T10:51:30.308Z", "active"=>false, "success"=>true, "resultMessage"=>"Created Hive Metastore Database Tables successfully.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "roleRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450", "roleName"=>"hive-00053450-HIVEMETASTORE-7a49a9c326c4e038f79aa74c9bf756b5"}}, {"id"=>225, "name"=>"CreateHiveWarehouseDir", "startTime"=>"2020-03-18T10:51:44.925Z", "endTime"=>"2020-03-18T10:51:49.870Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}}, {"id"=>223, "name"=>"CreateHiveUserDir", "startTime"=>"2020-03-18T10:51:39.995Z", "endTime"=>"2020-03-18T10:51:44.898Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}}, {"id"=>211, "name"=>"DeployClusterClientConfig", "startTime"=>"2020-03-18T10:51:25.377Z", "endTime"=>"2020-03-18T10:51:27.112Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed all client configurations.", "clusterRef"=>{"clusterName"=>"00053450"}}, {"id"=>228, "name"=>"Start", "startTime"=>"2020-03-18T10:51:49.956Z", "endTime"=>"2020-03-18T10:52:12.464Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}}, {"id"=>221, "name"=>"HiveValidateMetastore", "startTime"=>"2020-03-18T10:51:30.335Z", "endTime"=>"2020-03-18T10:51:39.975Z", "active"=>false, "success"=>true, "resultMessage"=>"Validated Hive Metastore Schema successfully.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450"}, "roleRef"=>{"clusterName"=>"00053450", "serviceName"=>"hive-00053450", "roleName"=>"hive-00053450-HIVEMETASTORE-7a49a9c326c4e038f79aa74c9bf756b5"}}, {"id"=>218, "name"=>"GlobalWait", "startTime"=>"2020-03-18T10:51:27.112Z", "endTime"=>"2020-03-18T10:51:27.136Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}]}, "canRetry"=>false}
18-Mar-2020 10:52:14 2020-03-18 10:52:14 +0000 INFO: ------------ Configure CDAP Service --------------
18-Mar-2020 10:52:14 2020-03-18 10:52:14 +0000 DEBUG: Request: {"items"=>[{"name"=>"security_store_provider", "value"=>"kms"}, {"name"=>"cdap-site.xml_service_safety_valve", "value"=>"<property><name>security.authorization.extension.config.sentry.site.url</name><value>/etc/sentry/conf/sentry-site.xml</value></property><property><name>cdap.ugi.cache.expiration.ms</name><value>60000</value></property><property><name>cdap.http.client.read.timeout.ms</name><value>120000</value></property><property><name>hive.server2.jdbc.url</name><value>jdbc:hive2://it-itc-cm512-738-53450-1000.coopr.sh:10000/default;principal=hive/_HOST@CONTINUUITY.NET</value></property>"}]}
18-Mar-2020 10:52:14 2020-03-18 10:52:14 +0000 DEBUG: Response {"items"=>[{"name"=>"cdap-site.xml_service_safety_valve", "value"=>"<property><name>security.authorization.extension.config.sentry.site.url</name><value>/etc/sentry/conf/sentry-site.xml</value></property><property><name>cdap.ugi.cache.expiration.ms</name><value>60000</value></property><property><name>cdap.http.client.read.timeout.ms</name><value>120000</value></property><property><name>hive.server2.jdbc.url</name><value>jdbc:hive2://it-itc-cm512-738-53450-1000.coopr.sh:10000/default;principal=hive/_HOST@CONTINUUITY.NET</value></property>"}, {"name"=>"csd_compatibility_check_enabled", "value"=>"false"}, {"name"=>"enable_unrecoverable_reset", "value"=>"true"}, {"name"=>"hbase_service", "value"=>"hbase-00053450"}, {"name"=>"hdfs_service", "value"=>"hdfs-00053450"}, {"name"=>"hive_service", "value"=>"hive-00053450"}, {"name"=>"kerberos_auth_enabled", "value"=>"true"}, {"name"=>"security_authorization_cache_ttl_secs", "value"=>"3"}, {"name"=>"security_authorization_extension_jar_path", "value"=>"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar"}, {"name"=>"security_store_provider", "value"=>"kms"}, {"name"=>"spark_on_yarn_service", "value"=>"spark_on_yarn-00053450"}, {"name"=>"yarn_service", "value"=>"yarn-00053450"}, {"name"=>"zookeeper_service", "value"=>"zookeeper-00053450"}]}
18-Mar-2020 10:52:16 2020-03-18 10:52:16 +0000 INFO: ------------ Start CDAP FirstRun --------------
18-Mar-2020 10:52:16 2020-03-18 10:52:16 +0000 DEBUG: Request: clusters/00053450/services/cdap-00053450/commands/firstRun
18-Mar-2020 10:52:16 2020-03-18 10:52:16 +0000 DEBUG: Response: {"id"=>234, "name"=>"First Run", "startTime"=>"2020-03-18T10:52:16.223Z", "active"=>true, "children"=>{"items"=>[]}}
18-Mar-2020 10:52:16 2020-03-18 10:52:16 +0000 INFO: ------------ Wait for CDAP FirstRun --------------
18-Mar-2020 10:52:16 2020-03-18 10:52:16 +0000 INFO: Waiting for command 234 to complete
18-Mar-2020 10:53:06 .........................
18-Mar-2020 10:53:06 2020-03-18 10:53:06 +0000 ERROR: Caught exception: Command 234 not successful: {"id"=>234, "name"=>"First Run", "startTime"=>"2020-03-18T10:52:16.223Z", "endTime"=>"2020-03-18T10:53:05.208Z", "active"=>false, "success"=>false, "resultMessage"=>"Failed to perform First Run of services.", "children"=>{"items"=>[{"id"=>246, "name"=>"CreateCdapUserHdfsDirCommand", "startTime"=>"2020-03-18T10:52:38.226Z", "endTime"=>"2020-03-18T10:52:43.392Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}}, {"id"=>243, "name"=>"CreateCdapHdfsDirCommand", "startTime"=>"2020-03-18T10:52:33.262Z", "endTime"=>"2020-03-18T10:52:38.193Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}}, {"id"=>242, "name"=>"GlobalWait", "startTime"=>"2020-03-18T10:52:33.215Z", "endTime"=>"2020-03-18T10:52:33.227Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}, {"id"=>235, "name"=>"DeployClusterClientConfig", "startTime"=>"2020-03-18T10:52:16.311Z", "endTime"=>"2020-03-18T10:52:33.214Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed all client configurations.", "clusterRef"=>{"clusterName"=>"00053450"}}, {"id"=>248, "name"=>"Start", "startTime"=>"2020-03-18T10:52:43.531Z", "endTime"=>"2020-03-18T10:53:05.207Z", "active"=>false, "success"=>false, "resultMessage"=>"Failed to start service.", "serviceRef"=>{"clusterName"=>"00053450", "serviceName"=>"cdap-00053450"}}]}, "canRetry"=>true} ["/var/bamboo/xml-data/build-dir/IT-ITC-CM512/coopr-internal/data/automatortypes/chef-solo/cookbooks/coopr_scripts/files/default/coopr-internal/bin/coopr_base_to_cm.rb:685:in `wait_for_command_success'", "/var/bamboo/xml-data/build-dir/IT-ITC-CM512/coopr-internal/data/automatortypes/chef-solo/cookbooks/coopr_scripts/files/default/coopr-internal/bin/coopr_base_to_cm.rb:2174:in `<top (required)>'", "coopr_base_to_cm.rb:20:in `load'", "coopr_base_to_cm.rb:20:in `<main>'"]
18-Mar-2020 10:53:07 Failing task since return code of [/opt/rbenv/shims/ruby coopr_base_to_cm.rb --coopr-uri ******** --coopr-tenant ******** --coopr-user bamboo --kdc-admin-user ******** --kdc-admin-password ******** --cdap-parcel-version 6.2.0.1584500997615-1 --remote-parcel-repo-url http://localhost:8080/itnparcelrepo --debug -i 00053450 --no-ha] was 1 while expected 0
18-Mar-2020 10:53:07 Finished task 'Execute coopr-base-to-cm' with result: Failed
18-Mar-2020 10:53:07 Running post build plugin 'Docker Container Cleanup'
18-Mar-2020 10:53:07 Running post build plugin 'NCover Results Collector'
18-Mar-2020 10:53:07 Running post build plugin 'Clover Results Collector'
18-Mar-2020 10:53:07 Running post build plugin 'npm Cache Cleanup'
18-Mar-2020 10:53:07 Running post build plugin 'Artifact Copier'
18-Mar-2020 10:53:07 Finalising the build...
18-Mar-2020 10:53:07 Stopping timer.
18-Mar-2020 10:53:07 Build IT-ITC-CM512-738 completed.
18-Mar-2020 10:53:07 Running on server: post build plugin 'NCover Results Collector'
18-Mar-2020 10:53:07 Running on server: post build plugin 'Build Hanging Detection Configuration'
18-Mar-2020 10:53:07 Running on server: post build plugin 'Clover Delta Calculator'
18-Mar-2020 10:53:07 Running on server: post build plugin 'Maven Dependencies Postprocessor'
18-Mar-2020 10:53:07 All post build plugins have finished
18-Mar-2020 10:53:07 Generating build results summary...
18-Mar-2020 10:53:07 Saving build results to disk...
18-Mar-2020 10:53:07 Logging substituted variables...
18-Mar-2020 10:53:07 Indexing build results...
18-Mar-2020 10:53:07 Finished building IT-ITC-CM512-738.