Build #644

Build: #644 failed

Job: Spark 2.2 Release 2 failed

Stages & jobs

  1. Variables

  2. Spinup and Test

Build log

The build generated 988 lines of output. Download or view full build log

20-Mar-2020 18:02:38 Build Integration Tests - CM Spark2 - Spark 2.2 Release 2 #644 (IT-CMSPARK2-CMSPK22R2-644) started building on agent bamboo-agent01.prod.continuuity.net
20-Mar-2020 18:02:38 Remote Agent
20-Mar-2020 18:02:38 Build working directory is /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
20-Mar-2020 18:02:38 Executing build Integration Tests - CM Spark2 - Spark 2.2 Release 2 #644 (IT-CMSPARK2-CMSPK22R2-644)
20-Mar-2020 18:02:38 Starting task 'Checkout Default Repository' of type 'com.atlassian.bamboo.plugins.vcs:task.vcs.checkout'
20-Mar-2020 18:02:38 Checking out into /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/cdap-integration-tests
20-Mar-2020 18:02:38 Updating source code to revision: 82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
20-Mar-2020 18:02:38 /usr/local/bin/git version
20-Mar-2020 18:02:38 /usr/local/bin/git log -1 --encoding=UTF-8 --format=%H HEAD
20-Mar-2020 18:02:38 /usr/local/bin/git -c credential.helper= -c 'credential.helper=store --file=/tmp/gitCredentials2282986781260396634.tmp' ls-remote https://github.com/cdapio/cdap-integration-tests
20-Mar-2020 18:02:38 Fetching 'refs/heads/develop' from 'https://github.com/cdapio/cdap-integration-tests'.
20-Mar-2020 18:02:38 /usr/local/bin/git -c credential.helper= -c 'credential.helper=store --file=/tmp/gitCredentials2282986781260396634.tmp' fetch https://github.com/cdapio/cdap-integration-tests +refs/heads/develop:refs/heads/develop --update-head-ok --progress --verbose
20-Mar-2020 18:02:38 From https://github.com/cdapio/cdap-integration-tests
20-Mar-2020 18:02:38 = [up to date]      develop    -> develop
20-Mar-2020 18:02:38 /usr/local/bin/git log -1 --encoding=UTF-8 --format=%H 82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
20-Mar-2020 18:02:38 Checking out revision 82f085e14e04ac4db8a4afb3cdc4f73022f2ab30.
20-Mar-2020 18:02:38 Creating local git repository in '/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/cdap-integration-tests/.git'.
20-Mar-2020 18:02:38 /usr/local/bin/git clone /var/bamboo/xml-data/build-dir/_git-repositories-cache/33e2d558e083e10088411e5f723ad31086756b8d --shared --no-checkout '-c filter.lfs.smudge=' '-c filter.lfs.required=false' /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/cdap-integration-tests
20-Mar-2020 18:02:38 Cloning into '/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/cdap-integration-tests'...
20-Mar-2020 18:02:38 done.
20-Mar-2020 18:02:38 /usr/local/bin/git show-ref develop
20-Mar-2020 18:02:38 /usr/local/bin/git checkout -f develop
20-Mar-2020 18:02:38 Switched to a new branch 'develop'
20-Mar-2020 18:02:38 Branch develop set up to track remote branch develop from origin.
20-Mar-2020 18:02:38 /usr/local/bin/git remote set-url origin file:///var/bamboo/xml-data/build-dir/_git-repositories-cache/33e2d558e083e10088411e5f723ad31086756b8d
20-Mar-2020 18:02:39 Updated source code to revision: 82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
20-Mar-2020 18:02:39 Finished task 'Checkout Default Repository' with result: Success
20-Mar-2020 18:02:39 Starting task 'Checkout coopr-internal Repository (develop branch)' of type 'com.atlassian.bamboo.plugins.vcs:task.vcs.checkout'
20-Mar-2020 18:02:39 Checking out into /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/coopr-internal
20-Mar-2020 18:02:39 Updating source code to revision: a4f0e696fb10f6d22a8035f2904a45080c86ec67
20-Mar-2020 18:02:39 Fetching 'refs/heads/develop' from 'https://github.com/cdapio/coopr-internal'.
20-Mar-2020 18:02:40 git: 'credential-' is not a git command. See 'git --help'.
20-Mar-2020 18:02:40
20-Mar-2020 18:02:40 Did you mean this?
20-Mar-2020 18:02:40         credential
20-Mar-2020 18:02:40 git: 'credential-' is not a git command. See 'git --help'.
20-Mar-2020 18:02:40
20-Mar-2020 18:02:40 Did you mean this?
20-Mar-2020 18:02:40         credential
20-Mar-2020 18:02:41 From https://github.com/cdapio/coopr-internal
20-Mar-2020 18:02:41    8c2797d..a4f0e69  develop    -> develop
20-Mar-2020 18:02:41 Checking out revision a4f0e696fb10f6d22a8035f2904a45080c86ec67.
20-Mar-2020 18:02:41 Creating local git repository in '/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/coopr-internal/.git'.
20-Mar-2020 18:02:41 Cloning into '/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/coopr-internal'...
20-Mar-2020 18:02:41 done.
20-Mar-2020 18:02:42 Switched to a new branch 'develop'
20-Mar-2020 18:02:42 Branch develop set up to track remote branch develop from origin.
20-Mar-2020 18:02:42 Updated source code to revision: a4f0e696fb10f6d22a8035f2904a45080c86ec67
20-Mar-2020 18:02:42 Finished task 'Checkout coopr-internal Repository (develop branch)' with result: Success
20-Mar-2020 18:02:42 Running pre-build action: VCS Version Collector
20-Mar-2020 18:02:42 Starting task 'Clean artifacts directory' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
20-Mar-2020 18:02:42
Beginning to execute external process for build 'Integration Tests - CM Spark2 - Spark 2.2 Release 2 #644 (IT-CMSPARK2-CMSPK22R2-644)'
... running command line:
/bin/sh /var/bamboo/temp/IT-CMSPARK2-CMSPK22R2-644-ScriptBuildTask-1267415613973304975.sh
... in: /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
... using extra environment variables:
bamboo_planRepository_1_branch=develop
bamboo_planRepository_2_branch=develop
bamboo_inject_delta_maven_version=0.1.0-SNAPSHOT
bamboo_planRepository_1_branchDisplayName=develop
bamboo_inject_buildNumber=2269
bamboo_repository_revision_number=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_inject_sql_pipelines_maven_version=6.2.0-SNAPSHOT
bamboo_capability_system_builder_command_s3cmd=/usr/bin/s3cmd
bamboo_docs_s3_bucket=docs.cask.co
bamboo_buildKey=IT-CMSPARK2-CMSPK22R2
bamboo_repository_77005186_git_branch=develop
bamboo_itn_kdc_admin_user_password=********
bamboo_gpg_password=********
bamboo_ops_gpg_password=********
bamboo_planRepository_2_branchDisplayName=develop
bamboo_shortJobName=Spark 2.2 Release 2
bamboo_buildResultsUrl=https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644
bamboo_capability_system_builder_mvn3_Maven_3_1=/opt/maven
bamboo_planRepository_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_s3_bucket=repository.cask.co
bamboo_repository_77005187_previous_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_aws_secret_access_key_password=********
bamboo_capability_system_builder_mvn3_Maven_3_6=/opt/maven
bamboo_agentId=21266433
bamboo_inject_package_full_version=6.2.0.1584671288450-1
bamboo_inject_dre_maven_version=1.4.0-SNAPSHOT
bamboo_inject_docker_repo=caskdata/cdap-sandbox
bamboo_capability_Swapfile=true
bamboo_inject_cdap_maven_version=6.2.0-SNAPSHOT
bamboo_repository_77005187_revision_number=a4f0e696fb10f6d22a8035f2904a45080c86ec67
bamboo_planRepository_revision=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_planRepository_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_freight=true
bamboo_repository_branch_name=develop
bamboo_itn_uri_password=********
bamboo_kdc_address_password=********
bamboo_capability_GPG=true
bamboo_capability_system_jdk_Oracle_JDK_8=/usr/lib/jvm/jdk8
bamboo_capability_system_jdk_Oracle_JDK_7=/usr/lib/jvm/jdk7
bamboo_dependenciesDisabled=false
bamboo_inject_cdap_version=6.2.0-SNAPSHOT
bamboo_downloads_s3_bucket=downloads.cask.co
bamboo_planRepository_branch=develop
bamboo_itn_provider=gce-audi
bamboo_inject_vm_artifact_name=cdap-sandbox
bamboo_capability_system_jdk_OpenJDK_1_8=/usr/lib/jvm/java-1.8.0
bamboo_inject_package_version=6.2.0.1584671288450
bamboo_inject_database_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_market_s3_access_key_password=********
bamboo_planRepository_1_type=gitv2
bamboo_planRepository_branchName=develop
bamboo_capability_rsync=true
bamboo_market_cloudfront_secret_key_password=********
bamboo_capability_system_jdk_JDK=/usr/lib/jvm/java
bamboo_hg_cache_directory=/var/bamboo/xml-data/build-dir/_hg-repositories-cache
bamboo_planRepository_1_username=
bamboo_planRepository_type=gitv2
bamboo_ManualBuildTriggerReason_userName=derek
bamboo_capability_expect=true
bamboo_itn_cdap_username=bob
bamboo_git_cache_directory=/var/bamboo/xml-data/build-dir/_git-repositories-cache
bamboo_planRepository_2_branchName=develop
bamboo_capability_RSYNC=rsync
bamboo_capability_system_builder_node_Node_js=/usr/bin/node
bamboo_capability_system_builder_mvn3_Maven_3=/opt/maven
bamboo_tmp_directory=/var/bamboo/temp
bamboo_planKey=IT-CMSPARK2
bamboo_hide_jdk_mirror_password=********
bamboo_planRepository_username=
bamboo_repository_77005186_git_username=
bamboo_capability_s3cmd=true
bamboo_planRepository_1_branchName=develop
bamboo_inject_cdap_version_stripped=6.2.0
bamboo_itn_tenant_password=********
bamboo_resultsUrl=https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644
bamboo_inject_cdap_version_maj_min=6.2
bamboo_capability_Sphinx=true
bamboo_build_working_directory=/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
bamboo_planRepository_1_name=cdapio/cdap-integration-tests
bamboo_inject_mmds_maven_version=1.4.0-SNAPSHOT
bamboo_shortPlanName=CM Spark2
bamboo_repository_77005186_name=cdapio/cdap-integration-tests
bamboo_planRepository_2_username=caskdata-ro
bamboo_planRepository_name=cdapio/cdap-integration-tests
bamboo_capability_git_lfs=true
bamboo_buildNumber=644
bamboo_itn_hardwaretype=standard-2xlarge
bamboo_repository_77005187_git_branch=develop
bamboo_inject_cdap_security_extn_maven_version=0.11.0-SNAPSHOT
bamboo_planName=Integration Tests - CM Spark2
bamboo_shortPlanKey=CMSPARK2
bamboo_repository_77005186_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_77005187_name=cdapio/coopr-internal
bamboo_shortJobKey=CMSPK22R2
bamboo_cdap_test=AllTests
bamboo_planRepository_2_name=cdapio/coopr-internal
bamboo_itn_cdap_password=********
bamboo_buildTimeStamp=2020-03-20T18:02:38.097Z
bamboo_repository_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_s3_bucket=repository.cask.co
bamboo_capability_system_builder_command_Docker=/usr/bin/docker
bamboo_repository_git_branch=develop
bamboo_buildResultKey=IT-CMSPARK2-CMSPK22R2-644
bamboo_market_s3_secret_key_password=********
bamboo_buildPlanName=Integration Tests - CM Spark2 - Spark 2.2 Release 2
bamboo_capability_system_jdk_JDK_1_8_0_101=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_system_builder_command_fpm=/opt/rbenv/shims/fpm
bamboo_repository_77005187_git_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_capability_Platform=rhel
bamboo_planRepository_1_revision=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_itn_imagetype=centos6
bamboo_repository_77005186_revision_number=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_itn_kdc_admin_password=********
bamboo_repository_name=cdapio/coopr-internal
bamboo_inject_standalone_artifact=cdap-sandbox-6.2.0-SNAPSHOT.zip
bamboo_planRepository_2_previousRevision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_buildFailed=false
bamboo_capability_system_docker_executable=/usr/bin/docker
bamboo_repository_77005187_branch_name=develop
bamboo_repository_77005186_branch_name=develop
bamboo_agentWorkingDirectory=/var/bamboo/xml-data/build-dir
bamboo_planRepository_2_revision=a4f0e696fb10f6d22a8035f2904a45080c86ec67
bamboo_capability_system_git_executable=/usr/local/bin/git
bamboo_repository_git_username=
bamboo_capability_system_jdk_JDK_1_8_0_232=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64
bamboo_planRepository_1_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_system_builder_command_Ruby=/opt/rbenv/shims/ruby
bamboo_itn_user=bamboo
bamboo_planRepository_branchDisplayName=develop
bamboo_inject_bigquery_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_inject_package_iteration=1
bamboo_repository_77005186_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_aws_access_key_password=********
bamboo_planRepository_2_type=gitv2
bamboo_capability_system_builder_mvn3_Maven_3_x=/opt/maven
bamboo_inject_standalone_artifact_name=cdap-sandbox
bamboo_plan_storageTag=plan-75497717
bamboo_planRepository_2_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_repository_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_market_cloudfront_access_key_password=********
bamboo_working_directory=/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
bamboo_planRepository_1_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_capability_createrepo=true
bamboo_capability_system_jdk_JDK_1_8=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_rpm_build=true
bamboo_capability_system_jdk_JDK_1_7=/usr/lib/jvm/jdk1.7.0_75
bamboo_inject_hydrator_plugins_maven_version=2.4.0-SNAPSHOT
bamboo_repository_77005187_git_username=caskdata-ro
20-Mar-2020 18:02:42 Finished task 'Clean artifacts directory' with result: Success
20-Mar-2020 18:02:42 Starting task 'Download BUT Parcels, Manifest' of type 'com.atlassian.bamboo.plugins.bamboo-artifact-downloader-plugin:artifactdownloadertask'
20-Mar-2020 18:02:42 Preparing to download plan result CDAP-BUT-2269 artifact: Shared artifact: [Parcel Repo Manifest], pattern: [manifest.json] anchored at: [cdap/cdap-distributions/target]
20-Mar-2020 18:02:42 Artifact [Parcel Repo Manifest] downloaded successfully in 98.28 ms to artifacts/
20-Mar-2020 18:02:42 Preparing to download plan result CDAP-BUT-2269 artifact: Shared artifact: [Parcels], pattern: [**/target/*.parcel]
20-Mar-2020 18:03:37 Artifact [Parcels] downloaded successfully in 54.94 s to artifacts/
20-Mar-2020 18:03:37 Finished task 'Download BUT Parcels, Manifest' with result: Success
20-Mar-2020 18:03:37 Starting task 'debug' of type 'com.atlassian.bamboo.plugins.bamboo-variable-inject-plugin:dump'
20-Mar-2020 18:03:37 ---- DUMPING VARIABLES TO LOG ---
20-Mar-2020 18:03:37 key: [ManualBuildTriggerReason.userName] value: [derek] type: CUSTOM
20-Mar-2020 18:03:37 key: [agentId] value: [21266433] type: CUSTOM
20-Mar-2020 18:03:37 key: [agentWorkingDirectory] value: [/var/bamboo/xml-data/build-dir] type: CUSTOM
20-Mar-2020 18:03:37 key: [aws_access_key.password] value: [**********] type: GLOBAL
20-Mar-2020 18:03:37 key: [aws_secret_access_key.password] value: [**********] type: GLOBAL
20-Mar-2020 18:03:37 key: [build.commandline.com.atlassian.bamboo.plugins.scripttask:task.builder.script.18] value: [/bin/sh /var/bamboo/temp/IT-CMSPARK2-CMSPK22R2-644-ScriptBuildTask-1267415613973304975.sh] type: CUSTOM
20-Mar-2020 18:03:37 key: [build.working.directory] value: [/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2] type: CUSTOM
20-Mar-2020 18:03:37 key: [buildFailed] value: [false] type: CUSTOM
20-Mar-2020 18:03:37 key: [buildKey] value: [IT-CMSPARK2-CMSPK22R2] type: CUSTOM
20-Mar-2020 18:03:37 key: [buildNumber] value: [644] type: CUSTOM
20-Mar-2020 18:03:37 key: [buildPlanName] value: [Integration Tests - CM Spark2 - Spark 2.2 Release 2] type: CUSTOM
20-Mar-2020 18:03:37 key: [buildResultKey] value: [IT-CMSPARK2-CMSPK22R2-644] type: CUSTOM
20-Mar-2020 18:03:37 key: [buildResultsUrl] value: [https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644] type: CUSTOM
20-Mar-2020 18:03:37 key: [buildTimeStamp] value: [2020-03-20T18:02:38.097Z] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.GPG] value: [true] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.Platform] value: [rhel] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.RSYNC] value: [rsync] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.Sphinx] value: [true] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.Swapfile] value: [true] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.createrepo] value: [true] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.expect] value: [true] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.freight] value: [true] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.git-lfs] value: [true] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.rpm-build] value: [true] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.rsync] value: [true] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.s3cmd] value: [true] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.builder.command.Docker] value: [/usr/bin/docker] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.builder.command.Ruby] value: [/opt/rbenv/shims/ruby] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.builder.command.fpm] value: [/opt/rbenv/shims/fpm] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.builder.command.s3cmd] value: [/usr/bin/s3cmd] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.builder.mvn3.Maven 3] value: [/opt/maven] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.builder.mvn3.Maven 3.1] value: [/opt/maven] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.builder.mvn3.Maven 3.6] value: [/opt/maven] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.builder.mvn3.Maven 3.x] value: [/opt/maven] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.builder.node.Node.js] value: [/usr/bin/node] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.docker.executable] value: [/usr/bin/docker] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.git.executable] value: [/usr/local/bin/git] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.jdk.JDK] value: [/usr/lib/jvm/java] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.jdk.JDK 1.7] value: [/usr/lib/jvm/jdk1.7.0_75] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.jdk.JDK 1.8] value: [/usr/lib/jvm/jdk1.8.0_101] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.jdk.JDK 1.8.0_101] value: [/usr/lib/jvm/jdk1.8.0_101] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.jdk.JDK 1.8.0_232] value: [/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.jdk.OpenJDK 1.8] value: [/usr/lib/jvm/java-1.8.0] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.jdk.Oracle JDK 7] value: [/usr/lib/jvm/jdk7] type: CUSTOM
20-Mar-2020 18:03:37 key: [capability.system.jdk.Oracle JDK 8] value: [/usr/lib/jvm/jdk8] type: CUSTOM
20-Mar-2020 18:03:37 key: [cdap.test] value: [AllTests] type: PLAN
20-Mar-2020 18:03:37 key: [dependenciesDisabled] value: [false] type: CUSTOM
20-Mar-2020 18:03:37 key: [docs_s3_bucket] value: [docs.cask.co] type: GLOBAL
20-Mar-2020 18:03:37 key: [downloads_s3_bucket] value: [downloads.cask.co] type: GLOBAL
20-Mar-2020 18:03:37 key: [git.cache.directory] value: [/var/bamboo/xml-data/build-dir/_git-repositories-cache] type: CUSTOM
20-Mar-2020 18:03:37 key: [gpg.password] value: [**********] type: GLOBAL
20-Mar-2020 18:03:37 key: [hg.cache.directory] value: [/var/bamboo/xml-data/build-dir/_hg-repositories-cache] type: CUSTOM
20-Mar-2020 18:03:37 key: [hide.jdk.mirror.password] value: [**********] type: GLOBAL
20-Mar-2020 18:03:37 key: [inject.bigquery-delta-plugins.maven.version] value: [0.1.0-SNAPSHOT] type: RESULT
20-Mar-2020 18:03:37 key: [inject.buildNumber] value: [2269] type: RESULT
20-Mar-2020 18:03:37 key: [inject.cdap-security-extn.maven.version] value: [0.11.0-SNAPSHOT] type: RESULT
20-Mar-2020 18:03:37 key: [inject.cdap.maven.version] value: [6.2.0-SNAPSHOT] type: RESULT
20-Mar-2020 18:03:37 key: [inject.cdap.version] value: [6.2.0-SNAPSHOT] type: RESULT
20-Mar-2020 18:03:37 key: [inject.cdap.version.maj_min] value: [6.2] type: RESULT
20-Mar-2020 18:03:37 key: [inject.cdap.version.stripped] value: [6.2.0] type: RESULT
20-Mar-2020 18:03:37 key: [inject.database-delta-plugins.maven.version] value: [0.1.0-SNAPSHOT] type: RESULT
20-Mar-2020 18:03:37 key: [inject.delta.maven.version] value: [0.1.0-SNAPSHOT] type: RESULT
20-Mar-2020 18:03:37 key: [inject.docker.repo] value: [caskdata/cdap-sandbox] type: RESULT
20-Mar-2020 18:03:37 key: [inject.dre.maven.version] value: [1.4.0-SNAPSHOT] type: RESULT
20-Mar-2020 18:03:37 key: [inject.hydrator-plugins.maven.version] value: [2.4.0-SNAPSHOT] type: RESULT
20-Mar-2020 18:03:37 key: [inject.mmds.maven.version] value: [1.4.0-SNAPSHOT] type: RESULT
20-Mar-2020 18:03:37 key: [inject.package.full.version] value: [6.2.0.1584671288450-1] type: RESULT
20-Mar-2020 18:03:37 key: [inject.package.iteration] value: [1] type: RESULT
20-Mar-2020 18:03:37 key: [inject.package.version] value: [6.2.0.1584671288450] type: RESULT
20-Mar-2020 18:03:37 key: [inject.sql-pipelines.maven.version] value: [6.2.0-SNAPSHOT] type: RESULT
20-Mar-2020 18:03:37 key: [inject.standalone.artifact] value: [cdap-sandbox-6.2.0-SNAPSHOT.zip] type: RESULT
20-Mar-2020 18:03:37 key: [inject.standalone.artifact.name] value: [cdap-sandbox] type: RESULT
20-Mar-2020 18:03:37 key: [inject.vm.artifact.name] value: [cdap-sandbox] type: RESULT
20-Mar-2020 18:03:37 key: [itn.cdap.password] value: [**********] type: PLAN
20-Mar-2020 18:03:37 key: [itn.cdap.username] value: [bob] type: PLAN
20-Mar-2020 18:03:37 key: [itn.hardwaretype] value: [standard-2xlarge] type: PLAN
20-Mar-2020 18:03:37 key: [itn.imagetype] value: [centos6] type: PLAN
20-Mar-2020 18:03:37 key: [itn.kdc.admin.password] value: [**********] type: PLAN
20-Mar-2020 18:03:37 key: [itn.kdc.admin.user.password] value: [**********] type: PLAN
20-Mar-2020 18:03:37 key: [itn.provider] value: [gce-audi] type: PLAN
20-Mar-2020 18:03:37 key: [itn.tenant.password] value: [**********] type: PLAN
20-Mar-2020 18:03:37 key: [itn.uri.password] value: [**********] type: PLAN
20-Mar-2020 18:03:37 key: [itn.user] value: [bamboo] type: PLAN
20-Mar-2020 18:03:37 key: [kdc.address.password] value: [**********] type: GLOBAL
20-Mar-2020 18:03:37 key: [market.cloudfront.access_key.password] value: [**********] type: GLOBAL
20-Mar-2020 18:03:37 key: [market.cloudfront.secret_key.password] value: [**********] type: GLOBAL
20-Mar-2020 18:03:37 key: [market.s3.access_key.password] value: [**********] type: GLOBAL
20-Mar-2020 18:03:37 key: [market.s3.secret_key.password] value: [**********] type: GLOBAL
20-Mar-2020 18:03:37 key: [ops.gpg.password] value: [**********] type: GLOBAL
20-Mar-2020 18:03:37 key: [plan.storageTag] value: [plan-75497717] type: CUSTOM
20-Mar-2020 18:03:37 key: [planKey] value: [IT-CMSPARK2] type: CUSTOM
20-Mar-2020 18:03:37 key: [planName] value: [Integration Tests - CM Spark2] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.1.branch] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.1.branchDisplayName] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.1.branchName] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.1.name] value: [cdapio/cdap-integration-tests] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.1.previousRevision] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.1.repositoryUrl] value: [https://github.com/cdapio/cdap-integration-tests] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.1.revision] value: [82f085e14e04ac4db8a4afb3cdc4f73022f2ab30] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.1.type] value: [gitv2] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.1.username] value: [] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.2.branch] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.2.branchDisplayName] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.2.branchName] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.2.name] value: [cdapio/coopr-internal] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.2.previousRevision] value: [8c2797da17295a6737c5c746943af521cf6bb43f] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.2.repositoryUrl] value: [https://github.com/cdapio/coopr-internal] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.2.revision] value: [a4f0e696fb10f6d22a8035f2904a45080c86ec67] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.2.type] value: [gitv2] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.2.username] value: [caskdata-ro] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.branch] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.branchDisplayName] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.branchName] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.name] value: [cdapio/cdap-integration-tests] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.previousRevision] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.repositoryUrl] value: [https://github.com/cdapio/cdap-integration-tests] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.revision] value: [82f085e14e04ac4db8a4afb3cdc4f73022f2ab30] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.type] value: [gitv2] type: CUSTOM
20-Mar-2020 18:03:37 key: [planRepository.username] value: [] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005186.branch.name] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005186.git.branch] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005186.git.repositoryUrl] value: [https://github.com/cdapio/cdap-integration-tests] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005186.git.username] value: [] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005186.name] value: [cdapio/cdap-integration-tests] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005186.previous.revision.number] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005186.revision.number] value: [82f085e14e04ac4db8a4afb3cdc4f73022f2ab30] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005187.branch.name] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005187.git.branch] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005187.git.repositoryUrl] value: [https://github.com/cdapio/coopr-internal] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005187.git.username] value: [caskdata-ro] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005187.name] value: [cdapio/coopr-internal] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005187.previous.revision.number] value: [8c2797da17295a6737c5c746943af521cf6bb43f] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.77005187.revision.number] value: [a4f0e696fb10f6d22a8035f2904a45080c86ec67] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.branch.name] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.git.branch] value: [develop] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.git.repositoryUrl] value: [https://github.com/cdapio/cdap-integration-tests] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.git.username] value: [] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.name] value: [cdapio/coopr-internal] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.previous.revision.number] value: [7e19abdd205b4a52461c1e10822afff44b877b75] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository.revision.number] value: [82f085e14e04ac4db8a4afb3cdc4f73022f2ab30] type: CUSTOM
20-Mar-2020 18:03:37 key: [repository_s3_bucket] value: [repository.cask.co] type: GLOBAL
20-Mar-2020 18:03:37 key: [resultsUrl] value: [https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644] type: CUSTOM
20-Mar-2020 18:03:37 key: [s3_bucket] value: [repository.cask.co] type: GLOBAL
20-Mar-2020 18:03:37 key: [shortJobKey] value: [CMSPK22R2] type: CUSTOM
20-Mar-2020 18:03:37 key: [shortJobName] value: [Spark 2.2 Release 2] type: CUSTOM
20-Mar-2020 18:03:37 key: [shortPlanKey] value: [CMSPARK2] type: CUSTOM
20-Mar-2020 18:03:37 key: [shortPlanName] value: [CM Spark2] type: CUSTOM
20-Mar-2020 18:03:37 key: [tmp.directory] value: [/var/bamboo/temp] type: CUSTOM
20-Mar-2020 18:03:37 key: [working.directory] value: [/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2] type: CUSTOM
20-Mar-2020 18:03:37 ---- END DUMPING VARIABLES TO LOG  ---
20-Mar-2020 18:03:37 Finished task 'debug' with result: Success
20-Mar-2020 18:03:37 Starting task 'Download CSD JAR Artifact' of type 'com.atlassian.bamboo.plugins.bamboo-artifact-downloader-plugin:artifactdownloadertask'
20-Mar-2020 18:03:37 Preparing to download plan result CDAP-CSD-60 artifact: Shared artifact: [CSD JAR], pattern: [CDAP-*.jar] anchored at: [cm_csd/target]
20-Mar-2020 18:03:37 Artifact [CSD JAR] downloaded successfully in 114.2 ms to artifacts/
20-Mar-2020 18:03:37 Finished task 'Download CSD JAR Artifact' with result: Success
20-Mar-2020 18:03:37
Substituting variable: ${bamboo.buildKey} with IT-CMSPARK2-CMSPK22R2
20-Mar-2020 18:03:37
Substituting variable: ${bamboo.buildNumber} with 644
20-Mar-2020 18:03:37
Substituting password variable: ${bamboo.itn.uri.password}
20-Mar-2020 18:03:37
Substituting password variable: ${bamboo.itn.tenant.password}
20-Mar-2020 18:03:37
Substituting variable: ${bamboo.itn.user} with bamboo
20-Mar-2020 18:03:37
Substituting variable: ${bamboo.inject.cdap-security-extn.maven.version} with 0.11.0-SNAPSHOT
20-Mar-2020 18:03:37
Substituting variable: ${bamboo.itn.provider} with gce-audi
20-Mar-2020 18:03:37
Substituting variable: ${bamboo.itn.hardwaretype} with standard-2xlarge
20-Mar-2020 18:03:37
Substituting variable: ${bamboo.itn.imagetype} with centos6
20-Mar-2020 18:03:37 Starting task 'Execute coopr-runner-wrapper to spin up cloudera-manager' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.command'
20-Mar-2020 18:03:37
Beginning to execute external process for build 'Integration Tests - CM Spark2 - Spark 2.2 Release 2 #644 (IT-CMSPARK2-CMSPK22R2-644)'
... running command line:
/opt/rbenv/shims/ruby cdap-integration-tests/bin/coopr-runner-wrapper.rb --num-machines 6 --name IT-CMSPARK2-CMSPK22R2-644- --uri ******** --tenant ******** --user bamboo --cluster-service-to-check cloudera-manager --cluster-service-ip-file cloudera-manager-ip.txt --config { "cloudera_manager": { "services": { "cdap": { "serviceConfigs": { "security_authorization_extension_jar_path":"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar" } } } } } --services cloudera-manager-agent,generic-users
... in: /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
... using extra environment variables:
bamboo_planRepository_1_branch=develop
bamboo_planRepository_2_branch=develop
bamboo_inject_delta_maven_version=0.1.0-SNAPSHOT
bamboo_planRepository_1_branchDisplayName=develop
bamboo_inject_buildNumber=2269
bamboo_repository_revision_number=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_inject_sql_pipelines_maven_version=6.2.0-SNAPSHOT
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_18=/bin/sh /var/bamboo/temp/IT-CMSPARK2-CMSPK22R2-644-ScriptBuildTask-1267415613973304975.sh
bamboo_capability_system_builder_command_s3cmd=/usr/bin/s3cmd
bamboo_docs_s3_bucket=docs.cask.co
bamboo_buildKey=IT-CMSPARK2-CMSPK22R2
bamboo_repository_77005186_git_branch=develop
bamboo_itn_kdc_admin_user_password=********
bamboo_gpg_password=********
bamboo_ops_gpg_password=********
bamboo_planRepository_2_branchDisplayName=develop
bamboo_shortJobName=Spark 2.2 Release 2
bamboo_buildResultsUrl=https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644
bamboo_capability_system_builder_mvn3_Maven_3_1=/opt/maven
bamboo_planRepository_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_s3_bucket=repository.cask.co
bamboo_repository_77005187_previous_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_aws_secret_access_key_password=********
bamboo_capability_system_builder_mvn3_Maven_3_6=/opt/maven
bamboo_agentId=21266433
COOPR_DRIVER_HARDWARETYPE=standard-2xlarge
bamboo_inject_package_full_version=6.2.0.1584671288450-1
bamboo_inject_dre_maven_version=1.4.0-SNAPSHOT
bamboo_inject_docker_repo=caskdata/cdap-sandbox
bamboo_capability_Swapfile=true
bamboo_inject_cdap_maven_version=6.2.0-SNAPSHOT
bamboo_repository_77005187_revision_number=a4f0e696fb10f6d22a8035f2904a45080c86ec67
bamboo_planRepository_revision=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_planRepository_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
COOPR_DRIVER_CLUSTER_ID_FILE=cdap-auto-clusterid.txt
bamboo_capability_freight=true
bamboo_repository_branch_name=develop
bamboo_itn_uri_password=********
bamboo_kdc_address_password=********
bamboo_capability_GPG=true
bamboo_capability_system_jdk_Oracle_JDK_8=/usr/lib/jvm/jdk8
bamboo_capability_system_jdk_Oracle_JDK_7=/usr/lib/jvm/jdk7
bamboo_dependenciesDisabled=false
bamboo_inject_cdap_version=6.2.0-SNAPSHOT
bamboo_downloads_s3_bucket=downloads.cask.co
bamboo_planRepository_branch=develop
bamboo_itn_provider=gce-audi
bamboo_inject_vm_artifact_name=cdap-sandbox
bamboo_capability_system_jdk_OpenJDK_1_8=/usr/lib/jvm/java-1.8.0
bamboo_inject_package_version=6.2.0.1584671288450
bamboo_inject_database_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_market_s3_access_key_password=********
COOPR_DRIVER_IMAGETYPE=centos6
bamboo_planRepository_1_type=gitv2
bamboo_planRepository_branchName=develop
bamboo_capability_rsync=true
bamboo_market_cloudfront_secret_key_password=********
bamboo_capability_system_jdk_JDK=/usr/lib/jvm/java
bamboo_hg_cache_directory=/var/bamboo/xml-data/build-dir/_hg-repositories-cache
bamboo_planRepository_1_username=
bamboo_planRepository_type=gitv2
bamboo_ManualBuildTriggerReason_userName=derek
bamboo_capability_expect=true
bamboo_itn_cdap_username=bob
bamboo_git_cache_directory=/var/bamboo/xml-data/build-dir/_git-repositories-cache
bamboo_planRepository_2_branchName=develop
bamboo_capability_RSYNC=rsync
bamboo_capability_system_builder_node_Node_js=/usr/bin/node
bamboo_capability_system_builder_mvn3_Maven_3=/opt/maven
bamboo_tmp_directory=/var/bamboo/temp
bamboo_planKey=IT-CMSPARK2
bamboo_hide_jdk_mirror_password=********
bamboo_planRepository_username=
bamboo_repository_77005186_git_username=
bamboo_capability_s3cmd=true
bamboo_planRepository_1_branchName=develop
bamboo_inject_cdap_version_stripped=6.2.0
bamboo_itn_tenant_password=********
bamboo_resultsUrl=https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644
bamboo_inject_cdap_version_maj_min=6.2
bamboo_capability_Sphinx=true
bamboo_build_working_directory=/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
bamboo_planRepository_1_name=cdapio/cdap-integration-tests
bamboo_inject_mmds_maven_version=1.4.0-SNAPSHOT
bamboo_shortPlanName=CM Spark2
bamboo_repository_77005186_name=cdapio/cdap-integration-tests
bamboo_planRepository_2_username=caskdata-ro
bamboo_planRepository_name=cdapio/cdap-integration-tests
bamboo_capability_git_lfs=true
COOPR_DRIVER_CLUSTERTEMPLATE=cloudera-manager
bamboo_buildNumber=644
bamboo_itn_hardwaretype=standard-2xlarge
bamboo_repository_77005187_git_branch=develop
bamboo_inject_cdap_security_extn_maven_version=0.11.0-SNAPSHOT
bamboo_planName=Integration Tests - CM Spark2
bamboo_shortPlanKey=CMSPARK2
bamboo_repository_77005186_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_77005187_name=cdapio/coopr-internal
bamboo_shortJobKey=CMSPK22R2
bamboo_cdap_test=AllTests
bamboo_planRepository_2_name=cdapio/coopr-internal
bamboo_itn_cdap_password=********
bamboo_buildTimeStamp=2020-03-20T18:02:38.097Z
bamboo_repository_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_s3_bucket=repository.cask.co
bamboo_capability_system_builder_command_Docker=/usr/bin/docker
bamboo_repository_git_branch=develop
bamboo_buildResultKey=IT-CMSPARK2-CMSPK22R2-644
bamboo_market_s3_secret_key_password=********
bamboo_buildPlanName=Integration Tests - CM Spark2 - Spark 2.2 Release 2
bamboo_capability_system_jdk_JDK_1_8_0_101=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_system_builder_command_fpm=/opt/rbenv/shims/fpm
bamboo_repository_77005187_git_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_capability_Platform=rhel
bamboo_planRepository_1_revision=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_itn_imagetype=centos6
bamboo_repository_77005186_revision_number=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_itn_kdc_admin_password=********
bamboo_repository_name=cdapio/coopr-internal
bamboo_inject_standalone_artifact=cdap-sandbox-6.2.0-SNAPSHOT.zip
bamboo_planRepository_2_previousRevision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_buildFailed=false
bamboo_capability_system_docker_executable=/usr/bin/docker
bamboo_repository_77005187_branch_name=develop
bamboo_repository_77005186_branch_name=develop
bamboo_agentWorkingDirectory=/var/bamboo/xml-data/build-dir
bamboo_planRepository_2_revision=a4f0e696fb10f6d22a8035f2904a45080c86ec67
bamboo_capability_system_git_executable=/usr/local/bin/git
bamboo_repository_git_username=
bamboo_capability_system_jdk_JDK_1_8_0_232=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64
bamboo_planRepository_1_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_system_builder_command_Ruby=/opt/rbenv/shims/ruby
bamboo_itn_user=bamboo
bamboo_planRepository_branchDisplayName=develop
bamboo_inject_bigquery_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_inject_package_iteration=1
bamboo_repository_77005186_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_aws_access_key_password=********
bamboo_planRepository_2_type=gitv2
bamboo_capability_system_builder_mvn3_Maven_3_x=/opt/maven
bamboo_inject_standalone_artifact_name=cdap-sandbox
bamboo_plan_storageTag=plan-75497717
COOPR_DRIVER_PROVIDER=gce-audi
bamboo_planRepository_2_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_repository_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_market_cloudfront_access_key_password=********
bamboo_working_directory=/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
bamboo_planRepository_1_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_capability_createrepo=true
bamboo_capability_system_jdk_JDK_1_8=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_rpm_build=true
bamboo_capability_system_jdk_JDK_1_7=/usr/lib/jvm/jdk1.7.0_75
bamboo_inject_hydrator_plugins_maven_version=2.4.0-SNAPSHOT
bamboo_repository_77005187_git_username=caskdata-ro
20-Mar-2020 18:03:37 Inserting configuration from /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/cdap-integration-tests/bin/../conf/all.json
20-Mar-2020 18:03:37 Inserting configuration from /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/cdap-integration-tests/bin/../conf/cloudera_manager.json
20-Mar-2020 18:03:37 Inserting configuration from /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/cdap-integration-tests/bin/../conf/cmspk22r2.json
20-Mar-2020 18:03:37 Running coopr-runner.rb with additional args: ["--provider-fields", "{\"bootstrap_interface\":\"bind_v4\",\"zone_name\":\"us-east1-c\"}", "--config", "{\"cloudera_manager\":{\"services\":{\"cdap\":{\"serviceConfigs\":{\"csd_compatibility_check_enabled\":\"false\"}},\"hdfs\":{\"serviceConfigs\":{\"hdfs_service_config_safety_valve\":\"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>\"},\"roleConfigGroups\":{\"gateway-base\":{\"configs\":{\"hdfs_client_config_safety_valve\":\"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>\"}}}},\"hbase\":{\"serviceConfigs\":{\"hbase_service_config_safety_valve\":\"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>\"},\"roleConfigGroups\":{\"gateway-base\":{\"configs\":{\"hbase_client_config_safety_valve\":\"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>\"}}}},\"yarn\":{\"serviceConfigs\":{\"yarn_service_config_safety_valve\":\"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>\"},\"roleConfigGroups\":{\"resourcemanager-base\":{\"configs\":{\"yarn_scheduler_minimum_allocation_mb\":\"768\"}},\"gateway-base\":{\"configs\":{\"yarn_client_config_safety_valve\":\"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>\"}}}}}}}", "--provider-fields", "{\"bootstrap_interface\":\"bind_v4\",\"zone_name\":\"us-central1-c\"}", "--initial-lease-duration", "82800000", "--services", "generic-users", "--config", "{\"cloudera_manager\":{\"distribution_version\":\"5.12\",\"csd\":{\"install\":{\"SPARK2\":\"http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.2.0.cloudera2.jar\"}}}}"]
20-Mar-2020 18:03:38 2020-03-20T18:03:38Z Creating cluster of spec {"name":"IT-CMSPARK2-CMSPK22R2-644-","numMachines":"6","provider":"gce-audi","hardwaretype":"standard-2xlarge","imagetype":"centos6","clusterTemplate":"cloudera-manager","services":["base","cdap-realm-file","cloudera-manager","cloudera-manager-agent","cloudera-manager-db","continuuity-sensu-monitoring","kerberos-client","mgr-deploy-cluster","generic-users"],"initialLeaseDuration":"82800000","config":{"cloudera_manager":{"distribution_version":"5.12","use_embedded_db":"true","csd":{"comment":"### CUSTOMIZE THE SPARK2 VERSION BELOW, per https://www.cloudera.com/documentation/spark2/latest/topics/spark2_admin.html","install":{"CDAP":"http://downloads.cask.co/cdap-csd/CDAP-5.1.0.jar","SPARK2":"http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.2.0.cloudera2.jar"}},"services":{"cdap":{"serviceConfigs":{"enable_unrecoverable_reset":"true","security_authorization_extension_jar_path":"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar","cdap-site.xml_service_safety_valve":"<property><name>security.authorization.extension.config.sentry.site.url</name><value>/etc/sentry/conf/sentry-site.xml</value></property><property><name>cdap.ugi.cache.expiration.ms</name><value>60000</value></property><property><name>cdap.http.client.read.timeout.ms</name><value>120000</value></property>","security_authorization_cache_ttl_secs":"3","csd_compatibility_check_enabled":"false"},"roles":{"cdap_auth_server":{"configs":{"security.authentication.handler.debug":"true","security.authentication.handler.hostname":"10.240.24.141","security.authentication.handler.port":"389","security.authentication.handler.userBaseDn":"ou=people,dc=continuuity,dc=com","security.authentication.handler.userObjectClass":"inetorgperson","security.authentication.handler.userRdnAttribute":"cn","security.authentication.loginmodule.className":"co.cask.cdap.security.server.LDAPLoginModule","security.authentication.handlerClassName":"co.cask.cdap.security.server.BasicAuthenticationHandler","security.authentication.basic.realmfile":"/etc/security/realmfile"}},"cdap_master":{"configs":{"security.keytab.path":"/etc/security/keytabs/${name}.headless.keytab"}}}},"sentry":{"serviceConfigs":{"SENTRY_service_env_safety_valve":"HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/data/cloudera/parcels/CDAP/master/ext/security/*","sentry.service.admin.group":"hive,impala,hue,solr,cdap,cdapitn","sentry.service.allow.connect":"hive,impala,hue,solr,cdap,cdapitn","sentry_server_config_safety_valve":"<property><name>sentry.cdap.action.factory</name><value>co.cask.cdap.security.authorization.sentry.model.ActionFactory</value></property>"}},"yarn":{"roleConfigGroups":{"nodemanager-base":{"configs":{"container_executor_min_user_id":"500"}},"resourcemanager-base":{"configs":{"yarn_scheduler_minimum_allocation_mb":"768"}},"gateway-base":{"configs":{"yarn_client_config_safety_valve":"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}}},"serviceConfigs":{"yarn_service_config_safety_valve":"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}},"hdfs":{"serviceConfigs":{"hdfs_service_config_safety_valve":"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>"},"roleConfigGroups":{"gateway-base":{"configs":{"hdfs_client_config_safety_valve":"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>"}}}},"hbase":{"serviceConfigs":{"hbase_service_config_safety_valve":"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"},"roleConfigGroups":{"gateway-base":{"configs":{"hbase_client_config_safety_valve":"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"}}}}},"agent":{"General":{"server_host":"%host.service.cloudera-manager%","parcel_dir":"/data/cloudera/parcels","host_dns_resolution_enabled":"false","java_home":"/usr/lib/jvm/java"}}},"coopr_mysql":{"mysql_service":{"clouderadb":{"bind_address":"0.0.0.0","data_dir":"/data/mysql","initial_root_password":"somedefaultpassword","mysqld_options":{"transaction-isolation":"READ-COMMITTED","key_buffer_size":"32M","max_allowed_packet":"32M","thread_stack":"256K","thread_cache_size":"64","query_cache_limit":"8M","query_cache_size":"64M","max_connections":"800","log_bin":"/data/mysql/mysql_binary_log","binlog_format":"mixed","read_buffer_size":"2M","read_rnd_buffer_size":"16M","sort_buffer_size":"8M","join_buffer_size":"8M","innodb_file_per_table":true,"innodb_flush_log_at_trx_commit":"2","innodb_log_buffer_size":"64M","innodb_buffer_pool_size":"4G","innodb_flush_method":"O_DIRECT","innodb_log_file_size":"512M","wait_timeout":"28800"},"port":"3306"}}},"java":{"install_flavor":"oracle","jdk_version":8,"jdk":{"7":{"x86_64":{"url":"https://********/jdk-7u75-linux-x64.tar.gz","checksum":"460959219b534dc23e34d77abc306e180b364069b9fc2b2265d964fa2c281610"}},"8":{"x86_64":{"url":"https://********/jdk-8u181-linux-x64.tar.gz","checksum":"1845567095bfbfebd42ed0d09397939796d05456290fb20a83c476ba09f991d3"}}},"oracle":{"accept_oracle_download_terms":true,"jce":{"7":{"url":"https://********/UnlimitedJCEPolicyJDK7.zip","checksum":"7a8d790e7bd9c2f82a83baddfae765797a4a56ea603c9150c87b7cdb7800194d"},"8":{"url":"https://********/jce_policy-8.zip","checksum":"f3020a3922efd6626c2fff45695d527f34a8020e938a49292561f18ad1320b59"}}}},"krb5":{"krb5_conf":{"libdefaults":{"default_realm":"CONTINUUITY.NET","ticket_lifetime":"1h","renew_lifetime":"2h"},"realms":{"default_realm_kdcs":["10.240.209.207"],"default_realm_admin_server":"10.240.209.207","realms":["CONTINUUITY.NET"]}}},"mysql":{"server_root_password":"somedefaultpassword"},"sensu_wrapper":{"additional_client_attributes":{"mail_to":"%cluster.owner%@cask.co"}},"cdap":{"cdap_site":{"security.authentication.basic.realmfile":"/etc/security/realmfile","security.authentication.handlerClassName":"co.cask.cdap.security.server.BasicAuthenticationHandler"},"security":{"manage_realmfile":"true","realmfile":{"cdapitn":"cdapitn","alice":"alicepassword","bob":"********","eve":"evepassword","carol":"carolpassword","systemadmin":"systemadmin"}}}},"providerFields":{"bootstrap_interface":"bind_v4","zone_name":"us-central1-c"}}
20-Mar-2020 18:03:38 2020-03-20T18:03:38Z Obtained cluster id: 00053556
20-Mar-2020 18:03:43 2020-03-20T18:03:43Z progress: 0 / 120
20-Mar-2020 18:04:13 2020-03-20T18:04:13Z progress: 6 / 120
20-Mar-2020 18:04:43 2020-03-20T18:04:43Z progress: 12 / 120
20-Mar-2020 18:05:13 2020-03-20T18:05:13Z progress: 12 / 120
20-Mar-2020 18:05:43 2020-03-20T18:05:43Z progress: 18 / 120
20-Mar-2020 18:06:13 2020-03-20T18:06:13Z progress: 20 / 120
20-Mar-2020 18:06:43 2020-03-20T18:06:43Z progress: 22 / 120
20-Mar-2020 18:07:13 2020-03-20T18:07:13Z progress: 22 / 120
20-Mar-2020 18:07:43 2020-03-20T18:07:43Z progress: 22 / 120
20-Mar-2020 18:08:13 2020-03-20T18:08:13Z progress: 22 / 120
20-Mar-2020 18:08:43 2020-03-20T18:08:43Z progress: 22 / 120
20-Mar-2020 18:09:13 2020-03-20T18:09:13Z progress: 24 / 120
20-Mar-2020 18:09:43 2020-03-20T18:09:43Z progress: 27 / 120
20-Mar-2020 18:10:13 2020-03-20T18:10:13Z progress: 28 / 120
20-Mar-2020 18:10:43 2020-03-20T18:10:43Z progress: 28 / 120
20-Mar-2020 18:11:13 2020-03-20T18:11:13Z progress: 28 / 120
20-Mar-2020 18:11:43 2020-03-20T18:11:43Z progress: 28 / 120
20-Mar-2020 18:12:13 2020-03-20T18:12:13Z progress: 29 / 120
20-Mar-2020 18:12:43 2020-03-20T18:12:43Z progress: 30 / 120
20-Mar-2020 18:13:13 2020-03-20T18:13:13Z progress: 34 / 120
20-Mar-2020 18:13:43 2020-03-20T18:13:43Z progress: 34 / 120
20-Mar-2020 18:14:13 2020-03-20T18:14:13Z progress: 34 / 120
20-Mar-2020 18:14:43 2020-03-20T18:14:43Z progress: 34 / 120
20-Mar-2020 18:15:14 2020-03-20T18:15:14Z progress: 34 / 120
20-Mar-2020 18:15:44 2020-03-20T18:15:44Z progress: 35 / 120
20-Mar-2020 18:16:14 2020-03-20T18:16:14Z progress: 38 / 120
20-Mar-2020 18:16:44 2020-03-20T18:16:44Z progress: 40 / 120
20-Mar-2020 18:17:14 2020-03-20T18:17:14Z progress: 40 / 120
20-Mar-2020 18:17:44 2020-03-20T18:17:44Z progress: 40 / 120
20-Mar-2020 18:18:14 2020-03-20T18:18:14Z progress: 41 / 120
20-Mar-2020 18:18:44 2020-03-20T18:18:44Z progress: 43 / 120
20-Mar-2020 18:19:14 2020-03-20T18:19:14Z progress: 46 / 120
20-Mar-2020 18:19:44 2020-03-20T18:19:44Z progress: 46 / 120
20-Mar-2020 18:20:14 2020-03-20T18:20:14Z progress: 46 / 120
20-Mar-2020 18:20:44 2020-03-20T18:20:44Z progress: 47 / 120
20-Mar-2020 18:21:14 2020-03-20T18:21:14Z progress: 53 / 120
20-Mar-2020 18:21:44 2020-03-20T18:21:44Z progress: 58 / 120
20-Mar-2020 18:22:14 2020-03-20T18:22:14Z progress: 59 / 120
20-Mar-2020 18:22:44 2020-03-20T18:22:44Z progress: 59 / 120
20-Mar-2020 18:23:14 2020-03-20T18:23:14Z progress: 59 / 120
20-Mar-2020 18:23:44 2020-03-20T18:23:44Z progress: 62 / 120
20-Mar-2020 18:24:14 2020-03-20T18:24:14Z progress: 66 / 120
20-Mar-2020 18:24:44 2020-03-20T18:24:44Z progress: 71 / 120
20-Mar-2020 18:25:14 2020-03-20T18:25:14Z progress: 77 / 120
20-Mar-2020 18:25:44 2020-03-20T18:25:44Z progress: 77 / 120
20-Mar-2020 18:26:14 2020-03-20T18:26:14Z progress: 77 / 120
20-Mar-2020 18:26:44 2020-03-20T18:26:44Z progress: 77 / 120
20-Mar-2020 18:27:14 2020-03-20T18:27:14Z progress: 78 / 120
20-Mar-2020 18:27:44 2020-03-20T18:27:44Z progress: 87 / 120
20-Mar-2020 18:28:14 2020-03-20T18:28:14Z progress: 96 / 120
20-Mar-2020 18:28:44 2020-03-20T18:28:44Z progress: 104 / 120
20-Mar-2020 18:29:14 2020-03-20T18:29:14Z progress: 109 / 120
20-Mar-2020 18:29:44 2020-03-20T18:29:44Z progress: 111 / 120
20-Mar-2020 18:30:14 2020-03-20T18:30:14Z progress: 113 / 120
20-Mar-2020 18:30:44 2020-03-20T18:30:44Z progress: 119 / 120
20-Mar-2020 18:31:14 2020-03-20T18:31:14Z Cluster 00053556 is complete and active
20-Mar-2020 18:31:14 Searching for Coopr service: cloudera-manager
20-Mar-2020 18:31:14 2020-03-20T18:31:14Z found IP 10.210.0.74 for service cloudera-manager on cluster 00053556
20-Mar-2020 18:31:14 Finished task 'Execute coopr-runner-wrapper to spin up cloudera-manager' with result: Success
20-Mar-2020 18:31:14 Starting task 'Extract cluster id' of type 'com.atlassian.bamboo.plugins.variable.updater.variable-updater-generic:variable-file-reader'
20-Mar-2020 18:31:14 Variable wasn't found in the Build context. It possibly doesn't exist.
20-Mar-2020 18:31:14 Changing variable remote-cluster-id of type JOB from null to 00053556
20-Mar-2020 18:31:14 Finished task 'Extract cluster id' with result: Success
20-Mar-2020 18:31:14 Starting task 'Extract Cloudera Manager IP' of type 'com.atlassian.bamboo.plugins.variable.updater.variable-updater-generic:variable-file-reader'
20-Mar-2020 18:31:14 Variable wasn't found in the Build context. It possibly doesn't exist.
20-Mar-2020 18:31:14 Changing variable cloudera-manager-ip of type JOB from null to 10.210.0.74
20-Mar-2020 18:31:14 Finished task 'Extract Cloudera Manager IP' with result: Success
20-Mar-2020 18:31:14
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.74
20-Mar-2020 18:31:14
Substituting variable: ${bamboo.inject.package.version} with 6.2.0.1584671288450
20-Mar-2020 18:31:14
Substituting variable: ${bamboo.inject.package.iteration} with 1
20-Mar-2020 18:31:14
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.74
20-Mar-2020 18:31:14
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.74
20-Mar-2020 18:31:14
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.74
20-Mar-2020 18:31:14
Substituting variable: ${bamboo.inject.package.version} with 6.2.0.1584671288450
20-Mar-2020 18:31:14
Substituting variable: ${bamboo.inject.package.iteration} with 1
20-Mar-2020 18:31:14
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.74
20-Mar-2020 18:31:14 Starting task 'Copy Parcel to remote CM host and instantiate Parcel Repo' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
20-Mar-2020 18:31:14
Beginning to execute external process for build 'Integration Tests - CM Spark2 - Spark 2.2 Release 2 #644 (IT-CMSPARK2-CMSPK22R2-644)'
... running command line:
/bin/sh /var/bamboo/temp/IT-CMSPARK2-CMSPK22R2-644-ScriptBuildTask-9127426810435409541.sh
... in: /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
... using extra environment variables:
bamboo_planRepository_1_branch=develop
bamboo_planRepository_2_branch=develop
bamboo_inject_delta_maven_version=0.1.0-SNAPSHOT
bamboo_planRepository_1_branchDisplayName=develop
bamboo_inject_buildNumber=2269
bamboo_repository_revision_number=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_inject_sql_pipelines_maven_version=6.2.0-SNAPSHOT
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_18=/bin/sh /var/bamboo/temp/IT-CMSPARK2-CMSPK22R2-644-ScriptBuildTask-1267415613973304975.sh
bamboo_capability_system_builder_command_s3cmd=/usr/bin/s3cmd
bamboo_docs_s3_bucket=docs.cask.co
bamboo_buildKey=IT-CMSPARK2-CMSPK22R2
bamboo_repository_77005186_git_branch=develop
bamboo_itn_kdc_admin_user_password=********
bamboo_gpg_password=********
bamboo_ops_gpg_password=********
bamboo_planRepository_2_branchDisplayName=develop
bamboo_shortJobName=Spark 2.2 Release 2
bamboo_buildResultsUrl=https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644
bamboo_capability_system_builder_mvn3_Maven_3_1=/opt/maven
bamboo_planRepository_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_s3_bucket=repository.cask.co
bamboo_repository_77005187_previous_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_aws_secret_access_key_password=********
bamboo_capability_system_builder_mvn3_Maven_3_6=/opt/maven
bamboo_agentId=21266433
bamboo_inject_package_full_version=6.2.0.1584671288450-1
bamboo_inject_dre_maven_version=1.4.0-SNAPSHOT
bamboo_inject_docker_repo=caskdata/cdap-sandbox
bamboo_capability_Swapfile=true
bamboo_inject_cdap_maven_version=6.2.0-SNAPSHOT
bamboo_repository_77005187_revision_number=a4f0e696fb10f6d22a8035f2904a45080c86ec67
bamboo_planRepository_revision=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_planRepository_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_freight=true
bamboo_repository_branch_name=develop
bamboo_itn_uri_password=********
bamboo_kdc_address_password=********
bamboo_capability_GPG=true
bamboo_capability_system_jdk_Oracle_JDK_8=/usr/lib/jvm/jdk8
bamboo_capability_system_jdk_Oracle_JDK_7=/usr/lib/jvm/jdk7
bamboo_dependenciesDisabled=false
bamboo_inject_cdap_version=6.2.0-SNAPSHOT
bamboo_downloads_s3_bucket=downloads.cask.co
bamboo_planRepository_branch=develop
bamboo_itn_provider=gce-audi
bamboo_inject_vm_artifact_name=cdap-sandbox
bamboo_capability_system_jdk_OpenJDK_1_8=/usr/lib/jvm/java-1.8.0
bamboo_inject_package_version=6.2.0.1584671288450
bamboo_inject_database_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_market_s3_access_key_password=********
bamboo_planRepository_1_type=gitv2
bamboo_planRepository_branchName=develop
bamboo_capability_rsync=true
bamboo_market_cloudfront_secret_key_password=********
bamboo_capability_system_jdk_JDK=/usr/lib/jvm/java
bamboo_hg_cache_directory=/var/bamboo/xml-data/build-dir/_hg-repositories-cache
bamboo_planRepository_1_username=
bamboo_planRepository_type=gitv2
bamboo_ManualBuildTriggerReason_userName=derek
bamboo_capability_expect=true
bamboo_itn_cdap_username=bob
bamboo_git_cache_directory=/var/bamboo/xml-data/build-dir/_git-repositories-cache
bamboo_planRepository_2_branchName=develop
bamboo_capability_RSYNC=rsync
bamboo_capability_system_builder_node_Node_js=/usr/bin/node
bamboo_capability_system_builder_mvn3_Maven_3=/opt/maven
bamboo_tmp_directory=/var/bamboo/temp
bamboo_planKey=IT-CMSPARK2
bamboo_hide_jdk_mirror_password=********
bamboo_planRepository_username=
bamboo_repository_77005186_git_username=
bamboo_capability_s3cmd=true
bamboo_planRepository_1_branchName=develop
bamboo_inject_cdap_version_stripped=6.2.0
bamboo_itn_tenant_password=********
bamboo_resultsUrl=https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644
bamboo_inject_cdap_version_maj_min=6.2
bamboo_capability_Sphinx=true
bamboo_build_working_directory=/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
bamboo_planRepository_1_name=cdapio/cdap-integration-tests
bamboo_inject_mmds_maven_version=1.4.0-SNAPSHOT
bamboo_shortPlanName=CM Spark2
bamboo_repository_77005186_name=cdapio/cdap-integration-tests
bamboo_planRepository_2_username=caskdata-ro
bamboo_planRepository_name=cdapio/cdap-integration-tests
bamboo_capability_git_lfs=true
bamboo_buildNumber=644
bamboo_itn_hardwaretype=standard-2xlarge
bamboo_repository_77005187_git_branch=develop
bamboo_inject_cdap_security_extn_maven_version=0.11.0-SNAPSHOT
bamboo_planName=Integration Tests - CM Spark2
bamboo_shortPlanKey=CMSPARK2
bamboo_repository_77005186_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_77005187_name=cdapio/coopr-internal
bamboo_shortJobKey=CMSPK22R2
bamboo_cdap_test=AllTests
bamboo_planRepository_2_name=cdapio/coopr-internal
bamboo_itn_cdap_password=********
bamboo_buildTimeStamp=2020-03-20T18:02:38.097Z
bamboo_repository_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_s3_bucket=repository.cask.co
bamboo_capability_system_builder_command_Docker=/usr/bin/docker
bamboo_repository_git_branch=develop
bamboo_buildResultKey=IT-CMSPARK2-CMSPK22R2-644
bamboo_market_s3_secret_key_password=********
bamboo_buildPlanName=Integration Tests - CM Spark2 - Spark 2.2 Release 2
bamboo_capability_system_jdk_JDK_1_8_0_101=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_system_builder_command_fpm=/opt/rbenv/shims/fpm
bamboo_repository_77005187_git_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_capability_Platform=rhel
bamboo_planRepository_1_revision=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_itn_imagetype=centos6
bamboo_repository_77005186_revision_number=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_itn_kdc_admin_password=********
bamboo_repository_name=cdapio/coopr-internal
bamboo_inject_standalone_artifact=cdap-sandbox-6.2.0-SNAPSHOT.zip
bamboo_planRepository_2_previousRevision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_buildFailed=false
bamboo_capability_system_docker_executable=/usr/bin/docker
bamboo_repository_77005187_branch_name=develop
bamboo_repository_77005186_branch_name=develop
bamboo_cloudera_manager_ip=10.210.0.74
bamboo_agentWorkingDirectory=/var/bamboo/xml-data/build-dir
bamboo_planRepository_2_revision=a4f0e696fb10f6d22a8035f2904a45080c86ec67
bamboo_capability_system_git_executable=/usr/local/bin/git
bamboo_repository_git_username=
bamboo_capability_system_jdk_JDK_1_8_0_232=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64
bamboo_planRepository_1_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_system_builder_command_Ruby=/opt/rbenv/shims/ruby
bamboo_itn_user=bamboo
bamboo_planRepository_branchDisplayName=develop
bamboo_inject_bigquery_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_inject_package_iteration=1
bamboo_repository_77005186_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_aws_access_key_password=********
bamboo_planRepository_2_type=gitv2
bamboo_capability_system_builder_mvn3_Maven_3_x=/opt/maven
bamboo_inject_standalone_artifact_name=cdap-sandbox
bamboo_plan_storageTag=plan-75497717
bamboo_planRepository_2_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_repository_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_remote_cluster_id=00053556
bamboo_market_cloudfront_access_key_password=********
bamboo_working_directory=/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_command_3=/opt/rbenv/shims/ruby cdap-integration-tests/bin/coopr-runner-wrapper.rb --num-machines 6 --name IT-CMSPARK2-CMSPK22R2-644- --uri ******** --tenant ******** --user bamboo --cluster-service-to-check cloudera-manager --cluster-service-ip-file cloudera-manager-ip.txt --config { "cloudera_manager": { "services": { "cdap": { "serviceConfigs": { "security_authorization_extension_jar_path":"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar" } } } } } --services cloudera-manager-agent,generic-users
bamboo_planRepository_1_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_capability_createrepo=true
bamboo_capability_system_jdk_JDK_1_8=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_rpm_build=true
bamboo_capability_system_jdk_JDK_1_7=/usr/lib/jvm/jdk1.7.0_75
bamboo_inject_hydrator_plugins_maven_version=2.4.0-SNAPSHOT
bamboo_repository_77005187_git_username=caskdata-ro
20-Mar-2020 18:31:14 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:15 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:22 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:23 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:23 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:23 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:24 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:24 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:24 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:25 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:25 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:25 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:25 Finished task 'Copy Parcel to remote CM host and instantiate Parcel Repo' with result: Success
20-Mar-2020 18:31:25
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.74
20-Mar-2020 18:31:25
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.74
20-Mar-2020 18:31:25
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.74
20-Mar-2020 18:31:25
Substituting variable: ${bamboo.cloudera-manager-ip} with 10.210.0.74
20-Mar-2020 18:31:25 Starting task 'Replace CSD on remote' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script'
20-Mar-2020 18:31:25
Beginning to execute external process for build 'Integration Tests - CM Spark2 - Spark 2.2 Release 2 #644 (IT-CMSPARK2-CMSPK22R2-644)'
... running command line:
/bin/sh /var/bamboo/temp/IT-CMSPARK2-CMSPK22R2-644-ScriptBuildTask-9205457978212079362.sh
... in: /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
... using extra environment variables:
bamboo_planRepository_1_branch=develop
bamboo_planRepository_2_branch=develop
bamboo_inject_delta_maven_version=0.1.0-SNAPSHOT
bamboo_planRepository_1_branchDisplayName=develop
bamboo_inject_buildNumber=2269
bamboo_repository_revision_number=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_inject_sql_pipelines_maven_version=6.2.0-SNAPSHOT
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_18=/bin/sh /var/bamboo/temp/IT-CMSPARK2-CMSPK22R2-644-ScriptBuildTask-1267415613973304975.sh
bamboo_capability_system_builder_command_s3cmd=/usr/bin/s3cmd
bamboo_docs_s3_bucket=docs.cask.co
bamboo_buildKey=IT-CMSPARK2-CMSPK22R2
bamboo_repository_77005186_git_branch=develop
bamboo_itn_kdc_admin_user_password=********
bamboo_gpg_password=********
bamboo_ops_gpg_password=********
bamboo_planRepository_2_branchDisplayName=develop
bamboo_shortJobName=Spark 2.2 Release 2
bamboo_buildResultsUrl=https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644
bamboo_capability_system_builder_mvn3_Maven_3_1=/opt/maven
bamboo_planRepository_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_s3_bucket=repository.cask.co
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_20=/bin/sh /var/bamboo/temp/IT-CMSPARK2-CMSPK22R2-644-ScriptBuildTask-9127426810435409541.sh
bamboo_repository_77005187_previous_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_aws_secret_access_key_password=********
bamboo_capability_system_builder_mvn3_Maven_3_6=/opt/maven
bamboo_agentId=21266433
bamboo_inject_package_full_version=6.2.0.1584671288450-1
bamboo_inject_dre_maven_version=1.4.0-SNAPSHOT
bamboo_inject_docker_repo=caskdata/cdap-sandbox
bamboo_capability_Swapfile=true
bamboo_inject_cdap_maven_version=6.2.0-SNAPSHOT
bamboo_repository_77005187_revision_number=a4f0e696fb10f6d22a8035f2904a45080c86ec67
bamboo_planRepository_revision=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_planRepository_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_freight=true
bamboo_repository_branch_name=develop
bamboo_itn_uri_password=********
bamboo_kdc_address_password=********
bamboo_capability_GPG=true
bamboo_capability_system_jdk_Oracle_JDK_8=/usr/lib/jvm/jdk8
bamboo_capability_system_jdk_Oracle_JDK_7=/usr/lib/jvm/jdk7
bamboo_dependenciesDisabled=false
bamboo_inject_cdap_version=6.2.0-SNAPSHOT
bamboo_downloads_s3_bucket=downloads.cask.co
bamboo_planRepository_branch=develop
bamboo_itn_provider=gce-audi
bamboo_inject_vm_artifact_name=cdap-sandbox
bamboo_capability_system_jdk_OpenJDK_1_8=/usr/lib/jvm/java-1.8.0
bamboo_inject_package_version=6.2.0.1584671288450
bamboo_inject_database_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_market_s3_access_key_password=********
bamboo_planRepository_1_type=gitv2
bamboo_planRepository_branchName=develop
bamboo_capability_rsync=true
bamboo_market_cloudfront_secret_key_password=********
bamboo_capability_system_jdk_JDK=/usr/lib/jvm/java
bamboo_hg_cache_directory=/var/bamboo/xml-data/build-dir/_hg-repositories-cache
bamboo_planRepository_1_username=
bamboo_planRepository_type=gitv2
bamboo_ManualBuildTriggerReason_userName=derek
bamboo_capability_expect=true
bamboo_itn_cdap_username=bob
bamboo_git_cache_directory=/var/bamboo/xml-data/build-dir/_git-repositories-cache
bamboo_planRepository_2_branchName=develop
bamboo_capability_RSYNC=rsync
bamboo_capability_system_builder_node_Node_js=/usr/bin/node
bamboo_capability_system_builder_mvn3_Maven_3=/opt/maven
bamboo_tmp_directory=/var/bamboo/temp
bamboo_planKey=IT-CMSPARK2
bamboo_hide_jdk_mirror_password=********
bamboo_planRepository_username=
bamboo_repository_77005186_git_username=
bamboo_capability_s3cmd=true
bamboo_planRepository_1_branchName=develop
bamboo_inject_cdap_version_stripped=6.2.0
bamboo_itn_tenant_password=********
bamboo_resultsUrl=https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644
bamboo_inject_cdap_version_maj_min=6.2
bamboo_capability_Sphinx=true
bamboo_build_working_directory=/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
bamboo_planRepository_1_name=cdapio/cdap-integration-tests
bamboo_inject_mmds_maven_version=1.4.0-SNAPSHOT
bamboo_shortPlanName=CM Spark2
bamboo_repository_77005186_name=cdapio/cdap-integration-tests
bamboo_planRepository_2_username=caskdata-ro
bamboo_planRepository_name=cdapio/cdap-integration-tests
bamboo_capability_git_lfs=true
bamboo_buildNumber=644
bamboo_itn_hardwaretype=standard-2xlarge
bamboo_repository_77005187_git_branch=develop
bamboo_inject_cdap_security_extn_maven_version=0.11.0-SNAPSHOT
bamboo_planName=Integration Tests - CM Spark2
bamboo_shortPlanKey=CMSPARK2
bamboo_repository_77005186_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_77005187_name=cdapio/coopr-internal
bamboo_shortJobKey=CMSPK22R2
bamboo_cdap_test=AllTests
bamboo_planRepository_2_name=cdapio/coopr-internal
bamboo_itn_cdap_password=********
bamboo_buildTimeStamp=2020-03-20T18:02:38.097Z
bamboo_repository_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_s3_bucket=repository.cask.co
bamboo_capability_system_builder_command_Docker=/usr/bin/docker
bamboo_repository_git_branch=develop
bamboo_buildResultKey=IT-CMSPARK2-CMSPK22R2-644
bamboo_market_s3_secret_key_password=********
bamboo_buildPlanName=Integration Tests - CM Spark2 - Spark 2.2 Release 2
bamboo_capability_system_jdk_JDK_1_8_0_101=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_system_builder_command_fpm=/opt/rbenv/shims/fpm
bamboo_repository_77005187_git_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_capability_Platform=rhel
bamboo_planRepository_1_revision=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_itn_imagetype=centos6
bamboo_repository_77005186_revision_number=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_itn_kdc_admin_password=********
bamboo_repository_name=cdapio/coopr-internal
bamboo_inject_standalone_artifact=cdap-sandbox-6.2.0-SNAPSHOT.zip
bamboo_planRepository_2_previousRevision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_buildFailed=false
bamboo_capability_system_docker_executable=/usr/bin/docker
bamboo_repository_77005187_branch_name=develop
bamboo_repository_77005186_branch_name=develop
bamboo_cloudera_manager_ip=10.210.0.74
bamboo_agentWorkingDirectory=/var/bamboo/xml-data/build-dir
bamboo_planRepository_2_revision=a4f0e696fb10f6d22a8035f2904a45080c86ec67
bamboo_capability_system_git_executable=/usr/local/bin/git
bamboo_repository_git_username=
bamboo_capability_system_jdk_JDK_1_8_0_232=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64
bamboo_planRepository_1_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_system_builder_command_Ruby=/opt/rbenv/shims/ruby
bamboo_itn_user=bamboo
bamboo_planRepository_branchDisplayName=develop
bamboo_inject_bigquery_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_inject_package_iteration=1
bamboo_repository_77005186_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_aws_access_key_password=********
bamboo_planRepository_2_type=gitv2
bamboo_capability_system_builder_mvn3_Maven_3_x=/opt/maven
bamboo_inject_standalone_artifact_name=cdap-sandbox
bamboo_plan_storageTag=plan-75497717
bamboo_planRepository_2_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_repository_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_remote_cluster_id=00053556
bamboo_market_cloudfront_access_key_password=********
bamboo_working_directory=/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_command_3=/opt/rbenv/shims/ruby cdap-integration-tests/bin/coopr-runner-wrapper.rb --num-machines 6 --name IT-CMSPARK2-CMSPK22R2-644- --uri ******** --tenant ******** --user bamboo --cluster-service-to-check cloudera-manager --cluster-service-ip-file cloudera-manager-ip.txt --config { "cloudera_manager": { "services": { "cdap": { "serviceConfigs": { "security_authorization_extension_jar_path":"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar" } } } } } --services cloudera-manager-agent,generic-users
bamboo_planRepository_1_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_capability_createrepo=true
bamboo_capability_system_jdk_JDK_1_8=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_rpm_build=true
bamboo_capability_system_jdk_JDK_1_7=/usr/lib/jvm/jdk1.7.0_75
bamboo_inject_hydrator_plugins_maven_version=2.4.0-SNAPSHOT
bamboo_repository_77005187_git_username=caskdata-ro
20-Mar-2020 18:31:26 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:26 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:26 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:27 Warning: Permanently added '10.210.0.74' (RSA) to the list of known hosts.
20-Mar-2020 18:31:29 Stopping cloudera-scm-server: [  OK  ]
20-Mar-2020 18:31:34 Starting cloudera-scm-server: [  OK  ]
20-Mar-2020 18:31:34 Finished task 'Replace CSD on remote' with result: Success
20-Mar-2020 18:31:34
Substituting password variable: ${bamboo.itn.uri.password}
20-Mar-2020 18:31:34
Substituting password variable: ${bamboo.itn.tenant.password}
20-Mar-2020 18:31:34
Substituting variable: ${bamboo.itn.user} with bamboo
20-Mar-2020 18:31:34
Substituting password variable: ${bamboo.itn.kdc.admin.user.password}
20-Mar-2020 18:31:34
Substituting password variable: ${bamboo.itn.kdc.admin.password}
20-Mar-2020 18:31:34
Substituting variable: ${bamboo.inject.package.version} with 6.2.0.1584671288450
20-Mar-2020 18:31:34
Substituting variable: ${bamboo.inject.package.iteration} with 1
20-Mar-2020 18:31:34
Substituting variable: ${bamboo.remote-cluster-id} with 00053556
20-Mar-2020 18:31:34 Starting task 'Execute coopr-base-to-cm' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.command'
20-Mar-2020 18:31:34
Beginning to execute external process for build 'Integration Tests - CM Spark2 - Spark 2.2 Release 2 #644 (IT-CMSPARK2-CMSPK22R2-644)'
... running command line:
/opt/rbenv/shims/ruby coopr_base_to_cm.rb --spark2 --coopr-uri ******** --coopr-tenant ******** --coopr-user bamboo --kdc-admin-user ******** --kdc-admin-password ******** --cdap-parcel-version 6.2.0.1584671288450-1 --remote-parcel-repo-url http://localhost:8080/itnparcelrepo --debug -i 00053556
... in: /var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/coopr-internal/bin
... using extra environment variables:
bamboo_planRepository_1_branch=develop
bamboo_planRepository_2_branch=develop
bamboo_inject_delta_maven_version=0.1.0-SNAPSHOT
bamboo_planRepository_1_branchDisplayName=develop
bamboo_inject_buildNumber=2269
bamboo_repository_revision_number=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_17=/bin/sh /var/bamboo/temp/IT-CMSPARK2-CMSPK22R2-644-ScriptBuildTask-9205457978212079362.sh
bamboo_inject_sql_pipelines_maven_version=6.2.0-SNAPSHOT
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_18=/bin/sh /var/bamboo/temp/IT-CMSPARK2-CMSPK22R2-644-ScriptBuildTask-1267415613973304975.sh
bamboo_capability_system_builder_command_s3cmd=/usr/bin/s3cmd
bamboo_docs_s3_bucket=docs.cask.co
bamboo_buildKey=IT-CMSPARK2-CMSPK22R2
bamboo_repository_77005186_git_branch=develop
bamboo_itn_kdc_admin_user_password=********
bamboo_gpg_password=********
bamboo_ops_gpg_password=********
bamboo_planRepository_2_branchDisplayName=develop
bamboo_shortJobName=Spark 2.2 Release 2
bamboo_buildResultsUrl=https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644
bamboo_capability_system_builder_mvn3_Maven_3_1=/opt/maven
bamboo_planRepository_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_s3_bucket=repository.cask.co
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_script_20=/bin/sh /var/bamboo/temp/IT-CMSPARK2-CMSPK22R2-644-ScriptBuildTask-9127426810435409541.sh
bamboo_repository_77005187_previous_revision_number=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_aws_secret_access_key_password=********
bamboo_capability_system_builder_mvn3_Maven_3_6=/opt/maven
bamboo_agentId=21266433
bamboo_inject_package_full_version=6.2.0.1584671288450-1
bamboo_inject_dre_maven_version=1.4.0-SNAPSHOT
bamboo_inject_docker_repo=caskdata/cdap-sandbox
bamboo_capability_Swapfile=true
bamboo_inject_cdap_maven_version=6.2.0-SNAPSHOT
bamboo_repository_77005187_revision_number=a4f0e696fb10f6d22a8035f2904a45080c86ec67
bamboo_planRepository_revision=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_planRepository_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_freight=true
bamboo_repository_branch_name=develop
bamboo_itn_uri_password=********
bamboo_kdc_address_password=********
bamboo_capability_GPG=true
bamboo_capability_system_jdk_Oracle_JDK_8=/usr/lib/jvm/jdk8
bamboo_capability_system_jdk_Oracle_JDK_7=/usr/lib/jvm/jdk7
bamboo_dependenciesDisabled=false
bamboo_inject_cdap_version=6.2.0-SNAPSHOT
bamboo_downloads_s3_bucket=downloads.cask.co
bamboo_planRepository_branch=develop
bamboo_itn_provider=gce-audi
bamboo_inject_vm_artifact_name=cdap-sandbox
bamboo_capability_system_jdk_OpenJDK_1_8=/usr/lib/jvm/java-1.8.0
bamboo_inject_package_version=6.2.0.1584671288450
bamboo_inject_database_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_market_s3_access_key_password=********
bamboo_planRepository_1_type=gitv2
bamboo_planRepository_branchName=develop
bamboo_capability_rsync=true
bamboo_market_cloudfront_secret_key_password=********
bamboo_capability_system_jdk_JDK=/usr/lib/jvm/java
bamboo_hg_cache_directory=/var/bamboo/xml-data/build-dir/_hg-repositories-cache
bamboo_planRepository_1_username=
bamboo_planRepository_type=gitv2
bamboo_ManualBuildTriggerReason_userName=derek
bamboo_capability_expect=true
bamboo_itn_cdap_username=bob
bamboo_git_cache_directory=/var/bamboo/xml-data/build-dir/_git-repositories-cache
bamboo_planRepository_2_branchName=develop
bamboo_capability_RSYNC=rsync
bamboo_capability_system_builder_node_Node_js=/usr/bin/node
bamboo_capability_system_builder_mvn3_Maven_3=/opt/maven
bamboo_tmp_directory=/var/bamboo/temp
bamboo_planKey=IT-CMSPARK2
bamboo_hide_jdk_mirror_password=********
bamboo_planRepository_username=
bamboo_repository_77005186_git_username=
bamboo_capability_s3cmd=true
bamboo_planRepository_1_branchName=develop
bamboo_inject_cdap_version_stripped=6.2.0
bamboo_itn_tenant_password=********
bamboo_resultsUrl=https://builds.cask.co/browse/IT-CMSPARK2-CMSPK22R2-644
bamboo_inject_cdap_version_maj_min=6.2
bamboo_capability_Sphinx=true
bamboo_build_working_directory=/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
bamboo_planRepository_1_name=cdapio/cdap-integration-tests
bamboo_inject_mmds_maven_version=1.4.0-SNAPSHOT
bamboo_shortPlanName=CM Spark2
bamboo_repository_77005186_name=cdapio/cdap-integration-tests
bamboo_planRepository_2_username=caskdata-ro
bamboo_planRepository_name=cdapio/cdap-integration-tests
bamboo_capability_git_lfs=true
bamboo_buildNumber=644
bamboo_itn_hardwaretype=standard-2xlarge
bamboo_repository_77005187_git_branch=develop
bamboo_inject_cdap_security_extn_maven_version=0.11.0-SNAPSHOT
bamboo_planName=Integration Tests - CM Spark2
bamboo_shortPlanKey=CMSPARK2
bamboo_repository_77005186_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_repository_77005187_name=cdapio/coopr-internal
bamboo_shortJobKey=CMSPK22R2
bamboo_cdap_test=AllTests
bamboo_planRepository_2_name=cdapio/coopr-internal
bamboo_itn_cdap_password=********
bamboo_buildTimeStamp=2020-03-20T18:02:38.097Z
bamboo_repository_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_s3_bucket=repository.cask.co
bamboo_capability_system_builder_command_Docker=/usr/bin/docker
bamboo_repository_git_branch=develop
bamboo_buildResultKey=IT-CMSPARK2-CMSPK22R2-644
bamboo_market_s3_secret_key_password=********
bamboo_buildPlanName=Integration Tests - CM Spark2 - Spark 2.2 Release 2
bamboo_capability_system_jdk_JDK_1_8_0_101=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_system_builder_command_fpm=/opt/rbenv/shims/fpm
bamboo_repository_77005187_git_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_capability_Platform=rhel
bamboo_planRepository_1_revision=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_itn_imagetype=centos6
bamboo_repository_77005186_revision_number=82f085e14e04ac4db8a4afb3cdc4f73022f2ab30
bamboo_itn_kdc_admin_password=********
bamboo_repository_name=cdapio/coopr-internal
bamboo_inject_standalone_artifact=cdap-sandbox-6.2.0-SNAPSHOT.zip
bamboo_planRepository_2_previousRevision=8c2797da17295a6737c5c746943af521cf6bb43f
bamboo_buildFailed=false
bamboo_capability_system_docker_executable=/usr/bin/docker
bamboo_repository_77005187_branch_name=develop
bamboo_repository_77005186_branch_name=develop
bamboo_cloudera_manager_ip=10.210.0.74
bamboo_agentWorkingDirectory=/var/bamboo/xml-data/build-dir
bamboo_planRepository_2_revision=a4f0e696fb10f6d22a8035f2904a45080c86ec67
bamboo_capability_system_git_executable=/usr/local/bin/git
bamboo_repository_git_username=
bamboo_capability_system_jdk_JDK_1_8_0_232=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.232.b09-1.el6_10.x86_64
bamboo_planRepository_1_previousRevision=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_capability_system_builder_command_Ruby=/opt/rbenv/shims/ruby
bamboo_itn_user=bamboo
bamboo_planRepository_branchDisplayName=develop
bamboo_inject_bigquery_delta_plugins_maven_version=0.1.0-SNAPSHOT
bamboo_inject_package_iteration=1
bamboo_repository_77005186_previous_revision_number=7e19abdd205b4a52461c1e10822afff44b877b75
bamboo_aws_access_key_password=********
bamboo_planRepository_2_type=gitv2
bamboo_capability_system_builder_mvn3_Maven_3_x=/opt/maven
bamboo_inject_standalone_artifact_name=cdap-sandbox
bamboo_plan_storageTag=plan-75497717
bamboo_planRepository_2_repositoryUrl=https://github.com/cdapio/coopr-internal
bamboo_repository_git_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
COOPR_DRIVER_CLUSTER_SERVICE_IP_FILE=cdap-auto-ip.txt
bamboo_remote_cluster_id=00053556
bamboo_market_cloudfront_access_key_password=********
bamboo_working_directory=/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2
bamboo_build_commandline_com_atlassian_bamboo_plugins_scripttask_task_builder_command_3=/opt/rbenv/shims/ruby cdap-integration-tests/bin/coopr-runner-wrapper.rb --num-machines 6 --name IT-CMSPARK2-CMSPK22R2-644- --uri ******** --tenant ******** --user bamboo --cluster-service-to-check cloudera-manager --cluster-service-ip-file cloudera-manager-ip.txt --config { "cloudera_manager": { "services": { "cdap": { "serviceConfigs": { "security_authorization_extension_jar_path":"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar" } } } } } --services cloudera-manager-agent,generic-users
bamboo_planRepository_1_repositoryUrl=https://github.com/cdapio/cdap-integration-tests
bamboo_capability_createrepo=true
bamboo_capability_system_jdk_JDK_1_8=/usr/lib/jvm/jdk1.8.0_101
bamboo_capability_rpm_build=true
bamboo_capability_system_jdk_JDK_1_7=/usr/lib/jvm/jdk1.7.0_75
bamboo_inject_hydrator_plugins_maven_version=2.4.0-SNAPSHOT
bamboo_repository_77005187_git_username=caskdata-ro
20-Mar-2020 18:31:35 2020-03-20 18:31:35 +0000 DEBUG: Found Cloudera Manager on host it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh. Configuring cluster to use it
20-Mar-2020 18:31:35 2020-03-20 18:31:35 +0000 INFO: Confirming CM API responsiveness
20-Mar-2020 18:32:00 #<Errno::ECONNREFUSED: Connection refused - connect(2)>
20-Mar-2020 18:32:13 .
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 INFO: ------------ Configure Hosts ----------------
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Response: {"items"=>[{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd", "ipAddress"=>"10.210.0.74", "hostname"=>"it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/hostRedirect/0a0a2ea0-acea-44dc-8b8b-dedc978aacbd", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}, {"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8", "ipAddress"=>"10.210.0.73", "hostname"=>"it-cmspark2-cmspk22r2-644-53556-1001.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/hostRedirect/766dd13d-6fe2-4dc0-8361-bf6c56f844a8", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}, {"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9", "ipAddress"=>"10.210.0.75", "hostname"=>"it-cmspark2-cmspk22r2-644-53556-1002.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/hostRedirect/6f1aa864-e7f8-456e-99be-22275c5915b9", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}, {"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d", "ipAddress"=>"10.210.0.67", "hostname"=>"it-cmspark2-cmspk22r2-644-53556-1003.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/hostRedirect/5cbaf150-38ca-4130-80c1-6fefcba4407d", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}, {"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3", "ipAddress"=>"10.210.0.66", "hostname"=>"it-cmspark2-cmspk22r2-644-53556-1004.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/hostRedirect/37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}, {"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87", "ipAddress"=>"10.210.0.128", "hostname"=>"it-cmspark2-cmspk22r2-644-53556-1005.coopr.sh", "rackId"=>"/default", "hostUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/hostRedirect/1113d35c-f3cb-4950-9c71-91440c35ba87", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "numCores"=>8, "totalPhysMemBytes"=>31688540160}]}
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Request: {"items"=>[{"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}, {"name"=>"host_dns_resolution_enabled", "value"=>"false"}]}
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Response: {"items"=>[{"name"=>"host_dns_resolution_enabled", "value"=>"false"}, {"name"=>"parcels_directory", "value"=>"/data/cloudera/parcels"}]}
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 INFO: ------------ Configure CM for Cask Internal --------------
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Request: {"items"=>[{"name"=>"KRB_MANAGE_KRB5_CONF", "value"=>"true"}, {"name"=>"KDC_HOST", "value"=>"10.240.209.207"}, {"name"=>"KRB_ENC_TYPES", "value"=>"aes256-cts-hmac-sha1-96 aes128-cts-hmac-sha1-96 des3-cbc-sha1 arcfour-hmac"}, {"name"=>"SECURITY_REALM", "value"=>"CONTINUUITY.NET"}, {"name"=>"CUSTOM_BANNER_HTML", "value"=>"Cluster 00053556"}, {"name"=>"CUSTOM_HEADER_COLOR", "value"=>"GREEN"}, {"name"=>"SESSION_TIMEOUT", "value"=>"3600"}, {"name"=>"PARCEL_UPDATE_FREQ", "value"=>"1"}, {"name"=>"ENABLE_API_DEBUG", "value"=>"true"}, {"name"=>"REMOTE_PARCEL_REPO_URLS", "value"=>"https://archive.cloudera.com/cdh5/parcels/{latest_supported}/,https://archive.cloudera.com/cdh4/parcels/latest/,https://archive.cloudera.com/impala/parcels/latest/,https://archive.cloudera.com/search/parcels/latest/,http://repository.cask.co/parcels/cdap/5.1/,http://archive.cloudera.com/spark2/parcels/2.2.0.cloudera2/,https://archive.cloudera.com/accumulo/parcels/1.4/,https://archive.cloudera.com/accumulo-c5/parcels/latest/,https://archive.cloudera.com/kafka/parcels/latest/,http://archive.cloudera.com/kudu/parcels/5.12/,http://archive.cloudera.com/kudu/parcels/latest/,https://archive.cloudera.com/spark/parcels/latest/,https://archive.cloudera.com/sqoop-connectors/parcels/latest/,http://repository.cask.co/parcels/cdap/6.0/,http://localhost:8080/itnparcelrepo"}]}
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Response: {"items"=>[{"name"=>"CLUSTER_STATS_START", "value"=>"10/23/2012 7:00"}, {"name"=>"CUSTOM_BANNER_HTML", "value"=>"Cluster 00053556"}, {"name"=>"CUSTOM_HEADER_COLOR", "value"=>"GREEN"}, {"name"=>"ENABLE_API_DEBUG", "value"=>"true"}, {"name"=>"KDC_HOST", "value"=>"10.240.209.207"}, {"name"=>"KRB_ENC_TYPES", "value"=>"aes256-cts-hmac-sha1-96 aes128-cts-hmac-sha1-96 des3-cbc-sha1 arcfour-hmac"}, {"name"=>"KRB_MANAGE_KRB5_CONF", "value"=>"true"}, {"name"=>"PARCEL_UPDATE_FREQ", "value"=>"1"}, {"name"=>"REMOTE_PARCEL_REPO_URLS", "value"=>"https://archive.cloudera.com/cdh5/parcels/{latest_supported}/,https://archive.cloudera.com/cdh4/parcels/latest/,https://archive.cloudera.com/impala/parcels/latest/,https://archive.cloudera.com/search/parcels/latest/,http://repository.cask.co/parcels/cdap/5.1/,http://archive.cloudera.com/spark2/parcels/2.2.0.cloudera2/,https://archive.cloudera.com/accumulo/parcels/1.4/,https://archive.cloudera.com/accumulo-c5/parcels/latest/,https://archive.cloudera.com/kafka/parcels/latest/,http://archive.cloudera.com/kudu/parcels/5.12/,http://archive.cloudera.com/kudu/parcels/latest/,https://archive.cloudera.com/spark/parcels/latest/,https://archive.cloudera.com/sqoop-connectors/parcels/latest/,http://repository.cask.co/parcels/cdap/6.0/,http://localhost:8080/itnparcelrepo"}, {"name"=>"SECURITY_REALM", "value"=>"CONTINUUITY.NET"}, {"name"=>"SESSION_TIMEOUT", "value"=>"3600"}]}
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 INFO: ------------ Import KDC admin credentials --------------
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Request: cm/commands/importAdminCredentials?username=cloudera-scm%2Fadmin%40CONTINUUITY.NET&password=********
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 DEBUG: Response: {"id"=>30, "name"=>"ImportCredentials", "startTime"=>"2020-03-20T18:32:13.726Z", "active"=>true, "children"=>{"items"=>[]}}
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 INFO: ------------ Wait for import admin credentials --------------
20-Mar-2020 18:32:13 2020-03-20 18:32:13 +0000 INFO: Waiting for command 30 to complete
20-Mar-2020 18:32:20 ...
20-Mar-2020 18:32:20 2020-03-20 18:32:20 +0000 DEBUG: Response: {"id"=>30, "name"=>"ImportCredentials", "startTime"=>"2020-03-20T18:32:13.726Z", "endTime"=>"2020-03-20T18:32:18.756Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully imported KDC Account Manager credentials.", "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:32:20 2020-03-20 18:32:20 +0000 INFO: ------------ Create Cloudera Management Services --------------
20-Mar-2020 18:32:20 2020-03-20 18:32:20 +0000 DEBUG: Request: {"name"=>"mgmt", "type"=>"MGMT"}
20-Mar-2020 18:32:20 2020-03-20 18:32:20 +0000 DEBUG: Response: {"name"=>"mgmt", "type"=>"MGMT", "serviceUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/mgmt", "roleInstancesUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/mgmt/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"mgmt", "entityStatus"=>"UNKNOWN"}
20-Mar-2020 18:32:20 2020-03-20 18:32:20 +0000 INFO: ------------ AutoAssignRoles for Cloudera Management Services --------------
20-Mar-2020 18:32:20 2020-03-20 18:32:20 +0000 DEBUG: Request: cm/service/autoAssignRoles
20-Mar-2020 18:32:25 2020-03-20 18:32:25 +0000 DEBUG: Response:
20-Mar-2020 18:32:25 2020-03-20 18:32:25 +0000 INFO: ------------ Autoconfigure Cloudera Management Services--------------
20-Mar-2020 18:32:25 2020-03-20 18:32:25 +0000 DEBUG: Request: cm/service/autoConfigure
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Response:
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 INFO: ------------ Configure Alert Publisher for Cask Internal --------------
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Request: {"items"=>[{"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-alertpublisher"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Response: {"items"=>[{"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-alertpublisher"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 INFO: ------------ Configure Event Server for Cask Internal --------------
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Request: {"items"=>[{"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-eventserver"}, {"name"=>"eventserver_index_dir", "value"=>"/data/lib/cloudera-scm-eventserver"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Response: {"items"=>[{"name"=>"event_server_heapsize", "value"=>"1073741824"}, {"name"=>"eventserver_index_dir", "value"=>"/data/lib/cloudera-scm-eventserver"}, {"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-eventserver"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 INFO: ------------ Configure Host Monitor for Cask Internal --------------
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Request: {"items"=>[{"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-firehose"}, {"name"=>"firehose_storage_dir", "value"=>"/data/lib/cloudera-host-monitor"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Response: {"items"=>[{"name"=>"firehose_heapsize", "value"=>"1073741824"}, {"name"=>"firehose_non_java_memory_bytes", "value"=>"1610612736"}, {"name"=>"firehose_storage_dir", "value"=>"/data/lib/cloudera-host-monitor"}, {"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-firehose"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 INFO: ------------ Configure Service Monitor for Cask Internal --------------
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Request: {"items"=>[{"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-firehose"}, {"name"=>"firehose_storage_dir", "value"=>"/data/lib/cloudera-service-monitor"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Response: {"items"=>[{"name"=>"firehose_heapsize", "value"=>"1073741824"}, {"name"=>"firehose_non_java_memory_bytes", "value"=>"1610612736"}, {"name"=>"firehose_storage_dir", "value"=>"/data/lib/cloudera-service-monitor"}, {"name"=>"mgmt_log_dir", "value"=>"/data/log/cloudera-scm-firehose"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 INFO: ------------ Create Cluster --------------
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Request: {"items"=>[{"name"=>"00053556", "displayName"=>"IT-CMSPARK2-CMSPK22R2-644--00053556", "fullVersion"=>5.12}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Response: {"items"=>[{"name"=>"00053556", "displayName"=>"IT-CMSPARK2-CMSPK22R2-644--00053556", "version"=>"CDH5", "fullVersion"=>"5.12.0", "maintenanceMode"=>false, "maintenanceOwners"=>[], "clusterUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/clusterRedirect/00053556", "hostsUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/clusterRedirect/00053556/hosts"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 INFO: ------------ Fetch Available Parcels --------------
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 INFO: ------------ Restore Default CM Parcel Update Frequency --------------
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Request: {"items"=>[{"name"=>"PARCEL_UPDATE_FREQ", "value"=>"60"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Response: {"items"=>[{"name"=>"CLUSTER_STATS_START", "value"=>"10/23/2012 7:00"}, {"name"=>"CUSTOM_BANNER_HTML", "value"=>"Cluster 00053556"}, {"name"=>"CUSTOM_HEADER_COLOR", "value"=>"GREEN"}, {"name"=>"ENABLE_API_DEBUG", "value"=>"true"}, {"name"=>"KDC_HOST", "value"=>"10.240.209.207"}, {"name"=>"KRB_ENC_TYPES", "value"=>"aes256-cts-hmac-sha1-96 aes128-cts-hmac-sha1-96 des3-cbc-sha1 arcfour-hmac"}, {"name"=>"KRB_MANAGE_KRB5_CONF", "value"=>"true"}, {"name"=>"PARCEL_UPDATE_FREQ", "value"=>"60"}, {"name"=>"REMOTE_PARCEL_REPO_URLS", "value"=>"https://archive.cloudera.com/cdh5/parcels/{latest_supported}/,https://archive.cloudera.com/cdh4/parcels/latest/,https://archive.cloudera.com/impala/parcels/latest/,https://archive.cloudera.com/search/parcels/latest/,http://repository.cask.co/parcels/cdap/5.1/,http://archive.cloudera.com/spark2/parcels/2.2.0.cloudera2/,https://archive.cloudera.com/accumulo/parcels/1.4/,https://archive.cloudera.com/accumulo-c5/parcels/latest/,https://archive.cloudera.com/kafka/parcels/latest/,http://archive.cloudera.com/kudu/parcels/5.12/,http://archive.cloudera.com/kudu/parcels/latest/,https://archive.cloudera.com/spark/parcels/latest/,https://archive.cloudera.com/sqoop-connectors/parcels/latest/,http://repository.cask.co/parcels/cdap/6.0/,http://localhost:8080/itnparcelrepo"}, {"name"=>"SECURITY_REALM", "value"=>"CONTINUUITY.NET"}, {"name"=>"SESSION_TIMEOUT", "value"=>"3600"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 INFO: ------------ Add Hosts to Cluster --------------
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Request: {"items"=>[{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Response: {"items"=>[{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, {"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}]}
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 INFO: ------------ Download CDH Parcel --------------
20-Mar-2020 18:32:26 2020-03-20 18:32:26 +0000 DEBUG: Request: clusters/00053556/parcels/products/CDH/versions/5.12.2-1.cdh5.12.2.p0.4/commands/startDownload
20-Mar-2020 18:32:27 2020-03-20 18:32:27 +0000 DEBUG: Response: {
20-Mar-2020 18:32:27   "id" : -1,
20-Mar-2020 18:32:27   "name" : "Start Parcel Download",
20-Mar-2020 18:32:27   "startTime" : "2020-03-20T18:32:26.920Z",
20-Mar-2020 18:32:27   "endTime" : "2020-03-20T18:32:26.920Z",
20-Mar-2020 18:32:27   "active" : false,
20-Mar-2020 18:32:27   "success" : true,
20-Mar-2020 18:32:27   "resultMessage" : "Synchronous command has finished",
20-Mar-2020 18:32:27   "clusterRef" : {
20-Mar-2020 18:32:27     "clusterName" : "00053556"
20-Mar-2020 18:32:27   },
20-Mar-2020 18:32:27   "canRetry" : false
20-Mar-2020 18:32:27 }
20-Mar-2020 18:32:27 2020-03-20 18:32:27 +0000 INFO: ------------ Download CDAP Parcel --------------
20-Mar-2020 18:32:27 2020-03-20 18:32:27 +0000 DEBUG: Request: clusters/00053556/parcels/products/CDAP/versions/6.2.0.1584671288450-1/commands/startDownload
20-Mar-2020 18:32:27 2020-03-20 18:32:27 +0000 DEBUG: Response: {
20-Mar-2020 18:32:27   "id" : -1,
20-Mar-2020 18:32:27   "name" : "Start Parcel Download",
20-Mar-2020 18:32:27   "startTime" : "2020-03-20T18:32:26.983Z",
20-Mar-2020 18:32:27   "endTime" : "2020-03-20T18:32:26.983Z",
20-Mar-2020 18:32:27   "active" : false,
20-Mar-2020 18:32:27   "success" : true,
20-Mar-2020 18:32:27   "resultMessage" : "Synchronous command has finished",
20-Mar-2020 18:32:27   "clusterRef" : {
20-Mar-2020 18:32:27     "clusterName" : "00053556"
20-Mar-2020 18:32:27   },
20-Mar-2020 18:32:27   "canRetry" : false
20-Mar-2020 18:32:27 }
20-Mar-2020 18:32:27 2020-03-20 18:32:27 +0000 INFO: ------------ Download SPARK2 Parcel --------------
20-Mar-2020 18:32:27 2020-03-20 18:32:27 +0000 DEBUG: Request: clusters/00053556/parcels/products/SPARK2/versions/2.2.0.cloudera2-1.cdh5.12.0.p0.232957/commands/startDownload
20-Mar-2020 18:32:27 2020-03-20 18:32:27 +0000 DEBUG: Response: {
20-Mar-2020 18:32:27   "id" : -1,
20-Mar-2020 18:32:27   "name" : "Start Parcel Download",
20-Mar-2020 18:32:27   "startTime" : "2020-03-20T18:32:27.051Z",
20-Mar-2020 18:32:27   "endTime" : "2020-03-20T18:32:27.051Z",
20-Mar-2020 18:32:27   "active" : false,
20-Mar-2020 18:32:27   "success" : true,
20-Mar-2020 18:32:27   "resultMessage" : "Synchronous command has finished",
20-Mar-2020 18:32:27   "clusterRef" : {
20-Mar-2020 18:32:27     "clusterName" : "00053556"
20-Mar-2020 18:32:27   },
20-Mar-2020 18:32:27   "canRetry" : false
20-Mar-2020 18:32:27 }
20-Mar-2020 18:32:27 2020-03-20 18:32:27 +0000 INFO: ------------ Confirm CDH Parcel Download --------------
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 DEBUG: Response: {"product"=>"CDH", "version"=>"5.12.2-1.cdh5.12.2.p0.4", "stage"=>"DOWNLOADED", "state"=>{"progress"=>100, "totalProgress"=>100, "count"=>1, "totalCount"=>1}, "clusterRef"=>{"clusterName"=>"00053556"}}
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 INFO: ------------ Confirm CDAP Parcel Download --------------
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 DEBUG: Response: {"product"=>"CDAP", "version"=>"6.2.0.1584671288450-1", "stage"=>"DOWNLOADED", "state"=>{"progress"=>100, "totalProgress"=>100, "count"=>1, "totalCount"=>1}, "clusterRef"=>{"clusterName"=>"00053556"}}
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 INFO: ------------ Confirm SPARK2 Parcel Download --------------
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 DEBUG: Response: {"product"=>"SPARK2", "version"=>"2.2.0.cloudera2-1.cdh5.12.0.p0.232957", "stage"=>"DOWNLOADED", "state"=>{"progress"=>100, "totalProgress"=>100, "count"=>1, "totalCount"=>1}, "clusterRef"=>{"clusterName"=>"00053556"}}
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 INFO: ------------ Distribute CDH Parcel --------------
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 DEBUG: Request: clusters/00053556/parcels/products/CDH/versions/5.12.2-1.cdh5.12.2.p0.4/commands/startDistribution
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 DEBUG: Response: {
20-Mar-2020 18:33:24   "id" : -1,
20-Mar-2020 18:33:24   "name" : "Start Parcel Distribution",
20-Mar-2020 18:33:24   "startTime" : "2020-03-20T18:33:24.097Z",
20-Mar-2020 18:33:24   "endTime" : "2020-03-20T18:33:24.097Z",
20-Mar-2020 18:33:24   "active" : false,
20-Mar-2020 18:33:24   "success" : true,
20-Mar-2020 18:33:24   "resultMessage" : "Synchronous command has finished",
20-Mar-2020 18:33:24   "clusterRef" : {
20-Mar-2020 18:33:24     "clusterName" : "00053556"
20-Mar-2020 18:33:24   },
20-Mar-2020 18:33:24   "canRetry" : false
20-Mar-2020 18:33:24 }
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 INFO: ------------ Distribute CDAP Parcel --------------
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 DEBUG: Request: clusters/00053556/parcels/products/CDAP/versions/6.2.0.1584671288450-1/commands/startDistribution
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 DEBUG: Response: {
20-Mar-2020 18:33:24   "id" : -1,
20-Mar-2020 18:33:24   "name" : "Start Parcel Distribution",
20-Mar-2020 18:33:24   "startTime" : "2020-03-20T18:33:24.140Z",
20-Mar-2020 18:33:24   "endTime" : "2020-03-20T18:33:24.140Z",
20-Mar-2020 18:33:24   "active" : false,
20-Mar-2020 18:33:24   "success" : true,
20-Mar-2020 18:33:24   "resultMessage" : "Synchronous command has finished",
20-Mar-2020 18:33:24   "clusterRef" : {
20-Mar-2020 18:33:24     "clusterName" : "00053556"
20-Mar-2020 18:33:24   },
20-Mar-2020 18:33:24   "canRetry" : false
20-Mar-2020 18:33:24 }
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 INFO: ------------ Distribute SPARK2 Parcel --------------
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 DEBUG: Request: clusters/00053556/parcels/products/SPARK2/versions/2.2.0.cloudera2-1.cdh5.12.0.p0.232957/commands/startDistribution
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 DEBUG: Response: {
20-Mar-2020 18:33:24   "id" : -1,
20-Mar-2020 18:33:24   "name" : "Start Parcel Distribution",
20-Mar-2020 18:33:24   "startTime" : "2020-03-20T18:33:24.179Z",
20-Mar-2020 18:33:24   "endTime" : "2020-03-20T18:33:24.179Z",
20-Mar-2020 18:33:24   "active" : false,
20-Mar-2020 18:33:24   "success" : true,
20-Mar-2020 18:33:24   "resultMessage" : "Synchronous command has finished",
20-Mar-2020 18:33:24   "clusterRef" : {
20-Mar-2020 18:33:24     "clusterName" : "00053556"
20-Mar-2020 18:33:24   },
20-Mar-2020 18:33:24   "canRetry" : false
20-Mar-2020 18:33:24 }
20-Mar-2020 18:33:24 2020-03-20 18:33:24 +0000 INFO: ------------ Confirm CDH Parcel Distribution --------------
20-Mar-2020 18:35:26 2020-03-20 18:35:26 +0000 DEBUG: Response: {"product"=>"CDH", "version"=>"5.12.2-1.cdh5.12.2.p0.4", "stage"=>"DISTRIBUTED", "state"=>{"progress"=>600, "totalProgress"=>600, "count"=>1, "totalCount"=>6}, "clusterRef"=>{"clusterName"=>"00053556"}}
20-Mar-2020 18:35:26 2020-03-20 18:35:26 +0000 INFO: ------------ Confirm CDAP Parcel Distribution --------------
20-Mar-2020 18:36:11 2020-03-20 18:36:11 +0000 DEBUG: Response: {"product"=>"CDAP", "version"=>"6.2.0.1584671288450-1", "stage"=>"DISTRIBUTED", "state"=>{"progress"=>600, "totalProgress"=>600, "count"=>1, "totalCount"=>6}, "clusterRef"=>{"clusterName"=>"00053556"}}
20-Mar-2020 18:36:11 2020-03-20 18:36:11 +0000 INFO: ------------ Confirm SPARK2 Parcel Distribution --------------
20-Mar-2020 18:36:25 2020-03-20 18:36:25 +0000 DEBUG: Response: {"product"=>"SPARK2", "version"=>"2.2.0.cloudera2-1.cdh5.12.0.p0.232957", "stage"=>"DISTRIBUTED", "state"=>{"progress"=>600, "totalProgress"=>600, "count"=>3, "totalCount"=>6}, "clusterRef"=>{"clusterName"=>"00053556"}}
20-Mar-2020 18:36:25 2020-03-20 18:36:25 +0000 INFO: ------------ ACTIVATE CDH Parcel --------------
20-Mar-2020 18:36:25 2020-03-20 18:36:25 +0000 DEBUG: Request: clusters/00053556/parcels/products/CDH/versions/5.12.2-1.cdh5.12.2.p0.4/commands/activate
20-Mar-2020 18:36:25 2020-03-20 18:36:25 +0000 DEBUG: Response {
20-Mar-2020 18:36:25   "id" : -1,
20-Mar-2020 18:36:25   "name" : "Activate Parcel",
20-Mar-2020 18:36:25   "startTime" : "2020-03-20T18:36:25.723Z",
20-Mar-2020 18:36:25   "endTime" : "2020-03-20T18:36:25.723Z",
20-Mar-2020 18:36:25   "active" : false,
20-Mar-2020 18:36:25   "success" : true,
20-Mar-2020 18:36:25   "resultMessage" : "Synchronous command has finished",
20-Mar-2020 18:36:25   "clusterRef" : {
20-Mar-2020 18:36:25     "clusterName" : "00053556"
20-Mar-2020 18:36:25   },
20-Mar-2020 18:36:25   "canRetry" : false
20-Mar-2020 18:36:25 }
20-Mar-2020 18:36:25 2020-03-20 18:36:25 +0000 INFO: ------------ ACTIVATE CDAP Parcel --------------
20-Mar-2020 18:36:25 2020-03-20 18:36:25 +0000 DEBUG: Request: clusters/00053556/parcels/products/CDAP/versions/6.2.0.1584671288450-1/commands/activate
20-Mar-2020 18:36:25 2020-03-20 18:36:25 +0000 DEBUG: Response: {
20-Mar-2020 18:36:25   "id" : -1,
20-Mar-2020 18:36:25   "name" : "Activate Parcel",
20-Mar-2020 18:36:25   "startTime" : "2020-03-20T18:36:25.799Z",
20-Mar-2020 18:36:25   "endTime" : "2020-03-20T18:36:25.799Z",
20-Mar-2020 18:36:25   "active" : false,
20-Mar-2020 18:36:25   "success" : true,
20-Mar-2020 18:36:25   "resultMessage" : "Synchronous command has finished",
20-Mar-2020 18:36:25   "clusterRef" : {
20-Mar-2020 18:36:25     "clusterName" : "00053556"
20-Mar-2020 18:36:25   },
20-Mar-2020 18:36:25   "canRetry" : false
20-Mar-2020 18:36:25 }
20-Mar-2020 18:36:25 2020-03-20 18:36:25 +0000 INFO: ------------ ACTIVATE SPARK2 Parcel --------------
20-Mar-2020 18:36:25 2020-03-20 18:36:25 +0000 DEBUG: Request: clusters/00053556/parcels/products/SPARK2/versions/2.2.0.cloudera2-1.cdh5.12.0.p0.232957/commands/activate
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: Response: {
20-Mar-2020 18:36:26   "id" : -1,
20-Mar-2020 18:36:26   "name" : "Activate Parcel",
20-Mar-2020 18:36:26   "startTime" : "2020-03-20T18:36:25.878Z",
20-Mar-2020 18:36:26   "endTime" : "2020-03-20T18:36:25.878Z",
20-Mar-2020 18:36:26   "active" : false,
20-Mar-2020 18:36:26   "success" : true,
20-Mar-2020 18:36:26   "resultMessage" : "Synchronous command has finished",
20-Mar-2020 18:36:26   "clusterRef" : {
20-Mar-2020 18:36:26     "clusterName" : "00053556"
20-Mar-2020 18:36:26   },
20-Mar-2020 18:36:26   "canRetry" : false
20-Mar-2020 18:36:26 }
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 INFO: ------------ Create HDFS Service --------------
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: Request: {"items"=>[{"name"=>"hdfs-00053556", "type"=>"HDFS", "displayName"=>"hdfs-00053556", "config"=>{"items"=>[{"name"=>"hdfs_service_config_safety_valve", "value"=>"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}}]}
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: Response: {"items"=>[{"name"=>"hdfs-00053556", "type"=>"HDFS", "clusterRef"=>{"clusterName"=>"00053556"}, "serviceUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/hdfs-00053556", "roleInstancesUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/hdfs-00053556/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"hdfs-00053556", "entityStatus"=>"UNKNOWN"}]}
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 INFO: ------------ Assign HDFS Roles --------------
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: processing roletype: DATANODE
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: No configuration found in cluster for service HDFS, role DATANODE
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: installing DATANODE on slave hosts
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: processing roletype: NAMENODE
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: No configuration found in cluster for service HDFS, role NAMENODE
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: installing NAMENODE on master host(s)
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: processing roletype: SECONDARYNAMENODE
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: No configuration found in cluster for service HDFS, role SECONDARYNAMENODE
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: processing roletype: BALANCER
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: No configuration found in cluster for service HDFS, role BALANCER
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: processing roletype: GATEWAY
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: No configuration found in cluster for service HDFS, role GATEWAY
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: installing GATEWAY on all hosts
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: processing roletype: HTTPFS
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: No configuration found in cluster for service HDFS, role HTTPFS
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: processing roletype: FAILOVERCONTROLLER
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: No configuration found in cluster for service HDFS, role FAILOVERCONTROLLER
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: installing FAILOVERCONTROLLER on master host(s)
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: processing roletype: JOURNALNODE
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: No configuration found in cluster for service HDFS, role JOURNALNODE
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: installing JOURNALNODE on master host(s)
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: processing roletype: NFSGATEWAY
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: No configuration found in cluster for service HDFS, role NFSGATEWAY
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: Request: {"items"=>[{"type"=>"DATANODE", "hostRef"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"type"=>"DATANODE", "hostRef"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"type"=>"DATANODE", "hostRef"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, {"type"=>"NAMENODE", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"NAMENODE", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"BALANCER", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"type"=>"GATEWAY", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"GATEWAY", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"GATEWAY", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"type"=>"GATEWAY", "hostRef"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"type"=>"GATEWAY", "hostRef"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"type"=>"GATEWAY", "hostRef"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, {"type"=>"FAILOVERCONTROLLER", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"FAILOVERCONTROLLER", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"JOURNALNODE", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"JOURNALNODE", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"JOURNALNODE", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}]}
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: Response: {"items"=>[{"name"=>"hdfs-00053556-DATANODE-a774dd4aa2ba715f70410bc79dc30127", "type"=>"DATANODE", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-DATANODE-a774dd4aa2ba715f70410bc79dc30127", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-DATANODE-BASE"}}, {"name"=>"hdfs-00053556-DATANODE-fc2029e9b0d7655ccc7f8c102447c6e0", "type"=>"DATANODE", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-DATANODE-fc2029e9b0d7655ccc7f8c102447c6e0", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-DATANODE-BASE"}}, {"name"=>"hdfs-00053556-DATANODE-a3ef7c322640086cd7b3c03ee02abcde", "type"=>"DATANODE", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-DATANODE-a3ef7c322640086cd7b3c03ee02abcde", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-DATANODE-BASE"}}, {"name"=>"hdfs-00053556-NAMENODE-9eb1736e47a87a4faa49317b6938fc01", "type"=>"NAMENODE", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-NAMENODE-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-NAMENODE-BASE"}}, {"name"=>"hdfs-00053556-NAMENODE-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"NAMENODE", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-NAMENODE-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-NAMENODE-BASE"}}, {"name"=>"hdfs-00053556-BALANCER-542ac06e21d3ff036b38e440ce84bb57", "type"=>"BALANCER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-BALANCER-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-BALANCER-BASE"}}, {"name"=>"hdfs-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-GATEWAY-BASE"}}, {"name"=>"hdfs-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-GATEWAY-BASE"}}, {"name"=>"hdfs-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-GATEWAY-BASE"}}, {"name"=>"hdfs-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-GATEWAY-BASE"}}, {"name"=>"hdfs-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-GATEWAY-BASE"}}, {"name"=>"hdfs-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-GATEWAY-BASE"}}, {"name"=>"hdfs9285e6d9-FAILOVERCONTROLLER-9eb1736e47a87a4faa49317b6938fc01", "type"=>"FAILOVERCONTROLLER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs9285e6d9-FAILOVERCONTROLLER-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-FAILOVERCONTROLLER-BASE"}}, {"name"=>"hdfs9285e6d9-FAILOVERCONTROLLER-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"FAILOVERCONTROLLER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs9285e6d9-FAILOVERCONTROLLER-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-FAILOVERCONTROLLER-BASE"}}, {"name"=>"hdfs-00053556-JOURNALNODE-9eb1736e47a87a4faa49317b6938fc01", "type"=>"JOURNALNODE", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-JOURNALNODE-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-JOURNALNODE-BASE"}}, {"name"=>"hdfs-00053556-JOURNALNODE-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"JOURNALNODE", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-JOURNALNODE-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-JOURNALNODE-BASE"}}, {"name"=>"hdfs-00053556-JOURNALNODE-542ac06e21d3ff036b38e440ce84bb57", "type"=>"JOURNALNODE", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hdfs-00053556-JOURNALNODE-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hdfs-00053556-JOURNALNODE-BASE"}}]}
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 INFO: ------------ Create ZOOKEEPER Service --------------
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: No configuration found in cluster for service ZOOKEEPER
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: Request: {"items"=>[{"name"=>"zookeeper-00053556", "type"=>"ZOOKEEPER", "displayName"=>"zookeeper-00053556"}]}
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: Response: {"items"=>[{"name"=>"zookeeper-00053556", "type"=>"ZOOKEEPER", "clusterRef"=>{"clusterName"=>"00053556"}, "serviceUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/zookeeper-00053556", "roleInstancesUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/zookeeper-00053556/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"zookeeper-00053556", "entityStatus"=>"UNKNOWN"}]}
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 INFO: ------------ Assign ZOOKEEPER Roles --------------
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: processing roletype: SERVER
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: No configuration found in cluster for service ZOOKEEPER, role SERVER
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: installing SERVER on master host(s)
20-Mar-2020 18:36:26 2020-03-20 18:36:26 +0000 DEBUG: Request: {"items"=>[{"type"=>"SERVER", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"SERVER", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"SERVER", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}]}
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: Response: {"items"=>[{"name"=>"zookeeper-00053556-SERVER-9eb1736e47a87a4faa49317b6938fc01", "type"=>"SERVER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"zookeeper-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/zookeeper-00053556-SERVER-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"zookeeper-00053556-SERVER-BASE"}}, {"name"=>"zookeeper-00053556-SERVER-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"SERVER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"zookeeper-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/zookeeper-00053556-SERVER-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"zookeeper-00053556-SERVER-BASE"}}, {"name"=>"zookeeper-00053556-SERVER-542ac06e21d3ff036b38e440ce84bb57", "type"=>"SERVER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"zookeeper-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/zookeeper-00053556-SERVER-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"zookeeper-00053556-SERVER-BASE"}}]}
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 INFO: ------------ Create YARN Service --------------
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: Request: {"items"=>[{"name"=>"yarn-00053556", "type"=>"YARN", "displayName"=>"yarn-00053556", "config"=>{"items"=>[{"name"=>"yarn_service_config_safety_valve", "value"=>"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}}]}
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: Response: {"items"=>[{"name"=>"yarn-00053556", "type"=>"YARN", "clusterRef"=>{"clusterName"=>"00053556"}, "serviceUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/yarn-00053556", "roleInstancesUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/yarn-00053556/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"yarn-00053556", "entityStatus"=>"UNKNOWN"}]}
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 INFO: ------------ Assign YARN Roles --------------
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: processing roletype: RESOURCEMANAGER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: No configuration found in cluster for service YARN, role RESOURCEMANAGER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: installing RESOURCEMANAGER on master host(s)
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: processing roletype: NODEMANAGER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: No configuration found in cluster for service YARN, role NODEMANAGER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: installing NODEMANAGER on slave hosts
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: processing roletype: JOBHISTORY
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: No configuration found in cluster for service YARN, role JOBHISTORY
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: processing roletype: GATEWAY
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: No configuration found in cluster for service YARN, role GATEWAY
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: installing GATEWAY on all hosts
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: Request: {"items"=>[{"type"=>"RESOURCEMANAGER", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"RESOURCEMANAGER", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"NODEMANAGER", "hostRef"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"type"=>"NODEMANAGER", "hostRef"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"type"=>"NODEMANAGER", "hostRef"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, {"type"=>"JOBHISTORY", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"type"=>"GATEWAY", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"GATEWAY", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"GATEWAY", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"type"=>"GATEWAY", "hostRef"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"type"=>"GATEWAY", "hostRef"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"type"=>"GATEWAY", "hostRef"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}]}
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: Response: {"items"=>[{"name"=>"yarn-00053556-RESOURCEMANAGER-9eb1736e47a87a4faa49317b6938fc01", "type"=>"RESOURCEMANAGER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-RESOURCEMANAGER-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-RESOURCEMANAGER-BASE"}}, {"name"=>"yarn-00053556-RESOURCEMANAGER-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"RESOURCEMANAGER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-RESOURCEMANAGER-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-RESOURCEMANAGER-BASE"}}, {"name"=>"yarn-00053556-NODEMANAGER-a774dd4aa2ba715f70410bc79dc30127", "type"=>"NODEMANAGER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-NODEMANAGER-a774dd4aa2ba715f70410bc79dc30127", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-NODEMANAGER-BASE"}}, {"name"=>"yarn-00053556-NODEMANAGER-fc2029e9b0d7655ccc7f8c102447c6e0", "type"=>"NODEMANAGER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-NODEMANAGER-fc2029e9b0d7655ccc7f8c102447c6e0", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-NODEMANAGER-BASE"}}, {"name"=>"yarn-00053556-NODEMANAGER-a3ef7c322640086cd7b3c03ee02abcde", "type"=>"NODEMANAGER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-NODEMANAGER-a3ef7c322640086cd7b3c03ee02abcde", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-NODEMANAGER-BASE"}}, {"name"=>"yarn-00053556-JOBHISTORY-542ac06e21d3ff036b38e440ce84bb57", "type"=>"JOBHISTORY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-JOBHISTORY-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-JOBHISTORY-BASE"}}, {"name"=>"yarn-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-GATEWAY-BASE"}}, {"name"=>"yarn-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-GATEWAY-BASE"}}, {"name"=>"yarn-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-GATEWAY-BASE"}}, {"name"=>"yarn-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-GATEWAY-BASE"}}, {"name"=>"yarn-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-GATEWAY-BASE"}}, {"name"=>"yarn-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}, "hostRef"=>{"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/yarn-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"yarn-00053556-GATEWAY-BASE"}}]}
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 INFO: ------------ Create HBASE Service --------------
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: Request: {"items"=>[{"name"=>"hbase-00053556", "type"=>"HBASE", "displayName"=>"hbase-00053556", "config"=>{"items"=>[{"name"=>"hbase_service_config_safety_valve", "value"=>"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"}]}}]}
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase-00053556", "type"=>"HBASE", "clusterRef"=>{"clusterName"=>"00053556"}, "serviceUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/hbase-00053556", "roleInstancesUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/hbase-00053556/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"hbase-00053556", "entityStatus"=>"UNKNOWN"}]}
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 INFO: ------------ Assign HBASE Roles --------------
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: processing roletype: MASTER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: No configuration found in cluster for service HBASE, role MASTER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: installing MASTER on master host(s)
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: processing roletype: REGIONSERVER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: No configuration found in cluster for service HBASE, role REGIONSERVER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: installing REGIONSERVER on slave hosts
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: processing roletype: GATEWAY
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: No configuration found in cluster for service HBASE, role GATEWAY
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: installing GATEWAY on all hosts
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: processing roletype: HBASERESTSERVER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: No configuration found in cluster for service HBASE, role HBASERESTSERVER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: processing roletype: HBASETHRIFTSERVER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: No configuration found in cluster for service HBASE, role HBASETHRIFTSERVER
20-Mar-2020 18:36:27 2020-03-20 18:36:27 +0000 DEBUG: Request: {"items"=>[{"type"=>"MASTER", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"MASTER", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"MASTER", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"type"=>"REGIONSERVER", "hostRef"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"type"=>"REGIONSERVER", "hostRef"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"type"=>"REGIONSERVER", "hostRef"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, {"type"=>"GATEWAY", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"GATEWAY", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"GATEWAY", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"type"=>"GATEWAY", "hostRef"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"type"=>"GATEWAY", "hostRef"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"type"=>"GATEWAY", "hostRef"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase-00053556-MASTER-9eb1736e47a87a4faa49317b6938fc01", "type"=>"MASTER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-MASTER-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-MASTER-BASE"}}, {"name"=>"hbase-00053556-MASTER-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"MASTER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-MASTER-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-MASTER-BASE"}}, {"name"=>"hbase-00053556-MASTER-542ac06e21d3ff036b38e440ce84bb57", "type"=>"MASTER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-MASTER-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-MASTER-BASE"}}, {"name"=>"hbase-00053556-REGIONSERVER-a774dd4aa2ba715f70410bc79dc30127", "type"=>"REGIONSERVER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-REGIONSERVER-a774dd4aa2ba715f70410bc79dc30127", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-REGIONSERVER-BASE"}}, {"name"=>"hbase-00053556-REGIONSERVER-fc2029e9b0d7655ccc7f8c102447c6e0", "type"=>"REGIONSERVER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-REGIONSERVER-fc2029e9b0d7655ccc7f8c102447c6e0", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-REGIONSERVER-BASE"}}, {"name"=>"hbase-00053556-REGIONSERVER-a3ef7c322640086cd7b3c03ee02abcde", "type"=>"REGIONSERVER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-REGIONSERVER-a3ef7c322640086cd7b3c03ee02abcde", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-REGIONSERVER-BASE"}}, {"name"=>"hbase-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-GATEWAY-BASE"}}, {"name"=>"hbase-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-GATEWAY-BASE"}}, {"name"=>"hbase-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-GATEWAY-BASE"}}, {"name"=>"hbase-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-GATEWAY-BASE"}}, {"name"=>"hbase-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-GATEWAY-BASE"}}, {"name"=>"hbase-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}, "hostRef"=>{"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hbase-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hbase-00053556-GATEWAY-BASE"}}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 INFO: ------------ Create HIVE Service --------------
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service HIVE
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Request: {"items"=>[{"name"=>"hive-00053556", "type"=>"HIVE", "displayName"=>"hive-00053556"}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Response: {"items"=>[{"name"=>"hive-00053556", "type"=>"HIVE", "clusterRef"=>{"clusterName"=>"00053556"}, "serviceUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/hive-00053556", "roleInstancesUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/hive-00053556/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"hive-00053556", "entityStatus"=>"UNKNOWN"}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 INFO: ------------ Assign HIVE Roles --------------
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: GATEWAY
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service HIVE, role GATEWAY
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: installing GATEWAY on all hosts
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: HIVEMETASTORE
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service HIVE, role HIVEMETASTORE
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: WEBHCAT
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service HIVE, role WEBHCAT
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: HIVESERVER2
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service HIVE, role HIVESERVER2
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Request: {"items"=>[{"type"=>"GATEWAY", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"GATEWAY", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"GATEWAY", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"type"=>"GATEWAY", "hostRef"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"type"=>"GATEWAY", "hostRef"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"type"=>"GATEWAY", "hostRef"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, {"type"=>"HIVEMETASTORE", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"type"=>"HIVESERVER2", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Response: {"items"=>[{"name"=>"hive-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053556-GATEWAY-BASE"}}, {"name"=>"hive-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053556-GATEWAY-BASE"}}, {"name"=>"hive-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053556-GATEWAY-BASE"}}, {"name"=>"hive-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "hostRef"=>{"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053556-GATEWAY-BASE"}}, {"name"=>"hive-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "hostRef"=>{"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053556-GATEWAY-BASE"}}, {"name"=>"hive-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "hostRef"=>{"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053556-GATEWAY-BASE"}}, {"name"=>"hive-00053556-HIVEMETASTORE-542ac06e21d3ff036b38e440ce84bb57", "type"=>"HIVEMETASTORE", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053556-HIVEMETASTORE-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053556-HIVEMETASTORE-BASE"}}, {"name"=>"hive-00053556-HIVESERVER2-542ac06e21d3ff036b38e440ce84bb57", "type"=>"HIVESERVER2", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/hive-00053556-HIVESERVER2-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"hive-00053556-HIVESERVER2-BASE"}}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 INFO: ------------ Create SPARK2_ON_YARN Service --------------
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service SPARK2_ON_YARN
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Request: {"items"=>[{"name"=>"spark2_on_yarn-00053556", "type"=>"SPARK2_ON_YARN", "displayName"=>"spark2_on_yarn-00053556"}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Response: {"items"=>[{"name"=>"spark2_on_yarn-00053556", "type"=>"SPARK2_ON_YARN", "clusterRef"=>{"clusterName"=>"00053556"}, "serviceUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/spark2_on_yarn-00053556", "roleInstancesUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/spark2_on_yarn-00053556/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"spark2_on_yarn-00053556", "entityStatus"=>"UNKNOWN"}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 INFO: ------------ Assign SPARK2_ON_YARN Roles --------------
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: SPARK2_YARN_HISTORY_SERVER
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service SPARK2_ON_YARN, role SPARK2_YARN_HISTORY_SERVER
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: GATEWAY
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service SPARK2_ON_YARN, role GATEWAY
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: installing GATEWAY on all hosts
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Request: {"items"=>[{"type"=>"SPARK2_YARN_HISTORY_SERVER", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"type"=>"GATEWAY", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"GATEWAY", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"GATEWAY", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"type"=>"GATEWAY", "hostRef"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"type"=>"GATEWAY", "hostRef"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"type"=>"GATEWAY", "hostRef"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Response: {"items"=>[{"name"=>"spar372b1b5f-SPARK2_YARN_HISTORY_SERVER-542ac06e21d3ff036b38e440", "type"=>"SPARK2_YARN_HISTORY_SERVER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"spark2_on_yarn-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/spar372b1b5f-SPARK2_YARN_HISTORY_SERVER-542ac06e21d3ff036b38e440", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark2_on_yarn-00053556-SPARK2_YARN_HISTORY_SERVER-BASE"}}, {"name"=>"spark2_on_yarn-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"spark2_on_yarn-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/spark2_on_yarn-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark2_on_yarn-00053556-GATEWAY-BASE"}}, {"name"=>"spark2_on_yarn-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"spark2_on_yarn-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/spark2_on_yarn-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark2_on_yarn-00053556-GATEWAY-BASE"}}, {"name"=>"spark2_on_yarn-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"spark2_on_yarn-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/spark2_on_yarn-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark2_on_yarn-00053556-GATEWAY-BASE"}}, {"name"=>"spark2_on_yarn-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"spark2_on_yarn-00053556"}, "hostRef"=>{"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/spark2_on_yarn-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark2_on_yarn-00053556-GATEWAY-BASE"}}, {"name"=>"spark2_on_yarn-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"spark2_on_yarn-00053556"}, "hostRef"=>{"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/spark2_on_yarn-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark2_on_yarn-00053556-GATEWAY-BASE"}}, {"name"=>"spark2_on_yarn-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"spark2_on_yarn-00053556"}, "hostRef"=>{"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/spark2_on_yarn-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"spark2_on_yarn-00053556-GATEWAY-BASE"}}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 INFO: ------------ Create CDAP Service --------------
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Request: {"items"=>[{"name"=>"cdap-00053556", "type"=>"CDAP", "displayName"=>"cdap-00053556", "config"=>{"items"=>[{"name"=>"enable_unrecoverable_reset", "value"=>"true"}, {"name"=>"security_authorization_extension_jar_path", "value"=>"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar"}, {"name"=>"cdap-site.xml_service_safety_valve", "value"=>"<property><name>security.authorization.extension.config.sentry.site.url</name><value>/etc/sentry/conf/sentry-site.xml</value></property><property><name>cdap.ugi.cache.expiration.ms</name><value>60000</value></property><property><name>cdap.http.client.read.timeout.ms</name><value>120000</value></property>"}, {"name"=>"security_authorization_cache_ttl_secs", "value"=>"3"}, {"name"=>"csd_compatibility_check_enabled", "value"=>"false"}]}}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Response: {"items"=>[{"name"=>"cdap-00053556", "type"=>"CDAP", "clusterRef"=>{"clusterName"=>"00053556"}, "serviceUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/cdap-00053556", "roleInstancesUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/cdap-00053556/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"cdap-00053556", "entityStatus"=>"UNKNOWN"}]}
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 INFO: ------------ Assign CDAP Roles --------------
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: CDAP_ROUTER
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service CDAP, role CDAP_ROUTER
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: installing CDAP_ROUTER on master host(s)
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: CDAP_KAFKA
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service CDAP, role CDAP_KAFKA
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: installing CDAP_KAFKA on master host(s)
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: CDAP_MASTER
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: installing CDAP_MASTER on master host(s)
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: CDAP_UI
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service CDAP, role CDAP_UI
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: installing CDAP_UI on master host(s)
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: CDAP_AUTH_SERVER
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: installing CDAP_AUTH_SERVER on master host(s)
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: processing roletype: GATEWAY
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: No configuration found in cluster for service CDAP, role GATEWAY
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: installing GATEWAY on all hosts
20-Mar-2020 18:36:28 2020-03-20 18:36:28 +0000 DEBUG: Request: {"items"=>[{"type"=>"CDAP_ROUTER", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"CDAP_ROUTER", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"CDAP_KAFKA", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"CDAP_KAFKA", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"CDAP_MASTER", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd", "config"=>{"items"=>[{"name"=>"security_keytab_path", "value"=>"/etc/security/keytabs/${name}.headless.keytab"}]}}, {"type"=>"CDAP_MASTER", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8", "config"=>{"items"=>[{"name"=>"security_keytab_path", "value"=>"/etc/security/keytabs/${name}.headless.keytab"}]}}, {"type"=>"CDAP_UI", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"CDAP_UI", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"CDAP_AUTH_SERVER", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd", "config"=>{"items"=>[{"name"=>"security_authentication_handler_debug", "value"=>"true"}, {"name"=>"security_authentication_handler_hostname", "value"=>"10.240.24.141"}, {"name"=>"security_authentication_handler_port", "value"=>"389"}, {"name"=>"security_authentication_handler_userBaseDn", "value"=>"ou=people,dc=continuuity,dc=com"}, {"name"=>"security_authentication_handler_userObjectClass", "value"=>"inetorgperson"}, {"name"=>"security_authentication_handler_userRdnAttribute", "value"=>"cn"}, {"name"=>"security_authentication_loginmodule_className", "value"=>"co.cask.cdap.security.server.LDAPLoginModule"}, {"name"=>"security_authentication_handlerClassName", "value"=>"co.cask.cdap.security.server.BasicAuthenticationHandler"}, {"name"=>"security_authentication_basic_realmfile", "value"=>"/etc/security/realmfile"}]}}, {"type"=>"CDAP_AUTH_SERVER", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8", "config"=>{"items"=>[{"name"=>"security_authentication_handler_debug", "value"=>"true"}, {"name"=>"security_authentication_handler_hostname", "value"=>"10.240.24.141"}, {"name"=>"security_authentication_handler_port", "value"=>"389"}, {"name"=>"security_authentication_handler_userBaseDn", "value"=>"ou=people,dc=continuuity,dc=com"}, {"name"=>"security_authentication_handler_userObjectClass", "value"=>"inetorgperson"}, {"name"=>"security_authentication_handler_userRdnAttribute", "value"=>"cn"}, {"name"=>"security_authentication_loginmodule_className", "value"=>"co.cask.cdap.security.server.LDAPLoginModule"}, {"name"=>"security_authentication_handlerClassName", "value"=>"co.cask.cdap.security.server.BasicAuthenticationHandler"}, {"name"=>"security_authentication_basic_realmfile", "value"=>"/etc/security/realmfile"}]}}, {"type"=>"GATEWAY", "hostRef"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, {"type"=>"GATEWAY", "hostRef"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"type"=>"GATEWAY", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"type"=>"GATEWAY", "hostRef"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"type"=>"GATEWAY", "hostRef"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"type"=>"GATEWAY", "hostRef"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}]}
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 DEBUG: Response: {"items"=>[{"name"=>"cdap-00053556-CDAP_ROUTER-9eb1736e47a87a4faa49317b6938fc01", "type"=>"CDAP_ROUTER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-CDAP_ROUTER-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-CDAP_ROUTER-BASE"}}, {"name"=>"cdap-00053556-CDAP_ROUTER-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"CDAP_ROUTER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-CDAP_ROUTER-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-CDAP_ROUTER-BASE"}}, {"name"=>"cdap-00053556-CDAP_KAFKA-9eb1736e47a87a4faa49317b6938fc01", "type"=>"CDAP_KAFKA", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-CDAP_KAFKA-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-CDAP_KAFKA-BASE"}}, {"name"=>"cdap-00053556-CDAP_KAFKA-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"CDAP_KAFKA", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-CDAP_KAFKA-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-CDAP_KAFKA-BASE"}}, {"name"=>"cdap-00053556-CDAP_MASTER-9eb1736e47a87a4faa49317b6938fc01", "type"=>"CDAP_MASTER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-CDAP_MASTER-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-CDAP_MASTER-BASE"}}, {"name"=>"cdap-00053556-CDAP_MASTER-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"CDAP_MASTER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-CDAP_MASTER-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-CDAP_MASTER-BASE"}}, {"name"=>"cdap-00053556-CDAP_UI-9eb1736e47a87a4faa49317b6938fc01", "type"=>"CDAP_UI", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-CDAP_UI-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-CDAP_UI-BASE"}}, {"name"=>"cdap-00053556-CDAP_UI-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"CDAP_UI", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-CDAP_UI-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-CDAP_UI-BASE"}}, {"name"=>"cdap-00053556-CDAP_AUTH_SERVER-9eb1736e47a87a4faa49317b6938fc01", "type"=>"CDAP_AUTH_SERVER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-CDAP_AUTH_SERVER-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-CDAP_AUTH_SERVER-BASE"}}, {"name"=>"cdap-00053556-CDAP_AUTH_SERVER-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"CDAP_AUTH_SERVER", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-CDAP_AUTH_SERVER-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-CDAP_AUTH_SERVER-BASE"}}, {"name"=>"cdap-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-GATEWAY-9eb1736e47a87a4faa49317b6938fc01", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-GATEWAY-BASE"}}, {"name"=>"cdap-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-GATEWAY-afc58c8db5e39f1defa3fcddcf23d53e", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-GATEWAY-BASE"}}, {"name"=>"cdap-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-GATEWAY-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-GATEWAY-BASE"}}, {"name"=>"cdap-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-GATEWAY-a774dd4aa2ba715f70410bc79dc30127", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-GATEWAY-BASE"}}, {"name"=>"cdap-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-GATEWAY-fc2029e9b0d7655ccc7f8c102447c6e0", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-GATEWAY-BASE"}}, {"name"=>"cdap-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "type"=>"GATEWAY", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}, "hostRef"=>{"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/cdap-00053556-GATEWAY-a3ef7c322640086cd7b3c03ee02abcde", "roleState"=>"NA", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"cdap-00053556-GATEWAY-BASE"}}]}
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 INFO: ------------ Create KMS Service --------------
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 DEBUG: No configuration found in cluster for service KMS
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 DEBUG: Request: {"items"=>[{"name"=>"kms-00053556", "type"=>"KMS", "displayName"=>"kms-00053556"}]}
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 DEBUG: Response: {"items"=>[{"name"=>"kms-00053556", "type"=>"KMS", "clusterRef"=>{"clusterName"=>"00053556"}, "serviceUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/kms-00053556", "roleInstancesUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/serviceRedirect/kms-00053556/instances", "serviceState"=>"NA", "configStalenessStatus"=>"FRESH", "clientConfigStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "displayName"=>"kms-00053556", "entityStatus"=>"UNKNOWN"}]}
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 INFO: ------------ Assign KMS Roles --------------
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 DEBUG: processing roletype: KMS
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 DEBUG: No configuration found in cluster for service KMS, role KMS
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 DEBUG: Request: {"items"=>[{"type"=>"KMS", "hostRef"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}]}
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 DEBUG: Response: {"items"=>[{"name"=>"kms-00053556-KMS-542ac06e21d3ff036b38e440ce84bb57", "type"=>"KMS", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"kms-00053556"}, "hostRef"=>{"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, "roleUrl"=>"http://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:7180/cmf/roleRedirect/kms-00053556-KMS-542ac06e21d3ff036b38e440ce84bb57", "roleState"=>"STOPPED", "configStalenessStatus"=>"FRESH", "maintenanceMode"=>false, "maintenanceOwners"=>[], "commissionState"=>"COMMISSIONED", "roleConfigGroupRef"=>{"roleConfigGroupName"=>"kms-00053556-KMS-BASE"}}]}
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 INFO: ------------ Autoconfigure --------------
20-Mar-2020 18:36:29 2020-03-20 18:36:29 +0000 DEBUG: Request: clusters/00053556/autoConfigure
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Response:
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 INFO: ------------ Configure any user-defined roleConfigGroups --------------
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 INFO: ------------ Configure yarn-00053556-NODEMANAGER-BASE for Cask Internal --------------
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Request: {"items"=>[{"name"=>"container_executor_min_user_id", "value"=>"500"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Response: {"items"=>[{"name"=>"container_executor_min_user_id", "value"=>"500"}, {"name"=>"node_manager_java_heapsize", "value"=>"1073741824"}, {"name"=>"yarn_nodemanager_heartbeat_interval_ms", "value"=>"100"}, {"name"=>"yarn_nodemanager_local_dirs", "value"=>"/yarn/nm"}, {"name"=>"yarn_nodemanager_log_dirs", "value"=>"/yarn/container-logs"}, {"name"=>"yarn_nodemanager_resource_cpu_vcores", "value"=>"8"}, {"name"=>"yarn_nodemanager_resource_memory_mb", "value"=>"8197"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 INFO: ------------ Configure yarn-00053556-RESOURCEMANAGER-BASE for Cask Internal --------------
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Request: {"items"=>[{"name"=>"yarn_scheduler_minimum_allocation_mb", "value"=>"768"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Response: {"items"=>[{"name"=>"resource_manager_java_heapsize", "value"=>"1073741824"}, {"name"=>"yarn_scheduler_maximum_allocation_mb", "value"=>"8197"}, {"name"=>"yarn_scheduler_maximum_allocation_vcores", "value"=>"8"}, {"name"=>"yarn_scheduler_minimum_allocation_mb", "value"=>"768"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 INFO: ------------ Configure yarn-00053556-GATEWAY-BASE for Cask Internal --------------
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Request: {"items"=>[{"name"=>"yarn_client_config_safety_valve", "value"=>"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Response: {"items"=>[{"name"=>"mapred_submit_replication", "value"=>"3"}, {"name"=>"yarn_client_config_safety_valve", "value"=>"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 INFO: ------------ Configure hdfs-00053556-GATEWAY-BASE for Cask Internal --------------
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Request: {"items"=>[{"name"=>"hdfs_client_config_safety_valve", "value"=>"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Response: {"items"=>[{"name"=>"dfs_client_use_trash", "value"=>"true"}, {"name"=>"hdfs_client_config_safety_valve", "value"=>"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 INFO: ------------ Configure hbase-00053556-GATEWAY-BASE for Cask Internal --------------
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Request: {"items"=>[{"name"=>"hbase_client_config_safety_valve", "value"=>"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase_client_config_safety_valve", "value"=>"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 INFO: ------------ Configure Hive Server 2 for Cask Internal --------------
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Request: {"items"=>[{"name"=>"hive_log_dir", "value"=>"/data/log/hive"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Response: {"items"=>[{"name"=>"hive_log_dir", "value"=>"/data/log/hive"}, {"name"=>"hiveserver2_java_heapsize", "value"=>"4294967296"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 INFO: ------------ Configure HiveMetastoreDatabase --------------
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Request: {"items"=>[{"name"=>"hive_metastore_database_host", "value"=>"it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh"}, {"name"=>"hive_metastore_database_name", "value"=>"hive00053556"}, {"name"=>"hive_metastore_database_user", "value"=>"hive00053556"}, {"name"=>"hive_metastore_database_password", "value"=>"somedefaultpassword"}, {"name"=>"hive_metastore_database_port", "value"=>"7432"}, {"name"=>"hive_metastore_database_type", "value"=>"postgresql"}, {"name"=>"sentry_metastore_service_users", "value"=>"hive,impala,hue,hdfs,cdap,cdapitn"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase_service", "value"=>"hbase-00053556"}, {"name"=>"hive_metastore_database_host", "value"=>"it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh"}, {"name"=>"hive_metastore_database_name", "value"=>"hive00053556"}, {"name"=>"hive_metastore_database_password", "value"=>"somedefaultpassword"}, {"name"=>"hive_metastore_database_port", "value"=>"7432"}, {"name"=>"hive_metastore_database_type", "value"=>"postgresql"}, {"name"=>"hive_metastore_database_user", "value"=>"hive00053556"}, {"name"=>"mapreduce_yarn_service", "value"=>"yarn-00053556"}, {"name"=>"sentry_metastore_service_users", "value"=>"hive,impala,hue,hdfs,cdap,cdapitn"}, {"name"=>"zookeeper_service", "value"=>"zookeeper-00053556"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 INFO: ------------ Configure Hive Metastore for Cask Internal --------------
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Request: {"items"=>[{"name"=>"hive_log_dir", "value"=>"/data/log/hive"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Response: {"items"=>[{"name"=>"hive_log_dir", "value"=>"/data/log/hive"}, {"name"=>"hive_metastore_java_heapsize", "value"=>"8589934592"}, {"name"=>"hive_metastore_server_max_message_size", "value"=>"858993459"}]}
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 INFO: ------------ Create HiveMetastoreDatabase --------------
20-Mar-2020 18:36:30 2020-03-20 18:36:30 +0000 DEBUG: Request: clusters/00053556/services/hive-00053556/commands/hiveCreateMetastoreDatabase
20-Mar-2020 18:36:31 2020-03-20 18:36:31 +0000 DEBUG: Response: {"id"=>68, "name"=>"CreateHiveDatabase", "startTime"=>"2020-03-20T18:36:30.877Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}}
20-Mar-2020 18:36:31 2020-03-20 18:36:31 +0000 INFO: ------------ Wait for create HiveMetastoreDatabase --------------
20-Mar-2020 18:36:31 2020-03-20 18:36:31 +0000 INFO: Waiting for command 68 to complete
20-Mar-2020 18:36:37 ...
20-Mar-2020 18:36:37 2020-03-20 18:36:37 +0000 DEBUG: Response: {"id"=>68, "name"=>"CreateHiveDatabase", "startTime"=>"2020-03-20T18:36:30.877Z", "endTime"=>"2020-03-20T18:36:36.528Z", "active"=>false, "success"=>true, "resultMessage"=>"Created Hive Metastore Database.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:36:37 2020-03-20 18:36:37 +0000 INFO: ------------ Create HiveMetastoreDatabaseTables --------------
20-Mar-2020 18:36:37 2020-03-20 18:36:37 +0000 DEBUG: Request: clusters/00053556/services/hive-00053556/commands/hiveCreateMetastoreDatabaseTables
20-Mar-2020 18:36:37 2020-03-20 18:36:37 +0000 DEBUG: Response: {"id"=>69, "name"=>"HiveCreateMetastoreTablesServiceCommand", "startTime"=>"2020-03-20T18:36:37.128Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}}
20-Mar-2020 18:36:37 2020-03-20 18:36:37 +0000 INFO: ------------ Wait for create HiveMetastoreDatabaseTables --------------
20-Mar-2020 18:36:37 2020-03-20 18:36:37 +0000 INFO: Waiting for command 69 to complete
20-Mar-2020 18:36:49 ......
20-Mar-2020 18:36:49 2020-03-20 18:36:49 +0000 DEBUG: Response: {"id"=>69, "name"=>"HiveCreateMetastoreTablesServiceCommand", "startTime"=>"2020-03-20T18:36:37.128Z", "endTime"=>"2020-03-20T18:36:49.233Z", "active"=>false, "success"=>true, "resultMessage"=>"Created Hive Metastore Database Tables successfully.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "children"=>{"items"=>[{"id"=>70, "name"=>"HiveCreateMetastoreTables", "startTime"=>"2020-03-20T18:36:37.145Z", "endTime"=>"2020-03-20T18:36:49.226Z", "active"=>false, "success"=>true, "resultMessage"=>"Created Hive Metastore Database Tables successfully.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556", "roleName"=>"hive-00053556-HIVEMETASTORE-542ac06e21d3ff036b38e440ce84bb57"}}]}, "canRetry"=>false}
20-Mar-2020 18:36:49 2020-03-20 18:36:49 +0000 INFO: ------------ Deploy Krb5.conf --------------
20-Mar-2020 18:36:49 2020-03-20 18:36:49 +0000 DEBUG: Request: clusters/00053556/commands/deployClusterClientConfig
20-Mar-2020 18:36:49 2020-03-20 18:36:49 +0000 DEBUG: Request Data: {"items"=>[{"hostId"=>"766dd13d-6fe2-4dc0-8361-bf6c56f844a8"}, {"hostId"=>"6f1aa864-e7f8-456e-99be-22275c5915b9"}, {"hostId"=>"1113d35c-f3cb-4950-9c71-91440c35ba87"}, {"hostId"=>"37c2b8a1-7bdf-4083-9f2b-9e7be8277ef3"}, {"hostId"=>"5cbaf150-38ca-4130-80c1-6fefcba4407d"}, {"hostId"=>"0a0a2ea0-acea-44dc-8b8b-dedc978aacbd"}]}
20-Mar-2020 18:36:49 2020-03-20 18:36:49 +0000 DEBUG: Response: {"id"=>71, "name"=>"DeployClientConfigsOfCluster", "startTime"=>"2020-03-20T18:36:49.838Z", "active"=>true, "clusterRef"=>{"clusterName"=>"00053556"}}
20-Mar-2020 18:36:49 2020-03-20 18:36:49 +0000 INFO: ------------ Wait for Krb5.conf deploy --------------
20-Mar-2020 18:36:49 2020-03-20 18:36:49 +0000 INFO: Waiting for command 71 to complete
20-Mar-2020 18:37:06 ........
20-Mar-2020 18:37:06 2020-03-20 18:37:06 +0000 DEBUG: Response: {"id"=>71, "name"=>"DeployClientConfigsOfCluster", "startTime"=>"2020-03-20T18:36:49.838Z", "endTime"=>"2020-03-20T18:37:05.132Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed krb5.conf.", "clusterRef"=>{"clusterName"=>"00053556"}, "children"=>{"items"=>[{"id"=>72, "name"=>"ProcessStalenessSuccessWaitCommand", "startTime"=>"2020-03-20T18:36:49.840Z", "endTime"=>"2020-03-20T18:36:49.861Z", "active"=>false, "success"=>true, "resultMessage"=>"Configuration staleness computation completed."}]}, "canRetry"=>false}
20-Mar-2020 18:37:06 2020-03-20 18:37:06 +0000 INFO: ------------ Import KDC admin credentials --------------
20-Mar-2020 18:37:06 2020-03-20 18:37:06 +0000 DEBUG: Request: cm/commands/importAdminCredentials?username=cloudera-scm%2Fadmin%40CONTINUUITY.NET&password=********
20-Mar-2020 18:37:06 2020-03-20 18:37:06 +0000 DEBUG: Response: {"id"=>73, "name"=>"ImportCredentials", "startTime"=>"2020-03-20T18:37:06.188Z", "active"=>true, "children"=>{"items"=>[]}}
20-Mar-2020 18:37:06 2020-03-20 18:37:06 +0000 INFO: ------------ Wait for import admin credentials --------------
20-Mar-2020 18:37:06 2020-03-20 18:37:06 +0000 INFO: Waiting for command 73 to complete
20-Mar-2020 18:37:12 ...
20-Mar-2020 18:37:12 2020-03-20 18:37:12 +0000 DEBUG: Response: {"id"=>73, "name"=>"ImportCredentials", "startTime"=>"2020-03-20T18:37:06.188Z", "endTime"=>"2020-03-20T18:37:11.210Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully imported KDC Account Manager credentials.", "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:37:12 2020-03-20 18:37:12 +0000 INFO: ------------ Configure Cluster for Kerberos --------------
20-Mar-2020 18:37:12 2020-03-20 18:37:12 +0000 DEBUG: Request: {"datanodeTransceiverPort"=>"1004", "datanodeWebPort"=>"1006"}
20-Mar-2020 18:37:12 2020-03-20 18:37:12 +0000 DEBUG: Response: {"id"=>75, "name"=>"ConfigureForKerberos", "startTime"=>"2020-03-20T18:37:12.364Z", "endTime"=>"2020-03-20T18:37:12.367Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully configured the cluster for Kerberos.", "clusterRef"=>{"clusterName"=>"00053556"}}
20-Mar-2020 18:37:12 2020-03-20 18:37:12 +0000 INFO: ------------ Wait for Configure Cluster for Kerberos --------------
20-Mar-2020 18:37:12 2020-03-20 18:37:12 +0000 INFO: Waiting for command 75 to complete
20-Mar-2020 18:37:12
20-Mar-2020 18:37:12 2020-03-20 18:37:12 +0000 DEBUG: Response: {"id"=>75, "name"=>"ConfigureForKerberos", "startTime"=>"2020-03-20T18:37:12.364Z", "endTime"=>"2020-03-20T18:37:12.367Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully configured the cluster for Kerberos.", "clusterRef"=>{"clusterName"=>"00053556"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:37:12 2020-03-20 18:37:12 +0000 INFO: ------------ Wait for Commands --------------
20-Mar-2020 18:37:12 2020-03-20 18:37:12 +0000 INFO: Waiting for global active GenerateCredentials commands to complete
20-Mar-2020 18:37:12 2020-03-20 18:37:12 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:14 .2020-03-20 18:37:14 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:16 .2020-03-20 18:37:16 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:18 .2020-03-20 18:37:18 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:20 .2020-03-20 18:37:20 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:23 .2020-03-20 18:37:23 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:25 .2020-03-20 18:37:25 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:27 .2020-03-20 18:37:27 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:29 .2020-03-20 18:37:29 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:31 .2020-03-20 18:37:31 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:33 .2020-03-20 18:37:33 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:35 .2020-03-20 18:37:35 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:37 .2020-03-20 18:37:37 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:39 .2020-03-20 18:37:39 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:41 .2020-03-20 18:37:41 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:43 .2020-03-20 18:37:43 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:45 .2020-03-20 18:37:45 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:47 .2020-03-20 18:37:47 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:49 .2020-03-20 18:37:49 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:51 .2020-03-20 18:37:51 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:53 .2020-03-20 18:37:53 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:55 .2020-03-20 18:37:55 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:57 .2020-03-20 18:37:57 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:37:59 .2020-03-20 18:37:59 +0000 DEBUG: Command result: {"items"=>[{"id"=>76, "name"=>"GenerateCredentials", "startTime"=>"2020-03-20T18:37:12.385Z", "active"=>true}]}
20-Mar-2020 18:38:01 .2020-03-20 18:38:01 +0000 DEBUG: Command result: {"items"=>[]}
20-Mar-2020 18:38:01
20-Mar-2020 18:38:01 2020-03-20 18:38:01 +0000 INFO: ------------ Configure Yarn for Secure CDAP Requirements --------------
20-Mar-2020 18:38:01 2020-03-20 18:38:01 +0000 DEBUG: Request: {"items"=>[{"name"=>"container_executor_allowed_system_users", "value"=>"nobody,impala,hive,llama,cdap"}, {"name"=>"yarn_nodemanager_delete_debug_delay_sec", "value"=>"43200"}]}
20-Mar-2020 18:38:01 2020-03-20 18:38:01 +0000 DEBUG: Response: {"items"=>[{"name"=>"container_executor_allowed_system_users", "value"=>"nobody,impala,hive,llama,cdap"}, {"name"=>"container_executor_min_user_id", "value"=>"500"}, {"name"=>"node_manager_java_heapsize", "value"=>"1073741824"}, {"name"=>"yarn_nodemanager_delete_debug_delay_sec", "value"=>"43200"}, {"name"=>"yarn_nodemanager_heartbeat_interval_ms", "value"=>"100"}, {"name"=>"yarn_nodemanager_local_dirs", "value"=>"/yarn/nm"}, {"name"=>"yarn_nodemanager_log_dirs", "value"=>"/yarn/container-logs"}, {"name"=>"yarn_nodemanager_resource_cpu_vcores", "value"=>"8"}, {"name"=>"yarn_nodemanager_resource_memory_mb", "value"=>"8197"}]}
20-Mar-2020 18:38:01 2020-03-20 18:38:01 +0000 INFO: ------------ Configure HBase for Secure CDAP --------------
20-Mar-2020 18:38:01 2020-03-20 18:38:01 +0000 DEBUG: Request: {"items"=>[{"name"=>"hbase_superuser", "value"=>"cdap"}]}
20-Mar-2020 18:38:01 2020-03-20 18:38:01 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase_security_authentication", "value"=>"kerberos"}, {"name"=>"hbase_security_authorization", "value"=>"true"}, {"name"=>"hbase_service_config_safety_valve", "value"=>"<property><name>hbase.auth.key.update.interval</name><value>600000</value></property>"}, {"name"=>"hbase_superuser", "value"=>"cdap"}, {"name"=>"hbase_thriftserver_security_authentication", "value"=>"auth-conf"}, {"name"=>"hdfs_service", "value"=>"hdfs-00053556"}, {"name"=>"zookeeper_service", "value"=>"zookeeper-00053556"}]}
20-Mar-2020 18:38:01 2020-03-20 18:38:01 +0000 INFO: ------------ Configure Zookeeper for Cask Internal --------------
20-Mar-2020 18:38:01 2020-03-20 18:38:01 +0000 DEBUG: Request: {"items"=>[{"name"=>"zk_server_log_dir", "value"=>"/data/log/zookeeper"}, {"name"=>"dataDir", "value"=>"/data/zookeeper"}, {"name"=>"dataLogDir", "value"=>"/data/zookeeper"}, {"name"=>"maxClientCnxns", "value"=>"0"}]}
20-Mar-2020 18:38:01 2020-03-20 18:38:01 +0000 DEBUG: Response: {"items"=>[{"name"=>"dataDir", "value"=>"/data/zookeeper"}, {"name"=>"dataLogDir", "value"=>"/data/zookeeper"}, {"name"=>"maxClientCnxns", "value"=>"0"}, {"name"=>"maxSessionTimeout", "value"=>"60000"}, {"name"=>"zk_server_log_dir", "value"=>"/data/log/zookeeper"}, {"name"=>"zookeeper_server_java_heapsize", "value"=>"1073741824"}]}
20-Mar-2020 18:38:01 2020-03-20 18:38:01 +0000 INFO: ------------ Start CM Management Services --------------
20-Mar-2020 18:38:01 2020-03-20 18:38:01 +0000 DEBUG: Request: cm/service/commands/start
20-Mar-2020 18:38:02 2020-03-20 18:38:02 +0000 DEBUG: Response: {"id"=>83, "name"=>"Start", "startTime"=>"2020-03-20T18:38:01.865Z", "active"=>true, "serviceRef"=>{"serviceName"=>"mgmt"}}
20-Mar-2020 18:38:02 2020-03-20 18:38:02 +0000 INFO: ------------ Wait for Management Services --------------
20-Mar-2020 18:38:02 2020-03-20 18:38:02 +0000 INFO: Waiting for command 83 to complete
20-Mar-2020 18:38:25 ...........
20-Mar-2020 18:38:25 2020-03-20 18:38:25 +0000 DEBUG: Response: {"id"=>83, "name"=>"Start", "startTime"=>"2020-03-20T18:38:01.865Z", "endTime"=>"2020-03-20T18:38:24.533Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"serviceName"=>"mgmt"}, "children"=>{"items"=>[{"id"=>87, "name"=>"Start", "startTime"=>"2020-03-20T18:38:02.192Z", "endTime"=>"2020-03-20T18:38:24.528Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"serviceName"=>"mgmt"}, "roleRef"=>{"serviceName"=>"mgmt", "roleName"=>"mgmt-SERVICEMONITOR-9eb1736e47a87a4faa49317b6938fc01"}}, {"id"=>86, "name"=>"Start", "startTime"=>"2020-03-20T18:38:02.078Z", "endTime"=>"2020-03-20T18:38:24.528Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"serviceName"=>"mgmt"}, "roleRef"=>{"serviceName"=>"mgmt", "roleName"=>"mgmt-HOSTMONITOR-9eb1736e47a87a4faa49317b6938fc01"}}, {"id"=>84, "name"=>"Start", "startTime"=>"2020-03-20T18:38:01.872Z", "endTime"=>"2020-03-20T18:38:24.527Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"serviceName"=>"mgmt"}, "roleRef"=>{"serviceName"=>"mgmt", "roleName"=>"mgmt-ALERTPUBLISHER-9eb1736e47a87a4faa49317b6938fc01"}}, {"id"=>85, "name"=>"Start", "startTime"=>"2020-03-20T18:38:01.971Z", "endTime"=>"2020-03-20T18:38:24.519Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"serviceName"=>"mgmt"}, "roleRef"=>{"serviceName"=>"mgmt", "roleName"=>"mgmt-EVENTSERVER-9eb1736e47a87a4faa49317b6938fc01"}}]}, "canRetry"=>false}
20-Mar-2020 18:38:25 2020-03-20 18:38:25 +0000 INFO: ------------ Start ZOOKEEPER FirstRun --------------
20-Mar-2020 18:38:25 2020-03-20 18:38:25 +0000 DEBUG: Request: clusters/00053556/services/zookeeper-00053556/commands/firstRun
20-Mar-2020 18:38:25 2020-03-20 18:38:25 +0000 DEBUG: Response: {"id"=>90, "name"=>"First Run", "startTime"=>"2020-03-20T18:38:25.140Z", "active"=>true, "children"=>{"items"=>[]}}
20-Mar-2020 18:38:25 2020-03-20 18:38:25 +0000 INFO: ------------ Wait for ZOOKEEPER FirstRun --------------
20-Mar-2020 18:38:25 2020-03-20 18:38:25 +0000 INFO: Waiting for command 90 to complete
20-Mar-2020 18:38:51 .............
20-Mar-2020 18:38:51 2020-03-20 18:38:51 +0000 DEBUG: Response: {"id"=>90, "name"=>"First Run", "startTime"=>"2020-03-20T18:38:25.140Z", "endTime"=>"2020-03-20T18:38:49.842Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished First Run of the following services successfully: zookeeper-00053556.", "children"=>{"items"=>[{"id"=>91, "name"=>"GlobalWait", "startTime"=>"2020-03-20T18:38:25.205Z", "endTime"=>"2020-03-20T18:38:25.224Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}, {"id"=>93, "name"=>"ZkInit", "startTime"=>"2020-03-20T18:38:25.328Z", "endTime"=>"2020-03-20T18:38:27.468Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully initialized ZooKeeper.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"zookeeper-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"zookeeper-00053556", "roleName"=>"zookeeper-00053556-SERVER-9eb1736e47a87a4faa49317b6938fc01"}}, {"id"=>95, "name"=>"ZkInit", "startTime"=>"2020-03-20T18:38:25.384Z", "endTime"=>"2020-03-20T18:38:26.024Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully initialized ZooKeeper.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"zookeeper-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"zookeeper-00053556", "roleName"=>"zookeeper-00053556-SERVER-542ac06e21d3ff036b38e440ce84bb57"}}, {"id"=>99, "name"=>"ZkStartPreservingDatastore", "startTime"=>"2020-03-20T18:38:27.483Z", "endTime"=>"2020-03-20T18:38:49.842Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully completed 3 steps.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"zookeeper-00053556"}}, {"id"=>94, "name"=>"ZkInit", "startTime"=>"2020-03-20T18:38:25.371Z", "endTime"=>"2020-03-20T18:38:26.056Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully initialized ZooKeeper.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"zookeeper-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"zookeeper-00053556", "roleName"=>"zookeeper-00053556-SERVER-afc58c8db5e39f1defa3fcddcf23d53e"}}, {"id"=>92, "name"=>"ServiceWaitCommand", "startTime"=>"2020-03-20T18:38:25.241Z", "endTime"=>"2020-03-20T18:38:25.310Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"zookeeper-00053556"}}]}, "canRetry"=>false}
20-Mar-2020 18:38:51 2020-03-20 18:38:51 +0000 INFO: ------------ Configure HDFS hdfs-00053556-DATANODE-BASE for Cask Internal --------------
20-Mar-2020 18:38:51 2020-03-20 18:38:51 +0000 DEBUG: Request: {"items"=>[{"name"=>"datanode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:51 2020-03-20 18:38:51 +0000 DEBUG: Response: {"items"=>[{"name"=>"datanode_java_heapsize", "value"=>"1073741824"}, {"name"=>"datanode_log_dir", "value"=>"/data/log/hadoop-hdfs"}, {"name"=>"dfs_data_dir_list", "value"=>"/dfs/dn"}, {"name"=>"dfs_datanode_data_dir_perm", "value"=>"700"}, {"name"=>"dfs_datanode_du_reserved", "value"=>"10737418240"}, {"name"=>"dfs_datanode_failed_volumes_tolerated", "value"=>"0"}, {"name"=>"dfs_datanode_http_port", "value"=>"1006"}, {"name"=>"dfs_datanode_max_locked_memory", "value"=>"4294967296"}, {"name"=>"dfs_datanode_port", "value"=>"1004"}]}
20-Mar-2020 18:38:51 2020-03-20 18:38:51 +0000 INFO: ------------ Configure HDFS hdfs-00053556-FAILOVERCONTROLLER-BASE for Cask Internal --------------
20-Mar-2020 18:38:51 2020-03-20 18:38:51 +0000 DEBUG: Request: {"items"=>[{"name"=>"failover_controller_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:51 2020-03-20 18:38:51 +0000 DEBUG: Response: {"items"=>[{"name"=>"failover_controller_java_heapsize", "value"=>"268435456"}, {"name"=>"failover_controller_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:51 2020-03-20 18:38:51 +0000 INFO: ------------ Configure HDFS hdfs-00053556-HTTPFS-BASE for Cask Internal --------------
20-Mar-2020 18:38:51 2020-03-20 18:38:51 +0000 DEBUG: Request: {"items"=>[{"name"=>"httpfs_log_dir", "value"=>"/data/log/hadoop-httpfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Response: {"items"=>[{"name"=>"httpfs_log_dir", "value"=>"/data/log/hadoop-httpfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 INFO: ------------ Configure HDFS hdfs-00053556-JOURNALNODE-BASE for Cask Internal --------------
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Request: {"items"=>[{"name"=>"journalnode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Response: {"items"=>[{"name"=>"dfs_journalnode_edits_dir", "value"=>"/dfs/jn"}, {"name"=>"journalNode_java_heapsize", "value"=>"536870912"}, {"name"=>"journalnode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 INFO: ------------ Configure HDFS hdfs-00053556-NFSGATEWAY-BASE for Cask Internal --------------
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Request: {"items"=>[{"name"=>"nfsgateway_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Response: {"items"=>[{"name"=>"nfsgateway_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 INFO: ------------ Configure HDFS hdfs-00053556-NAMENODE-BASE for Cask Internal --------------
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Request: {"items"=>[{"name"=>"namenode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Response: {"items"=>[{"name"=>"dfs_name_dir_list", "value"=>"/dfs/nn"}, {"name"=>"dfs_namenode_handler_count", "value"=>"30"}, {"name"=>"dfs_namenode_service_handler_count", "value"=>"30"}, {"name"=>"dfs_namenode_servicerpc_address", "value"=>"8022"}, {"name"=>"namenode_java_heapsize", "value"=>"3725590528"}, {"name"=>"namenode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 INFO: ------------ Configure HDFS hdfs-00053556-SECONDARYNAMENODE-BASE for Cask Internal --------------
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Request: {"items"=>[{"name"=>"secondarynamenode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Response: {"items"=>[{"name"=>"secondarynamenode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 INFO: ------------ Configure Namenode 0 For HA --------------
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Request: {"items"=>[{"name"=>"dfs_federation_namenode_nameservice", "value"=>"ns00053556"}, {"name"=>"dfs_namenode_quorum_journal_name", "value"=>"ns00053556"}, {"name"=>"autofailover_enabled", "value"=>"true"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Response: {"items"=>[{"name"=>"autofailover_enabled", "value"=>"true"}, {"name"=>"dfs_federation_namenode_nameservice", "value"=>"ns00053556"}, {"name"=>"dfs_name_dir_list", "value"=>"/dfs/nn"}, {"name"=>"dfs_namenode_handler_count", "value"=>"30"}, {"name"=>"dfs_namenode_quorum_journal_name", "value"=>"ns00053556"}, {"name"=>"dfs_namenode_service_handler_count", "value"=>"30"}, {"name"=>"dfs_namenode_servicerpc_address", "value"=>"8022"}, {"name"=>"namenode_java_heapsize", "value"=>"3725590528"}, {"name"=>"namenode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 INFO: ------------ Configure Namenode 1 For HA --------------
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Request: {"items"=>[{"name"=>"dfs_federation_namenode_nameservice", "value"=>"ns00053556"}, {"name"=>"dfs_namenode_quorum_journal_name", "value"=>"ns00053556"}, {"name"=>"autofailover_enabled", "value"=>"true"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Response: {"items"=>[{"name"=>"autofailover_enabled", "value"=>"true"}, {"name"=>"dfs_federation_namenode_nameservice", "value"=>"ns00053556"}, {"name"=>"dfs_name_dir_list", "value"=>"/dfs/nn"}, {"name"=>"dfs_namenode_handler_count", "value"=>"30"}, {"name"=>"dfs_namenode_quorum_journal_name", "value"=>"ns00053556"}, {"name"=>"dfs_namenode_service_handler_count", "value"=>"30"}, {"name"=>"dfs_namenode_servicerpc_address", "value"=>"8022"}, {"name"=>"namenode_java_heapsize", "value"=>"3725590528"}, {"name"=>"namenode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 INFO: ------------ Configure JournalNode RFG For HA --------------
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Request: {"items"=>[{"name"=>"dfs_journalnode_edits_dir", "value"=>"/data/dfs/jn"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Response: {"items"=>[{"name"=>"dfs_journalnode_edits_dir", "value"=>"/data/dfs/jn"}, {"name"=>"journalNode_java_heapsize", "value"=>"536870912"}, {"name"=>"journalnode_log_dir", "value"=>"/data/log/hadoop-hdfs"}]}
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 INFO: ------------ Configure HDFS For HA --------------
20-Mar-2020 18:38:52 2020-03-20 18:38:52 +0000 DEBUG: Request: {"items"=>[{"name"=>"dfs_ha_fencing_methods", "value"=>"shell(true)"}]}
20-Mar-2020 18:38:53 2020-03-20 18:38:53 +0000 DEBUG: Response: {"items"=>[{"name"=>"dfs_encrypt_data_transfer_algorithm", "value"=>"AES/CTR/NoPadding"}, {"name"=>"dfs_ha_fencing_methods", "value"=>"shell(true)"}, {"name"=>"hadoop_security_authentication", "value"=>"kerberos"}, {"name"=>"hadoop_security_authorization", "value"=>"true"}, {"name"=>"hdfs_service_config_safety_valve", "value"=>"<property><name>dfs.namenode.delegation.token.renew-interval</name><value>600000</value></property><property><name>dfs.namenode.delegation.token.max-lifetime</name><value>1200000</value></property>"}, {"name"=>"kms_service", "value"=>"kms-00053556"}, {"name"=>"zookeeper_service", "value"=>"zookeeper-00053556"}]}
20-Mar-2020 18:38:53 2020-03-20 18:38:53 +0000 INFO: ------------ Initialize Automatic Failover for HDFS --------------
20-Mar-2020 18:38:53 2020-03-20 18:38:53 +0000 DEBUG: Request: {"items"=>["hdfs9285e6d9-FAILOVERCONTROLLER-afc58c8db5e39f1defa3fcddcf23d53e"]}
20-Mar-2020 18:38:53 2020-03-20 18:38:53 +0000 DEBUG: Response: {"errors"=>[], "items"=>[{"id"=>118, "name"=>"FailoverControllerInitializeZNodeCommand", "startTime"=>"2020-03-20T18:38:53.017Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs9285e6d9-FAILOVERCONTROLLER-afc58c8db5e39f1defa3fcddcf23d53e"}}]}
20-Mar-2020 18:38:53 2020-03-20 18:38:53 +0000 INFO: ------------ Wait for Command 118 to finish --------------
20-Mar-2020 18:38:53 2020-03-20 18:38:53 +0000 INFO: Waiting for command 118 to complete
20-Mar-2020 18:38:59 ...
20-Mar-2020 18:38:59 2020-03-20 18:38:59 +0000 DEBUG: Response: {"id"=>118, "name"=>"FailoverControllerInitializeZNodeCommand", "startTime"=>"2020-03-20T18:38:53.017Z", "endTime"=>"2020-03-20T18:38:57.496Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully initialized High Availability state in ZooKeeper from Failover Controller (it-cmspark2-cmspk22r2-644-53556-1001)", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs9285e6d9-FAILOVERCONTROLLER-afc58c8db5e39f1defa3fcddcf23d53e"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:38:59 2020-03-20 18:38:59 +0000 INFO: ------------ Start JournalNodes for HDFS --------------
20-Mar-2020 18:38:59 2020-03-20 18:38:59 +0000 DEBUG: Request: {"items"=>["hdfs-00053556-JOURNALNODE-9eb1736e47a87a4faa49317b6938fc01", "hdfs-00053556-JOURNALNODE-afc58c8db5e39f1defa3fcddcf23d53e", "hdfs-00053556-JOURNALNODE-542ac06e21d3ff036b38e440ce84bb57"]}
20-Mar-2020 18:39:00 2020-03-20 18:39:00 +0000 DEBUG: Response: {"errors"=>[], "items"=>[{"id"=>121, "name"=>"Start", "startTime"=>"2020-03-20T18:38:59.402Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-JOURNALNODE-9eb1736e47a87a4faa49317b6938fc01"}}, {"id"=>123, "name"=>"Start", "startTime"=>"2020-03-20T18:38:59.560Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-JOURNALNODE-afc58c8db5e39f1defa3fcddcf23d53e"}}, {"id"=>125, "name"=>"Start", "startTime"=>"2020-03-20T18:38:59.762Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-JOURNALNODE-542ac06e21d3ff036b38e440ce84bb57"}}]}
20-Mar-2020 18:39:00 2020-03-20 18:39:00 +0000 INFO: ------------ Wait for Command 121 to finish --------------
20-Mar-2020 18:39:00 2020-03-20 18:39:00 +0000 INFO: Waiting for command 121 to complete
20-Mar-2020 18:39:22 ...........
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 DEBUG: Response: {"id"=>121, "name"=>"Start", "startTime"=>"2020-03-20T18:38:59.402Z", "endTime"=>"2020-03-20T18:39:21.865Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-JOURNALNODE-9eb1736e47a87a4faa49317b6938fc01"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 INFO: ------------ Wait for Command 123 to finish --------------
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 INFO: Waiting for command 123 to complete
20-Mar-2020 18:39:22
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 DEBUG: Response: {"id"=>123, "name"=>"Start", "startTime"=>"2020-03-20T18:38:59.560Z", "endTime"=>"2020-03-20T18:39:22.018Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-JOURNALNODE-afc58c8db5e39f1defa3fcddcf23d53e"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 INFO: ------------ Wait for Command 125 to finish --------------
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 INFO: Waiting for command 125 to complete
20-Mar-2020 18:39:22
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 DEBUG: Response: {"id"=>125, "name"=>"Start", "startTime"=>"2020-03-20T18:38:59.762Z", "endTime"=>"2020-03-20T18:39:22.288Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-JOURNALNODE-542ac06e21d3ff036b38e440ce84bb57"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 INFO: ------------ Format Primary Namenode --------------
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 DEBUG: Request: {"items"=>["hdfs-00053556-NAMENODE-afc58c8db5e39f1defa3fcddcf23d53e"]}
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 DEBUG: Response: {"errors"=>[], "items"=>[{"id"=>130, "name"=>"Format", "startTime"=>"2020-03-20T18:39:22.699Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-NAMENODE-afc58c8db5e39f1defa3fcddcf23d53e"}}]}
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 INFO: ------------ Wait for Command 130 to finish --------------
20-Mar-2020 18:39:22 2020-03-20 18:39:22 +0000 INFO: Waiting for command 130 to complete
20-Mar-2020 18:39:28 ...
20-Mar-2020 18:39:28 2020-03-20 18:39:28 +0000 DEBUG: Response: {"id"=>130, "name"=>"Format", "startTime"=>"2020-03-20T18:39:22.699Z", "endTime"=>"2020-03-20T18:39:28.563Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully formatted NameNode.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-NAMENODE-afc58c8db5e39f1defa3fcddcf23d53e"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:39:28 2020-03-20 18:39:28 +0000 INFO: ------------ Start Primary Namenode --------------
20-Mar-2020 18:39:28 2020-03-20 18:39:28 +0000 DEBUG: Request: {"items"=>["hdfs-00053556-NAMENODE-afc58c8db5e39f1defa3fcddcf23d53e"]}
20-Mar-2020 18:39:29 2020-03-20 18:39:29 +0000 DEBUG: Response: {"errors"=>[], "items"=>[{"id"=>133, "name"=>"Start", "startTime"=>"2020-03-20T18:39:29.011Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-NAMENODE-afc58c8db5e39f1defa3fcddcf23d53e"}}]}
20-Mar-2020 18:39:29 2020-03-20 18:39:29 +0000 INFO: ------------ Wait for Command 133 to finish --------------
20-Mar-2020 18:39:29 2020-03-20 18:39:29 +0000 INFO: Waiting for command 133 to complete
20-Mar-2020 18:39:51 ...........
20-Mar-2020 18:39:51 2020-03-20 18:39:51 +0000 DEBUG: Response: {"id"=>133, "name"=>"Start", "startTime"=>"2020-03-20T18:39:29.011Z", "endTime"=>"2020-03-20T18:39:51.302Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-NAMENODE-afc58c8db5e39f1defa3fcddcf23d53e"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:39:51 2020-03-20 18:39:51 +0000 INFO: ------------ Wait for Namenode to Startup --------------
20-Mar-2020 18:39:51 Artificial sleep
20-Mar-2020 18:40:51 2020-03-20 18:40:51 +0000 INFO: ------------ Bootstrap Standby Namenode --------------
20-Mar-2020 18:40:51 2020-03-20 18:40:51 +0000 DEBUG: Request: {"items"=>["hdfs-00053556-NAMENODE-9eb1736e47a87a4faa49317b6938fc01"]}
20-Mar-2020 18:40:51 2020-03-20 18:40:51 +0000 DEBUG: Response: {"errors"=>[], "items"=>[{"id"=>137, "name"=>"BootstrapStandbyNameNode", "startTime"=>"2020-03-20T18:40:51.750Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-NAMENODE-9eb1736e47a87a4faa49317b6938fc01"}}]}
20-Mar-2020 18:40:51 2020-03-20 18:40:51 +0000 INFO: ------------ Wait for Command 137 to finish --------------
20-Mar-2020 18:40:51 2020-03-20 18:40:51 +0000 INFO: Waiting for command 137 to complete
20-Mar-2020 18:40:57 ...
20-Mar-2020 18:40:57 2020-03-20 18:40:57 +0000 DEBUG: Response: {"id"=>137, "name"=>"BootstrapStandbyNameNode", "startTime"=>"2020-03-20T18:40:51.750Z", "endTime"=>"2020-03-20T18:40:57.050Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully bootstrapped Standby NameNode NameNode (it-cmspark2-cmspk22r2-644-53556-1000).", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-NAMENODE-9eb1736e47a87a4faa49317b6938fc01"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:40:57 2020-03-20 18:40:57 +0000 INFO: ------------ Start Secondary Namenode --------------
20-Mar-2020 18:40:57 2020-03-20 18:40:57 +0000 DEBUG: Request: {"items"=>["hdfs-00053556-NAMENODE-9eb1736e47a87a4faa49317b6938fc01"]}
20-Mar-2020 18:40:58 2020-03-20 18:40:58 +0000 DEBUG: Response: {"errors"=>[], "items"=>[{"id"=>140, "name"=>"Start", "startTime"=>"2020-03-20T18:40:58.057Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-NAMENODE-9eb1736e47a87a4faa49317b6938fc01"}}]}
20-Mar-2020 18:40:58 2020-03-20 18:40:58 +0000 INFO: ------------ Wait for Command 140 to finish --------------
20-Mar-2020 18:40:58 2020-03-20 18:40:58 +0000 INFO: Waiting for command 140 to complete
20-Mar-2020 18:41:20 ...........
20-Mar-2020 18:41:20 2020-03-20 18:41:20 +0000 DEBUG: Response: {"id"=>140, "name"=>"Start", "startTime"=>"2020-03-20T18:40:58.057Z", "endTime"=>"2020-03-20T18:41:20.363Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-NAMENODE-9eb1736e47a87a4faa49317b6938fc01"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:41:20 2020-03-20 18:41:20 +0000 INFO: ------------ Start Failover Controllers --------------
20-Mar-2020 18:41:20 2020-03-20 18:41:20 +0000 DEBUG: Request: {"items"=>["hdfs9285e6d9-FAILOVERCONTROLLER-afc58c8db5e39f1defa3fcddcf23d53e", "hdfs9285e6d9-FAILOVERCONTROLLER-9eb1736e47a87a4faa49317b6938fc01"]}
20-Mar-2020 18:41:21 2020-03-20 18:41:21 +0000 DEBUG: Response: {"errors"=>[], "items"=>[{"id"=>143, "name"=>"Start", "startTime"=>"2020-03-20T18:41:20.600Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs9285e6d9-FAILOVERCONTROLLER-afc58c8db5e39f1defa3fcddcf23d53e"}}, {"id"=>145, "name"=>"Start", "startTime"=>"2020-03-20T18:41:20.776Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs9285e6d9-FAILOVERCONTROLLER-9eb1736e47a87a4faa49317b6938fc01"}}]}
20-Mar-2020 18:41:21 2020-03-20 18:41:21 +0000 INFO: ------------ Wait for Command 143 to finish --------------
20-Mar-2020 18:41:21 2020-03-20 18:41:21 +0000 INFO: Waiting for command 143 to complete
20-Mar-2020 18:41:43 ...........
20-Mar-2020 18:41:43 2020-03-20 18:41:43 +0000 DEBUG: Response: {"id"=>143, "name"=>"Start", "startTime"=>"2020-03-20T18:41:20.600Z", "endTime"=>"2020-03-20T18:41:42.891Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs9285e6d9-FAILOVERCONTROLLER-afc58c8db5e39f1defa3fcddcf23d53e"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:41:43 2020-03-20 18:41:43 +0000 INFO: ------------ Wait for Command 145 to finish --------------
20-Mar-2020 18:41:43 2020-03-20 18:41:43 +0000 INFO: Waiting for command 145 to complete
20-Mar-2020 18:41:43
20-Mar-2020 18:41:43 2020-03-20 18:41:43 +0000 DEBUG: Response: {"id"=>145, "name"=>"Start", "startTime"=>"2020-03-20T18:41:20.776Z", "endTime"=>"2020-03-20T18:41:43.198Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started process.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs9285e6d9-FAILOVERCONTROLLER-9eb1736e47a87a4faa49317b6938fc01"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:41:43 2020-03-20 18:41:43 +0000 INFO: ------------ Wait for Standby Namenode to Startup --------------
20-Mar-2020 18:41:43 Artificial sleep
20-Mar-2020 18:42:43 2020-03-20 18:42:43 +0000 INFO: ------------ Start HDFS --------------
20-Mar-2020 18:42:43 2020-03-20 18:42:43 +0000 DEBUG: Request: clusters/00053556/services/hdfs-00053556/commands/start
20-Mar-2020 18:42:43 2020-03-20 18:42:43 +0000 DEBUG: Response: {"id"=>150, "name"=>"HdfsStartWithFailovers", "startTime"=>"2020-03-20T18:42:43.479Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}}
20-Mar-2020 18:42:43 2020-03-20 18:42:43 +0000 INFO: ------------ Wait for HDFS Start --------------
20-Mar-2020 18:42:43 2020-03-20 18:42:43 +0000 INFO: Waiting for command 150 to complete
20-Mar-2020 18:43:06 ...........
20-Mar-2020 18:43:06 2020-03-20 18:43:06 +0000 DEBUG: Response: {"id"=>150, "name"=>"HdfsStartWithFailovers", "startTime"=>"2020-03-20T18:42:43.479Z", "endTime"=>"2020-03-20T18:43:05.922Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started HDFS service", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "children"=>{"items"=>[{"id"=>151, "name"=>"Start", "startTime"=>"2020-03-20T18:42:43.501Z", "endTime"=>"2020-03-20T18:43:05.921Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}}]}, "canRetry"=>false}
20-Mar-2020 18:43:06 2020-03-20 18:43:06 +0000 INFO: ------------ Create HDFS Tmp Dir --------------
20-Mar-2020 18:43:06 2020-03-20 18:43:06 +0000 DEBUG: Request: clusters/00053556/services/hdfs-00053556/commands/hdfsCreateTmpDir
20-Mar-2020 18:43:06 2020-03-20 18:43:06 +0000 DEBUG: Response: {"id"=>158, "name"=>"CreateTmp", "startTime"=>"2020-03-20T18:43:06.236Z", "active"=>true, "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-NAMENODE-afc58c8db5e39f1defa3fcddcf23d53e"}}
20-Mar-2020 18:43:06 2020-03-20 18:43:06 +0000 INFO: ------------ Wait for HDFS Tmp Dir --------------
20-Mar-2020 18:43:06 2020-03-20 18:43:06 +0000 INFO: Waiting for command 158 to complete
20-Mar-2020 18:43:22 ........
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 DEBUG: Response: {"id"=>158, "name"=>"CreateTmp", "startTime"=>"2020-03-20T18:43:06.236Z", "endTime"=>"2020-03-20T18:43:21.883Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory /tmp.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hdfs-00053556", "roleName"=>"hdfs-00053556-NAMENODE-afc58c8db5e39f1defa3fcddcf23d53e"}, "children"=>{"items"=>[]}, "canRetry"=>false}
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 INFO: ------------ Configure Yarn for Cask Internal --------------
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 DEBUG: Request: {"items"=>[{"name"=>"yarn_application_classpath", "value"=>"$HADOOP_CLIENT_CONF_DIR,$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*,$HADOOP_HDFS_HOME/*,$HADOOP_HDFS_HOME/lib/*,$HADOOP_YARN_HOME/*,$HADOOP_YARN_HOME/lib/*,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*,$MR2_CLASSPATH"}]}
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 DEBUG: Response: {"items"=>[{"name"=>"hdfs_service", "value"=>"hdfs-00053556"}, {"name"=>"yarn_application_classpath", "value"=>"$HADOOP_CLIENT_CONF_DIR,$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*,$HADOOP_HDFS_HOME/*,$HADOOP_HDFS_HOME/lib/*,$HADOOP_YARN_HOME/*,$HADOOP_YARN_HOME/lib/*,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*,$MR2_CLASSPATH"}, {"name"=>"yarn_service_config_safety_valve", "value"=>"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}, {"name"=>"zookeeper_service", "value"=>"zookeeper-00053556"}]}
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 INFO: ------------ Configure Yarn RM for Cask Internal --------------
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 DEBUG: Request: {"items"=>[{"name"=>"resource_manager_log_dir", "value"=>"/data/log/hadoop-yarn"}]}
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 DEBUG: Response: {"items"=>[{"name"=>"resource_manager_java_heapsize", "value"=>"1073741824"}, {"name"=>"resource_manager_log_dir", "value"=>"/data/log/hadoop-yarn"}, {"name"=>"yarn_scheduler_maximum_allocation_mb", "value"=>"8197"}, {"name"=>"yarn_scheduler_maximum_allocation_vcores", "value"=>"8"}, {"name"=>"yarn_scheduler_minimum_allocation_mb", "value"=>"768"}]}
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 INFO: ------------ Configure Yarn NM for Cask Internal --------------
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 DEBUG: Request: {"items"=>[{"name"=>"yarn_nodemanager_log_dirs", "value"=>"/data/log/hadoop-yarn/container"}, {"name"=>"yarn_nodemanager_recovery_dir", "value"=>"/data/yarn/yarn-nm-recovery"}, {"name"=>"node_manager_log_dir", "value"=>"/data/log/hadoop-yarn"}, {"name"=>"yarn_nodemanager_resource_cpu_vcores", "value"=>"32"}]}
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 DEBUG: Response: {"items"=>[{"name"=>"container_executor_allowed_system_users", "value"=>"nobody,impala,hive,llama,cdap"}, {"name"=>"container_executor_min_user_id", "value"=>"500"}, {"name"=>"node_manager_java_heapsize", "value"=>"1073741824"}, {"name"=>"node_manager_log_dir", "value"=>"/data/log/hadoop-yarn"}, {"name"=>"yarn_nodemanager_delete_debug_delay_sec", "value"=>"43200"}, {"name"=>"yarn_nodemanager_heartbeat_interval_ms", "value"=>"100"}, {"name"=>"yarn_nodemanager_local_dirs", "value"=>"/yarn/nm"}, {"name"=>"yarn_nodemanager_log_dirs", "value"=>"/data/log/hadoop-yarn/container"}, {"name"=>"yarn_nodemanager_recovery_dir", "value"=>"/data/yarn/yarn-nm-recovery"}, {"name"=>"yarn_nodemanager_resource_cpu_vcores", "value"=>"32"}, {"name"=>"yarn_nodemanager_resource_memory_mb", "value"=>"8197"}]}
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 INFO: ------------ Configure Yarn JHS for Cask Internal --------------
20-Mar-2020 18:43:22 2020-03-20 18:43:22 +0000 DEBUG: Request: {"items"=>[{"name"=>"mr2_jobhistory_log_dir", "value"=>"/data/log/hadoop-mapreduce"}]}
20-Mar-2020 18:43:23 2020-03-20 18:43:23 +0000 DEBUG: Response: {"items"=>[{"name"=>"mr2_jobhistory_java_heapsize", "value"=>"1073741824"}, {"name"=>"mr2_jobhistory_log_dir", "value"=>"/data/log/hadoop-mapreduce"}]}
20-Mar-2020 18:43:23 2020-03-20 18:43:23 +0000 INFO: ------------ Configure Yarn Gateway for Cask Internal --------------
20-Mar-2020 18:43:23 2020-03-20 18:43:23 +0000 DEBUG: Request: {"items"=>[{"name"=>"mapreduce_map_java_opts_max_heap", "value"=>"402653184"}, {"name"=>"mapreduce_reduce_java_opts_max_heap", "value"=>"402653184"}, {"name"=>"io_sort_mb", "value"=>"100"}]}
20-Mar-2020 18:43:23 2020-03-20 18:43:23 +0000 DEBUG: Response: {"items"=>[{"name"=>"io_sort_mb", "value"=>"100"}, {"name"=>"mapred_submit_replication", "value"=>"3"}, {"name"=>"mapreduce_map_java_opts_max_heap", "value"=>"402653184"}, {"name"=>"mapreduce_reduce_java_opts_max_heap", "value"=>"402653184"}, {"name"=>"yarn_client_config_safety_valve", "value"=>"<property><name>yarn.resourcemanager.delegation.token.renew-interval</name><value>600000</value></property><property><name>yarn.resourcemanager.delegation.token.max-lifetime</name><value>1200000</value></property>"}]}
20-Mar-2020 18:43:25 2020-03-20 18:43:25 +0000 INFO: ------------ Start YARN FirstRun --------------
20-Mar-2020 18:43:25 2020-03-20 18:43:25 +0000 DEBUG: Request: clusters/00053556/services/yarn-00053556/commands/firstRun
20-Mar-2020 18:43:25 2020-03-20 18:43:25 +0000 DEBUG: Response: {"id"=>165, "name"=>"First Run", "startTime"=>"2020-03-20T18:43:25.203Z", "active"=>true, "children"=>{"items"=>[]}}
20-Mar-2020 18:43:25 2020-03-20 18:43:25 +0000 INFO: ------------ Wait for YARN FirstRun --------------
20-Mar-2020 18:43:25 2020-03-20 18:43:25 +0000 INFO: Waiting for command 165 to complete
20-Mar-2020 18:44:34 ..................................
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 DEBUG: Response: {"id"=>165, "name"=>"First Run", "startTime"=>"2020-03-20T18:43:25.203Z", "endTime"=>"2020-03-20T18:44:33.034Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished First Run of the following services successfully: yarn-00053556.", "children"=>{"items"=>[{"id"=>175, "name"=>"Start", "startTime"=>"2020-03-20T18:43:42.456Z", "endTime"=>"2020-03-20T18:44:04.735Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"kms-00053556"}}, {"id"=>179, "name"=>"CreateLogDir", "startTime"=>"2020-03-20T18:44:04.831Z", "endTime"=>"2020-03-20T18:44:10.157Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}}, {"id"=>174, "name"=>"GlobalWait", "startTime"=>"2020-03-20T18:43:42.431Z", "endTime"=>"2020-03-20T18:43:42.450Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}, {"id"=>166, "name"=>"DeployClusterClientConfig", "startTime"=>"2020-03-20T18:43:25.288Z", "endTime"=>"2020-03-20T18:43:42.430Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed all client configurations.", "clusterRef"=>{"clusterName"=>"00053556"}}, {"id"=>181, "name"=>"Start", "startTime"=>"2020-03-20T18:44:10.188Z", "endTime"=>"2020-03-20T18:44:33.033Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}}, {"id"=>178, "name"=>"CreateHistoryDir", "startTime"=>"2020-03-20T18:44:04.744Z", "endTime"=>"2020-03-20T18:44:08.995Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"yarn-00053556"}}]}, "canRetry"=>false}
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 INFO: ------------ Configure HBase Master for Cask Internal --------------
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 DEBUG: Request: {"items"=>[{"name"=>"hbase_master_log_dir", "value"=>"/data/log/hbase"}]}
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase_master_java_heapsize", "value"=>"1073741824"}, {"name"=>"hbase_master_log_dir", "value"=>"/data/log/hbase"}]}
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 INFO: ------------ Configure HBase Regionserver for Cask Internal --------------
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 DEBUG: Request: {"items"=>[{"name"=>"hbase_regionserver_log_dir", "value"=>"/data/log/hbase"}]}
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 DEBUG: Response: {"items"=>[{"name"=>"hbase_bucketcache_size", "value"=>"1024"}, {"name"=>"hbase_regionserver_java_heapsize", "value"=>"6611271680"}, {"name"=>"hbase_regionserver_log_dir", "value"=>"/data/log/hbase"}]}
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 INFO: ------------ Start HBASE FirstRun --------------
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 DEBUG: Request: clusters/00053556/services/hbase-00053556/commands/firstRun
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 DEBUG: Response: {"id"=>195, "name"=>"First Run", "startTime"=>"2020-03-20T18:44:34.738Z", "active"=>true, "children"=>{"items"=>[]}}
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 INFO: ------------ Wait for HBASE FirstRun --------------
20-Mar-2020 18:44:34 2020-03-20 18:44:34 +0000 INFO: Waiting for command 195 to complete
20-Mar-2020 18:45:05 ...............
20-Mar-2020 18:45:05 2020-03-20 18:45:05 +0000 DEBUG: Response: {"id"=>195, "name"=>"First Run", "startTime"=>"2020-03-20T18:44:34.738Z", "endTime"=>"2020-03-20T18:45:04.901Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished First Run of the following services successfully: hbase-00053556.", "children"=>{"items"=>[{"id"=>203, "name"=>"GlobalWait", "startTime"=>"2020-03-20T18:44:37.206Z", "endTime"=>"2020-03-20T18:44:37.226Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}, {"id"=>196, "name"=>"DeployClusterClientConfig", "startTime"=>"2020-03-20T18:44:34.912Z", "endTime"=>"2020-03-20T18:44:37.205Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed all client configurations.", "clusterRef"=>{"clusterName"=>"00053556"}}, {"id"=>206, "name"=>"Start", "startTime"=>"2020-03-20T18:44:42.309Z", "endTime"=>"2020-03-20T18:45:04.901Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}}, {"id"=>204, "name"=>"CreateRootDir", "startTime"=>"2020-03-20T18:44:37.246Z", "endTime"=>"2020-03-20T18:44:42.274Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hbase-00053556"}}]}, "canRetry"=>false}
20-Mar-2020 18:45:05 2020-03-20 18:45:05 +0000 INFO: ------------ Start HIVE FirstRun --------------
20-Mar-2020 18:45:05 2020-03-20 18:45:05 +0000 DEBUG: Request: clusters/00053556/services/hive-00053556/commands/firstRun
20-Mar-2020 18:45:05 2020-03-20 18:45:05 +0000 DEBUG: Response: {"id"=>217, "name"=>"First Run", "startTime"=>"2020-03-20T18:45:05.428Z", "active"=>true, "children"=>{"items"=>[]}}
20-Mar-2020 18:45:05 2020-03-20 18:45:05 +0000 INFO: ------------ Wait for HIVE FirstRun --------------
20-Mar-2020 18:45:05 2020-03-20 18:45:05 +0000 INFO: Waiting for command 217 to complete
20-Mar-2020 18:45:52 .......................
20-Mar-2020 18:45:52 2020-03-20 18:45:52 +0000 DEBUG: Response: {"id"=>217, "name"=>"First Run", "startTime"=>"2020-03-20T18:45:05.428Z", "endTime"=>"2020-03-20T18:45:52.189Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished First Run of the following services successfully: hive-00053556.", "children"=>{"items"=>[{"id"=>225, "name"=>"GlobalWait", "startTime"=>"2020-03-20T18:45:07.693Z", "endTime"=>"2020-03-20T18:45:07.710Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}, {"id"=>230, "name"=>"CreateHiveUserDir", "startTime"=>"2020-03-20T18:45:20.168Z", "endTime"=>"2020-03-20T18:45:25.025Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}}, {"id"=>218, "name"=>"DeployClusterClientConfig", "startTime"=>"2020-03-20T18:45:05.580Z", "endTime"=>"2020-03-20T18:45:07.692Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed all client configurations.", "clusterRef"=>{"clusterName"=>"00053556"}}, {"id"=>235, "name"=>"Start", "startTime"=>"2020-03-20T18:45:29.713Z", "endTime"=>"2020-03-20T18:45:52.188Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}}, {"id"=>226, "name"=>"HiveCreateMetastoreTables", "startTime"=>"2020-03-20T18:45:07.755Z", "endTime"=>"2020-03-20T18:45:10.731Z", "active"=>false, "success"=>true, "resultMessage"=>"Created Hive Metastore Database Tables successfully.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556", "roleName"=>"hive-00053556-HIVEMETASTORE-542ac06e21d3ff036b38e440ce84bb57"}}, {"id"=>232, "name"=>"CreateHiveWarehouseDir", "startTime"=>"2020-03-20T18:45:25.042Z", "endTime"=>"2020-03-20T18:45:29.648Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}}, {"id"=>228, "name"=>"HiveValidateMetastore", "startTime"=>"2020-03-20T18:45:10.761Z", "endTime"=>"2020-03-20T18:45:20.146Z", "active"=>false, "success"=>true, "resultMessage"=>"Validated Hive Metastore Schema successfully.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556"}, "roleRef"=>{"clusterName"=>"00053556", "serviceName"=>"hive-00053556", "roleName"=>"hive-00053556-HIVEMETASTORE-542ac06e21d3ff036b38e440ce84bb57"}}]}, "canRetry"=>false}
20-Mar-2020 18:45:52 2020-03-20 18:45:52 +0000 INFO: ------------ Start SPARK2_ON_YARN FirstRun --------------
20-Mar-2020 18:45:52 2020-03-20 18:45:52 +0000 DEBUG: Request: clusters/00053556/services/spark2_on_yarn-00053556/commands/firstRun
20-Mar-2020 18:45:52 2020-03-20 18:45:52 +0000 DEBUG: Response: {"id"=>240, "name"=>"First Run", "startTime"=>"2020-03-20T18:45:52.359Z", "active"=>true, "children"=>{"items"=>[]}}
20-Mar-2020 18:45:52 2020-03-20 18:45:52 +0000 INFO: ------------ Wait for SPARK2_ON_YARN FirstRun --------------
20-Mar-2020 18:45:52 2020-03-20 18:45:52 +0000 INFO: Waiting for command 240 to complete
20-Mar-2020 18:46:27 .................
20-Mar-2020 18:46:27 2020-03-20 18:46:27 +0000 DEBUG: Response: {"id"=>240, "name"=>"First Run", "startTime"=>"2020-03-20T18:45:52.359Z", "endTime"=>"2020-03-20T18:46:26.500Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished First Run of the following services successfully: spark2_on_yarn-00053556.", "children"=>{"items"=>[{"id"=>249, "name"=>"CreateSparkUserDirCommand", "startTime"=>"2020-03-20T18:45:54.838Z", "endTime"=>"2020-03-20T18:45:59.459Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"spark2_on_yarn-00053556"}}, {"id"=>253, "name"=>"Start", "startTime"=>"2020-03-20T18:46:04.210Z", "endTime"=>"2020-03-20T18:46:26.500Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully started service.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"spark2_on_yarn-00053556"}}, {"id"=>251, "name"=>"CreateSparkHistoryDirCommand", "startTime"=>"2020-03-20T18:45:59.477Z", "endTime"=>"2020-03-20T18:46:04.115Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"spark2_on_yarn-00053556"}}, {"id"=>248, "name"=>"GlobalWait", "startTime"=>"2020-03-20T18:45:54.792Z", "endTime"=>"2020-03-20T18:45:54.807Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}, {"id"=>241, "name"=>"DeployClusterClientConfig", "startTime"=>"2020-03-20T18:45:52.594Z", "endTime"=>"2020-03-20T18:45:54.792Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed all client configurations.", "clusterRef"=>{"clusterName"=>"00053556"}}]}, "canRetry"=>false}
20-Mar-2020 18:46:27 2020-03-20 18:46:27 +0000 INFO: ------------ Configure CDAP Service --------------
20-Mar-2020 18:46:27 2020-03-20 18:46:27 +0000 DEBUG: Request: {"items"=>[{"name"=>"security_store_provider", "value"=>"kms"}, {"name"=>"cdap-site.xml_service_safety_valve", "value"=>"<property><name>security.authorization.extension.config.sentry.site.url</name><value>/etc/sentry/conf/sentry-site.xml</value></property><property><name>cdap.ugi.cache.expiration.ms</name><value>60000</value></property><property><name>cdap.http.client.read.timeout.ms</name><value>120000</value></property><property><name>hive.server2.jdbc.url</name><value>jdbc:hive2://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:2181,it-cmspark2-cmspk22r2-644-53556-1001.coopr.sh:2181,it-cmspark2-cmspk22r2-644-53556-1002.coopr.sh:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2</value></property>"}, {"name"=>"CDAP_service_env_safety_valve", "value"=>"\nSPARK_MAJOR_VERSION=2"}]}
20-Mar-2020 18:46:27 2020-03-20 18:46:27 +0000 DEBUG: Response {"items"=>[{"name"=>"CDAP_service_env_safety_valve", "value"=>"\nSPARK_MAJOR_VERSION=2"}, {"name"=>"cdap-site.xml_service_safety_valve", "value"=>"<property><name>security.authorization.extension.config.sentry.site.url</name><value>/etc/sentry/conf/sentry-site.xml</value></property><property><name>cdap.ugi.cache.expiration.ms</name><value>60000</value></property><property><name>cdap.http.client.read.timeout.ms</name><value>120000</value></property><property><name>hive.server2.jdbc.url</name><value>jdbc:hive2://it-cmspark2-cmspk22r2-644-53556-1000.coopr.sh:2181,it-cmspark2-cmspk22r2-644-53556-1001.coopr.sh:2181,it-cmspark2-cmspk22r2-644-53556-1002.coopr.sh:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2</value></property>"}, {"name"=>"csd_compatibility_check_enabled", "value"=>"false"}, {"name"=>"enable_unrecoverable_reset", "value"=>"true"}, {"name"=>"hbase_service", "value"=>"hbase-00053556"}, {"name"=>"hdfs_service", "value"=>"hdfs-00053556"}, {"name"=>"hive_service", "value"=>"hive-00053556"}, {"name"=>"kerberos_auth_enabled", "value"=>"true"}, {"name"=>"security_authorization_cache_ttl_secs", "value"=>"3"}, {"name"=>"security_authorization_extension_jar_path", "value"=>"/data/cloudera/parcels/CDAP/master/ext/security/cdap-sentry-binding-0.11.0-SNAPSHOT.jar"}, {"name"=>"security_store_provider", "value"=>"kms"}, {"name"=>"spark2_on_yarn_service", "value"=>"spark2_on_yarn-00053556"}, {"name"=>"yarn_service", "value"=>"yarn-00053556"}, {"name"=>"zookeeper_service", "value"=>"zookeeper-00053556"}]}
20-Mar-2020 18:46:29 2020-03-20 18:46:29 +0000 INFO: ------------ Start CDAP FirstRun --------------
20-Mar-2020 18:46:29 2020-03-20 18:46:29 +0000 DEBUG: Request: clusters/00053556/services/cdap-00053556/commands/firstRun
20-Mar-2020 18:46:29 2020-03-20 18:46:29 +0000 DEBUG: Response: {"id"=>259, "name"=>"First Run", "startTime"=>"2020-03-20T18:46:29.236Z", "active"=>true, "children"=>{"items"=>[]}}
20-Mar-2020 18:46:29 2020-03-20 18:46:29 +0000 INFO: ------------ Wait for CDAP FirstRun --------------
20-Mar-2020 18:46:29 2020-03-20 18:46:29 +0000 INFO: Waiting for command 259 to complete
20-Mar-2020 18:47:20 .........................
20-Mar-2020 18:47:20 2020-03-20 18:47:20 +0000 ERROR: Caught exception: Command 259 not successful: {"id"=>259, "name"=>"First Run", "startTime"=>"2020-03-20T18:46:29.236Z", "endTime"=>"2020-03-20T18:47:19.618Z", "active"=>false, "success"=>false, "resultMessage"=>"Failed to perform First Run of services.", "children"=>{"items"=>[{"id"=>273, "name"=>"Start", "startTime"=>"2020-03-20T18:46:56.019Z", "endTime"=>"2020-03-20T18:47:19.618Z", "active"=>false, "success"=>false, "resultMessage"=>"Failed to start service.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}}, {"id"=>268, "name"=>"CreateCdapHdfsDirCommand", "startTime"=>"2020-03-20T18:46:46.595Z", "endTime"=>"2020-03-20T18:46:51.201Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}}, {"id"=>260, "name"=>"DeployClusterClientConfig", "startTime"=>"2020-03-20T18:46:29.328Z", "endTime"=>"2020-03-20T18:46:46.535Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully deployed all client configurations.", "clusterRef"=>{"clusterName"=>"00053556"}}, {"id"=>267, "name"=>"GlobalWait", "startTime"=>"2020-03-20T18:46:46.535Z", "endTime"=>"2020-03-20T18:46:46.552Z", "active"=>false, "success"=>true, "resultMessage"=>"Finished waiting"}, {"id"=>271, "name"=>"CreateCdapUserHdfsDirCommand", "startTime"=>"2020-03-20T18:46:51.227Z", "endTime"=>"2020-03-20T18:46:55.829Z", "active"=>false, "success"=>true, "resultMessage"=>"Successfully created HDFS directory.", "serviceRef"=>{"clusterName"=>"00053556", "serviceName"=>"cdap-00053556"}}]}, "canRetry"=>true} ["/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/coopr-internal/data/automatortypes/chef-solo/cookbooks/coopr_scripts/files/default/coopr-internal/bin/coopr_base_to_cm.rb:685:in `wait_for_command_success'", "/var/bamboo/xml-data/build-dir/IT-CMSPARK2-CMSPK22R2/coopr-internal/data/automatortypes/chef-solo/cookbooks/coopr_scripts/files/default/coopr-internal/bin/coopr_base_to_cm.rb:2174:in `<top (required)>'", "coopr_base_to_cm.rb:20:in `load'", "coopr_base_to_cm.rb:20:in `<main>'"]
20-Mar-2020 18:47:20 Failing task since return code of [/opt/rbenv/shims/ruby coopr_base_to_cm.rb --spark2 --coopr-uri ******** --coopr-tenant ******** --coopr-user bamboo --kdc-admin-user ******** --kdc-admin-password ******** --cdap-parcel-version 6.2.0.1584671288450-1 --remote-parcel-repo-url http://localhost:8080/itnparcelrepo --debug -i 00053556] was 1 while expected 0
20-Mar-2020 18:47:20 Finished task 'Execute coopr-base-to-cm' with result: Failed
20-Mar-2020 18:47:20 Running post build plugin 'Docker Container Cleanup'
20-Mar-2020 18:47:20 Running post build plugin 'NCover Results Collector'
20-Mar-2020 18:47:20 Running post build plugin 'Clover Results Collector'
20-Mar-2020 18:47:20 Running post build plugin 'npm Cache Cleanup'
20-Mar-2020 18:47:20 Running post build plugin 'Artifact Copier'
20-Mar-2020 18:47:20 Finalising the build...
20-Mar-2020 18:47:20 Stopping timer.
20-Mar-2020 18:47:20 Build IT-CMSPARK2-CMSPK22R2-644 completed.
20-Mar-2020 18:47:20 Running on server: post build plugin 'NCover Results Collector'
20-Mar-2020 18:47:20 Running on server: post build plugin 'Build Hanging Detection Configuration'
20-Mar-2020 18:47:20 Running on server: post build plugin 'Clover Delta Calculator'
20-Mar-2020 18:47:20 Running on server: post build plugin 'Maven Dependencies Postprocessor'
20-Mar-2020 18:47:20 All post build plugins have finished
20-Mar-2020 18:47:20 Generating build results summary...
20-Mar-2020 18:47:20 Saving build results to disk...
20-Mar-2020 18:47:20 Logging substituted variables...
20-Mar-2020 18:47:20 Indexing build results...
20-Mar-2020 18:47:20 Finished building IT-CMSPARK2-CMSPK22R2-644.