Build #7

GCP Cloud Sandbox built from DA Artifacts

Build: #7 failed Manual run by Matt Wuenschel

Build result summary

Details

Completed
Duration
12 minutes
Labels
None
Agent
bamboo-vmxagent01.c.continuuity-loom-clusters.internal
Revision
dac04700dd129bb5fd0546ad346fdbc582841dd3 dac04700dd129bb5fd0546ad346fdbc582841dd3
Fixed in
#8 (Manual run by Matt Wuenschel)

No failed tests found, a possible compilation error occurred.

Responsible

No one has taken responsibility for this failure

Code commits

Author Commit Message Commit date
mattwuenschel <mwuenschel@google.com> mattwuenschel <mwuenschel@google.com> dac04700dd129bb5fd0546ad346fdbc582841dd3 dac04700dd129bb5fd0546ad346fdbc582841dd3 Merge pull request #10569 from caskdata/feature/distributions-packer-gce
add packer googlecompute builder
albertshau <ashau@google.com> albertshau <ashau@google.com> 1d44ef638930c243786a4c0976e5738a7b901f50 1d44ef638930c243786a4c0976e5738a7b901f50 Merge pull request #10563 from caskdata/feature/CDAP-14104-provisioner-ip-choice
CDAP-14104 add ability to determine which ip to use for dataproc
mattwuenschel <mwuenschel@google.com> mattwuenschel <mwuenschel@google.com> 9a8e914e68a9ee40a50cb1d156f1f7bb778d1374 m 9a8e914e68a9ee40a50cb1d156f1f7bb778d1374 add packer googlecompute builder
albertshau <ashau@google.com> albertshau <ashau@google.com> 24600efe45a8cc374dcad101df8d502c32eee5eb m 24600efe45a8cc374dcad101df8d502c32eee5eb CDAP-14104 add ability to determine which ip to use for dataproc
Changed the Dataproc provisioner so that if it is running on GCP
in the same network as the dataproc cluster, it will by default
use the internal ip address when communicating with the cluster.
This makes it less likely that firewall rules will be an issue.
If users still want to use the external ip address, that is left
as an option.

Performed some refactoring so that CDAP no longer looks for the
'ip.external' node property, since that is no longer accurate.
Instead, added ip address as a required field in the Node class,
since it was functionally required anyway. This allows us to make
the contract explicit, instead of having required properties in
some Map.

Also made network and zone optional properties. When the provisioner
is running on GCP, the network and zone can be picked up from the
metadata server running on the VM.

Configuration changes

Plan configuration has changed since the last successful build. See the plan audit log for more details.

JIRA issues

IssueDescriptionStatus
Unknown Issue TypeCDAP-14104Could not obtain issue details from JIRA

Error summary for GCP Image

The job generated some errors, drill down into the full build log for more details.

2018/08/24 00:17:59 ui:     cdap-cloud-sandbox-gcp: W: mdadm: /etc/mdadm/mdadm.conf defines no arrays.
2018/08/24 00:18:03 ui:     cdap-cloud-sandbox-gcp: Processing triggers for libc-bin (2.23-0ubuntu10) ...
2018/08/24 00:18:03 ui:     cdap-cloud-sandbox-gcp: Processing triggers for man-db (2.7.5-1) ...
2018/08/24 00:18:04 ui:     cdap-cloud-sandbox-gcp: Reading package lists...
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: Building dependency tree...
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: Reading state information...
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: The following packages will be REMOVED:
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: autogen-doc g++ g++-5 guile-2.0-libs libgc1c2 libltdl-dev libltdl7
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: libopts25-dev libstdc++-5-dev libunistring0 m4
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: 0 upgraded, 0 newly installed, 11 to remove and 0 not upgraded.
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: After this operation, 57.1 MB disk space will be freed.
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: (Reading database ... 80437 files and directories currently installed.)
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: Removing autogen-doc (1:5.18.7-3) ...
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: Removing g++ (4:5.3.1-1ubuntu1) ...
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: Removing g++-5 (5.4.0-6ubuntu1~16.04.10) ...
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: Removing guile-2.0-libs:amd64 (2.0.11+1-10ubuntu0.1) ...
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: Removing libgc1c2:amd64 (1:7.4.2-7.3ubuntu0.1) ...
2018/08/24 00:18:05 ui:     cdap-cloud-sandbox-gcp: Removing libltdl-dev:amd64 (2.4.6-0.1) ...
2018/08/24 00:18:06 ui:     cdap-cloud-sandbox-gcp: Removing libltdl7:amd64 (2.4.6-0.1) ...
2018/08/24 00:18:06 ui:     cdap-cloud-sandbox-gcp: Removing libopts25-dev:amd64 (1:5.18.7-3) ...
2018/08/24 00:18:06 ui:     cdap-cloud-sandbox-gcp: Removing libstdc++-5-dev:amd64 (5.4.0-6ubuntu1~16.04.10) ...
2018/08/24 00:18:06 ui:     cdap-cloud-sandbox-gcp: Removing libunistring0:amd64 (0.9.3-5.2ubuntu1) ...
2018/08/24 00:18:06 ui:     cdap-cloud-sandbox-gcp: Removing m4 (1.4.17-5) ...
2018/08/24 00:18:06 ui:     cdap-cloud-sandbox-gcp: Processing triggers for man-db (2.7.5-1) ...
2018/08/24 00:18:08 ui:     cdap-cloud-sandbox-gcp: Processing triggers for libc-bin (2.23-0ubuntu10) ...
2018/08/24 00:18:08 ui:     cdap-cloud-sandbox-gcp: Processing triggers for install-info (6.1.0.dfsg.1-5) ...
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] RPC endpoint: Communicator ended with: 0
2018/08/24 00:18:09 [INFO] 5164 bytes written for 'stdout'
2018/08/24 00:18:09 [INFO] 0 bytes written for 'stderr'
2018/08/24 00:18:09 [INFO] RPC client: Communicator ended with: 0
2018/08/24 00:18:09 [INFO] RPC endpoint: Communicator ended with: 0
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] 5164 bytes written for 'stdout'
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] 0 bytes written for 'stderr'
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] RPC client: Communicator ended with: 0
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 opening new ssh session
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 starting remote command: rm -f /tmp/script_1480.sh
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] RPC endpoint: Communicator ended with: 0
2018/08/24 00:18:09 [INFO] RPC client: Communicator ended with: 0
2018/08/24 00:18:09 [INFO] RPC endpoint: Communicator ended with: 0
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] RPC client: Communicator ended with: 0
2018/08/24 00:18:09 ui: ==> cdap-cloud-sandbox-gcp: Provisioning with shell script: scripts/ssh-cleanup.sh
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 Opening scripts/ssh-cleanup.sh for reading
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] 756 bytes written for 'uploadData'
2018/08/24 00:18:09 [INFO] 756 bytes written for 'uploadData'
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 opening new ssh session
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 Starting remote scp process:  scp -vt /tmp
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 Started SCP session, beginning transfers...
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 Copying input data into temporary file so we can read the length
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [DEBUG] scp: Uploading script_5434.sh: perms=C0644 size=756
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 SCP session complete, closing stdin pipe.
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 Waiting for SSH session to complete.
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 scp stderr (length 31): Sink: C0644 756 script_5434.sh
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 opening new ssh session
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 starting remote command: chmod 0755 /tmp/script_5434.sh
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] RPC endpoint: Communicator ended with: 0
2018/08/24 00:18:09 [INFO] RPC client: Communicator ended with: 0
2018/08/24 00:18:09 [INFO] RPC endpoint: Communicator ended with: 0
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] RPC client: Communicator ended with: 0
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 opening new ssh session
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 starting remote command: sudo bash -c 'PACKER_BUILDER_TYPE='googlecompute' PACKER_BUILD_NAME='cdap-cloud-sandbox-gcp'  /tmp/script_5434.sh'
2018/08/24 00:18:09 ui:     cdap-cloud-sandbox-gcp: passwd: password expiry information changed.
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] RPC endpoint: Communicator ended with: 0
2018/08/24 00:18:09 [INFO] 45 bytes written for 'stdout'
2018/08/24 00:18:09 [INFO] RPC client: Communicator ended with: 0
2018/08/24 00:18:09 [INFO] 0 bytes written for 'stderr'
2018/08/24 00:18:09 [INFO] RPC endpoint: Communicator ended with: 0
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] 45 bytes written for 'stdout'
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] 0 bytes written for 'stderr'
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] RPC client: Communicator ended with: 0
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 opening new ssh session
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 starting remote command: rm -f /tmp/script_5434.sh
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] RPC endpoint: Communicator ended with: 0
2018/08/24 00:18:09 [INFO] RPC client: Communicator ended with: 0
2018/08/24 00:18:09 [INFO] RPC endpoint: Communicator ended with: 0
2018/08/24 00:18:09 packer: 2018/08/24 00:18:09 [INFO] RPC client: Communicator ended with: 0
2018/08/24 00:18:09 ui: ==> cdap-cloud-sandbox-gcp: Deleting instance...
2018/08/24 00:19:24 ui:     cdap-cloud-sandbox-gcp: Instance has been deleted!
2018/08/24 00:19:24 ui: ==> cdap-cloud-sandbox-gcp: Creating image...
2018/08/24 00:20:45 ui: ==> cdap-cloud-sandbox-gcp: Deleting disk...
2018/08/24 00:20:48 ui:     cdap-cloud-sandbox-gcp: Disk has been deleted!
2018/08/24 00:20:48 ui: Build 'cdap-cloud-sandbox-gcp' finished.
2018/08/24 00:20:48 Builds completed. Waiting on interrupt barrier...
2018/08/24 00:20:48 ui:
==> Builds finished. The artifacts of successful builds are:
2018/08/24 00:20:48 machine readable: cdap-cloud-sandbox-gcp,artifact-count []string{"1"}
2018/08/24 00:20:48 machine readable: cdap-cloud-sandbox-gcp,artifact []string{"0", "builder-id", "packer.googlecompute"}
2018/08/24 00:20:48 machine readable: cdap-cloud-sandbox-gcp,artifact []string{"0", "id", "packer-1535069338"}
2018/08/24 00:20:48 machine readable: cdap-cloud-sandbox-gcp,artifact []string{"0", "string", "A disk image was created: packer-1535069338"}
2018/08/24 00:20:48 machine readable: cdap-cloud-sandbox-gcp,artifact []string{"0", "files-count", "0"}
2018/08/24 00:20:48 machine readable: cdap-cloud-sandbox-gcp,artifact []string{"0", "end"}
2018/08/24 00:20:48 ui: --> cdap-cloud-sandbox-gcp: A disk image was created: packer-1535069338
2018/08/24 00:20:48 waiting for all plugin processes to complete...
2018/08/24 00:20:48 /usr/local/packer-1.0.0/packer: plugin process exited
2018/08/24 00:20:48 /usr/local/packer-1.0.0/packer: plugin process exited
2018/08/24 00:20:48 /usr/local/packer-1.0.0/packer: plugin process exited
2018/08/24 00:20:48 /usr/local/packer-1.0.0/packer: plugin process exited
2018/08/24 00:20:48 /usr/local/packer-1.0.0/packer: plugin process exited
2018/08/24 00:20:48 /usr/local/packer-1.0.0/packer: plugin process exited
2018/08/24 00:20:48 /usr/local/packer-1.0.0/packer: plugin process exited
2018/08/24 00:20:48 /usr/local/packer-1.0.0/packer: plugin process exited
Variable 'build.commandline.com.atlassian.bamboo.plugins.scripttask:task.builder.command.5' references 'inject.vm.artifact.name' which doesn't exist. Can't resolve it.
Variable 'build.commandline.com.atlassian.bamboo.plugins.scripttask:task.builder.command.5' references 'inject.cdap.version' which doesn't exist. Can't resolve it.
/var/bamboo/temp/CDAP-CSBXGCPREL-VAR-7-ScriptBuildTask-5162836615562654944.sh: line 1: shed: command not found