Build #540

Build: #540 failed Scheduled with changes by 6 people

Build result summary

Details

Completed
Duration
143 minutes
Labels
None
Agent
bamboo-agent02
Revisions
caskdata/cdap
ecc70b28d6014f8265f84af78f745f8012510d30 ecc70b28d6014f8265f84af78f745f8012510d30
caskdata/cdap-integration-tests
f9f9ced42f3367d303a4e6abbbfb34f90e02f2ad f9f9ced42f3367d303a4e6abbbfb34f90e02f2ad
Fixed in
#551 (Scheduled with changes by 5 people)

No failed tests found, a possible compilation error occurred.

Responsible

Code commits

caskdata/cdap
Author Commit Message Commit date
Edwin Elia <edwinelia@google.com> Edwin Elia <edwinelia@google.com> ecc70b28d6014f8265f84af78f745f8012510d30 ecc70b28d6014f8265f84af78f745f8012510d30 Merge pull request #12247 from cdapio/feature-ui/CDAP-16886-run-ui-unit-tests
[CDAP-16886] add pom profile to run UI unit tests
albertshau <ashau@google.com> albertshau <ashau@google.com> 4313c35cb2475365e03b5a95a478343805bf9bdc 4313c35cb2475365e03b5a95a478343805bf9bdc Merge pull request #12252 from cdapio/feature/CDAP-16852-auto-join-macro-schemas
CDAP-16852 handle dynamic schemas in auto join
Terence Yim <885032+chtyim@users.noreply.github.com> Terence Yim <885032+chtyim@users.noreply.github.com> 4d3fccccac6f6563b717a41b0d2a6ac3e497f72d 4d3fccccac6f6563b717a41b0d2a6ac3e497f72d Merge pull request #12255 from cdapio/feature/CDAP-16669-long-running-dataproc
(CDAP-16669) New Dataproc provisioner for existing cluster
Terence Yim Terence Yim f655c17dfd40eeb2d1f5663f0ecdcf05915e7d21 f655c17dfd40eeb2d1f5663f0ecdcf05915e7d21 (CDAP-16669) Added a new Dataproc provisioner for existing cluster
albertshau <ashau@google.com> albertshau <ashau@google.com> 7a67c119ca4920bb33a84af541adbbe00b368cc3 7a67c119ca4920bb33a84af541adbbe00b368cc3 CDAP-16852 handle dynamic schemas in auto join
Properly handle the case when the inputs into an auto-join stage
have null schemas due to the schema being unknown at deploy time,
usually because of macros.

In order to support this type of use case, added a way for a
plugin to specify the output schema in the JoinDefinition.
This should be used when the output schema cannot be derived
at deployment time due to macros. This is what the existing
Joiner currently requires the user to do for dynamic join
use cases.

For Spark, the implementation becomes significantly more difficult
due to the fact that the schema of each input stage needs to be
known in the Spark driver, in order to convert RDDs into
DataFrames.

Added logic that derives the input schema using the output schema,
selected fields, and join keys. It is possible to derive
a usable schema when all the join keys are present in the final
output schema.

JIRA issues

IssueDescriptionStatus
2 more issues…
Unknown Issue TypeCDAP-11661Could not obtain issue details from JIRA
Unknown Issue TypeCDAP-16607Could not obtain issue details from JIRA
Unknown Issue TypeCDAP-16669Could not obtain issue details from JIRA
Unknown Issue TypeCDAP-16797Could not obtain issue details from JIRA
Unknown Issue TypeCDAP-16852Could not obtain issue details from JIRA

Error summary for Default Job

The job generated some errors, drill down into the full build log for more details.

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that the RSA host key has just been changed.
The fingerprint for the RSA key sent by the remote host is
5a:2f:a1:98:5a:d3:e7:b8:51:26:50:f9:30:1b:3f:18.
Please contact your system administrator.
Add correct host key in /home/bamboo/.ssh/known_hosts to get rid of this message.
Offending key in /home/bamboo/.ssh/known_hosts:49
Password authentication is disabled to avoid man-in-the-middle attacks.
Keyboard-interactive authentication is disabled to avoid man-in-the-middle attacks.
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that the RSA host key has just been changed.
The fingerprint for the RSA key sent by the remote host is
5a:2f:a1:98:5a:d3:e7:b8:51:26:50:f9:30:1b:3f:18.
Please contact your system administrator.
Add correct host key in /home/bamboo/.ssh/known_hosts to get rid of this message.
Offending key in /home/bamboo/.ssh/known_hosts:49
Password authentication is disabled to avoid man-in-the-middle attacks.
Keyboard-interactive authentication is disabled to avoid man-in-the-middle attacks.
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that the RSA host key has just been changed.
The fingerprint for the RSA key sent by the remote host is
5a:2f:a1:98:5a:d3:e7:b8:51:26:50:f9:30:1b:3f:18.
Please contact your system administrator.
Add correct host key in /home/bamboo/.ssh/known_hosts to get rid of this message.
Offending key in /home/bamboo/.ssh/known_hosts:49
Password authentication is disabled to avoid man-in-the-middle attacks.
Keyboard-interactive authentication is disabled to avoid man-in-the-middle attacks.