Cask Data Application Platform - Develop Build and Test

Build: #3067 was successful Child of CDAP-DRC-5091

Build result summary

Details

Completed
Duration
126 minutes
Labels
None
Agent
bamboo-vmxagent01.c.continuuity-loom-clusters.internal
Revision
3e8fd78330e17e3d907dd8222bd04748584b60b5 3e8fd78330e17e3d907dd8222bd04748584b60b5
Total tests
2856
First to pass since
#3066 (Child of CDAP-DRC-5089)

Code commits

Author Commit Message Commit date
Terence Yim <885032+chtyim@users.noreply.github.com> Terence Yim <885032+chtyim@users.noreply.github.com> 3e8fd78330e17e3d907dd8222bd04748584b60b5 3e8fd78330e17e3d907dd8222bd04748584b60b5 Merge pull request #12782 from cdapio/feature/CDAP-17287-collect-spark-history
(CDAP-17287) Collects Spark execution event logs
Terence Yim Terence Yim 63aa9a75cc72dbe0cc11b61f7a15fc0c12274427 63aa9a75cc72dbe0cc11b61f7a15fc0c12274427 (CDAP-17287) Collection of Spark execution event logs
- Introducing the Spark event logging and upload of logs through the runtime service.
  Based on the cConf settings, the event logging collection will be on/off regardless
  of the Spark job spark.eventLog.* configurations.
- Refactoring of the SparkRuntimeEnv class to simplify the logic by using CompletableFuture.
- Make runtime system services shutdown after the SparkExecutionContext stopped.
  Currently they stop concurrently. It is not a problem before this PR since we
  are not doing any important work at the context stop.
  However, this PR introduces uploading the event logs at the context stop,
  which needs to be completed before the system services shutdown and process termination.
Ajai <1452845+ajainarayanan@users.noreply.github.com> Ajai <1452845+ajainarayanan@users.noreply.github.com> 4a8898a7fc4cc7abf128b03a9360e236e725f989 4a8898a7fc4cc7abf128b03a9360e236e725f989 Merge pull request #12778 from cdapio/bugfix-ui/CDAP-17264-6.3
[CDAP-17264] [CDAP-17268] [CDAP-17267] Fixes handling undefined schemas in schema editor
Ajai Narayan Ajai Narayan f5f537adb15eaec5816770eb0ade08e696aaafc0 m f5f537adb15eaec5816770eb0ade08e696aaafc0 Fixes SchemaParser to default keys in map type to string when not present
Ajai Narayan Ajai Narayan 7bb1b6ee4d42b1f3ae55da062c85c4a8145a2f6e m 7bb1b6ee4d42b1f3ae55da062c85c4a8145a2f6e Adds additional check while copying nodes in pipeline canvas

Tests

Fixed tests 3
Status Test Failing since View job Duration
Successful PreviewDataPipelineTest testPreviewStop History
Failing since build #3066 (Child of CDAP-DRC-5089) Unit Test Job 14 secs
Successful PreviewDataPipelineTest testDataPipelinePreviewRuns History
Failing since build #3066 (Child of CDAP-DRC-5089) Unit Test Job 14 secs
Successful PreviewDataPipelineTest testPreviewFailedRun History
Failing since build #3066 (Child of CDAP-DRC-5089) Unit Test Job 13 secs

JIRA issues

IssueDescriptionStatus
Unknown Issue TypeCDAP-17264Could not obtain issue details from JIRA
Unknown Issue TypeCDAP-17267Could not obtain issue details from JIRA
Unknown Issue TypeCDAP-17268Could not obtain issue details from JIRA
Unknown Issue TypeCDAP-17287Could not obtain issue details from JIRA
Unknown Issue TypeCDAP-17624Could not obtain issue details from JIRA