Cask Data Application Platform - Develop Build and Test

Build: #3036 was successful Child of CDAP-DRC-5049

Code commits

caskdata/cdap

  • Jay Pandya

    Jay Pandya eebeed5bdd91435913ff7304a79d0a6abcd512cb

    Merge pull request #12643 from cdapio/feature/CDAP-17194-fix-pre-upgrade-job-retry-issue
    [CDAP-17194] Fix race condition for stopping pipelines in pre upgrade job

  • Terence Yim <885032+chtyim@users.noreply.github.com>

    Terence Yim <885032+chtyim@users.noreply.github.com> 05d52f0a5eec1449a7500ff80c68887b43ce5318

    Merge pull request #12644 from cdapio/feature/CDAP-17120-startup-concurrency
    (CDAP-17120) (CDAP-17199) Fixing concurrent program launch

  • Jay Pandya <jaypandya@google.com>

    Jay Pandya <jaypandya@google.com> f89cc0c8bc907323ed80f521b265d003d3d64290 m

    Fix race condition for pre upgrade job

    • cdap-client/src/main/java/io/cdap/cdap/client/ProgramClient.java (version f89cc0c8bc907323ed80f521b265d003d3d64290)
    • cdap-master/src/main/java/io/cdap/cdap/master/upgrade/UpgradeJobMain.java (version f89cc0c8bc907323ed80f521b265d003d3d64290)
  • Terence Yim

    Terence Yim 19a2575c0680787badcf5db8e312bfa14119b993 m

    (CDAP-17120) Correctly control number of parallel launch
    - Correctly control the size of the startup thread pool
    - Make the DistributedProgramRunner blocks on running

    • cdap-app-fabric/src/main/java/io/cdap/cdap/app/runtime/AbstractProgramRuntimeService.java (version 19a2575c0680787badcf5db8e312bfa14119b993)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/DistributedProgramRunner.java (version 19a2575c0680787badcf5db8e312bfa14119b993)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillRunnerService.java (version 19a2575c0680787badcf5db8e312bfa14119b993)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/app/runtime/AbstractProgramRuntimeServiceTest.java (version 19a2575c0680787badcf5db8e312bfa14119b993)
  • Terence Yim

    Terence Yim 0e0e8eb75e6f3c080ec22bd9fe8e02a0e44a029e m

    (CDAP-17199) Fix exception when concurrent launches on long running Dataproc cluster
    - Failure to update labels due to concurrent modification is acceptable

    • cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/provisioner/dataproc/DataprocClient.java (version 0e0e8eb75e6f3c080ec22bd9fe8e02a0e44a029e)
    • cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/provisioner/dataproc/ExistingDataprocProvisioner.java (version 0e0e8eb75e6f3c080ec22bd9fe8e02a0e44a029e)