Build #475

Build: #475 failed Scheduled with changes by 4 people

Code commits

caskdata/cdap

  • Vinisha Shah <CuriousVini@users.noreply.github.com>

    Vinisha Shah <CuriousVini@users.noreply.github.com> 49ed3615b2770f2a0768e1b93dc330b7ac8021d8

    Merge pull request #11977 from cdapio/feature/CDAP-15633-twill-controller
    Adding implementation for Twill Runner Service

  • Vinisha Shah

    Vinisha Shah e48fdadd92eeae34da885d75ea970d9084a1d8ed

    [CDAP-16420]  Add twill runner service for job manager

    • cdap-app-fabric/src/main/java/io/cdap/cdap/app/guice/RemoteExecutionProgramRunnerModule.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/AbstractRuntimeTwillController.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/AbstractRuntimeTwillPreparer.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/DistributedProgramRunner.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionJobMain.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillController.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillControllerFactory.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillPreparer.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillRunnerService.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtime/RuntimeTwillRunnerService.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtime/TwillControllerFactory.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtimejob/DefaultRuntimeInfo.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtimejob/DefaultRuntimeJob.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtimejob/RuntimeJobTwillController.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtimejob/RuntimeJobTwillPreparer.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtimejob/RuntimeJobTwillRunnerService.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/provision/DefaultProvisionerContext.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/provision/ProvisionerExtensionLoader.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/provision/ProvisioningService.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/provision/task/ClusterCreateSubtask.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-distributions/src/etc/cdap/conf.dist/logback-container.xml (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/common/DataprocUtils.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/provisioner/dataproc/DataprocClient.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/provisioner/dataproc/DataprocProvisioner.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/DataprocJarUtil.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/DataprocJobMain.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/DataprocRuntimeJobManager.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-ext-dataproc/src/test/java/io/cdap/cdap/runtime/spi/provisioner/dataproc/DataprocRuntimeJobManagerTest.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/provisioner/ProvisionerContext.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/ProgramRunInfo.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/RuntimeJobDetail.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/RuntimeJobId.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/RuntimeJobInfo.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/RuntimeJobManager.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/RuntimeLocalFile.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
    • cdap-spark-core-base/src/main/java/io/cdap/cdap/app/runtime/spark/distributed/DistributedSparkProgramRunner.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
  • Prashant Jaikumar

    Prashant Jaikumar 7dce246faf478a4b096ac692b856b60223009128

    Merge pull request #12028 from cdapio/inputStages_compat
    Handle backward compatibility for inputStages.

  • wyzhang <wyzhang@google.com>

    wyzhang <wyzhang@google.com> 03ace0a7fca62cd659fba2627380a768913d362b

    Merge pull request #12024 from cdapio/feature/CDAP-16353/wyzhang/preview/testServiceMain
    (CDAP-16353) Small refactoring of test for k8s service test base

  • wyzhang <wyzhang@google.com>

    wyzhang <wyzhang@google.com> 4b600d8a498581ab0a96ea4115db6688ac459629 m

    (CDAP-16353) Small refactoring of test for k8s service test base
    What:
    Introduce APIs for starting and stopping service in k8s service main test base.

    Why:
    Will be used in a follow-up PR to allow preview test to start and stop
    preview service.

    • cdap-master/src/test/java/io/cdap/cdap/master/environment/k8s/MasterServiceMainTestBase.java (version 4b600d8a498581ab0a96ea4115db6688ac459629)
  • wyzhang <wyzhang@google.com>

    wyzhang <wyzhang@google.com> 551ba14db7ab7ad2fca5f4fe451e71bb3d04d1fb

    Merge pull request #12023 from cdapio/feature/CDAP-16353/wyzhang/preview/binding
    (CDAP-16353) cleanup/refactor: move bindings for preview runner into its module

  • Prashant Jaikumar

    Prashant Jaikumar 9b38fba29f33bf959fe723f9ede62b1299ef0ff1 m

    Handle backward compatibility for inputStages.
    Pipelines created with older code will not have inputStages in serialized JSON. In these cases we should derive inputStages from keys of inputSchemas.

    • cdap-app-templates/cdap-etl/cdap-etl-proto/src/main/java/io/cdap/cdap/etl/proto/v2/spec/StageSpec.java (version 9b38fba29f33bf959fe723f9ede62b1299ef0ff1)
    • cdap-app-templates/cdap-etl/cdap-etl-proto/src/test/java/io/cdap/cdap/etl/proto/v2/spec/StageSpecTest.java (version 9b38fba29f33bf959fe723f9ede62b1299ef0ff1)
  • wyzhang <wyzhang@google.com>

    wyzhang <wyzhang@google.com> bd613f78189e3b74939a05b39c452e7f70fbfdd0 m

    (CDAP-16353) cleanup/refactor: move bindings for preview runner into its module.
    Motivation:
    small refactoring to move bindings for preview runner into central location
    (i.e. its own guice module DefaultPreviewRunnerModule)

    • cdap-app-fabric/src/main/java/io/cdap/cdap/app/preview/DefaultPreviewRunnerModule.java (version bd613f78189e3b74939a05b39c452e7f70fbfdd0)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/preview/DefaultPreviewManager.java (version bd613f78189e3b74939a05b39c452e7f70fbfdd0)