Build #2,542

Cask Data Application Platform - Develop Build and Test

Build: #2542 failed Child of CDAP-DRC-4390

Code commits

caskdata/cdap

  • Ali Anwar

    Ali Anwar b972189d0feae18061c0770862d65c1461628d53

    Merge pull request #11178 from cdapio/revert-11164-feature/CDAP-14644-checkpointing-for-gcs
    Revert "Implement checkpointing on GCS."

  • Ali Anwar

    Ali Anwar 87a2e2c451b2b091c3dffd201526cf81ee1a0cb7

    Revert "Implement checkpointing on GCS."

    • cdap-app-templates/cdap-etl/cdap-data-streams/src/main/java/co/cask/cdap/datastreams/DataStreamsApp.java (version 87a2e2c451b2b091c3dffd201526cf81ee1a0cb7)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/main/java/co/cask/cdap/datastreams/DataStreamsPipelineSpec.java (version 87a2e2c451b2b091c3dffd201526cf81ee1a0cb7)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/main/java/co/cask/cdap/datastreams/DataStreamsPipelineSpecGenerator.java (version 87a2e2c451b2b091c3dffd201526cf81ee1a0cb7)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/main/java/co/cask/cdap/datastreams/DataStreamsSparkLauncher.java (version 87a2e2c451b2b091c3dffd201526cf81ee1a0cb7)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/main/java/co/cask/cdap/datastreams/SparkStreamingPipelineDriver.java (version 87a2e2c451b2b091c3dffd201526cf81ee1a0cb7)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/test/java/co/cask/cdap/datastreams/DataStreamsSparkSinkTest.java (version 87a2e2c451b2b091c3dffd201526cf81ee1a0cb7)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/test/java/co/cask/cdap/datastreams/DataStreamsTest.java (version 87a2e2c451b2b091c3dffd201526cf81ee1a0cb7)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/test/java/co/cask/cdap/datastreams/preview/PreviewDataStreamsTest.java (version 87a2e2c451b2b091c3dffd201526cf81ee1a0cb7)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/StreamingCompat.java (version 87a2e2c451b2b091c3dffd201526cf81ee1a0cb7)
    • cdap-app-templates/cdap-etl/hydrator-spark-core2_2.11/src/main/java/co/cask/cdap/etl/spark/StreamingCompat.java (version 87a2e2c451b2b091c3dffd201526cf81ee1a0cb7)
  • Edwin Elia <edwinelia@google.com>

    Edwin Elia <edwinelia@google.com> 0159408ac526d3657f3e31ce4cc806ebf642d423

    Merge pull request #11170 from cdapio/feature-ui/CDAP-14877-metadata-pagination
    [CDAP-14877] handle pagination and cursor in home page

  • Edwin Elia <edwinelia@google.com>

    Edwin Elia <edwinelia@google.com> 01c4fd157341ea8d7159a3c7090130d7a6c3accb

    [CDAP-14877] handle pagination and cursor in home page

    • cdap-ui/app/cdap/components/EntityListView/EntityListInfo/EntityListInfo.scss (version 01c4fd157341ea8d7159a3c7090130d7a6c3accb)
    • cdap-ui/app/cdap/components/EntityListView/EntityListInfo/index.js (version 01c4fd157341ea8d7159a3c7090130d7a6c3accb)
    • cdap-ui/app/cdap/components/EntityListView/SearchStore/ActionCreator.js (version 01c4fd157341ea8d7159a3c7090130d7a6c3accb)
    • cdap-ui/app/cdap/components/EntityListView/SearchStore/index.js (version 01c4fd157341ea8d7159a3c7090130d7a6c3accb)
    • cdap-ui/app/cdap/components/PaginationStepper/index.tsx (version 01c4fd157341ea8d7159a3c7090130d7a6c3accb)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> f3c2bece421b8c53c842766369f02b656544872d

    Merge pull request #11131 from cdapio/feature/CDAP-14905-k8s-twill-runner
    CDAP-14905 add a kubernetes twill runner

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 05761d69486e41f471e83b3278134ae0f2fbbf11

    Merge pull request #11174 from cdapio/feature/CDAP-15037-fix-user-plugin-loading
    CDAP-15037 fix user scoped plugin loading in service

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> c18172e4f23b1ff945887332a39b5dfad693a877 m

    CDAP-14905 add a kubernetes twill runner
    Add a kubernetes implementation of TwillRunner to support running
    programs on Kubernetes instead of YARN.
    The runner currently only supports service program types.

    It works by creating a config-map that contains the serialized
    app spec and program options. It then creates a deployment for
    the actual service program, with the config-map mounted as a
    volume and arguments that point to the app spec and options.
    The deployment and config-map are both run specific, and are
    cleaned up when the program stops.

    • cdap-app-fabric/pom.xml (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedProgramRunner.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-app-fabric/src/main/java/co/cask/cdap/master/environment/k8s/AbstractServiceMain.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-kubernetes/pom.xml (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-kubernetes/src/main/java/co/cask/cdap/k8s/runtime/KubeTwillController.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-kubernetes/src/main/java/co/cask/cdap/k8s/runtime/KubeTwillPreparer.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-kubernetes/src/main/java/co/cask/cdap/k8s/runtime/KubeTwillRunnerService.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-kubernetes/src/main/java/co/cask/cdap/master/environment/k8s/KubeMasterEnvironment.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-kubernetes/src/main/java/co/cask/cdap/master/environment/k8s/PodInfo.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-master-spi/pom.xml (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-master-spi/src/main/java/co/cask/cdap/master/spi/environment/MasterEnvironment.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-master/src/main/java/co/cask/cdap/master/environment/k8s/AppFabricServiceMain.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-master/src/main/java/co/cask/cdap/master/environment/k8s/NoopTwillController.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-master/src/main/java/co/cask/cdap/master/environment/k8s/NoopTwillPreparer.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-master/src/main/java/co/cask/cdap/master/environment/k8s/NoopTwillRunnerService.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-master/src/test/java/co/cask/cdap/master/environment/MockMasterEnvironment.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-master/src/test/java/co/cask/cdap/master/environment/NoopTwillController.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-master/src/test/java/co/cask/cdap/master/environment/NoopTwillPreparer.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
    • cdap-master/src/test/java/co/cask/cdap/master/environment/NoopTwillRunnerService.java (version c18172e4f23b1ff945887332a39b5dfad693a877)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> bbfa725ebe73308836c47f860de31f87098a851c m

    CDAP-15037 fix user scoped plugin loading in service
    Added a way to get a dynamic plugin configurer for a different
    namespace than the one a service is running in. Used this
    capability to fix a bug in the pipeline studio service where
    only system scoped plugins were able to be loaded.

    • cdap-api/src/main/java/co/cask/cdap/api/service/http/HttpServiceContext.java (version bbfa725ebe73308836c47f860de31f87098a851c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/service/http/BasicHttpServiceContext.java (version bbfa725ebe73308836c47f860de31f87098a851c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/service/http/HttpHandlerGeneratorTest.java (version bbfa725ebe73308836c47f860de31f87098a851c)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/co/cask/cdap/datapipeline/service/ValidationHandler.java (version bbfa725ebe73308836c47f860de31f87098a851c)
    • cdap-unit-test/src/test/java/co/cask/cdap/service/DynamicPluginServiceApp.java (version bbfa725ebe73308836c47f860de31f87098a851c)
    • cdap-unit-test/src/test/java/co/cask/cdap/service/DynamicPluginServiceTestRun.java (version bbfa725ebe73308836c47f860de31f87098a851c)