Build #1,526

Build: #1526 failed Child of CDAP-DRC-5483

Code commits

caskdata/cdap

  • wyzhang <wyzhang@google.com>

    wyzhang <wyzhang@google.com> 27b70b59e60383b3654d6a979e74bcbc5098e6f5

    Merge pull request #13484 from cdapio/bug/CDAP-18076/wyzhang-task-worker-certificate
    CDAP-18076: Unset certificate path in CConfiguration when launching TaskWorkerTwillApplication

  • MEseifan <54917202+MEseifan@users.noreply.github.com>

    MEseifan <54917202+MEseifan@users.noreply.github.com> 8a9a8ee9435368c2ff2fe18a8a21ac1bfc3d3173

    Merge pull request #13454 from cdapio/feature/sidecar-container-mo
    Implement ArtifactLocalizerService which runs in sidecar container

  • Masoud Saeida Ardekani

    Masoud Saeida Ardekani 76e055aaa7d243b3f2599a09cfc857ccdedb30ba m

    Implement artifact localizer and refactor configurator to use sidecar

    • cdap-app-fabric/src/main/java/io/cdap/cdap/app/guice/AppFabricServiceRuntimeModule.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/gateway/handlers/ArtifactHttpHandlerInternal.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/artifact/RemoteArtifactRepository.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/artifact/RemoteArtifactRepositoryReader.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/artifact/RemotePluginFinder.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/ConfiguratorTask.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/ConfiguratorTaskModule.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/RemoteWorkerPluginFinder.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/sidecar/ArtifactLocalizer.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/sidecar/ArtifactLocalizerClient.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/sidecar/ArtifactLocalizerHttpHandlerInternal.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/sidecar/ArtifactLocalizerService.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/sidecar/ArtifactLocalizerTwillRunnable.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/internal/app/deploy/RemoteConfiguratorTest.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/internal/app/worker/sidecar/ArtifactLocalizerServiceTest.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
    • cdap-kubernetes/src/main/java/io/cdap/cdap/k8s/runtime/KubeTwillPreparer.java (version 76e055aaa7d243b3f2599a09cfc857ccdedb30ba)
  • Masoud Saeida Ardekani

    Masoud Saeida Ardekani 0baa150a7cc4f1a5f5766dfbf22d3926ce32f77d

    Merge pull request #13470 from cdapio/feature/sidecar-container-security-context
    Add TwillRunnable security context and readonly volumes

  • wyzhang <wyzhang@google.com>

    wyzhang <wyzhang@google.com> dc56fa5cf8f8505a0a6b7abd1a15d9b1da48b00d m

    CDAP-18076: Unset certificate path in CConfiguration when launching TaskWorkerTwillApplication
    Why:
    TaskWorkerService is currently used to run user code in isolation and
    cdap-security is not exposed to it. So it has no access to certificate.
    Unset the path in the cConf for TaskWorkerService, so it will generate
    a certifacte itself if SSL is enabled. This is fine for now as currently
    there is no code path verify the certificate (e.g. always trust servers)

    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/TaskWorkerServiceLauncher.java (version dc56fa5cf8f8505a0a6b7abd1a15d9b1da48b00d)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/TaskWorkerTwillRunnable.java (version dc56fa5cf8f8505a0a6b7abd1a15d9b1da48b00d)
  • Masoud Saeida Ardekani

    Masoud Saeida Ardekani 86c7ff4dd01f3a56fc5881ccaae6d0fdf93d6e2c m

    Add readonly volumes to containers

    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/preview/DistributedPreviewManager.java (version 86c7ff4dd01f3a56fc5881ccaae6d0fdf93d6e2c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/DistributedProgramRunner.java (version 86c7ff4dd01f3a56fc5881ccaae6d0fdf93d6e2c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/TaskWorkerServiceLauncher.java (version 86c7ff4dd01f3a56fc5881ccaae6d0fdf93d6e2c)
    • cdap-kubernetes/src/main/java/io/cdap/cdap/k8s/runtime/KubeTwillPreparer.java (version 86c7ff4dd01f3a56fc5881ccaae6d0fdf93d6e2c)
    • cdap-master-spi/src/main/java/io/cdap/cdap/master/spi/twill/SecurityContext.java (version 86c7ff4dd01f3a56fc5881ccaae6d0fdf93d6e2c)
    • cdap-master-spi/src/main/java/io/cdap/cdap/master/spi/twill/StatefulTwillPreparer.java (version 86c7ff4dd01f3a56fc5881ccaae6d0fdf93d6e2c)
  • Masoud Saeida Ardekani

    Masoud Saeida Ardekani 6864fd8baedac502199271746f1f98dcd023f686 m

    Add container security context for artifact localizer

    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/preview/DistributedPreviewManager.java (version 6864fd8baedac502199271746f1f98dcd023f686)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/DistributedProgramRunner.java (version 6864fd8baedac502199271746f1f98dcd023f686)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/TaskWorkerServiceLauncher.java (version 6864fd8baedac502199271746f1f98dcd023f686)
    • cdap-common/src/main/java/io/cdap/cdap/common/conf/Constants.java (version 6864fd8baedac502199271746f1f98dcd023f686)
    • cdap-kubernetes/src/main/java/io/cdap/cdap/k8s/runtime/KubeTwillPreparer.java (version 6864fd8baedac502199271746f1f98dcd023f686)
    • cdap-master-spi/src/main/java/io/cdap/cdap/master/spi/twill/SecureTwillPreparer.java (version 6864fd8baedac502199271746f1f98dcd023f686)
    • cdap-master-spi/src/main/java/io/cdap/cdap/master/spi/twill/SecurityContext.java (version 6864fd8baedac502199271746f1f98dcd023f686)