Code commits
caskdata/cdap
-
Vinisha Shah <CuriousVini@users.noreply.github.com> 49ed3615b2770f2a0768e1b93dc330b7ac8021d8
Merge pull request #11977 from cdapio/feature/CDAP-15633-twill-controller
Adding implementation for Twill Runner Service -
Vinisha Shah e48fdadd92eeae34da885d75ea970d9084a1d8ed
[CDAP-16420] Add twill runner service for job manager
- cdap-app-fabric/src/main/java/io/cdap/cdap/app/guice/RemoteExecutionProgramRunnerModule.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/AbstractRuntimeTwillController.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/AbstractRuntimeTwillPreparer.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/DistributedProgramRunner.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionJobMain.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillController.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillControllerFactory.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillPreparer.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillRunnerService.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtime/RuntimeTwillRunnerService.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtime/TwillControllerFactory.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtimejob/DefaultRuntimeInfo.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtimejob/DefaultRuntimeJob.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtimejob/RuntimeJobTwillController.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtimejob/RuntimeJobTwillPreparer.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/runtimejob/RuntimeJobTwillRunnerService.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/provision/DefaultProvisionerContext.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/provision/ProvisionerExtensionLoader.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/provision/ProvisioningService.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/provision/task/ClusterCreateSubtask.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-distributions/src/etc/cdap/conf.dist/logback-container.xml (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/common/DataprocUtils.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/provisioner/dataproc/DataprocClient.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/provisioner/dataproc/DataprocProvisioner.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/DataprocJarUtil.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/DataprocJobMain.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/DataprocRuntimeJobManager.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-ext-dataproc/src/test/java/io/cdap/cdap/runtime/spi/provisioner/dataproc/DataprocRuntimeJobManagerTest.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/provisioner/ProvisionerContext.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/ProgramRunInfo.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/RuntimeJobDetail.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/RuntimeJobId.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/RuntimeJobInfo.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/RuntimeJobManager.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-runtime-spi/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/RuntimeLocalFile.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
- cdap-spark-core-base/src/main/java/io/cdap/cdap/app/runtime/spark/distributed/DistributedSparkProgramRunner.java (version e48fdadd92eeae34da885d75ea970d9084a1d8ed)
-
Prashant Jaikumar 7dce246faf478a4b096ac692b856b60223009128
Merge pull request #12028 from cdapio/inputStages_compat
Handle backward compatibility for inputStages. -
wyzhang <wyzhang@google.com> 03ace0a7fca62cd659fba2627380a768913d362b
Merge pull request #12024 from cdapio/feature/CDAP-16353/wyzhang/preview/testServiceMain
(CDAP-16353) Small refactoring of test for k8s service test base -
wyzhang <wyzhang@google.com> 4b600d8a498581ab0a96ea4115db6688ac459629 m
(CDAP-16353) Small refactoring of test for k8s service test base
What:
Introduce APIs for starting and stopping service in k8s service main test base.
Why:
Will be used in a follow-up PR to allow preview test to start and stop
preview service.- cdap-master/src/test/java/io/cdap/cdap/master/environment/k8s/MasterServiceMainTestBase.java (version 4b600d8a498581ab0a96ea4115db6688ac459629)
-
wyzhang <wyzhang@google.com> 551ba14db7ab7ad2fca5f4fe451e71bb3d04d1fb
Merge pull request #12023 from cdapio/feature/CDAP-16353/wyzhang/preview/binding
(CDAP-16353) cleanup/refactor: move bindings for preview runner into its module -
Prashant Jaikumar 9b38fba29f33bf959fe723f9ede62b1299ef0ff1 m
Handle backward compatibility for inputStages.
Pipelines created with older code will not have inputStages in serialized JSON. In these cases we should derive inputStages from keys of inputSchemas.- cdap-app-templates/cdap-etl/cdap-etl-proto/src/main/java/io/cdap/cdap/etl/proto/v2/spec/StageSpec.java (version 9b38fba29f33bf959fe723f9ede62b1299ef0ff1)
- cdap-app-templates/cdap-etl/cdap-etl-proto/src/test/java/io/cdap/cdap/etl/proto/v2/spec/StageSpecTest.java (version 9b38fba29f33bf959fe723f9ede62b1299ef0ff1)
-
wyzhang <wyzhang@google.com> bd613f78189e3b74939a05b39c452e7f70fbfdd0 m
(CDAP-16353) cleanup/refactor: move bindings for preview runner into its module.
Motivation:
small refactoring to move bindings for preview runner into central location
(i.e. its own guice module DefaultPreviewRunnerModule)- cdap-app-fabric/src/main/java/io/cdap/cdap/app/preview/DefaultPreviewRunnerModule.java (version bd613f78189e3b74939a05b39c452e7f70fbfdd0)
- cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/preview/DefaultPreviewManager.java (version bd613f78189e3b74939a05b39c452e7f70fbfdd0)