Build Sign and Push
Cask Marketplace
| Tests: | Testless build |
|---|---|
| Duration: | 18 minutes |
| Changes: | Who: yaojiefeng <yaojie@google.com> Why: Merge pull request #344 from cdapio/update-cassandra update cassandra plugins Who: yaojie <yaojie@google.com> Why: update cassandra plugins |
Manual run by Yaojie Feng
Build Sign and Push Develop
Cask Marketplace
| Tests: | Testless build |
|---|---|
| Duration: | 4 minutes |
| Changes: | Who: Shankar Selvam Why: adding 1.1 version whole-file-source Who: Shankar Selvam Why: deleting the old 1.0.0 version Who: Shankar <gowrishankar1988@gmail.com> Why: Merge pull request #210 from caskdata/feature/update-whole-file-source adding 1.1 version whole-file-source Who: sreevatsanraman <sreevatsan@gmail.com> Why: Merge master to feature branch Who: Sreevatsan Raman Why: Merge pull request #208 from caskdata/feature/add-kafka-9 add kafka 9 ... |
Manual run by Shankar Selvam
Child of CDAP-DRC-4829
Child of CDAP-BUT-2286
Build UI Pack
CDAP
| Tests: | Testless build |
|---|---|
| Duration: | 13 minutes |
| Changes: | Who: wyzhang <wyzhang@google.com> Why: Merge pull request #12007 from cdapio/feature/CDAP-16353/wyzhang/localFetchers {CDAP-16353) Implement LocalScheduleFetcher to get schedule from local store |
Changes by wyzhang <wyzhang@google.com>
Changes by Ali Anwar
Manual run by Terence Yim
Cloud Sandbox - GCP
CDAP
| Tests: | Testless build |
|---|---|
| Duration: | 7 minutes |
| Changes: | Who: Anudeep Katragadda <51677126+itsanudeep@users.noreply.github.com> Why: Merge pull request #11436 from cdapio/feature-ui/CDAP-15553 [CDAP-15553] fixed issue with connections going down at origin for splitter Who: Ajai <1452845+ajainarayanan@users.noreply.github.com> Why: Merge pull request #11445 from cdapio/feature-ui/CDAP15523-e2e-tests [CDAP-15523] Adds initial set of e2e tests for DataPrep Connections. Who: itsanudeep <itsanudeep@google.com> Why: driver version defaults to 1.0.0-SNAPSHOT, if not present. Who: yukiej <yukiej@gmail.com> Why: Add edges and anchors to FLL tables Draw edges and anchors Redraw links on window resize Add ns,ds,fd, and target/cause/impact delimiters to fieldId and tableId to prevent clashes Get link and anchor colors from ThemeWrapper/colors Who: sagarkapare <sagarkapare@google.com> Why: Merge pull request #11434 from cdapio/feature/CDAP-15562-external-proxy (CDAP-15562) Added initial proxy support ... |
Manual run by Miguel Velez
Manual run by Derek Wood
Deploy CDAP Maven Plugin
CDAP
| Tests: | Testless build |
|---|---|
| Duration: | 13 minutes |
| Changes: | Who: Terence Yim <terencey@google.com> Why: Rename from co.cask to io.cdap Also cleanup pom.xml Who: Terence Yim <885032+chtyim@users.noreply.github.com> Why: Merge pull request #11 from cdapio/feature/rename Rename from co.cask to io.cdap |
Manual run by Derek Wood
Develop Build and Test
CDAP
| Tests: | 2683 passed |
|---|---|
| Duration: | 107 minutes |
| Changes: | Who: wyzhang <wyzhang@google.com> Why: (CDAP-16353) Make ProperitesResolver using PreferencesFetcher to get preference properites. Motivation: At the moment, ProperitesResolver directly accesses local preferences store. Change that to use PreferencesFetcher allows us to fetch properties either from local storage or from a remote service via REST calls. This paves the path for support per service local level DB. Additional changes: - Make PreferencesHttpHandler to return empty properties instead of fail if the requested entity (e.g. program, or applciation) doesn"t exist, for 2 reasons 1) consistent with the behavior of preferences store 2) user may request resolved properties for a program, which will include properites from parents (e.g. application, namespace and instance). Even through the program doesn"t exist, it would be good to return resolved properties from its parent and above. Who: wyzhang <wyzhang@google.com> Why: Merge pull request #12001 from cdapio/feature/CDAP-16353/wyzhang/preview/propertyResolver (CDAP-16353) Make ProperitesResolver use PreferencesFetcher to get properties |
Child of CDAP-DRC-4829
Develop Build and Verify
CDAP
| Tests: | 360 passed |
|---|---|
| Duration: | 5 minutes |
| Changes: | Who: Edwin Elia <edwinelia@google.com> Why: Add UI support for secure keys for dataprep database and S3 connections Who: Terence Yim <885032+chtyim@users.noreply.github.com> Why: Merge pull request #11280 from cdapio/feature_release/CDAP-15249-fix-dataproc-npe (CDAP-15249) Check for null firewall list Who: Terence Yim <terencey@google.com> Why: Fix all warnings from the mvn command Who: Bobby Meelu Why: add section on building with additional artifacts, namely plugins Who: Terence Yim <terencey@google.com> Why: (CDAP-15224) Set program logging context in startup task ... |
Manual run by Bobby Meelu
Scheduled
Manual run by Rohit Sinha
Docs Quick Build
7
7CDAP
| Tests: | Testless build |
|---|---|
| Duration: | 36 minutes |
| Changes: | Who: Terence Yim <terencey@google.com> Why: Fix all warnings from the mvn command Who: Ali <alianwar@google.com> Why: v6.1.0-SNAPSHOT Who: Ajai Narayan Why: Fixes lower bound value of the ydomain while rendering logs metrics graph Who: Terence Yim <885032+chtyim@users.noreply.github.com> Why: Merge pull request #11257 from cdapio/feature/CDAP-15113-fix-injector (CDAP-15113) Fix MR and Spark runtime for on prem Who: Terence Yim <terencey@google.com> Why: (CDAP-15253) Fix a stop hanging issue for programs running in K8s - Also refactor the synchronization scope of program lifecycle service - Fix the application on k8s restoration upon restarting app-fabric ... |
Manual run by Ali Anwar
RAT and Checkstyle
CDAP
| Tests: | Testless build |
|---|---|
| Duration: | 5 minutes |
| Changes: | Who: wyzhang <wyzhang@google.com> Why: Merge pull request #12007 from cdapio/feature/CDAP-16353/wyzhang/localFetchers {CDAP-16353) Implement LocalScheduleFetcher to get schedule from local store |
Changes by wyzhang <wyzhang@google.com>
Release Build and Test
CDAP
| Tests: | 2683 passed |
|---|---|
| Duration: | 112 minutes |
| Changes: | Who: wyzhang <wyzhang@google.com> Why: Merge pull request #12001 from cdapio/feature/CDAP-16353/wyzhang/preview/propertyResolver (CDAP-16353) Make ProperitesResolver use PreferencesFetcher to get properties Who: wyzhang <wyzhang@google.com> Why: (CDAP-16353) Make ProperitesResolver using PreferencesFetcher to get preference properites. Motivation: At the moment, ProperitesResolver directly accesses local preferences store. Change that to use PreferencesFetcher allows us to fetch properties either from local storage or from a remote service via REST calls. This paves the path for support per service local level DB. Additional changes: - Make PreferencesHttpHandler to return empty properties instead of fail if the requested entity (e.g. program, or applciation) doesn"t exist, for 2 reasons 1) consistent with the behavior of preferences store 2) user may request resolved properties for a program, which will include properites from parents (e.g. application, namespace and instance). Even through the program doesn"t exist, it would be good to return resolved properties from its parent and above. |
Child of CDAP-DRC-4829
UI Pack Develop Build and Test
CDAP
| Tests: | Testless build |
|---|---|
| Duration: | 13 minutes |
| Changes: | Who: wyzhang <wyzhang@google.com> Why: Merge pull request #12007 from cdapio/feature/CDAP-16353/wyzhang/localFetchers {CDAP-16353) Implement LocalScheduleFetcher to get schedule from local store |
Child of CDAP-DRC-4830
UI Pack Release Build and Test
CDAP
| Tests: | Testless build |
|---|---|
| Duration: | 10 minutes |
| Changes: | Who: wyzhang <wyzhang@google.com> Why: Merge pull request #12007 from cdapio/feature/CDAP-16353/wyzhang/localFetchers {CDAP-16353) Implement LocalScheduleFetcher to get schedule from local store |
Child of CDAP-DRC-4830
Scheduled
Scheduled
Scheduled
Scheduled
Scheduled
Scheduled
Scheduled
Scheduled
Scheduled
Deploy Artifacts
CDAP Navigator
| Tests: | Testless build |
|---|---|
| Duration: | 23 minutes |
| Changes: | Who: Ali Anwar Why: Update pom.xml |
Changes by Ali Anwar
Develop
Chaos Monkey
| Tests: | Testless build |
|---|---|
| Duration: | 1 minute |
| Changes: | Who: Terence Yim <885032+chtyim@users.noreply.github.com> Why: Merge pull request #48 from cdapio/feature/rename Rename from co.cask to io.cdap Who: Terence Yim <terencey@google.com> Why: Rename from co.cask to io.cdap |
Manual run by Terence Yim
Build and Deploy
Common
| Tests: | 1 of 25 failed |
|---|---|
| Duration: | 18 minutes |
| Changes: | Who: Terence Yim <terencey@google.com> Why: Bump version for 0.12.0 release Who: Terence Yim <terencey@google.com> Why: Merge branch "release/0.12" into develop Who: Terence Yim <terencey@google.com> Why: Remove SNAPSHOT, prepare for release |
Changes by Terence Yim <terencey@google.com>
Build and Unit Test
Coopr
| Tests: | Testless build |
|---|---|
| Duration: | 94 minutes |
| Changes: | Who: Derek Wood <derekwood@google.com> Why: update org Who: dereklwood <derekwood@google.com> Why: Merge pull request #76 from cdapio/feature/update-org update org |
Develop Build and Test
Coopr
| Tests: | 1 of 145 failed |
|---|---|
| Duration: | 6 minutes |
| Changes: | Who: Derek Wood <derekwood@google.com> Why: update org name Who: dereklwood <derekwood@google.com> Why: Merge pull request #984 from cdapio/feature/update-org update org Who: Derek Wood <derekwood@google.com> Why: update org |
Doc Site Build
Documentation
| Tests: | Testless build |
|---|---|
| Duration: | 4 seconds |
| Changes: | Who: Ajai Narayan Why: Updates docs for site to include 6.1.1 Who: Ajai <1452845+ajainarayanan@users.noreply.github.com> Why: Merge pull request #41 from cdapio/feature/add-6.1 Updates docs for site to include 6.1.1 |
Child of DOC-SITE-68
Build and Deploy
Hydrator Plugins
| Tests: | 860 passed |
|---|---|
| Duration: | 51 minutes |
| Changes: | Who: Prashant Jaikumar Why: Merge pull request #1043 from cdapio/CDAP-16324_3 CDAP-16324: [CDAP-16324] Improve macro support for analytics plugins |
Changes by Prashant Jaikumar
Wrangler Transform
Hydrator Plugins
| Tests: | 344 passed |
|---|---|
| Duration: | 11 minutes |
| Changes: | Who: Terence Yim <885032+chtyim@users.noreply.github.com> Why: Merge pull request #389 from data-integrations/feature/CDAP-16480-ex-cause (CDAP-16480) Rethrow exception with original cause in EL engine Who: Terence Yim Why: (CDAP-16480) Rethrow exception with original cause in EL engine |
Changes by Terence Yim <885032+chtyim@users.noreply.github.com> and Terence Yim
Ambari
Integration Tests
| Tests: | 55 of 55 failed |
|---|---|
| Duration: | 264 minutes |
| Changes: | Who: Rohit Sinha <rosinha@google.com> Why: Merge pull request #957 from caskdata/fix/purchase-metadata LOG purchase history service run id Who: Ali <alianwar@google.com> Why: CDAP-14132 Update the integration test, similar to how the unit test was updated for WikipediaPipelineAppTest in https://github.com/caskdata/cdap/pull/10538/files/ce178dd9a1fcb77bdc77f15e8605a8105bb74567#diff-3845df6cbb9ec56ff7404fee98ca9608. Who: Rohit Sinha <rosinha@google.com> Why: CDAP-13261 Metadata Stress Test Who: Rohit Sinha <rosinha@google.com> Why: Merge pull request #935 from caskdata/feature/meta-stress-test CDAP-13261 Metadata Stress Test Who: Ali Anwar Why: Merge pull request #946 from caskdata/release/5.0 Release/5.0 ... |
Manual run by Ali Anwar
Scheduled
Custom Cluster
Integration Tests
| Tests: | 1 of 1 failed |
|---|---|
| Duration: | 12 minutes |
| Changes: | Who: Vlad Hlinskiy <vglinskiy@cybervisiontech.com> Why: CDAP-15735 Support all data types in integration tests for Spanner, including arrays and null values. Who: Terence Yim <885032+chtyim@users.noreply.github.com> Why: Merge pull request #1007 from cdapio/feature/rename Rename from co.cask to io.cdap Who: vaibhav gaikwad Why: Fix checkstyle; ITN build is failing across all distros. Who: albertshau <ashau@google.com> Why: Revert "CDAP-15735 Support all data types in integration tests for Spanner" Who: vaibhav gaikwad Why: Bump cdap version on develop, after branching release/6.0 ... |
Manual run by Ali Anwar
Docker Sandbox ITN
Integration Tests
| Tests: | 42 passed |
|---|---|
| Duration: | 30 minutes |
| Changes: | Who: albertshau <ashau@google.com> Why: Merge pull request #1062 from cdapio/increase-cluster-size increase dataproc cluster size Who: albertshau <ashau@google.com> Why: fix integration tests Fix the google library dependencies to versions that all use compatible dependencies, and remove the direct gax-grpc depdendency that was causing Spanner to fail. Also use macros in the BQ tests to both test macros and to workaround an issue when the CDAP instance is running on a GCE VM. Who: albertshau <ashau@google.com> Why: Merge pull request #1063 from cdapio/fix-integration-tests fix integration tests Who: albertshau <ashau@google.com> Why: increase dataproc cluster size This fixes an issue where some pipelines in some environments are stuck forever with MapReduce jobs that stay in pending state. |
Scheduled with changes by albertshau <ashau@google.com>
Impersonation - Integration Tests
Integration Tests
| Tests: | 46 passed |
|---|---|
| Duration: | 270 minutes |
| Changes: | No changes |
Scheduled
Integration Tests - CM Auth
Integration Tests
| Tests: | 14 of 33 failed |
|---|---|
| Duration: | 82 minutes |
| Changes: | No changes |
Manual run by Rohit Sinha
Integration Tests - Mini
Integration Tests
| Tests: | 45 passed |
|---|---|
| Duration: | 246 minutes |
| Changes: | Who: albertshau <ashau@google.com> Why: Merge pull request #1034 from cdapio/remove-validator-test remove validator test Who: albertshau <ashau@google.com> Why: disable yarn pmem check CDAP services are getting killed by yarn due to physical memory constraints. Disable the pmem check to avoid this. Who: Anton Gensitskiy Why: PLUGIN-82: Update testUpsertOperationWithDedupeSourceData() integration test. Who: albertshau <ashau@google.com> Why: Merge pull request #1031 from cdapio/feature/CDAP-15879-gcs-formats-test CDAP-15879 test GCS formats Who: albertshau <ashau@google.com> Why: Merge pull request #1042 from yeweidaniel/integration-docs Update steps for running integration test ... |
Manual run by Vinisha Shah
Integration Tests - Nightly
Integration Tests
| Tests: | 1 of 584 failed |
|---|---|
| Duration: | 301 minutes |
| Changes: | No changes |
Scheduled
Integration Tests - Top
Integration Tests
| Tests: | 159 passed |
|---|---|
| Duration: | 335 minutes |
| Changes: | Who: Ali <alianwar@google.com> Why: Most of our integration test builds don"t support Spark2, so separating those tests out. Who: Ali Anwar Why: Merge pull request #953 from caskdata/fix-workflow-test CDAP-14132 Update the integration test, due to the examples being bumped to Spark2 Who: Ali Anwar Why: Merge pull request #952 from caskdata/separate-spark2-tests Most of our integration test builds don"t support Spark2, so separating those out |
Manual run by Ali Anwar
Integration Tests Ambari Authorization
Integration Tests
| Tests: | 32 of 32 failed |
|---|---|
| Duration: | 96 minutes |
| Changes: | Who: mattwuenschel <mwuenschel@google.com> Why: version bump CDAP for Ambari Who: Ali <alianwar@google.com> Why: Use File sink plugin instead of HDFSSink plugin, for GCSTest. Who: Ali Anwar Why: Merge pull request #964 from caskdata/fix-failing-tests Use File sink plugin instead of HDFSSink plugin, for GCSTest. Who: mattwuenschel <mwuenschel@google.com> Why: Merge pull request #969 from caskdata/feature/ambari-version-bump version bump CDAP for Ambari Who: Rohit Sinha <rosinha@google.com> Why: Merge pull request #961 from caskdata/feature/remove-run-record-meta Remove RunId metadata assertion ... |
Manual run by Rohit Sinha
Integration Tests Ambari Custom Cluster
Integration Tests
| Tests: | 32 of 32 failed |
|---|---|
| Duration: | 40 minutes |
| Changes: | No changes |
Manual run by Rohit Sinha
Manual run by Matt Wuenschel
SANDBOX
Integration Tests
| Tests: | 42 passed |
|---|---|
| Duration: | 75 minutes |
| Changes: | Who: albertshau <ashau@google.com> Why: Merge pull request #1062 from cdapio/increase-cluster-size increase dataproc cluster size Who: albertshau <ashau@google.com> Why: Merge pull request #1063 from cdapio/fix-integration-tests fix integration tests Who: albertshau <ashau@google.com> Why: increase dataproc cluster size This fixes an issue where some pipelines in some environments are stuck forever with MapReduce jobs that stay in pending state. Who: albertshau <ashau@google.com> Why: fix integration tests Fix the google library dependencies to versions that all use compatible dependencies, and remove the direct gax-grpc depdendency that was causing Spanner to fail. Also use macros in the BQ tests to both test macros and to workaround an issue when the CDAP instance is running on a GCE VM. |
Scheduled with changes by albertshau <ashau@google.com>
UI E2E Tests
Integration Tests
| Tests: | Testless build |
|---|---|
| Duration: | 96 minutes |
| Changes: | Who: wyzhang <wyzhang@google.com> Why: (CDAP-16353) Move get artifact details for range into ArtifactRepositoryReader Motivation: AppLifecycleDeployment use getArtifactDetails to find the artifact detail for deploymnet. Moving this method into ArtifactRepositoryReader allows us to have remote vs local implication used by preview (when configured with local levelDB) and appfabric respectively. Add implementation for this method in both LocalArtifactRepositoryReader and RemoteArtifactRepositoryReader. But the latter is not being used anywhere at the moment. A follow-up change will make preview to use RemoteArtifactRepositoryReader when configured with local levelDB. Who: wyzhang <wyzhang@google.com> Why: Merge pull request #12004 from cdapio/feature/CDAP-16353/wyzhang/preview/artifactRepo (CDAP-16353) Move get artifact details for range into ArtifactRepositoryReader Who: wyzhang <wyzhang@google.com> Why: Merge pull request #12001 from cdapio/feature/CDAP-16353/wyzhang/preview/propertyResolver (CDAP-16353) Make ProperitesResolver use PreferencesFetcher to get properties Who: wyzhang <wyzhang@google.com> Why: (CDAP-16353) Make ProperitesResolver using PreferencesFetcher to get preference properites. Motivation: At the moment, ProperitesResolver directly accesses local preferences store. Change that to use PreferencesFetcher allows us to fetch properties either from local storage or from a remote service via REST calls. This paves the path for support per service local level DB. Additional changes: - Make PreferencesHttpHandler to return empty properties instead of fail if the requested entity (e.g. program, or applciation) doesn"t exist, for 2 reasons 1) consistent with the behavior of preferences store 2) user may request resolved properties for a program, which will include properites from parents (e.g. application, namespace and instance). Even through the program doesn"t exist, it would be good to return resolved properties from its parent and above. Who: wyzhang <wyzhang@google.com> Why: Merge pull request #12007 from cdapio/feature/CDAP-16353/wyzhang/localFetchers {CDAP-16353) Implement LocalScheduleFetcher to get schedule from local store ... |
Scheduled with changes by wyzhang <wyzhang@google.com>
UI E2E Tests Mini
Integration Tests
| Tests: | Testless build |
|---|---|
| Duration: | 37 seconds |
| Changes: | Who: yukiej <yukiej@gmail.com> Why: Merge pull request #11450 from cdapio/fll-ui/CDAP-15433-3 [CDAP-15433] Part 3: Update graph on selecting field, View, and Reset Who: Miguel Velez <miguelvelez@google.com> Why: Merge pull request #11486 from cdapio/feature-ui-CDAP-15607-apollo-client-pipelines-list-view (CDAP-15607) Integrated Apollo Client with Apollo Server to fetch data for pipelines list view Who: yaojiefeng <yaojie@google.com> Why: Merge pull request #11455 from cdapio/feature/CDAP-15594-batch-system-metadata CDAP-15594 batch system metadata Who: Edwin Elia <edwinelia@google.com> Why: [CDAP-15491] migrate function dropdown alias widget to react Who: yukiej <yukiej@gmail.com> Why: Add allfieldlineage endpoint to metadata frontend api and get params from router Update path for experiment to include namespace and dataset Get namespace and datasetId from url for API call Get start and end times from query params Add dropdown menu for target fields ... |
Manual run by Yuki Jung
Upgrade Tests - Nightly
Integration Tests
| Tests: | Testless build |
|---|---|
| Duration: | 80 minutes |
| Changes: | Who: mattwuenschel <mwuenschel@google.com> Why: version bump CDAP for Ambari Who: mattwuenschel <mwuenschel@google.com> Why: Merge pull request #969 from caskdata/feature/ambari-version-bump version bump CDAP for Ambari |
Manual run by Rohit Sinha
Build And Test
Microservices
| Tests: | 2 passed |
|---|---|
| Duration: | 1 minute |
| Changes: | Who: Gokul Gunasekaran Why: Error count check should be accompanied by exponential backoff Who: Gokul Gunasekaran Why: Merge pull request #17 from cask-solutions/feature/error-sleep Error count check should be accompanied by exponential backoff |
Changes by Gokul Gunasekaran
Deploy Artifacts
Microservices
| Tests: | Testless build |
|---|---|
| Duration: | 1 minute |
| Changes: | Who: Gokul Gunasekaran Why: Merge pull request #17 from cask-solutions/feature/error-sleep Error count check should be accompanied by exponential backoff Who: Gokul Gunasekaran Why: Error count check should be accompanied by exponential backoff |
Changes by Gokul Gunasekaran
Build and Deploy
Netty HTTP
| Tests: | 172 passed |
|---|---|
| Duration: | 1 minute |
| Changes: | Who: Terence Yim Why: Bump develop version to 1.5.0-SNAPSHOT Who: Terence Yim Why: Merge branch "release/1.4" into develop Who: Terence Yim Why: Remove SNAPSHOT from version for release 1.4.0 |
Changes by Terence Yim
Develop Build and Test
Tephra
| Tests: | 264 passed |
|---|---|
| Duration: | 14 minutes |
| Changes: | Who: Poorna Chandra Why: Update doc for Apache Tephra Who: Poorna Chandra Why: Merge pull request #118 from caskdata/feature/doc-update Update doc for Apache Tephra |
Changes by Poorna Chandra
Child of TEP-DUT-86
Deploy Artifacts
Tracker
| Tests: | Testless build |
|---|---|
| Duration: | 1 minute |
| Changes: | Who: Yaser Why: Merge pull request #91 from caskdata/fix/Tracker-264 Refactor validate method to accept a CDAP Schema JSON object Who: Nishith Nand Why: Removed -SNAPSHOT from 0.4 Who: Yaser Why: Merge pull request #89 from caskdata/fix/Tracker-254 [TRACKER-254] Refactoring getServiceResponse method HttpRequests library Who: Sreevatsan Raman Why: Merge pull request #103 from caskdata/bumping-version-to-0.4.1 Bumping version Who: Chris Gianelloni Why: Merge pull request #95 from caskdata/merge-03-develop Merge 03 develop ... |
Manual run by Ali Anwar