Build #236

Automatically provisions CDAP cluster and runs integration test suite against it.

Build: #236 failed Manual run by Ali Anwar

Code commits

caskdata/cdap-integration-tests

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 0ff7d962a4c4f954a2f17dbc4feb2a2277d137d1

    Merge pull request #1030 from cdapio/set-dataproc-network
    Add ability to configure the network used for tests

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 6ce027035f91712b6672c9c5402f9562304e5c30

    Add ability to configure the network used for tests

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/gcp/DataprocETLTestBase.java (version 6ce027035f91712b6672c9c5402f9562304e5c30)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> f7ffcfd0e88141efda2949d695c99aa50273dc2f

    Merge pull request #1029 from cdapio/fix-profile-creation
    Fix dataproc profile creation to only set region

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 47bc1c2e6da0a36091cf075e53a008a545e8d52a

    Fix dataproc profile creation to only set region

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/gcp/DataprocETLTestBase.java (version 47bc1c2e6da0a36091cf075e53a008a545e8d52a)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> a445544d05ec43b670535a2de2b522768fceebfe

    Merge pull request #1027 from cdapio/group-cloud-tests
    Create a GCP test suite and fix tests to set project for plugins

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> eb57a1c2b4ea3b4df3927327a5f786c0da56323e

    Create a GCP test suite and fix tests to set project for plugins
    Fixed the bigtable test to create an instance at the start of the
    tests instead of requiring that an instance is already setup.

    Added artifact info to all of the pipelines so that they are
    viewable through the UI.

    Fixed datetime checks for failing BigQuery test

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/DataprocETLTestBase.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/GCSTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/PubSubTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/GoogleBigQueryTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/GoogleCloudBigtableTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/GoogleCloudDatastoreTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/GoogleCloudSpannerTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/gcp/DataprocETLTestBase.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/gcp/GCSTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/gcp/GoogleBigQueryTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/gcp/GoogleCloudBigtableTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/gcp/GoogleCloudDatastoreTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/gcp/GoogleCloudSpannerTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/gcp/PubSubTest.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
    • integration-test-remote/src/test/java/io/cdap/cdap/test/suite/GCPSuite.java (version eb57a1c2b4ea3b4df3927327a5f786c0da56323e)
  • Ali Anwar

    Ali Anwar b4f627d73d515f12b67dcacc3ebcb88c7dff7b8d

    Merge pull request #1028 from cdapio/increase-program-timeout
    Increase default program timeout to 120 seconds.

  • Ali Anwar

    Ali Anwar 576da880881c9bdc228414c054ae83fb11ead5ec

    Increase default program timeout to 120 seconds.

    • integration-test-core/src/main/java/io/cdap/cdap/test/AudiTestBase.java (version 576da880881c9bdc228414c054ae83fb11ead5ec)
  • dereklwood <derekwood@google.com>

    dereklwood <derekwood@google.com> 7ba6c68eb6e98648e47f576cf52e5587b1627d20

    Merge pull request #1026 from cdapio/feature/update-cdap-version
    update cdap version to trigger new node.js version requirement in coo…

  • Derek Wood <derekwood@google.com>

    Derek Wood <derekwood@google.com> 69b849cffff528f9b71c13996a7519d61f21b748

    update cdap version to trigger new node.js version requirement in cookbook

    • conf/cdap_sdk.json (version 69b849cffff528f9b71c13996a7519d61f21b748)
  • Ali Anwar

    Ali Anwar de70731ab45f116b5958e22d4f728aa6544e62dd

    Merge pull request #1025 from cdapio/fix-install-plugin-from-market
    Fix HivePluginTest (installing from market)

  • Ali <alianwar@google.com>

    Ali <alianwar@google.com> 85edfae1341d87b4ae3974d200a3f919b7b97e61

    This change is needed due to https://github.com/cdapio/cdap/pull/11546 and https://github.com/cdapio/cdap/pull/11568.

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/ETLTestBase.java (version 85edfae1341d87b4ae3974d200a3f919b7b97e61)
  • Terence Yim

    Terence Yim d9ba849b35ebf98f4f19755c337efcf611976c5f

    Added travis configuration

    • .travis.yml (version d9ba849b35ebf98f4f19755c337efcf611976c5f)
  • Ali Anwar

    Ali Anwar 2f42b3263ee929be292ddb25654afdea8445b772

    Merge pull request #1024 from cdapio/fix-checkstyle
    Fix checkstyle; ITN build is failing across all distros.

  • Ali <alianwar@google.com>

    Ali <alianwar@google.com> 33054223f3b4dc4d17c05f3ecd766e8e810195c2

    Fix checkstyle; ITN build is failing across all distros.

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/GoogleCloudSpannerTest.java (version 33054223f3b4dc4d17c05f3ecd766e8e810195c2)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 4f62faccad0ed4fff8d94ea2ae079baf7321184e

    Merge pull request #1022 from AntonGensitskiy/bug/CDAP-15771
    CDAP-15771: Added check for BigQuery bytes type.

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 687c86190f950bd4c46151bb1082fbe50aa18126

    Merge pull request #1023 from vladhlinskiy/feature/CDAP-15735_Added_tests_for_Array_in_Spanner_plugin2
    CDAP-15735 Support all data types in integration tests for Spanner

  • Vlad Hlinskiy <vglinskiy@cybervisiontech.com>

    Vlad Hlinskiy <vglinskiy@cybervisiontech.com> 0a777940dd4d4a123e4218adf8a917fe4e176467

    CDAP-15735 Support all data types in integration tests for Spanner, including arrays and null values.

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/GoogleCloudSpannerTest.java (version 0a777940dd4d4a123e4218adf8a917fe4e176467)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> e53fac8e1947c40d5ddfbf815e247e88d2d867ef

    Merge pull request #1021 from cdapio/revert-1020-feature/CDAP-15735_Added_tests_for_Array_in_Spanner_plugin
    Revert "CDAP-15735 Support all data types in integration tests for Spanner"

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 9bed0fc6d921b6b2ebd1ad6150d07cb047a0da6e

    Revert "CDAP-15735 Support all data types in integration tests for Spanner"

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/GoogleCloudSpannerTest.java (version 9bed0fc6d921b6b2ebd1ad6150d07cb047a0da6e)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 1613b2626be0a90f53c09112f981216083d2dbbb

    Merge pull request #1020 from vladhlinskiy/feature/CDAP-15735_Added_tests_for_Array_in_Spanner_plugin
    CDAP-15735 Support all data types in integration tests for Spanner

  • Vlad Hlinskiy <vglinskiy@cybervisiontech.com>

    Vlad Hlinskiy <vglinskiy@cybervisiontech.com> 1a0178db3cd282d76d2b479fe13e6d33aeeb191a

    CDAP-15735 Support all data types in integration tests for Spanner

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/GoogleCloudSpannerTest.java (version 1a0178db3cd282d76d2b479fe13e6d33aeeb191a)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 3327f829fe5e740dae1974ba15e73ffd71b219e8

    Merge pull request #1019 from vladhlinskiy/feature/CDAP-15731-GCS-Data-Types
    CDAP-15731 Support all data types in integration tests for GCS

  • Vlad Hlinskiy <vglinskiy@cybervisiontech.com>

    Vlad Hlinskiy <vglinskiy@cybervisiontech.com> eab4bf2691c547469a405cad58a990143a70613a

    CDAP-15731 Support all data types in integration tests for GCS - dynamically generate avro file.

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/GCSTest.java (version eab4bf2691c547469a405cad58a990143a70613a)
    • integration-test-remote/src/test/resources/gcs-types/schema.json (version eab4bf2691c547469a405cad58a990143a70613a)
    • integration-test-remote/src/test/resources/gcs-types/test.avro (version eab4bf2691c547469a405cad58a990143a70613a)
  • Anton Gensitskiy

    Anton Gensitskiy 6932d8410fae5d93a147d35ed8e2d2c7f918bd3b

    CDAP-15771: Added check for BigQuery bytes type.

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/GoogleBigQueryTest.java (version 6932d8410fae5d93a147d35ed8e2d2c7f918bd3b)
  • Vlad Hlinskiy <vglinskiy@cybervisiontech.com>

    Vlad Hlinskiy <vglinskiy@cybervisiontech.com> 2d390ce6d9826081be19a49eb70bf77f4997ad4b

    CDAP-15731 Support all data types in integration tests for GCS - remove JsonObject usage, move to streams, add missing checks.

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/GCSTest.java (version 2d390ce6d9826081be19a49eb70bf77f4997ad4b)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 8ae032f2667fb2237f1ce2f0f146b269405403fe

    Merge pull request #1016 from AntonGensitskiy/feature/CDAP-15644-bigquery-intergation-tests
    CDAP-15644: Added BigQuery integration tests.

  • Anton Gensitskiy

    Anton Gensitskiy 34aff56de2fd648a3480304acf2bd0ef16f8a62f

    CDAP-15644: Added BigQuery integration tests.

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/GoogleBigQueryTest.java (version 34aff56de2fd648a3480304acf2bd0ef16f8a62f)
    • pom.xml (version 34aff56de2fd648a3480304acf2bd0ef16f8a62f)
  • Vlad Hlinskiy <vglinskiy@cybervisiontech.com>

    Vlad Hlinskiy <vglinskiy@cybervisiontech.com> f64cf66c4f53df51b5c89102d0060a5f1f2a2ef3

    CDAP-15731 Support all data types in integration tests for GCS

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/GCSTest.java (version f64cf66c4f53df51b5c89102d0060a5f1f2a2ef3)
    • integration-test-remote/src/test/resources/gcs-types/schema.json (version f64cf66c4f53df51b5c89102d0060a5f1f2a2ef3)
    • integration-test-remote/src/test/resources/gcs-types/test.avro (version f64cf66c4f53df51b5c89102d0060a5f1f2a2ef3)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 66df4985a333b898fe437731043f5b6126e791cf

    Merge pull request #1018 from vladhlinskiy/CDAP-15756-fix-spanner-tests
    CDAP-15756 GoogleCloudSpannerTest broken due to pubsub dependency

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 856d521dfbcc84340fad4049b3b0daab65c959e9

    Merge pull request #1017 from mlozbin-cybervisiontech/feature/CDAP-15643-bigtable-integration-tests
    CDAP-15643 & CDAP-15734 Support all data types in BigTable Sink & Source integration tests

  • Maksim Lozbin

    Maksim Lozbin 7660894a5e925b992713254bc55f82f2d0e06ec6

    CDAP-15643 added tests for Bigtable plugin

    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/DataprocETLTestBase.java (version 7660894a5e925b992713254bc55f82f2d0e06ec6)
    • integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/GoogleCloudBigtableTest.java (version 7660894a5e925b992713254bc55f82f2d0e06ec6)
    • pom.xml (version 7660894a5e925b992713254bc55f82f2d0e06ec6)
  • Vlad Hlinskiy <vglinskiy@cybervisiontech.com>

    Vlad Hlinskiy <vglinskiy@cybervisiontech.com> b45dd6a836552a0740a99748c09cb8dd978a6e70

    CDAP-15756 GoogleCloudSpannerTest broken due to pubsub dependency

    • pom.xml (version b45dd6a836552a0740a99748c09cb8dd978a6e70)