Build #1,952

Cask Data Application Platform - Develop Build and Test

Build: #1952 failed Child of CDAP-DRC-3464

Code commits

CDAP

  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> b42a2fd1a24d533f31dd28a627744711b2c65af0

    Merge pull request #9278 from caskdata/feature/CDAP-12036-splitter-spark-pipelines
    CDAP-12036 spark splitter transform

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> c248431abb6c54d162d499f9293c2c61af2b1c2b m

    CDAP-12036 spark splitter transform
    Implementing SplitterTransform in Spark pipelines. Involves
    refactoring the Spark collections to output RecordInfo instead
    of KeyValue, then filtering that output based on the port.

    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/test/java/co/cask/cdap/datapipeline/DataPipelineTest.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/main/java/co/cask/cdap/datastreams/SparkStreamingPipelineDriver.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/main/java/co/cask/cdap/datastreams/SparkStreamingPipelineRunner.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/test/java/co/cask/cdap/datastreams/DataStreamsTest.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/RecordInfo.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/CombinedEmitter.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/SparkCollection.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/SparkPipelineRunner.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/BatchSparkPipelineDriver.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/RDDCollection.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/function/AggregatorAggregateFunction.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/function/BatchSourceFunction.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/function/ErrorFilter.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/function/ErrorPassFilter.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/function/ErrorTransformFunction.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/function/MultiOutputTransformFunction.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/function/OutputFilter.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/function/OutputPassFilter.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/function/TransformFunction.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/streaming/DStreamCollection.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/streaming/function/DynamicAggregatorAggregate.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/streaming/function/DynamicTransform.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/streaming/function/WrapOutputTransformFunction.java (version c248431abb6c54d162d499f9293c2c61af2b1c2b)
  • Ali Anwar

    Ali Anwar 942f5b97555fdf2f4d4e4151dfb998a1192aff39

    Merge pull request #9302 from caskdata/merge-release/4.2-to-develop
    Merge release/4.2 to develop

  • Ali Anwar

    Ali Anwar 2534b7ff7bfac91b3a722baa441550fecf408587 m

    Merge branch 'release/4.2' into merge-release/4.2-to-develop

  • vinishavyasa <CuriousVini@users.noreply.github.com>

    vinishavyasa <CuriousVini@users.noreply.github.com> 91d8584e217c82ac573a0aa4c89aa42e588e58ff m

    Merge pull request #9289 from caskdata/bugfix/preview-connector-datasets
    Fix connector datasets for preview

  • Vinisha Shah

    Vinisha Shah dee4b39f3d7353b12b1391d41105da0dcd08d6a3 m

    Fix connector datasets for preview

    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/co/cask/cdap/datapipeline/SmartWorkflow.java (version dee4b39f3d7353b12b1391d41105da0dcd08d6a3)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/test/java/co/cask/cdap/datapipeline/preview/PreviewDataPipelineTest.java (version dee4b39f3d7353b12b1391d41105da0dcd08d6a3)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/mapreduce/ETLMapReduce.java (version dee4b39f3d7353b12b1391d41105da0dcd08d6a3)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/batch/mapreduce/MapReduceBatchContext.java (version dee4b39f3d7353b12b1391d41105da0dcd08d6a3)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/Constants.java (version dee4b39f3d7353b12b1391d41105da0dcd08d6a3)
  • Tony Bach

    Tony Bach 8c79ce8c9eb966c41d1e0e364d3c673a756e5668 m

    Merge pull request #9285 from caskdata/bugfix_release/pipeline-sink-dataset
    Bugfix to not popup alert when user opens a sink in Details view (release/4.2)

  • Tony Bach

    Tony Bach 1320375f503b8287ad4bbdecf0b36a976096d02f m

    Don't show dataset change popup in detail view

    • cdap-ui/app/directives/widget-container/widget-dataset-selector/widget-dataset-selector.js (version 1320375f503b8287ad4bbdecf0b36a976096d02f)
  • Edwin Elia

    Edwin Elia 9c63397126815215d030e6c51a968215d2e6f10b m

    Merge pull request #9287 from caskdata/bugfix_release/bump-ui-pack-version
    bump ui pack version

  • Edwin Elia

    Edwin Elia 47b40691d7fd8d39aa93df4d456e8a7902d7bfe3 m

    bump ui pack version

    • cdap-ui/pom.xml (version 47b40691d7fd8d39aa93df4d456e8a7902d7bfe3)
  • Edwin Elia

    Edwin Elia 577b607ac919d9639998ad3b0587ed6183da2975 m

    Merge pull request #9283 from caskdata/bugfix_release/ui-dataprep-pick-version
    pick latest version when there are multiple data pipeline or data str…

  • Edwin Elia

    Edwin Elia 4d5eea15709f4c38449e808e4603f43efe407035 m

    pick latest version when there are multiple data pipeline or data streams artifacts present

    • cdap-ui/app/cdap/components/DataPrep/TopPanel/AddToPipelineModal.js (version 4d5eea15709f4c38449e808e4603f43efe407035)
    • cdap-ui/app/cdap/components/DataPrep/TopPanel/CreateDatasetBtn/index.js (version 4d5eea15709f4c38449e808e4603f43efe407035)
    • cdap-ui/app/cdap/components/DataPrep/TopPanel/PipelineConfigHelper.js (version 4d5eea15709f4c38449e808e4603f43efe407035)
  • Ali Anwar

    Ali Anwar cf94949ad947476c79229c9b5c50a85c35682420 m

    Merge pull request #9198 from caskdata/bugfix_release/CDAP-12054
    CDAP-12054 Fix PartitionedFileSet to work with CombineFileInputFormat

  • Ali Anwar

    Ali Anwar 4be5181da2393890ead577ceb506b70acbebbb3c m

    CDAP-12054 Fix PartitionedFileSet to work with CombineFileInputFormat, as input to a batch job. Fix BasicPartitionedFileSetInputContext#getInputPartitionKey to work with CombineFileInputFormat.

    • cdap-api/src/main/java/co/cask/cdap/api/data/batch/PartitionedFileSetInputContext.java (version 4be5181da2393890ead577ceb506b70acbebbb3c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/dataset/input/BasicPartitionedFileSetInputContext.java (version 4be5181da2393890ead577ceb506b70acbebbb3c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/batch/AppWithPartitionedFileSet.java (version 4be5181da2393890ead577ceb506b70acbebbb3c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/batch/MapReduceWithPartitionedTest.java (version 4be5181da2393890ead577ceb506b70acbebbb3c)
  • Ajai Narayan

    Ajai Narayan 0dd68a1a83a739d68f0b9a0b05f3a555288fc05a m

    Merge pull request #9247 from caskdata/bugfix_release/ui-CDAP-12121-4.2
    [CDAP-12121] - Fixes pipeline metrics to fetch only user metrics

  • Ajai Narayan

    Ajai Narayan d079c45fd051ef65c7abe92815d87bc1ffc1c9fb m

    Fixes pipeline metrics to fetch only user metrics and avoid accidentally fetching system metrics

    • cdap-ui/app/hydrator/services/detail/actions/pipeline-detail-metrics-actions.js (version d079c45fd051ef65c7abe92815d87bc1ffc1c9fb)
  • Ali Anwar

    Ali Anwar 457b13d03ad8eea833de46b9201bc650b9f01207 m

    Merge pull request #9196 from caskdata/feature/CDAP-6329
    CDAP-6329 Put pid in heapdump file name.

  • Ali Anwar

    Ali Anwar 586820315a81741d3835ee98a74f291abc030c01 m

    CDAP-6329 Put pid in heapdump file name.

    • cdap-common/bin/functions.sh (version 586820315a81741d3835ee98a74f291abc030c01)
    • cdap-distributions/src/etc/cdap/conf.dist/cdap-env.sh (version 586820315a81741d3835ee98a74f291abc030c01)
  • sagarkapare <sagar@cask.co>

    sagarkapare <sagar@cask.co> 3c50aa89467f33110421e0a1fc2e525ae26b9183 m

    Merge pull request #9241 from caskdata/fix/cherry-pick-CDAP-12053
    Cherry-pick CDAP-12053 to release 4.2

  • sagarkapare <sagar@cask.co>

    sagarkapare <sagar@cask.co> 27d69e99f3b94d787823f56e31e42bf173da3e67 m

    Cherry-pick CDAP-12053 to release 4.2

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedProgramRunner.java (version 27d69e99f3b94d787823f56e31e42bf173da3e67)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/MasterTwillApplication.java (version 27d69e99f3b94d787823f56e31e42bf173da3e67)
  • Yaojie Feng

    Yaojie Feng 1ce6a19c665be4b328361fc3495608551570f670 m

    Merge pull request #9232 from caskdata/feature_release/cherry-pick-9230
    fix ugi cache for explore

  • Yaojie Feng

    Yaojie Feng 7680c1fb72546c12397e3a97c23fdf8baa965c71 m

    fix ugi cache for explore

    • cdap-security/src/main/java/co/cask/cdap/security/impersonation/AbstractCachedUGIProvider.java (version 7680c1fb72546c12397e3a97c23fdf8baa965c71)