Build #206

Build: #206 was successful Child of CDAP-DRC-3502

Code commits

CDAP

  • Chester Cheng

    Chester Cheng fbb683a9e16cbdb6ce81b15511c5d14c694c490a

    Merge pull request #9359 from caskdata/fix/CDAP-12294
    CDAP-12294 fix

  • Chester Cheng <chestercheng@Chesters-MacBook-Pro.local>

    Chester Cheng <chestercheng@Chesters-MacBook-Pro.local> 2aebf6e8dca8766b472a99f5d259530bef913156

    CDAP-12294 fix
    1. Replaced LOG.info with LOG.debug. LOG.warns aren't changed.

    • cdap-security/src/main/java/co/cask/cdap/security/auth/DistributedKeyManager.java (version 2aebf6e8dca8766b472a99f5d259530bef913156)
  • anew <andreas@cask.co>

    anew <andreas@cask.co> e5d7e9510ff24273a2ea7d05c571619b47751e36

    Merge branch 'feature/cdap-12285-sort-compat' into develop

  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 4bf53ba03da7ed8293a04a55e8ef652f8cc8fafe

    Merge pull request #9329 from caskdata/feature/CDAP-12191-expose-pipeline-name-and-namespace
    CDAP-12191 expose pipeline info for each plugin context

  • anew <andreas@cask.co>

    anew <andreas@cask.co> 8e0212f88957dd745e6209231768a9fc7cc7a570 m

    [CDAP-12285] Sort jars in hbase comp library dir

    • cdap-common/bin/functions.sh (version 8e0212f88957dd745e6209231768a9fc7cc7a570)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 20ef14f08ccca5695565dd2257f06be649e763f1 m

    CDAP-12191 expose pipeline info for each plugin context
    Adds methods to get pipeline name, namespace, logical start time,
    and output port schemas to StageContext so that every plugin has
    access to them at runtime. Also doing some cleanup and refactoring
    so that exposing more information in the future will be easier.

    Consolidated common pipeline info and CDAP contexts into a
    PipelineRuntime class that is passed around in all the plugin
    context constructors. The next time we need to expose more fields,
    or CDAP capabilities, we can just modify that class instead of
    modifying every single constructor in the context hierarchy.
    Also removed as many of the constructors as possible to try and
    simplify things.

    Also removed the getHadoopJob method that has been deprecated since
    3.x and which usually just throws an UnsupportedOperationException.

    • cdap-app-templates/cdap-data-quality/src/main/java/co/cask/cdap/dq/DataQualityApp.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/co/cask/cdap/datapipeline/SmartWorkflow.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/etl/api/StageContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/etl/api/action/ActionContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/etl/api/action/SettableArguments.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/etl/api/batch/BatchContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/etl/api/batch/BatchRuntimeContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/ETLWorkflow.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/WorkflowBackedActionContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/condition/BasicConditionContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/customaction/BasicActionContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/customaction/PipelineAction.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/mapreduce/ETLMapReduce.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/mapreduce/MapReduceTransformExecutorFactory.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/mapreduce/TransformRunner.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/batch/AbstractBatchContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/batch/DefaultAggregatorContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/batch/DefaultJoinerContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/batch/mapreduce/MapReduceBatchContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/batch/mapreduce/MapReduceRuntimeContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/AbstractStageContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/AbstractTransformContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/DefaultAlertPublisherContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/PipelineRuntime.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/SparkPipelineRuntime.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/AbstractSparkBatchContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/BasicSparkExecutionPluginContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/BasicSparkPluginContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/ETLSpark.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/RDDCollection.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/SparkBatchRuntimeContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/SparkBatchSinkContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/SparkBatchSourceContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/function/BatchSinkFunction.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/function/PluginFunctionContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/streaming/DStreamCollection.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/streaming/DefaultStreamingContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/streaming/SparkStreamingExecutionContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/streaming/function/DynamicSparkCompute.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/streaming/function/StreamingAlertPublishFunction.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/streaming/function/StreamingBatchSinkFunction.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/streaming/function/StreamingSparkSinkFunction.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-test/src/main/java/co/cask/cdap/etl/mock/action/MockActionContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)
    • cdap-app-templates/cdap-etl/hydrator-test/src/main/java/co/cask/cdap/etl/mock/transform/MockTransformContext.java (version 20ef14f08ccca5695565dd2257f06be649e763f1)