Build #2,541

Cask Data Application Platform - Develop Build and Test

Build: #2541 failed Child of CDAP-DRC-4386

Code commits

caskdata/cdap

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> aa9b7a95cbeed28bf6d71635a7c0cc5ca6771bed

    Merge pull request #11166 from cdapio/feature/CDAP-13326-consolidate-pipeline-prepare
    CDAP-13326 consolidate prepare logic into a common class

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 8126e179840bd4a0395525ed9daa65c4d9d6ae4b m

    CDAP-13326 consolidate prepare logic into a common class
    Consolidate the common code in ETLMapReduce and ETLSpark.

    This basically amounts to moving code that was common to both
    into a new PipelinePhasePreparer and moving MR specific logic into
    MapReducePreparer and Spark specific logic into SparkPreparer.

    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/mapreduce/ETLMapReduce.java (version 8126e179840bd4a0395525ed9daa65c4d9d6ae4b)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/mapreduce/MapReducePreparer.java (version 8126e179840bd4a0395525ed9daa65c4d9d6ae4b)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/batch/PipelinePhasePreparer.java (version 8126e179840bd4a0395525ed9daa65c4d9d6ae4b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/ETLSpark.java (version 8126e179840bd4a0395525ed9daa65c4d9d6ae4b)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/co/cask/cdap/etl/spark/batch/SparkPreparer.java (version 8126e179840bd4a0395525ed9daa65c4d9d6ae4b)