Build #1,297

Build: #1297 was successful Child of CDAP-DRC-5277

Code commits

caskdata/cdap

  • Terence Yim <885032+chtyim@users.noreply.github.com>

    Terence Yim <885032+chtyim@users.noreply.github.com> 7031347218eba6b7e95bfa8d2f8391fbd782c5d3

    Merge pull request #13081 from githubwua/develop
    Resolve "java.lang.NumberFormatException: multiple points"

  • Terence Yim <885032+chtyim@users.noreply.github.com>

    Terence Yim <885032+chtyim@users.noreply.github.com> 2ee9340160df03d6a06bee97b7f1902bf103216d

    Merge pull request #13096 from cdapio/feature/CDAP-17610-oauth-macro
    (CDAP-17610) Adding a new macro function for OAuth integration

  • Terence Yim

    Terence Yim 9b27db84eaa356c51486e72de1e0e785e66d6add m

    Close connection in unit-test

    • cdap-unit-test/src/test/java/io/cdap/cdap/test/app/TestFrameworkTestRun.java (version 9b27db84eaa356c51486e72de1e0e785e66d6add)
  • Terence Yim

    Terence Yim 25b8c1ab6f68348051f2c953110c12bb7c18f4ef m

    (CDAP-17610) Added OAuth macro function
    - Expanded plugin config to support object type fields
    - Added a new OAuth macro function that uses the studio app for getting oauth information

    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/artifact/ArtifactInspector.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/plugin/PluginInstantiator.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/internal/app/plugins/test/TestPlugin.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/internal/app/runtime/artifact/ArtifactRepositoryTest.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/io/cdap/cdap/datapipeline/service/SecureStoreMacroEvaluator.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/io/cdap/cdap/datapipeline/service/StudioService.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/io/cdap/cdap/datapipeline/service/ValidationHandler.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/test/java/io/cdap/cdap/datapipeline/DataPipelineServiceTest.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/common/Constants.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/common/DefaultMacroEvaluator.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/common/OAuthMacroEvaluator.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/common/SecureStoreMacroEvaluator.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/common/macro/LogicalStartTimeMacro.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/common/macro/LogicalStartTimeMacroEvaluator.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/test/java/io/cdap/cdap/etl/common/OAuthMacroEvaluatorTest.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/test/java/io/cdap/cdap/etl/common/macro/LogicalStartTimeMacroEvaluatorTest.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/test/java/io/cdap/cdap/etl/common/macro/LogicalStartTimeMacroTest.java (version 25b8c1ab6f68348051f2c953110c12bb7c18f4ef)
  • Terence Yim

    Terence Yim f0b91addbe9d67b9582fb07fedca397a083e70c7 m

    (CDAP-17610) Refactor to pass in ServiceDiscoverer for Macro usage

    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/io/cdap/cdap/datapipeline/ExternalSparkProgram.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/io/cdap/cdap/datapipeline/JavaSparkMainWrapper.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/io/cdap/cdap/datapipeline/SmartWorkflow.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/scala/io/cdap/cdap/datapipeline/ScalaSparkMainWrapper.scala (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/main/java/io/cdap/cdap/datastreams/SparkStreamingPipelineDriver.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/io/cdap/cdap/etl/batch/condition/PipelineCondition.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/io/cdap/cdap/etl/batch/customaction/PipelineAction.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/io/cdap/cdap/etl/batch/mapreduce/ETLMapReduce.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/io/cdap/cdap/etl/batch/mapreduce/MapReduceTransformExecutorFactory.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/common/AbstractStageContext.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/common/DefaultMacroEvaluator.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/SparkPipelineRunner.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/batch/ETLSpark.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/function/MultiSinkFunction.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/function/PluginFunctionContext.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/streaming/function/StreamingAlertPublishFunction.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/streaming/function/StreamingBatchSinkFunction.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/streaming/function/StreamingMultiSinkFunction.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/streaming/function/StreamingSparkSinkFunction.java (version f0b91addbe9d67b9582fb07fedca397a083e70c7)
  • Terence Yim

    Terence Yim 92b3eb645b952d44101164e275b2dea6bb9a222b m

    (CDAP-17610) Added support for system app service discovery
    - Allows runtime to discovery and communicate with system app services

    • cdap-api/src/main/java/io/cdap/cdap/api/ServiceDiscoverer.java (version 92b3eb645b952d44101164e275b2dea6bb9a222b)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/app/services/AbstractServiceDiscoverer.java (version 92b3eb645b952d44101164e275b2dea6bb9a222b)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/batch/MapReduceLifecycleContext.java (version 92b3eb645b952d44101164e275b2dea6bb9a222b)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/distributed/remote/RemoteExecutionDiscoveryService.java (version 92b3eb645b952d44101164e275b2dea6bb9a222b)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/internal/app/runtime/service/http/HttpHandlerGeneratorTest.java (version 92b3eb645b952d44101164e275b2dea6bb9a222b)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/common/AbstractStageContext.java (version 92b3eb645b952d44101164e275b2dea6bb9a222b)
    • cdap-app-templates/cdap-etl/hydrator-test/src/main/java/io/cdap/cdap/etl/mock/action/MockActionContext.java (version 92b3eb645b952d44101164e275b2dea6bb9a222b)
    • cdap-app-templates/cdap-etl/hydrator-test/src/main/java/io/cdap/cdap/etl/mock/transform/MockTransformContext.java (version 92b3eb645b952d44101164e275b2dea6bb9a222b)
    • cdap-common/src/main/java/io/cdap/cdap/common/internal/remote/RemoteClient.java (version 92b3eb645b952d44101164e275b2dea6bb9a222b)
    • cdap-spark-core-base/src/main/java/io/cdap/cdap/app/runtime/spark/BasicSparkClientContext.java (version 92b3eb645b952d44101164e275b2dea6bb9a222b)
    • cdap-spark-core-base/src/main/java/io/cdap/cdap/app/runtime/spark/SparkServiceDiscoverer.java (version 92b3eb645b952d44101164e275b2dea6bb9a222b)
  • WuA <githubwua@gmail.com>

    WuA <githubwua@gmail.com> 361494fb347b358b69cffe6a5404de79caf1237a m

    Resolve "java.lang.NumberFormatException: multiple points"
    SimpleDateFormat is not threadsafe.  Use new SimpleDateFormat() for every new conversion

    • cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/provisioner/dataproc/DataprocClient.java (version 361494fb347b358b69cffe6a5404de79caf1237a)