Build #440

Build: #440 failed Child of CDAP-DRC-3812

Code commits

CDAP

  • dereklwood <derekwood@google.com>

    dereklwood <derekwood@google.com> b85aad8d2d9be5c3649208b4ed1b5107eb19d919

    Merge pull request #10148 from caskdata/feature/fix-hdinsight-ambari-configs
    update to use ambari configs.py instead of the forcefully deprecated …

  • derekwood <derekwood@google.com>

    derekwood <derekwood@google.com> 2b3f79548615438716e8853609a03702fabef177

    update to use ambari configs.py instead of the forcefully deprecated configs.sh which is now broken

    • cdap-distributions/src/hdinsight/pkg/pageblob-configure.sh (version 2b3f79548615438716e8853609a03702fabef177)
  • Edwin Elia <edwinelia@google.com>

    Edwin Elia <edwinelia@google.com> f1b1577ee8607bafba2f77acaf30b8158ad5894a

    Merge pull request #10146 from caskdata/feature-ui/CDAP-13302-dashboard-reports-improvements
    [CDAP-13302] dashboard reports improvements

  • Terence Yim <885032+chtyim@users.noreply.github.com>

    Terence Yim <885032+chtyim@users.noreply.github.com> eabd88a523ac7287cf823752a40987bffa362021

    Merge pull request #10144 from caskdata/feature/CDAP-13418-cloud-spark
    (CDAP-13418) Spark runtime in cloud

  • Terence Yim

    Terence Yim 144b6b251de7367920afcb3078c238c0e5ada225 m

    (CDAP-13418) Support Spark in cloud

    • cdap-app-fabric-tests/src/test/java/co/cask/cdap/internal/app/runtime/distributed/DistributedProgramRunnerTxTimeoutTest.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/ConstantTransactionSystemClient.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/DistributedProgramContainerModule.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/UnsupportedPluginFinder.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/AbstractProgramTwillRunnable.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedProgramRunner.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/ProgramLaunchConfig.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/WorkflowTwillRunnable.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillPreparer.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-app-fabric/src/main/java/co/cask/cdap/security/TokenSecureStoreRenewer.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-app-fabric/src/main/resources/setupSpark.py (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-app-fabric/src/main/resources/setupSpark.sh (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/SparkPackageUtils.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/SparkProgramRunner.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/SparkProgramRuntimeProvider.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeContextConfig.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeContextProvider.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeService.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/distributed/DistributedSparkProgramRunner.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/distributed/SparkTwillRunnable.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/submit/DistributedSparkSubmitter.java (version 144b6b251de7367920afcb3078c238c0e5ada225)
  • Terence Yim

    Terence Yim 50ee10ce765c8d7fcd0f457a06244c34028c8651 m

    (CDAP-13418) Handle exception from user spark program correctly to allow multiple attempts

    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/SparkProgramCompletion.java (version 50ee10ce765c8d7fcd0f457a06244c34028c8651)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeUtils.java (version 50ee10ce765c8d7fcd0f457a06244c34028c8651)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/classloader/SparkClassRewriter.java (version 50ee10ce765c8d7fcd0f457a06244c34028c8651)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/distributed/SparkDriverService.java (version 50ee10ce765c8d7fcd0f457a06244c34028c8651)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/distributed/SparkExecutionService.java (version 50ee10ce765c8d7fcd0f457a06244c34028c8651)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/submit/LocalSparkSubmitter.java (version 50ee10ce765c8d7fcd0f457a06244c34028c8651)
    • cdap-spark-core-base/src/main/scala/co/cask/cdap/app/runtime/spark/SparkMainWrapper.scala (version 50ee10ce765c8d7fcd0f457a06244c34028c8651)
  • Terence Yim

    Terence Yim 3378431877aeeee07e8846974438162554970e83 m

    (CDAP-13418) Don’t store key content in memory and don’t serialize them

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/DefaultSSHContext.java (version 3378431877aeeee07e8846974438162554970e83)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisioningService.java (version 3378431877aeeee07e8846974438162554970e83)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/SSHKeyInfo.java (version 3378431877aeeee07e8846974438162554970e83)
  • Edwin Elia

    Edwin Elia c22604510c4c7c2e146a06525fffc8cfa8ab45e2 m

    fix dashboard runs table fix runtime arguments for display

    • cdap-ui/app/cdap/components/OpsDashboard/RunsGraph/DataParser.js (version c22604510c4c7c2e146a06525fffc8cfa8ab45e2)
    • cdap-ui/app/cdap/components/OpsDashboard/RunsList/RunsList.scss (version c22604510c4c7c2e146a06525fffc8cfa8ab45e2)
    • cdap-ui/app/cdap/components/OpsDashboard/RunsList/index.js (version c22604510c4c7c2e146a06525fffc8cfa8ab45e2)
    • cdap-ui/app/cdap/components/OpsDashboard/store/DashboardStore.js (version c22604510c4c7c2e146a06525fffc8cfa8ab45e2)
    • cdap-ui/app/cdap/components/Reports/ReportsDetail/Runs/index.js (version c22604510c4c7c2e146a06525fffc8cfa8ab45e2)