Build #1,718

Cask Data Application Platform - Develop Build and Test

Build: #1718 was successful Child of CDAP-DRC-2908

Code commits

CDAP

  • Yaojie Feng

    Yaojie Feng 5a3e1f6241376eec30d938c3a4e91fe6921167f3

    (CDAP-7540)(CDAP-7541) DebugLogger API implementation and PreviewStore implementation (#7101)

    • cdap-api/src/main/java/co/cask/cdap/api/RuntimeContext.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-api/src/main/java/co/cask/cdap/api/preview/DataTracer.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/preview/DataTracerFactory.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/store/preview/PreviewStore.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/preview/DefaultDataTracer.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/preview/DefaultDataTracerFactory.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/preview/NoopDataTracer.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/preview/NoopDataTracerFactory.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/AbstractContext.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/MapReduceLifecycleContext.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/flow/BasicFlowletContext.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/preview/DefaultPreviewStore.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/service/http/HttpHandlerGeneratorTest.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/preview/DefaultPreviewStoreTest.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/BasicSparkClientContext.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/preview/SparkDataTracer.java (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-spark-core/src/main/scala/co/cask/cdap/app/runtime/spark/DefaultJavaSparkExecutionContext.scala (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-spark-core/src/main/scala/co/cask/cdap/app/runtime/spark/DefaultSparkExecutionContext.scala (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
    • cdap-spark-core/src/main/scala/co/cask/cdap/app/runtime/spark/SerializableSparkExecutionContext.scala (version 5a3e1f6241376eec30d938c3a4e91fe6921167f3)
  • Terence Yim

    Terence Yim 16e1f1c8cfd8da2bf66293c36bf5db48ca9dcf67

    Merge pull request #7107 from caskdata/merge-3.6-develop
    Merge 3.6 develop

  • Terence Yim

    Terence Yim afd69c4dbfa0215f2577300751f7cb2be8d26d73

    Merge branch 'release/3.6' into develop

  • Terence Yim

    Terence Yim bb3e19e2e7ee362844bd69d01def5739003b7cbd

    Merge pull request #7106 from caskdata/merge-3.5-3.6
    Merge 3.5 3.6

  • Terence Yim

    Terence Yim d4f7152255c839049044fbbfc5a08a3b307be898

    Merge pull request #7105 from caskdata/merge-3.6
    Merge 3.6 to develop

  • Terence Yim

    Terence Yim 9dcc7e74d9428cf8547977a32e6e3a9f9f85898e

    Merge branch 'release/3.5' into release/3.6

  • Terence Yim

    Terence Yim 342f69a2b635dae5b4787b3b2b32a1a29002e13e

    Merge branch 'release/3.6' into develop

  • Terence Yim

    Terence Yim 91443bc6a85fab379dd22c8ad25356f9b41c2caa

    Merge pull request #7103 from caskdata/feature_release/pick-CDAP-7612-fixes
    Cherry-pick Spark Controller fix from #7096

  • Terence Yim

    Terence Yim eefe20c323459cd2ecfdd0fe97f88bff71b937e1

    Merge pull request #7104 from caskdata/merge-3.5
    Merge 3.5 to 3.6

  • Terence Yim

    Terence Yim 69c32a48c58d0ded3c85b3f8ae5d3c054f4f5a1b

    Merge branch 'release/3.5' into merge-3.5

  • Terence Yim

    Terence Yim cd6bb09b8903aca80e2e472243c0bb394ef00ff8

    (CDAP-7612) Makes ProgramController creation done by corresponding ProgramRunner
    - This allows program runtime extension to provide ProgramController instance
    - Don’t create new SparkRunnerClassLoader for DistributedSparkProgramRunner
      -        memorize the SparkRunnerClassLoader created for DistributedSparkProgramRunner
      - This avoid consuming permgen proportion to number of active Spark jobs

    (CDAP-6885) Supports concurrent runs of Spark program

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/runtime/AbstractProgramRuntimeService.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/runtime/distributed/DistributedProgramControllerFactory.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/AbstractDistributedProgramRunner.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedFlowProgramRunner.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedMapReduceProgramRunner.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedProgramRuntimeService.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedServiceProgramRunner.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedWebappProgramRunner.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedWorkerProgramRunner.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedWorkflowProgramRunner.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ProgramLifecycleService.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkProgramRuntimeProvider.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkRunnerClassLoader.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/distributed/DistributedSparkProgramRunner.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/distributed/SparkContainerLauncher.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
    • cdap-spark-core/src/test/java/co/cask/cdap/app/runtime/spark/SparkRunnerClassLoaderTest.java (version cd6bb09b8903aca80e2e472243c0bb394ef00ff8)
  • Ali Anwar

    Ali Anwar 5b04be7458a928774c61442624104c0bbdf161d7

    Merge pull request #7011 from caskdata/bugfix_release/CDAP-6587-explore-impersonation
    CDAP-6587 Impersonation in Explore

  • Ali Anwar

    Ali Anwar 8af53d55c56b58485a3fe66a20601a2ddac68ff4

    Merge pull request #7097 from caskdata/bugfix_release/CDAP-5395-quotes-in-cli-logs-unreadable
    CDAP-5395 Disable escaping HTML for fetching logs from ProgramClient

  • Ali Anwar

    Ali Anwar e9a01abc1564efcb7186b561dc66fde27d497c87

    CDAP-6587 Impersonation in Explore service.

    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-common/src/main/java/co/cask/cdap/common/security/DefaultUGIProvider.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-common/src/main/java/co/cask/cdap/common/utils/FileUtils.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore-client/src/main/java/co/cask/cdap/explore/client/ExploreHttpClient.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore-client/src/main/java/co/cask/cdap/explore/service/Explore.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/executor/ExploreExecutorHttpHandler.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/executor/ExploreMetadataHttpHandler.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/executor/NamespacedExploreMetadataHttpHandler.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/executor/NamespacedQueryExecutorHttpHandler.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/executor/QueryExecutorHttpHandler.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/guice/ExploreRuntimeModule.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/ExploreService.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/ExploreServiceUtils.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/ExploreTableManager.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/ActiveOperationRemovalHandler.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/BaseHiveExploreService.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/Hive12CDH5ExploreService.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/Hive12ExploreService.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/Hive13ExploreService.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/Hive14ExploreService.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/OperationInfo.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
    • cdap-explore/src/test/java/co/cask/cdap/explore/service/HiveExploreServiceTestRun.java (version e9a01abc1564efcb7186b561dc66fde27d497c87)
  • Chengfeng Mao <mao@cask.co>

    Chengfeng Mao <mao@cask.co> 2cf84e3f8c0416cd9a03ac10d7666ecdfc009eac

    Merge pull request #7089 from caskdata/feature/CDAP-6183-extra-jar
    [CDAP-6183] localize extra jars set in cdap-site.xml for programs

  • Chengfeng Mao <Chengfeng@Casks-MacBook-Pro.local>

    Chengfeng Mao <Chengfeng@Casks-MacBook-Pro.local> e39e4b0333af312eb7f48e7f1b168571d23f8cff

    [CDAP-6183] localize extra jars set in cdap-site.xml for programs

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/LocalizationUtils.java (version e39e4b0333af312eb7f48e7f1b168571d23f8cff)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/MapReduceRuntimeService.java (version e39e4b0333af312eb7f48e7f1b168571d23f8cff)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/AbstractDistributedProgramRunner.java (version e39e4b0333af312eb7f48e7f1b168571d23f8cff)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/CConfigurationUtil.java (version e39e4b0333af312eb7f48e7f1b168571d23f8cff)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version e39e4b0333af312eb7f48e7f1b168571d23f8cff)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeService.java (version e39e4b0333af312eb7f48e7f1b168571d23f8cff)
  • Ali Anwar

    Ali Anwar 5bb7a30292b40dcb5fef21170f54d7e5ce755136

    Merge pull request #7098 from caskdata/merge-release/3.5-to-release/3.6
    Merge release/3.5 to release/3.6

  • Ali Anwar

    Ali Anwar d56f3bd3f53351de613994ff10298dd2baab15a2

    CDAP-5395 Disable escaping HTML for fetching logs from ProgramClient (used by 'get <program-type> logs ...' command).

    • cdap-client/src/main/java/co/cask/cdap/client/ProgramClient.java (version d56f3bd3f53351de613994ff10298dd2baab15a2)