Build #954

Cask Data Application Platform - Develop Build and Test

Build: #954 was successful Child of CDAP-DRC-1670

Code commits

CDAP/develop

  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> fb0cb32bf3f6fa50b4bb81eacbe96359088087f6

    Merge pull request #3786 from caskdata/feature/CDAP-3490-upgrade-templates
    CDAP-3490 cdap upgrade for templates and adapters

  • Bhooshan Mogal

    Bhooshan Mogal 9d947af11e8e4786b928da5d3199b9a59fce790e

    Merge pull request #3812 from caskdata/fix/checkstyle
    Fix checkstyle error in AbstractProgramRuntimeServiceTest

  • Bhooshan Mogal

    Bhooshan Mogal f496eb7293c291fb8268710cee2b3f2ae13d6b61

    Fix checkstyle error in AbstractProgramRuntimeServiceTest

    • cdap-app-fabric/src/test/java/co/cask/cdap/app/runtime/AbstractProgramRuntimeServiceTest.java (version f496eb7293c291fb8268710cee2b3f2ae13d6b61)
  • Terence Yim

    Terence Yim 6f4e400fd2bc490096ebf869cea29e987cac63db

    Merge pull request #3811 from caskdata/feature/CDAP-3579-fix-RuntimeService-deadlock
    (CDAP-3579) Reduce locking scope of the AbstractProgramRuntimeService.run() method

  • Terence Yim

    Terence Yim 84bb0f751fde6dcd64b608fbce712f9243855bef

    (CDAP-3579) Reduce locking scope of the AbstractProgramRuntimeService.run() method - Locking is only required when modifying the runtimeInfos map, no need to lock the entire time inside the run() method - If we lock the whole run() method, it’s possible that the program finish very fast such that while run() is holding the lock, the ProgramController listener.completed() method is triggered (from another thread), which also tries to acquire the lock to modify the runtimeInfos map, causing a deadlock.

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/runtime/AbstractProgramRuntimeService.java (version 84bb0f751fde6dcd64b608fbce712f9243855bef)
    • cdap-app-fabric/src/test/java/co/cask/cdap/app/runtime/AbstractProgramRuntimeServiceTest.java (version 84bb0f751fde6dcd64b608fbce712f9243855bef)
  • ataylor4 <ataylor4@stanford.edu>

    ataylor4 <ataylor4@stanford.edu> 048c1c95313818cd12aa0ca92dc837313f9c36f8

    Merge pull request #3790 from caskdata/feature/custom-action-etl
    Added optional email action to ETL Workflow

  • Edwin Elia

    Edwin Elia 4c1bee43dd3e0236a786f542cd86537d2b2d44b2

    Merge pull request #3805 from caskdata/feature/ui-fix-workers-request
    fixes data requests for workers

  • Ashley Taylor

    Ashley Taylor af33f8db06daada40cc55b312256984f8812ee32

    updated to address PR comments

    • cdap-app-templates/cdap-etl/cdap-etl-batch-app/src/main/java/co/cask/cdap/app/etl/batch/EmailAction.java (version af33f8db06daada40cc55b312256984f8812ee32)
  • Ajai Narayan

    Ajai Narayan a12c2ac6e7e9b4245885a2c30f2fa95da97613b0

    Fixes workers logs controller

    • cdap-ui/app/features/workers/controllers/tabs/runs/tabs/log-ctrl.js (version a12c2ac6e7e9b4245885a2c30f2fa95da97613b0)
  • Bhooshan Mogal

    Bhooshan Mogal 03544f227d3a9c4cabc48cc448fd1989c2bbed11

    Merge pull request #3806 from caskdata/feature/ui-rat-check
    Enabled RAT check for cdap-ui. Also removed a travis yml file that se…

  • Chris Gianelloni

    Chris Gianelloni bef88d12f763b7d8855919ce6196ebe64d5b9d8d

    Merge pull request #3798 from caskdata/feature/rpm-from-osx
    Allow RPM builds on OSX and other non-Linux systems

  • Chris Gianelloni

    Chris Gianelloni d6262b9efde28b939d44ca3123fc920e4dc84f51

    Top-level pom needs this, too

    • pom.xml (version d6262b9efde28b939d44ca3123fc920e4dc84f51)
  • Edwin Elia

    Edwin Elia d1cb714d324b8d0c522f9844b6b0f0e0fb95381e

    Merge pull request #3808 from caskdata/fix/ui-license-header-html
    Fixes license header comments to be removed while building html templates

  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 3915d9dfc8980b64604c459af79d526c96d7a1bb

    Merge pull request #3797 from caskdata/feature/CDAP-3560-isSystem-to-scope
    CDAP-3560 change isSystem to a scope enum

  • Ajai Narayan

    Ajai Narayan 4bdf7028fcb72304f6cbed7de0eb067afd6bc96b

    Fixes license header comments to be removed while building html templates

    • cdap-ui/Gulpfile.js (version 4bdf7028fcb72304f6cbed7de0eb067afd6bc96b)
    • cdap-ui/package.json (version 4bdf7028fcb72304f6cbed7de0eb067afd6bc96b)
  • Bhooshan Mogal

    Bhooshan Mogal 5b99405b28bd954a50c6f3dbbd3efc262de69dac

    Enabled RAT check for cdap-ui. Also removed a travis yml file that seems unnecessary.

    • cdap-ui/.travis.yml (version 5b99405b28bd954a50c6f3dbbd3efc262de69dac)
    • cdap-ui/app/index.html (version 5b99405b28bd954a50c6f3dbbd3efc262de69dac)
    • cdap-ui/pom.xml (version 5b99405b28bd954a50c6f3dbbd3efc262de69dac)
    • pom.xml (version 5b99405b28bd954a50c6f3dbbd3efc262de69dac)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> 57dbe4474badd1a9694f528db253c90398bf5726

    fixes data requests for workers

    • cdap-ui/app/features/workers/templates/detail.html (version 57dbe4474badd1a9694f528db253c90398bf5726)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 1de19e818df28f39699b6111e35ea8beb7f1df50

    CDAP-3560 remove some duplicate code

    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/ArtifactHttpHandler.java (version 1de19e818df28f39699b6111e35ea8beb7f1df50)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 96a165ebda3100dbf1c23a9b11a27d5c52671ea1

    CDAP-3490 move deletion of templates to AdapterService
    Instead of checking the application name to see if an app is an
    application template, moving template deletion logic into the
    adapter service. Adapter service can tell what is a template
    because the presence of an adapter means there is a deployed
    application template. And if there are no adapters, we know the
    corresponding template was already deleted.

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/AppFabricServiceRuntimeModule.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/AdapterHttpHandler.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/AppLifecycleHttpHandler.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/ApplicationTemplateHandler.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/ProgramLifecycleHttpHandler.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/WorkflowHttpHandler.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/deploy/LocalApplicationManager.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/deploy/LocalApplicationTemplateManager.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/deploy/pipeline/ApplicationTemplateVerificationStage.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/deploy/pipeline/ApplicationVerificationStage.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/namespace/DefaultNamespaceAdmin.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/adapter/AdapterService.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/adapter/PluginRepository.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/AdapterService.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/AppFabricServer.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ApplicationLifecycleService.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/StandaloneAppFabricServer.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/adapter/AdapterLifecycleTest.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/adapter/AdapterServiceTest.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/ApplicationLifecycleServiceTest.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/http/handlers/NamespaceHttpHandlerTest.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/UpgradeTool.java (version 96a165ebda3100dbf1c23a9b11a27d5c52671ea1)
  • Chris Gianelloni

    Chris Gianelloni d6d87509df64f71fd0f47b72b75159623e85a006

    Allow RPM builds on OSX and other non-Linux systems

    • cdap-distributions/pom.xml (version d6d87509df64f71fd0f47b72b75159623e85a006)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 38d864fc9cd96529385d91fa2ca60206e2123e48

    CDAP-3560 change isSystem to a scope enum
    Changing the isSystem boolean to an enum for artifact scope.
    We will start out with system and user scopes, but this allows us
    to add new scopes in the future and is consistent with other
    concepts like metrics.

    Also doing some cleanup so that ArtifactId is used in a few
    classes instead of storing the individual id fields.

    Also adding missing package-info file for artifacts.

    • cdap-api/src/main/java/co/cask/cdap/api/artifact/ArtifactDescriptor.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-api/src/main/java/co/cask/cdap/api/artifact/ArtifactId.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-api/src/main/java/co/cask/cdap/api/artifact/ArtifactScope.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-api/src/main/java/co/cask/cdap/api/artifact/Plugin.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-api/src/main/java/co/cask/cdap/api/artifact/package-info.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/DefaultAppConfigurer.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/AppLifecycleHttpHandler.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/ArtifactHttpHandler.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/util/AbstractAppFabricHttpHandler.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/DefaultPluginConfigurer.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/AbstractContext.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/adapter/PluginInstantiator.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/artifact/ArtifactInspector.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/artifact/ArtifactRepository.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/artifact/ArtifactStore.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/MapReduceClassLoader.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ApplicationLifecycleService.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/artifact/ArtifactRepositoryTest.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/artifact/ArtifactStoreTest.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/ApplicationLifecycleServiceTest.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/http/handlers/AppLifecycleHttpHandlerTest.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/http/handlers/ArtifactHttpHandlerTest.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-templates/cdap-data-quality/src/test/java/co/cask/cdap/dq/DataQualityAppTest.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-app-templates/cdap-etl/cdap-etl-batch-app/src/test/java/co/cask/cdap/app/etl/batch/BaseETLBatchTest.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-client-tests/src/test/java/co/cask/cdap/client/ApplicationClientTestRun.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-client-tests/src/test/java/co/cask/cdap/client/ArtifactClientTestRun.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-client/src/main/java/co/cask/cdap/client/ArtifactClient.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-proto/src/main/java/co/cask/cdap/proto/Id.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-proto/src/main/java/co/cask/cdap/proto/artifact/ArtifactInfo.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-proto/src/main/java/co/cask/cdap/proto/artifact/ArtifactSummary.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-unit-test/src/main/java/co/cask/cdap/test/UnitTestManager.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
    • cdap-unit-test/src/test/java/co/cask/cdap/test/app/TestFrameworkTestRun.java (version 38d864fc9cd96529385d91fa2ca60206e2123e48)
  • Ashley Taylor

    Ashley Taylor 3d10aaab6170ad4c883f9e107482fe908e64d7e0

    Updated docs and addressed PR comments

    • cdap-app-templates/cdap-etl/cdap-etl-batch-app/src/main/java/co/cask/cdap/app/etl/batch/ETLWorkflow.java (version 3d10aaab6170ad4c883f9e107482fe908e64d7e0)
    • cdap-app-templates/cdap-etl/cdap-etl-batch-app/src/main/java/co/cask/cdap/app/etl/batch/EmailAction.java (version 3d10aaab6170ad4c883f9e107482fe908e64d7e0)
    • cdap-app-templates/cdap-etl/cdap-etl-batch-app/src/test/java/co/cask/cdap/app/etl/batch/ETLEmailActionTest.java (version 3d10aaab6170ad4c883f9e107482fe908e64d7e0)
  • Ashley Taylor

    Ashley Taylor a776979abb3c7e4a2f00cd2779d78e87bf0ff344

    Email action after batch ETL application run

    • cdap-app-templates/cdap-etl/cdap-etl-batch-app/pom.xml (version a776979abb3c7e4a2f00cd2779d78e87bf0ff344)
    • cdap-app-templates/cdap-etl/cdap-etl-batch-app/src/main/java/co/cask/cdap/app/etl/batch/ETLBatchApplication.java (version a776979abb3c7e4a2f00cd2779d78e87bf0ff344)
    • cdap-app-templates/cdap-etl/cdap-etl-batch-app/src/main/java/co/cask/cdap/app/etl/batch/ETLWorkflow.java (version a776979abb3c7e4a2f00cd2779d78e87bf0ff344)
    • cdap-app-templates/cdap-etl/cdap-etl-batch-app/src/main/java/co/cask/cdap/app/etl/batch/EmailAction.java (version a776979abb3c7e4a2f00cd2779d78e87bf0ff344)
    • cdap-app-templates/cdap-etl/cdap-etl-batch-app/src/main/java/co/cask/cdap/app/etl/batch/config/ETLBatchConfig.java (version a776979abb3c7e4a2f00cd2779d78e87bf0ff344)
    • cdap-app-templates/cdap-etl/cdap-etl-batch-app/src/test/java/co/cask/cdap/app/etl/batch/ETLEmailActionTest.java (version a776979abb3c7e4a2f00cd2779d78e87bf0ff344)
    • pom.xml (version a776979abb3c7e4a2f00cd2779d78e87bf0ff344)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 38fc5649f25f474229a956043f829e8d94c4371d

    CDAP-3490 cdap upgrade for templates and adapters
    We are removing templates and adapters, which means the upgrade
    process should delete any existing adapters and templates.

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/adapter/AdapterService.java (version 38fc5649f25f474229a956043f829e8d94c4371d)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ApplicationLifecycleService.java (version 38fc5649f25f474229a956043f829e8d94c4371d)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/ApplicationLifecycleServiceTest.java (version 38fc5649f25f474229a956043f829e8d94c4371d)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/UpgradeTool.java (version 38fc5649f25f474229a956043f829e8d94c4371d)