Build #2,858

License check with RAT and Checkstyle

Build: #2858 was successful Changes by 17 people

Code commits

CDAP

  • vinishavyasa <CuriousVini@users.noreply.github.com>

    vinishavyasa <CuriousVini@users.noreply.github.com> 1dc10ae502efb1197f4ecbe0f63a9207a9ecdcdd

    Merge pull request #6988 from caskdata/feature/merge-r36-develop
    Feature/merge r36 develop

  • Vinisha Shah

    Vinisha Shah 1b6cf7f94ea923fabbb798a681325b6fbfc1b98c

    Addressing comments

    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/transaction/queue/hbase/HBaseQueueAdmin.java (version 1b6cf7f94ea923fabbb798a681325b6fbfc1b98c)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/ExistingEntitySystemMetadataWriter.java (version 1b6cf7f94ea923fabbb798a681325b6fbfc1b98c)
  • Vinisha Shah

    Vinisha Shah 3cde515a4c132182be9a48dab2ea89e8ac2630bf

    Resolving merge conflicts

  • Vinisha Shah

    Vinisha Shah 5a27655decfcaf5b17d997499276f7d1497fc9ef

    Addressing comments

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/schedule/DefaultSchedulerService.java (version 5a27655decfcaf5b17d997499276f7d1497fc9ef)
  • Vinisha Shah

    Vinisha Shah 963419113759444fa90df8360355dcee042b1906

    Resolving compilation errors

    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/transaction/queue/hbase/HBaseQueueAdmin.java (version 963419113759444fa90df8360355dcee042b1906)
    • cdap-integration-test/src/main/java/co/cask/cdap/test/IntegrationTestBase.java (version 963419113759444fa90df8360355dcee042b1906)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/DatasetUpgrader.java (version 963419113759444fa90df8360355dcee042b1906)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/ExistingEntitySystemMetadataWriter.java (version 963419113759444fa90df8360355dcee042b1906)
    • cdap-unit-test/src/test/java/co/cask/cdap/security/AuthorizationTest.java (version 963419113759444fa90df8360355dcee042b1906)
  • Vinisha Shah

    Vinisha Shah f4157b5f56901292c28e16eead27d6796950dec6

    Resolving conflicts

  • vinishavyasa <CuriousVini@users.noreply.github.com>

    vinishavyasa <CuriousVini@users.noreply.github.com> 2c5c8f5101666b8f2824cb2d9534d3c29cd4d065

    Merge pull request #6985 from caskdata/feature/merge-r35-36
    Feature/merge r35 36

  • Vinisha Shah

    Vinisha Shah e148f1146003a3e958edb5f36677c69437e2d82c

    Merge branch 'release/3.5' into feature/merge-r35-36

  • Terence Yim

    Terence Yim c67c0f205c89d8857336093b42136e46b938df14

    Merge pull request #6980 from caskdata/feature/CDAP-7500-fix-mr-close
    (CDAP-7500) Fix premature closing of MR classloader

  • John Jackson

    John Jackson bcfe6a070271d0b253822704c852d8acc17eba8e

    Merge pull request #6983 from caskdata/docs/r3.5_windows_start_scripts
    Fix Windows-version of CDAP scripts to handle spaces in paths

  • Poorna Chandra

    Poorna Chandra 2db143b605902fa43902e14278abaac0a7135d01

    Merge pull request #6969 from caskdata/bugfix_release/log-exceptions
    Log exception in log saver while processing messages

  • John Jackson

    John Jackson 8921e56c4f66cf10be8be76e5e3ba1fedbcb63ce

    Backports the changes to cap.bat and cdap-cli.bat to handle spaces in both CDAP_HOME and JAVA_HOME paths.

    • cdap-cli/bin/cdap-cli.bat (version 8921e56c4f66cf10be8be76e5e3ba1fedbcb63ce)
    • cdap-standalone/bin/cdap.bat (version 8921e56c4f66cf10be8be76e5e3ba1fedbcb63ce)
  • Terence Yim

    Terence Yim e766753aa98b2a991ffdb223d7961e177fbe8d75

    (CDAP-7500) Fix premature closing of MR classloader
    - Reverted CDAP-7392 fix to use shutdown hook for closing CDAP Services
    - Create Kafka Producer from daemon thread
      - This will ensure the async ProducerSendThread created from the kafka Producer constructor
        is also a daemon thread (from Java Thread class javadoc)
    - Also fixed an annoying and misleading exception from Kafka when the caller thread is interrupted.

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/distributed/MapReduceContainerLauncher.java (version e766753aa98b2a991ffdb223d7961e177fbe8d75)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/appender/kafka/SimpleKafkaProducer.java (version e766753aa98b2a991ffdb223d7961e177fbe8d75)
  • Poorna Chandra

    Poorna Chandra ca926718da10e4b1257ce556856e53278cdd69d4

    Log exception in log saver while processing messages

    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/KafkaMessageCallback.java (version ca926718da10e4b1257ce556856e53278cdd69d4)
  • sagarkapare <sagar@cask.co>

    sagarkapare <sagar@cask.co> 5c7ea371effb57f8ec1e2fd5d3120d9c9cb22458

    Merge pull request #6967 from caskdata/fix/release3.5_in_3.6
    Merge release 3.5 to release 3.6

  • Ali Anwar

    Ali Anwar 4540d0acab9bd28f8b1d1a380c5e43a0980b701a

    Merge pull request #6970 from caskdata/bugfix_release/CDAP-7474-fix-npe-in-File-Reader
    CDAP-7474 Fix NPE by making FileLogReader#getLog never return null.

  • Edwin Elia

    Edwin Elia f48261d8e21d614386b88f8709e64bcd319a23be

    Merge pull request #6968 from caskdata/bugfix_release/ui-express-error-on-download-logs
    [CDAP-7435] [CDAP-7478] Bugfix release/ui express error on download logs

  • Ali Anwar

    Ali Anwar ca8b1f5de35e3834e69ff8aad695eacbd76e50ba

    Merge pull request #6972 from caskdata/bugfix_release/CDAP-6572-integration-test-single-namespace
    CDAP-6572 Execute integration tests in a single (configurable) namespace

  • Nishith Nand <nishith.nand@gmail.com>

    Nishith Nand <nishith.nand@gmail.com> 375aed4ce5a324c021ed1a4620253484c45266e1

    Merge pull request #6961 from caskdata/bugfix_release/kms_jar_to_container
    Adding the cdap-kms class to the Job Jar for mapreduce and Dependency…

  • Vinisha Shah

    Vinisha Shah 80d1add211154e237da199d4f7f3dab8365a4229

    Addressing comments

    • cdap-integration-test/src/main/java/co/cask/cdap/test/IntegrationTestBase.java (version 80d1add211154e237da199d4f7f3dab8365a4229)
  • Vinisha Shah

    Vinisha Shah a58c27883535abd49aa37771b61bbc6529f006f6

    Addressing comments

    • cdap-integration-test/src/main/java/co/cask/cdap/test/IntegrationTestBase.java (version a58c27883535abd49aa37771b61bbc6529f006f6)
  • Vinisha Shah

    Vinisha Shah 89b3845aa4e6b7c727b8597833ca65b6f61a9725

    Fix race condition for namespace creation in IntegrationTestBase

    • cdap-integration-test/src/main/java/co/cask/cdap/test/IntegrationTestBase.java (version 89b3845aa4e6b7c727b8597833ca65b6f61a9725)
  • Chengfeng Mao <Chengfeng@Casks-MacBook-Pro.local>

    Chengfeng Mao <Chengfeng@Casks-MacBook-Pro.local> eb85197cdea26256afdcf0424bc84974a58951ca

    deleted unecessary namespaces check

    • cdap-integration-test/src/main/java/co/cask/cdap/test/IntegrationTestBase.java (version eb85197cdea26256afdcf0424bc84974a58951ca)
  • Ali Anwar

    Ali Anwar 19544c019c8abd7a2cd0108b18a433ef58e9a85c

    CDAP-6572 Execute integration tests in a single (configurable) namespace.

    • cdap-integration-test/README.rst (version 19544c019c8abd7a2cd0108b18a433ef58e9a85c)
    • cdap-integration-test/src/main/java/co/cask/cdap/test/IntegrationTestBase.java (version 19544c019c8abd7a2cd0108b18a433ef58e9a85c)
  • Ali Anwar

    Ali Anwar 4ab4ca3ea582624901b52f68c8f66fcc0d44c7b2

    Merge pull request #6966 from caskdata/hotfix_release/CDAP-7473-fix-program-log-file
    CDAP-7473 Be able to write program.log file, even if 'yarn.nodemanage…

  • Ali Anwar

    Ali Anwar d536b8b3f67c0e95666fcf637d0faa1a950c87c0

    Merge pull request #6964 from caskdata/fix-default-ugi-provider
    Fix DefaultUGIProvider.

  • Ali Anwar

    Ali Anwar d4f1c67c72fd7ab5e3c3394b189781cb9d93f905

    CDAP-7474 Fix NPE by making FileLogReader#getLog never return null.

    • cdap-watchdog/src/main/java/co/cask/cdap/logging/read/DistributedLogReader.java (version d4f1c67c72fd7ab5e3c3394b189781cb9d93f905)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/read/FileLogReader.java (version d4f1c67c72fd7ab5e3c3394b189781cb9d93f905)
    • cdap-watchdog/src/test/java/co/cask/cdap/logging/save/LogSaverPluginTest.java (version d4f1c67c72fd7ab5e3c3394b189781cb9d93f905)
  • Edwin Elia

    Edwin Elia ba8bd11b86302b82e77dc0595a52f79834ec7186

    disable click event on log viewer

    • cdap-ui/app/directives/log-viewer/log-viewer.html (version ba8bd11b86302b82e77dc0595a52f79834ec7186)
    • cdap-ui/app/directives/log-viewer/log-viewer.js (version ba8bd11b86302b82e77dc0595a52f79834ec7186)
  • sagarkapare <sagar@cask.co>

    sagarkapare <sagar@cask.co> a1d23a16cbc72c1bec932ffeff2cfbfb6919c1ff

    Resolved conflicts.

  • Edwin Elia

    Edwin Elia cf9098d1bd8f4d4da20c09fab5b25da4e91d86d0

    fix error setting headers after response is sent

    • cdap-ui/server/express.js (version cf9098d1bd8f4d4da20c09fab5b25da4e91d86d0)
  • Ali Anwar

    Ali Anwar c3d3a872738fab9f7b449d5eceb482f0010be4de

    Fix DefaultUGIProvider.

    • cdap-common/src/main/java/co/cask/cdap/common/security/DefaultUGIProvider.java (version c3d3a872738fab9f7b449d5eceb482f0010be4de)
    • cdap-common/src/test/java/co/cask/cdap/common/security/UGIProviderTest.java (version c3d3a872738fab9f7b449d5eceb482f0010be4de)
  • Ali Anwar

    Ali Anwar 1cb2a985b8e07f618a309582bf1a732f3b4ac810

    CDAP-7473 Be able to write program.log file, even if 'yarn.nodemanager.log-dirs' is not configured as a single directory.

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/AbstractDistributedProgramRunner.java (version 1cb2a985b8e07f618a309582bf1a732f3b4ac810)
    • cdap-distributions/src/etc/cdap/conf.dist/logback-container.xml (version 1cb2a985b8e07f618a309582bf1a732f3b4ac810)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/MasterServiceMain.java (version 1cb2a985b8e07f618a309582bf1a732f3b4ac810)
  • Nishith Nand

    Nishith Nand 45cc0c2fdbc61745b9d1bcd35e280771787d961a

    Adding the cdap-kms class to the Job Jar for mapreduce and Dependency jar for spark.

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/MapReduceRuntimeService.java (version 45cc0c2fdbc61745b9d1bcd35e280771787d961a)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeService.java (version 45cc0c2fdbc61745b9d1bcd35e280771787d961a)
  • Ali Anwar

    Ali Anwar c287db0e9694dae8a5841808862ac815900d50a8

    Merge pull request #6939 from caskdata/feature/CDAP-6577-impersonate-during-upgrade
    Impersonation during UpgradeTool

  • Ali Anwar

    Ali Anwar 423bbd64fa7a82c0dd606639742ec73030877713

    CDAP-6577 Impersonation during UpgradeTool.

    • cdap-common/src/main/java/co/cask/cdap/common/twill/AbstractMasterTwillRunnable.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/dataset2/lib/table/hbase/HBaseMetricsTableTest.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/transaction/distributed/TransactionServiceClientTest.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/transaction/distributed/TransactionServiceTest.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/transaction/queue/hbase/HBaseQueueAdmin.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/transaction/queue/hbase/HBaseQueueTest.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/TransactionServiceTwillRunnable.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/AbstractQueueUpgrader.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/DatasetUpgrader.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/ExistingEntitySystemMetadataWriter.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/StreamStateStoreUpgrader.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/UpgradeTool.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
    • cdap-watchdog/src/main/java/co/cask/cdap/metrics/runtime/MetricsProcessorTwillRunnable.java (version 423bbd64fa7a82c0dd606639742ec73030877713)
  • Ali Anwar

    Ali Anwar 96e8ee27cb7ddb8c645b96601d69d0ea4d703dcf

    Merge pull request #6950 from caskdata/bugfix_release/CDAP-7291-support-cdh-5.9
    Support CDH 5.9, by reusing the HBASE_12_CDH57 compat module.

  • Terence Yim

    Terence Yim 64d92b6ee1072058a410cecb1c3989ec153911d9

    Merge pull request #6938 from caskdata/feature/fix-cluster-report
    Refactor to perform all Twill related impersonation by wrapping TwillRunnerService

  • Terence Yim

    Terence Yim 20b1e0e7e7acd742f78957a92426e6b7f77c2107

    Merge pull request #6954 from caskdata/feature/ugi-provider-cache
    (CDAP-6635) Added caching of UGI

  • Terence Yim

    Terence Yim 35b4a05051e6941d7648ea423c5b64bba63a4775

    (CDAP-6635) Added caching of UGI
    - Avoid hammering KDC too much
    - Make impersonation faster

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/AppFabricServiceRuntimeModule.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/DistributedProgramRunnableModule.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-app-fabric/src/main/java/co/cask/cdap/security/CurrentUGIProvider.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-app-fabric/src/main/java/co/cask/cdap/security/DefaultUGIProvider.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-common/pom.xml (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-common/src/main/java/co/cask/cdap/common/security/AbstractCachedUGIProvider.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-common/src/main/java/co/cask/cdap/common/security/CurrentUGIProvider.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-common/src/main/java/co/cask/cdap/common/security/DefaultUGIProvider.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-common/src/main/java/co/cask/cdap/common/security/ImpersonationInfo.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-common/src/main/java/co/cask/cdap/common/security/RemoteUGIProvider.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-common/src/main/java/co/cask/cdap/common/security/UGIProvider.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-common/src/main/resources/cdap-default.xml (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-common/src/test/java/co/cask/cdap/common/security/UGIProviderTest.java (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • cdap-common/src/test/resources/logback-test.xml (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
    • pom.xml (version 35b4a05051e6941d7648ea423c5b64bba63a4775)
  • Terence Yim

    Terence Yim ff7c81e7ac4187543975a0f57254c174f1dbaaee

    Merge pull request #6953 from caskdata/revert-6947-feature/ugi-provider-cache
    Revert "Added caching of UGI"

  • Terence Yim

    Terence Yim 43854ea9cbd958b9a46f683052c113381d177f79

    Revert "Added caching of UGI"

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/AppFabricServiceRuntimeModule.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/DistributedProgramRunnableModule.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-app-fabric/src/main/java/co/cask/cdap/security/CurrentUGIProvider.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-app-fabric/src/main/java/co/cask/cdap/security/DefaultUGIProvider.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-common/pom.xml (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-common/src/main/java/co/cask/cdap/common/security/AbstractCachedUGIProvider.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-common/src/main/java/co/cask/cdap/common/security/CurrentUGIProvider.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-common/src/main/java/co/cask/cdap/common/security/DefaultUGIProvider.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-common/src/main/java/co/cask/cdap/common/security/ImpersonationInfo.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-common/src/main/java/co/cask/cdap/common/security/RemoteUGIProvider.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-common/src/main/java/co/cask/cdap/common/security/UGIProvider.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-common/src/main/resources/cdap-default.xml (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-common/src/test/java/co/cask/cdap/common/security/UGIProviderTest.java (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • cdap-common/src/test/resources/logback-test.xml (version 43854ea9cbd958b9a46f683052c113381d177f79)
    • pom.xml (version 43854ea9cbd958b9a46f683052c113381d177f79)
  • Terence Yim

    Terence Yim 56710f81d1b2d2c304eda6f35adbe15d78959bf8

    Merge pull request #6947 from caskdata/feature/ugi-provider-cache
    Added caching of UGI

  • Terence Yim

    Terence Yim 7b797debcb71983cab09a1973fb1d885c6f3f37b

    fix checkstyle.

    • cdap-common/src/test/java/co/cask/cdap/common/security/UGIProviderTest.java (version 7b797debcb71983cab09a1973fb1d885c6f3f37b)
  • Terence Yim

    Terence Yim 18208ec262d793e9754f0a679355edd59d91eecc

    fixup

    • cdap-common/src/main/java/co/cask/cdap/common/security/AbstractCachedUGIProvider.java (version 18208ec262d793e9754f0a679355edd59d91eecc)
    • cdap-common/src/test/java/co/cask/cdap/common/security/UGIProviderTest.java (version 18208ec262d793e9754f0a679355edd59d91eecc)
  • Terence Yim

    Terence Yim 28968ac4dcfd512883ef0d1f5a52c581589b4424

    Propagate RuntimeException without wrapping. This accompany with underlying changes not to explicitly throwing RuntimeException.

    • cdap-common/src/main/java/co/cask/cdap/common/security/AbstractCachedUGIProvider.java (version 28968ac4dcfd512883ef0d1f5a52c581589b4424)
    • cdap-common/src/main/java/co/cask/cdap/common/security/RemoteUGIProvider.java (version 28968ac4dcfd512883ef0d1f5a52c581589b4424)
  • Terence Yim

    Terence Yim 38219405f1696ff7934f83e5ed2b1947b68ef8c0

    Added unit-test. Fixed problems discovered by unit-test.

    • cdap-common/pom.xml (version 38219405f1696ff7934f83e5ed2b1947b68ef8c0)
    • cdap-common/src/main/java/co/cask/cdap/common/security/AbstractCachedUGIProvider.java (version 38219405f1696ff7934f83e5ed2b1947b68ef8c0)
    • cdap-common/src/main/java/co/cask/cdap/common/security/DefaultUGIProvider.java (version 38219405f1696ff7934f83e5ed2b1947b68ef8c0)
    • cdap-common/src/main/java/co/cask/cdap/common/security/RemoteUGIProvider.java (version 38219405f1696ff7934f83e5ed2b1947b68ef8c0)
    • cdap-common/src/test/java/co/cask/cdap/common/security/UGIProviderTest.java (version 38219405f1696ff7934f83e5ed2b1947b68ef8c0)
    • cdap-common/src/test/resources/logback-test.xml (version 38219405f1696ff7934f83e5ed2b1947b68ef8c0)
    • pom.xml (version 38219405f1696ff7934f83e5ed2b1947b68ef8c0)
  • John Jackson

    John Jackson a146919ac4d4b258656bb7005cd781fce7ab7967

    Merge pull request #6946 from caskdata/docs/r3.5.2_7439_remove_kinit
    CDAP-7439 Remove "kinit" instruction

  • Ali Anwar

    Ali Anwar db3bc3439c6fd75e5b0d7593e6a414bf2f87f7b0

    Support CDH 5.9, by reusing the HBASE_12_CDH57 compat module.

    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/util/hbase/HBaseVersion.java (version db3bc3439c6fd75e5b0d7593e6a414bf2f87f7b0)
  • Terence Yim

    Terence Yim e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4

    Added caching of UGI
    - Avoid hammering KDC too much
    - Make impersonation faster

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/AppFabricServiceRuntimeModule.java (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/DistributedProgramRunnableModule.java (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
    • cdap-app-fabric/src/main/java/co/cask/cdap/security/CurrentUGIProvider.java (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
    • cdap-app-fabric/src/main/java/co/cask/cdap/security/DefaultUGIProvider.java (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
    • cdap-common/src/main/java/co/cask/cdap/common/security/AbstractCachedUGIProvider.java (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
    • cdap-common/src/main/java/co/cask/cdap/common/security/CurrentUGIProvider.java (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
    • cdap-common/src/main/java/co/cask/cdap/common/security/DefaultUGIProvider.java (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
    • cdap-common/src/main/java/co/cask/cdap/common/security/ImpersonationInfo.java (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
    • cdap-common/src/main/java/co/cask/cdap/common/security/RemoteUGIProvider.java (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
    • cdap-common/src/main/java/co/cask/cdap/common/security/UGIProvider.java (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
    • cdap-common/src/main/resources/cdap-default.xml (version e33ccfec2ad628fb30da9c9ed3ab8cc6220966e4)
  • Rohit Sinha

    Rohit Sinha 18b4121f1432b2d39fbe799a0c09cfa5c84726fe

    CDAP-7404 Support authorization for schedule (#6922)
    * CDAP-7404 Support authorization for schedule

    * Address comments and fix test

    * Addressed comments

    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/ProgramLifecycleHttpHandler.java (version 18b4121f1432b2d39fbe799a0c09cfa5c84726fe)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/WorkflowHttpHandler.java (version 18b4121f1432b2d39fbe799a0c09cfa5c84726fe)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ProgramLifecycleService.java (version 18b4121f1432b2d39fbe799a0c09cfa5c84726fe)
    • cdap-unit-test/src/test/java/co/cask/cdap/security/AuthorizationTest.java (version 18b4121f1432b2d39fbe799a0c09cfa5c84726fe)
    • cdap-unit-test/src/test/java/co/cask/cdap/test/app/AppWithSchedule.java (version 18b4121f1432b2d39fbe799a0c09cfa5c84726fe)
  • John Jackson

    John Jackson e26a6ac48fd9b63da928835ba560c77f30cc3353

    Remove "kinit" instruction.

    • cdap-docs/admin-manual/source/upgrading/packages.rst (version e26a6ac48fd9b63da928835ba560c77f30cc3353)
  • Terence Yim

    Terence Yim 78e8bcb714dadc8c0784d259d7a31578645ab553

    Centralize twill related impersonation into TwillRunnerService

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/ImpersonatedTwillController.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/ImpersonatedTwillPreparer.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/ImpersonatedTwillRunnerService.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/TwillModule.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/AbstractDistributedProgramRunner.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/AbstractProgramTwillApplication.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedProgramRuntimeService.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/ImpersonatedTwillController.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-app-fabric/src/main/java/co/cask/cdap/security/TokenSecureStoreUpdater.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-app-fabric/src/main/java/org/apache/twill/yarn/YarnTwillController.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-common/src/main/java/co/cask/cdap/common/guice/TwillModule.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/MasterServiceMain.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/HBaseQueueDebugger.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/UpgradeDatasetServiceManager.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/UpgradeTool.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/flow/FlowQueuePendingCorrector.java (version 78e8bcb714dadc8c0784d259d7a31578645ab553)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 5839e8e10d2c10a53e5e89faa47f0a7f0941fc97

    Merge pull request #6937 from caskdata/bugfix_release/CDAP-7318-macros-fix
    CDAP-7318 fix an error getting app spec when there are many macros

  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 595663a4173fe116bf81de0eaf78823904c109ce

    Merge pull request #6936 from caskdata/bugfix_release/CDAP-7318-too-many-macros-fix
    CDAP-7318 fix an error getting app spec when there are many macros

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> af745f60c108670138634a96c5d510fe2e0a5fc2

    CDAP-7318 fix an error getting app spec when there are many macros
    If there are more than 20 macros in the app spec, Hadoop's
    Configuration will throw an error. Switching to getRaw() instead of
    just get() so that no substitution will be attempted on the app spec.

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/MapReduceContextConfig.java (version af745f60c108670138634a96c5d510fe2e0a5fc2)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/batch/MapReduceContextConfigTest.java (version af745f60c108670138634a96c5d510fe2e0a5fc2)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeContextConfig.java (version af745f60c108670138634a96c5d510fe2e0a5fc2)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 2ee009acd8644274a57cc11e3b990e7d7ccf7179

    CDAP-7318 fix an error getting app spec when there are many macros
    If there are more than 20 macros in the app spec, Hadoop's
    Configuration will throw an error. Switching to getRaw() instead of
    just get() so that no substitution will be attempted on the app spec.

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/MapReduceContextConfig.java (version 2ee009acd8644274a57cc11e3b990e7d7ccf7179)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/batch/MapReduceContextConfigTest.java (version 2ee009acd8644274a57cc11e3b990e7d7ccf7179)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeContextConfig.java (version 2ee009acd8644274a57cc11e3b990e7d7ccf7179)
  • Ali Anwar

    Ali Anwar 6421098d782d3929c0722f7b07fb07d0bc9db5e3

    Merge pull request #6931 from caskdata/feature/CDAP-7420-program-lifecycle-impersonation
    (CDAP-7420) Program lifecycle impersonation

  • Terence Yim

    Terence Yim b7ba023985deabe2a414b3888acb3f77846afc53

    (CDAP-7420) Program lifecycle impersonation
    Refactor the ProgramRuntimeService and wrap the TwillController to minimize places that need to be aware of impersonation

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/runtime/AbstractProgramRuntimeService.java (version b7ba023985deabe2a414b3888acb3f77846afc53)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/deploy/pipeline/NamespacedImpersonator.java (version b7ba023985deabe2a414b3888acb3f77846afc53)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/AbstractDistributedProgramRunner.java (version b7ba023985deabe2a414b3888acb3f77846afc53)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedFlowProgramRunner.java (version b7ba023985deabe2a414b3888acb3f77846afc53)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedFlowletInstanceUpdater.java (version b7ba023985deabe2a414b3888acb3f77846afc53)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedProgramRuntimeService.java (version b7ba023985deabe2a414b3888acb3f77846afc53)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/ImpersonatedTwillController.java (version b7ba023985deabe2a414b3888acb3f77846afc53)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/service/InMemoryProgramRuntimeService.java (version b7ba023985deabe2a414b3888acb3f77846afc53)
    • cdap-app-fabric/src/main/java/org/apache/twill/yarn/YarnTwillController.java (version b7ba023985deabe2a414b3888acb3f77846afc53)
    • cdap-app-fabric/src/test/java/co/cask/cdap/app/runtime/AbstractProgramRuntimeServiceTest.java (version b7ba023985deabe2a414b3888acb3f77846afc53)
    • cdap-common/src/main/java/org/apache/twill/internal/yarn/Hadoop21YarnAppClient.java (version b7ba023985deabe2a414b3888acb3f77846afc53)
  • Ali Anwar

    Ali Anwar 6c21a8ea4b115c540d58a74a6c1035e6c3774e72

    Merge pull request #6932 from caskdata/bugfix_release/CDAP-7438-kinit-upgrade-tool-queue-debugger
    Perform Keytab login for upgrade tool and queue debugger

  • Chengfeng Mao <maocf1993@gmail.com>

    Chengfeng Mao <maocf1993@gmail.com> 0f1d5dd67bd5432eefa0d6644a676fd936ac993b

    Merge pull request #6923 from caskdata/feature/id-comparison
    [CDAP-7415] fix comparison between ProgramId and Id.Program

  • Ali Anwar

    Ali Anwar fbccda577db3bcbb45c082eb9e74309b2d74a6c1

    CDAP-7438 Perform login from Keytab for UpgradeTool and HBaseQueueDebugger.

    • cdap-master/src/main/java/co/cask/cdap/data/tools/HBaseQueueDebugger.java (version fbccda577db3bcbb45c082eb9e74309b2d74a6c1)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/UpgradeTool.java (version fbccda577db3bcbb45c082eb9e74309b2d74a6c1)
  • Ali Anwar

    Ali Anwar e47b0468fccdd551e33da8e66fa36ad528b75902

    Merge pull request #6930 from caskdata/bugfix_release/CDAP-CDAP-7433-start-auth-service-for-queue-debugger
    Start AuthorizationEnforcementService before using the HBaseQueueDebugger

  • Ali Anwar

    Ali Anwar 8ea8c64821f60de016dc7b690822662013e9a606

    CDAP-7433 Start AuthorizationEnforcementService before using the HBaseQueueDebugger. Otherwise, it will fail if authorziation is enabled.

    • cdap-master/src/main/java/co/cask/cdap/data/tools/HBaseQueueDebugger.java (version 8ea8c64821f60de016dc7b690822662013e9a606)
  • Ali Anwar

    Ali Anwar 427b6b22873f7ba39e09ffb0e5e2ecc75fb5ebd8

    Merge pull request #6928 from caskdata/bugfix_release/CDAP-7431-impersonation-for-hbase-queue-debugger
    Perform impersonation when running HBaseQueueDebugger

  • Ali Anwar

    Ali Anwar 383c7d058d73598cbff53d31ab1b78ed9cad9d92

    CDAP-7431 Perform impersonation when running HBaseQueueDebugger, since cdap system principal may not have the necessary privileges on the hbase tables in various namespaces.

    • cdap-master/src/main/java/co/cask/cdap/data/tools/HBaseQueueDebugger.java (version 383c7d058d73598cbff53d31ab1b78ed9cad9d92)
  • Chengfeng <mao@cask.co>

    Chengfeng <mao@cask.co> 33c6a0f2d5eb56eb194dc42d5dcee9452c9e1493

    [CDAP-7415] fix comparison between ProgramId and Id.Program

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/artifact/ArtifactStore.java (version 33c6a0f2d5eb56eb194dc42d5dcee9452c9e1493)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedProgramRuntimeService.java (version 33c6a0f2d5eb56eb194dc42d5dcee9452c9e1493)
  • Rohit Sinha

    Rohit Sinha f80013ec41991eccc765290dea96ee1ba5dc1c83

    CDAP-7396 Run scheduled job with with impersonated user in impersonat… (#6886)
    * CDAP-7396 Run scheduled job with with impersonated user in impersonated ns

    * Addressed comments

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/namespace/DefaultNamespaceAdmin.java (version f80013ec41991eccc765290dea96ee1ba5dc1c83)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/schedule/DefaultSchedulerService.java (version f80013ec41991eccc765290dea96ee1ba5dc1c83)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/schedule/ScheduleTaskRunner.java (version f80013ec41991eccc765290dea96ee1ba5dc1c83)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/schedule/StreamSizeScheduler.java (version f80013ec41991eccc765290dea96ee1ba5dc1c83)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/schedule/TimeScheduler.java (version f80013ec41991eccc765290dea96ee1ba5dc1c83)
  • Rohit Sinha

    Rohit Sinha 2fc0b3d3fe6d0ba48639682d40c24cdeaf9ef3d7

    Merge pull request #6888 from caskdata/feature/CDAP-7398-app-del-fix
    CDAP-7398 fix cross ns app deletion check

  • Chris Gianelloni

    Chris Gianelloni 55b030da080ab9969ea863a24be60360d1269d2a

    Bump IDEA IntelliJ version to latest (#6921)

    • cdap-distributions/src/packer/cdap-sdk-ubuntu12-with-uri.json (version 55b030da080ab9969ea863a24be60360d1269d2a)
  • Chris Gianelloni

    Chris Gianelloni 797d024727ce9ebeb41f4b5afd2f05d2467a5043

    Bump IDEA IntelliJ version to latest (#6920)

    • cdap-distributions/src/packer/cdap-sdk-ubuntu12-with-uri.json (version 797d024727ce9ebeb41f4b5afd2f05d2467a5043)
  • Rohit Sinha

    Rohit Sinha 35781e27fc545fd8f8a67b5e03d99886d9eb5184

    Add unit test

    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/ApplicationLifecycleServiceTest.java (version 35781e27fc545fd8f8a67b5e03d99886d9eb5184)
  • Rohit Sinha

    Rohit Sinha 6510dd95d5a754dd3eebf26cc04e96c54fb74c44

    CDAP-7398 fix cross ns app deletion check

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ApplicationLifecycleService.java (version 6510dd95d5a754dd3eebf26cc04e96c54fb74c44)