Build #2

Docs quick-build (builds without javadocs)

Build: #2 failed Manual run by John Jackson

Code commits

Showing 102 of 618 code changes

CDAP

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 7cee83dbcf17c41d2de41c38c03f7633dd691540

    Merge pull request #6087 from caskdata/feature/CDAP-6196-spark-joins
    CDAP-6196 adding join implementation to spark engine

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 5ae2c7cbc66aa187b063b89535ccbe0fdded4673

    CDAP-6196 adding join implementation to spark engine

    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/test/java/co/cask/cdap/datapipeline/DataPipelineTest.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/etl/api/JoinElement.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/DefaultMacroEvaluator.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/SparkPipelineDriver.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/BatchSparkPipelineDriver.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/ETLSpark.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/SparkJoinerContext.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/SparkJoinerRuntimeContext.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/AggregatorAggregateFunction.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/AggregatorGroupByFunction.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/BatchSinkFunction.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/BatchSourceFunction.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/InitialJoinFunction.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/JoinFlattenFunction.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/JoinMergeFunction.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/JoinOnFunction.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/LeftJoinFlattenFunction.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/OuterJoinFlattenFunction.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/PluginFunctionContext.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/TransformFunction.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeUtils.java (version 5ae2c7cbc66aa187b063b89535ccbe0fdded4673)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 99756b20a151b0f3cfba961ae4f1f57db2a343bf

    Merge pull request #6079 from caskdata/feature/multiphase-with-planner-fix
    Adding support for multiple joiner plugin in pipeline

  • anew <andreas@continuuity.com>

    anew <andreas@continuuity.com> 57d642382466047eb4becb56ba65243951827184

    [CDAP-6062] make PFS.dropPartition fail fast and abort if it cannot drop the partition from Hive; fix error propagation in explore service and client

    • cdap-cli/src/main/java/co/cask/cdap/cli/command/ExecuteQueryCommand.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/dataset2/lib/partitioned/PartitionedFileSetDataset.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore-client/src/main/java/co/cask/cdap/explore/client/AbstractExploreClient.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore-client/src/main/java/co/cask/cdap/explore/client/ExploreFacade.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore-client/src/main/java/co/cask/cdap/explore/client/ExploreHttpClient.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore-client/src/main/java/co/cask/cdap/explore/service/Explore.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore-client/src/main/java/co/cask/cdap/explore/service/UnexpectedQueryStatusException.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore-jdbc/src/main/java/co/cask/cdap/explore/jdbc/ExploreStatement.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore/src/main/java/co/cask/cdap/explore/executor/ExploreExecutorHttpHandler.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore/src/main/java/co/cask/cdap/explore/executor/NamespacedQueryExecutorHttpHandler.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore/src/main/java/co/cask/cdap/explore/executor/QueryExecutorHttpHandler.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/ExploreTableManager.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/BaseHiveExploreService.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/Hive12CDH5ExploreService.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/Hive13ExploreService.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/Hive14ExploreService.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore/src/test/java/co/cask/cdap/explore/service/BaseHiveExploreServiceTest.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-explore/src/test/java/co/cask/cdap/explore/service/HiveExploreServiceFileSetTestRun.java (version 57d642382466047eb4becb56ba65243951827184)
    • cdap-proto/src/main/java/co/cask/cdap/proto/QueryStatus.java (version 57d642382466047eb4becb56ba65243951827184)
  • anew <andreas@continuuity.com>

    anew <andreas@continuuity.com> e836c6f66894e916bc574b42f9a7ec7485f489a3

    Merge branch 'feature/cdap-6510-remove-explore-upgrade' into develop

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 7f57da1d94730c8c873181f6625d083f80554ba7

    Merge pull request #6072 from caskdata/ui-styling-tracker-fix-results-sort
    Ui styling tracker fix results sort

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 671e4d430fce050f95ec397bf7a89e8e882b583b

    Merge pull request #6071 from caskdata/feature/ui-tracker-add-meter-info-icon
    adds conditional truth meter info icon

  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> b8afdc01d597212b037a2c8ccab1713984d00d88

    fixes vertical alignment of info icon

    • cdap-ui/app/features/tracker/directives/truth-meter/truth-meter.less (version b8afdc01d597212b037a2c8ccab1713984d00d88)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> e7a0591c6c0e1fdf2caefff3b44bf251460ad59e

    cleans up tag fetching + variable use in templates

    • cdap-ui/app/features/tracker/controllers/tags-ctrl.js (version e7a0591c6c0e1fdf2caefff3b44bf251460ad59e)
    • cdap-ui/app/features/tracker/templates/partial/add-preferred-tags-popover.html (version e7a0591c6c0e1fdf2caefff3b44bf251460ad59e)
    • cdap-ui/app/features/tracker/templates/tags.html (version e7a0591c6c0e1fdf2caefff3b44bf251460ad59e)
  • Vinisha Shah

    Vinisha Shah 711be796eaf09346cbcfe2c793480b1d85751437

    Adding support for multiple joiner plugin in pipeline

    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/test/java/co/cask/cdap/datapipeline/DataPipelineTest.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/KVTransformations.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/PipelinePluginInstantiator.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/TransformExecutorFactory.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/connector/ConnectorSink.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/connector/ConnectorSource.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/join/Join.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/mapreduce/ErrorOutputWriter.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/mapreduce/MapReduceTransformExecutorFactory.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/mapreduce/TransformRunner.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/TrackedEmitter.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/TrackedTransform.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/TransformDetail.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/TransformExecutor.java (version 711be796eaf09346cbcfe2c793480b1d85751437)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> d56fae12e50892ee44e71a560ced0430e09e285a

    Merge pull request #6022 from caskdata/feature/ui-complex-schema-parity
    [CDAP-4986] UI Complex Schema Integration Part 2

  • Edwin Elia

    Edwin Elia b34e3364466ca8329250421546c38871976d1a1c

    complete complex schema feature parity update schema with implicit schema add stream special case add dataset selected event listener remove clearDOM setting on schema clear event fix error blink when switching to complex schema types grouping schema types for simple and complex handle stream import/export schema cleanup commented out code remove comment from dataset selected event add spec-version 1.3 add error message when trying to export empty schema modify compile to use es6 literals

    • cdap-ui/app/directives/complex-schema/array-schema/array-schema.html (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/directives/complex-schema/array-schema/array-schema.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/directives/complex-schema/complex-schema-helpers.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/directives/complex-schema/complex-schema.html (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/directives/complex-schema/complex-schema.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/directives/complex-schema/enum-schema/enum-schema.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/directives/complex-schema/map-schema/map-schema.html (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/directives/complex-schema/map-schema/map-schema.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/directives/complex-schema/union-schema/union-schema.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/directives/widget-container/widget-complex-schema-editor/widget-complex-schema-editor.html (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/directives/widget-container/widget-complex-schema-editor/widget-complex-schema-editor.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/directives/widget-container/widget-input-schema/widget-input-schema.html (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/features/hydratorplusplus/controllers/create/partials/nodeconfig-ctrl.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/features/hydratorplusplus/services/create/stores/config-store.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/features/hydratorplusplus/services/detail/stores/pipeline-detail-nonruns-store.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/features/hydratorplusplus/services/hydrator-node-service.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/features/hydratorplusplus/services/hydrator-service.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/features/hydratorplusplus/services/plugin-config-factory.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/features/hydratorplusplus/templates/partial/node-config-modal/node-config/plugin-edit-output-schema.html (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/features/tracker/controllers/metadata-ctrl.js (version b34e3364466ca8329250421546c38871976d1a1c)
    • cdap-ui/app/features/tracker/templates/metadata.html (version b34e3364466ca8329250421546c38871976d1a1c)
  • anew <andreas@continuuity.com>

    anew <andreas@continuuity.com> 80b3953323a85744a6aafa6971a28cb34ce02f96

    [CDAP-6510] remove upgrade of explore - it was only for 2.6 -> 2.8

    • cdap-explore-client/src/main/java/co/cask/cdap/explore/client/AbstractExploreClient.java (version 80b3953323a85744a6aafa6971a28cb34ce02f96)
    • cdap-explore-client/src/main/java/co/cask/cdap/explore/service/Explore.java (version 80b3953323a85744a6aafa6971a28cb34ce02f96)
    • cdap-explore/src/main/java/co/cask/cdap/explore/executor/ExploreExecutorService.java (version 80b3953323a85744a6aafa6971a28cb34ce02f96)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/BaseHiveExploreService.java (version 80b3953323a85744a6aafa6971a28cb34ce02f96)
    • cdap-explore/src/test/java/co/cask/cdap/explore/service/ExploreUpgradeTest.java (version 80b3953323a85744a6aafa6971a28cb34ce02f96)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> 35bfabcbca95f3fd9d01bd1997ed7b4e1663c88d

    adds backend integration to Tags tab

    • cdap-ui/app/features/tracker/controllers/tags-ctrl.js (version 35bfabcbca95f3fd9d01bd1997ed7b4e1663c88d)
    • cdap-ui/app/features/tracker/services/my-tracker-api.js (version 35bfabcbca95f3fd9d01bd1997ed7b4e1663c88d)
    • cdap-ui/app/features/tracker/templates/partial/add-preferred-tags-popover.html (version 35bfabcbca95f3fd9d01bd1997ed7b4e1663c88d)
    • cdap-ui/app/features/tracker/templates/partial/delete-preferred-tags-popover.html (version 35bfabcbca95f3fd9d01bd1997ed7b4e1663c88d)
    • cdap-ui/app/features/tracker/templates/tags.html (version 35bfabcbca95f3fd9d01bd1997ed7b4e1663c88d)
    • cdap-ui/app/features/tracker/tracker.less (version 35bfabcbca95f3fd9d01bd1997ed7b4e1663c88d)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> 9f78962674d028950af2a3da777e2972d47478fc

    fixes styling issues with tags table + modals

    • cdap-ui/app/features/tracker/controllers/tags-ctrl.js (version 9f78962674d028950af2a3da777e2972d47478fc)
    • cdap-ui/app/features/tracker/templates/partial/add-preferred-tags-popover.html (version 9f78962674d028950af2a3da777e2972d47478fc)
    • cdap-ui/app/features/tracker/templates/partial/delete-preferred-tags-popover.html (version 9f78962674d028950af2a3da777e2972d47478fc)
    • cdap-ui/app/features/tracker/templates/tags.html (version 9f78962674d028950af2a3da777e2972d47478fc)
    • cdap-ui/app/features/tracker/tracker.less (version 9f78962674d028950af2a3da777e2972d47478fc)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> 2b02dc3d0554ee143e1d4b8b94e776e8f0e50358

    cleans up paths, removes unused empty

    • cdap-ui/app/features/tracker/controllers/tags-ctrl.js (version 2b02dc3d0554ee143e1d4b8b94e776e8f0e50358)
    • cdap-ui/app/features/tracker/services/my-tracker-api.js (version 2b02dc3d0554ee143e1d4b8b94e776e8f0e50358)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> 51ab42a52ca8543bcb547a86b3c0da1282bf600a

    fixes issues with pagination

    • cdap-ui/app/features/tracker/templates/tags.html (version 51ab42a52ca8543bcb547a86b3c0da1282bf600a)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> dc2f60480cfa70239525808107c63b1ae769669e

    adds minor layout fixes to results view

    • cdap-ui/app/features/tracker/templates/results.html (version dc2f60480cfa70239525808107c63b1ae769669e)
    • cdap-ui/app/features/tracker/tracker.less (version dc2f60480cfa70239525808107c63b1ae769669e)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 02ea913f024c11f95b0334cceaec682999db0d1d

    Merge pull request #6086 from caskdata/feature/move-classes
    Added AuthorizationEnforcementModule. Moved RemotePrivilegesFetcher t…

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 0ed61d0d555c00a6cf68ffd4dfb8fa60cd2d4be0

    Merge pull request #6084 from caskdata/fix/itn-error
    CDAP-6528 Attempt Macro substituion only if the value is provided by user.

  • sagarkapare <sagar@cask.co>

    sagarkapare <sagar@cask.co> d7704204b067cae993d52c9ffbfeff9f560e5858

    CDAP-6528 Attempt Macro substituion only if the value is provided by user.

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/plugin/PluginInstantiator.java (version d7704204b067cae993d52c9ffbfeff9f560e5858)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 1f7d78b0e8fa8de7cff922eed3ce770c4a29de63

    Merge pull request #6081 from caskdata/feature/enforce-filter-abstract
    Moved default implementations of enforce and filter to AbstractAuthor…

  • Bhooshan Mogal

    Bhooshan Mogal e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e

    Added AuthorizationEnforcementModule. Moved RemotePrivilegesFetcher to cdap-security and RemoteOpsClient/MethodArgument to cdap-common so they can be accessed by both cdap-app-fabric and cdap-data-fabric.

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/DistributedProgramRunnableModule.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/AbstractRemoteSystemOpsHandler.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteLineageWriterHandler.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemotePrivilegeFetcherHandler.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteRuntimeStoreHandler.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteUsageRegistryHandler.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/remote/MethodArgument.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/remote/RemoteLineageWriter.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/remote/RemoteOpsClient.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/remote/RemotePrivilegesFetcher.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/remote/RemoteRuntimeStore.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/remote/RemoteRuntimeUsageRegistry.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/remote/RemotePrivilegesFetcherTest.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/guice/AppFabricTestModule.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-common/src/main/java/co/cask/cdap/common/internal/remote/MethodArgument.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-common/src/main/java/co/cask/cdap/common/internal/remote/RemoteOpsClient.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-security/src/main/java/co/cask/cdap/security/authorization/AuthorizationEnforcementModule.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
    • cdap-security/src/main/java/co/cask/cdap/security/authorization/RemotePrivilegesFetcher.java (version e7c3cdbc7376a534ec42bdf31d7e5a7bf8686c9e)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 056ebb94b80ecead9050481a987c73bdb3795c07

    Merge pull request #6065 from caskdata/feature/CDAP-6375-refactor-hydrator-spark
    CDAP-6375 refactor hydrator spark

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> adbe8850f5e14dae21bb65e53586048b6bc3f2dd

    CDAP-6375 refactor hydrator spark
    Pulling Spark related Hydrator logic into its own module in
    preparation for the new artifact that will run pipelines using
    Spark Streaming.

    As part of this refactor, a single Spark program can now be used
    to run an entire pipeline, which removes the need for running the
    planner logic and local connector datasets used by the mapreduce
    engine.

    • cdap-app-templates/cdap-etl/cdap-data-pipeline/pom.xml (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/co/cask/cdap/datapipeline/DataPipelineApp.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/co/cask/cdap/datapipeline/SmartWorkflow.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/test/java/co/cask/cdap/datapipeline/DataPipelineTest.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/pom.xml (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/BatchPhaseSpec.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/CompositeFinisher.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/ETLBatchApplication.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/ETLWorkflow.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/Finisher.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/mapreduce/ETLMapReduce.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/AbstractSparkBatchContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/BasicSparkExecutionPluginContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/BasicSparkPluginContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/DatasetInfo.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/ETLSpark.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/ETLSparkProgram.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/Serializations.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/SparkAggregatorContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/SparkBatchRuntimeContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/SparkBatchSinkContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/SparkBatchSinkFactory.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/SparkBatchSourceContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/SparkBatchSourceFactory.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/spark/SparkTransformExecutorFactory.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/test/java/co/cask/cdap/etl/batch/BatchPhaseSpecTest.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/batch/BatchPhaseSpec.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/batch/BatchPipelineSpec.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/batch/BatchPipelineSpecGenerator.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/CompositeFinisher.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/Finisher.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/PipelinePhase.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/TransformingEmitter.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/planner/PipelinePlanner.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/planner/StageInfo.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/test/java/co/cask/cdap/etl/planner/PipelinePlannerTest.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/pom.xml (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/NoLookupProvider.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/SparkPipelineDriver.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/AbstractSparkBatchContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/BasicSparkExecutionPluginContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/BasicSparkPluginContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/BatchSparkPipelineDriver.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/DatasetInfo.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/ETLSpark.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/Serializations.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/SparkAggregatorContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/SparkBatchRuntimeContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/SparkBatchSinkContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/SparkBatchSinkFactory.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/SparkBatchSourceContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/batch/SparkBatchSourceFactory.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/AggregatorAggregateFunction.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/AggregatorGroupByFunction.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/BatchSinkFunction.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/BatchSourceFunction.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/PluginFunctionContext.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/hydrator-spark-core/src/main/java/co/cask/cdap/etl/spark/function/TransformFunction.java (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
    • cdap-app-templates/cdap-etl/pom.xml (version adbe8850f5e14dae21bb65e53586048b6bc3f2dd)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> bb539a6afedcf0c3a06a2e19085e83b2f6592ac4

    Merge pull request #6076 from caskdata/feature/remote-sysop-scale
    Scaling RemoteSystemOperation handlers using DatasetOpExecutorTwillRunnable

  • Gokul Gunasekaran

    Gokul Gunasekaran 2c6b1dd4b68746c0537ff435b95c3d15fc010215

    Scaling RemoteSystemOperations by creating a new Guava service and start it in DatasetOpExecutorTwillRunnable
    Should not be public-routable, used only through RemoteOpsClient

    Add AuthModule to the DatasetOpTwillRunnable's injector since RemotePrivlege handler needs it

    Adding RemoteSystemOp to system service status endpoint

    Missed Inject annotation

    Addressed comments

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/AppFabricServiceRuntimeModule.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteSystemOperationsService.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteSystemOperationsServiceModule.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/remote/RemoteOpsClient.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/http/AppFabricTestBase.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/RemoteLineageWriterTest.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/RemotePrivilegesFetcherTest.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/RemoteRuntimeStoreTest.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/RemoteRuntimeUsageRegistryTest.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/remote/RemoteLineageWriterTest.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/remote/RemotePrivilegesFetcherTest.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/remote/RemoteRuntimeStoreTest.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/remote/RemoteRuntimeUsageRegistryTest.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/guice/AppFabricTestModule.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-common/src/main/resources/cdap-default.xml (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/datafabric/dataset/RemoteSystemOperationServiceManager.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/DatasetOpExecutorServerTwillRunnable.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
    • cdap-standalone/src/main/java/co/cask/cdap/StandaloneMain.java (version 2c6b1dd4b68746c0537ff435b95c3d15fc010215)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> f9469075548f577287ac9b4052e704f315ff7b50

    CDAP-6154 Custom Namespace Mapping for Filesystem (#6009)

    • cdap-app-fabric-tests/pom.xml (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/pom.xml (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/DistributedProgramRunnableModule.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/runtime/scheduler/SchedulerQueueResolver.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/NamespaceHttpHandler.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/namespace/AbstractStorageProviderNamespaceAdmin.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/namespace/DefaultNamespaceAdmin.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/namespace/DistributedStorageProviderNamespaceAdmin.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/namespace/LocalStorageProviderNamespaceAdmin.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/artifact/ArtifactStore.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/PropertiesResolver.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/deploy/pipeline/ProgramGenerationStageTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/namespace/DefaultNamespaceAdminTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/namespace/StorageProviderNamespaceAdminTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/schedule/store/DatasetBasedTimeScheduleStoreTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/http/handlers/NamespaceHttpHandlerTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/http/handlers/ProgramLifecycleHttpHandlerTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/guice/AppFabricTestModule.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/test/java/co/cask/cdap/metadata/SystemMetadataKafkaPublishTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-app-fabric/src/test/java/co/cask/cdap/runtime/OpenCloseDataSetTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-common/src/main/java/co/cask/cdap/common/namespace/DefaultNamespacedLocationFactory.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-common/src/main/java/co/cask/cdap/common/namespace/guice/NamespaceClientRuntimeModule.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-common/src/test/java/co/cask/cdap/common/guice/LocationUnitTestModule.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-common/src/test/java/co/cask/cdap/common/namespace/DefaultNamespacedLocationFactoryTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-common/src/test/java/co/cask/cdap/common/namespace/NamespacedLocationFactoryTestClient.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/pom.xml (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data/stream/DFSStreamFileJanitorTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data/stream/DistributedStreamCoordinatorClientTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data/stream/InMemoryStreamCoordinatorClientTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data/stream/LocalStreamFileJanitorTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data/stream/StreamFileJanitorTestBase.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data/stream/service/DFSConcurrentStreamWriterTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data/stream/service/DFSStreamHeartbeatsTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data/stream/service/LocalConcurrentStreamWriterTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data/stream/service/StreamFileSizeFetcherTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/dataset2/lib/table/hbase/HBaseMetricsTableTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/transaction/distributed/TransactionServiceClientTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/transaction/distributed/TransactionServiceTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/transaction/stream/hbase/HBaseConsumerStateTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/transaction/stream/hbase/HBaseFileStreamAdminTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/transaction/stream/hbase/HBaseStreamConsumerTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/transaction/stream/leveldb/LevelDBFileStreamAdminTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/transaction/stream/leveldb/LevelDBStreamConsumerStateTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric-tests/src/test/java/co/cask/cdap/data2/transaction/stream/leveldb/LevelDBStreamConsumerTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/pom.xml (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data/stream/StreamFileJanitor.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/datafabric/dataset/service/DatasetInstanceService.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/datafabric/dataset/service/DatasetService.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/datafabric/dataset/service/DatasetTypeHandler.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/api/dataset/lib/SystemDatasetDefinitionTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data/view/MDSViewStoreTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/datafabric/dataset/RemoteDatasetFrameworkTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/datafabric/dataset/service/DatasetServiceTestBase.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/datafabric/dataset/service/executor/DatasetOpExecutorServiceTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/dataset2/AbstractDatasetFrameworkTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/dataset2/DatasetFrameworkTestUtil.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/dataset2/lib/table/inmemory/InMemoryMetricsTableTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/dataset2/lib/table/leveldb/LevelDBMetricsTableTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/dataset2/lib/table/leveldb/LevelDBTableServiceTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/dataset2/lib/table/leveldb/LevelDBTableTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/transaction/queue/LocalQueueTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/transaction/queue/hbase/HBaseQueueTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/transaction/queue/inmemory/InMemoryQueueTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/transaction/queue/leveldb/LevelDBQueueTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-explore/pom.xml (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/BaseHiveExploreService.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/Hive12CDH5ExploreService.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/Hive12ExploreService.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/Hive13ExploreService.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-explore/src/main/java/co/cask/cdap/explore/service/hive/Hive14ExploreService.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-explore/src/test/java/co/cask/cdap/explore/service/BaseHiveExploreServiceTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-explore/src/test/java/co/cask/cdap/explore/service/ExploreDisabledTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-explore/src/test/java/co/cask/cdap/explore/service/HiveExploreServiceTestRun.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-explore/src/test/java/co/cask/cdap/explore/service/InMemoryExploreServiceTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-gateway/pom.xml (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-gateway/src/main/java/co/cask/cdap/gateway/router/RouterMain.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-gateway/src/test/java/co/cask/cdap/gateway/handlers/metrics/MetricsSuiteTestBase.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-master/pom.xml (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/DatasetOpExecutorServerTwillRunnable.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/ExploreServiceTwillRunnable.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/StreamHandlerRunnable.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/TransactionServiceTwillRunnable.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/DataMigration.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/DatasetServiceManager.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-notifications/pom.xml (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-notifications/src/test/java/co/cask/cdap/notifications/NotificationTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-proto/src/main/java/co/cask/cdap/proto/NamespaceConfig.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-proto/src/main/java/co/cask/cdap/proto/NamespaceMeta.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-watchdog/pom.xml (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/run/LogSaverTwillRunnable.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-watchdog/src/main/java/co/cask/cdap/metrics/runtime/MetricsProcessorTwillRunnable.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-watchdog/src/main/java/co/cask/cdap/metrics/runtime/MetricsTwillRunnable.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-watchdog/src/test/java/co/cask/cdap/logging/KafkaTestBase.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-watchdog/src/test/java/co/cask/cdap/logging/appender/TestResilientLogging.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-watchdog/src/test/java/co/cask/cdap/logging/appender/file/TestFileLogging.java (version f9469075548f577287ac9b4052e704f315ff7b50)
    • cdap-watchdog/src/test/java/co/cask/cdap/logging/write/LogCleanupTest.java (version f9469075548f577287ac9b4052e704f315ff7b50)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 1c40bfcb517d5f096979a06ab81d9e2284bbddcd

    Merge pull request #6019 from caskdata/feature/ui-new-log-viewer-integration
    [CDAP-6174] Feature/ui new log viewer integration

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 70eccded81acd46af13ae9e8c1f7b824c4e6ee96

    (CDAP-6127) set default bind port to 0 for tx service (#6078)

    • cdap-common/src/main/resources/cdap-default.xml (version 70eccded81acd46af13ae9e8c1f7b824c4e6ee96)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 7d9e41554f80924187548899bf335b471e06226f

    Merge pull request #6074 from caskdata/feature/ui-top-panel-hydrator++-9
    Feature/ui top panel hydrator++ 9

  • Bhooshan Mogal

    Bhooshan Mogal 5f0dc4f18f5ce19969253de5dceae17d8f57044f

    Moved default implementations of enforce and filter to AbstractAuthorizer

    • cdap-security-spi/src/main/java/co/cask/cdap/security/spi/authorization/AbstractAuthorizer.java (version 5f0dc4f18f5ce19969253de5dceae17d8f57044f)
    • cdap-security-spi/src/main/java/co/cask/cdap/security/spi/authorization/NoOpAuthorizer.java (version 5f0dc4f18f5ce19969253de5dceae17d8f57044f)
    • cdap-security/src/test/java/co/cask/cdap/security/authorization/AuthorizerInstantiatorTest.java (version 5f0dc4f18f5ce19969253de5dceae17d8f57044f)
    • cdap-security/src/test/java/co/cask/cdap/security/authorization/InMemoryAuthorizer.java (version 5f0dc4f18f5ce19969253de5dceae17d8f57044f)
  • Ajai Narayan

    Ajai Narayan 3e9d40928fae53a68014ae148a15238baf6ed4b7

    Fixes minor styling in top panel for run player

    • cdap-ui/app/features/hydratorplusplus/toppanel.less (version 3e9d40928fae53a68014ae148a15238baf6ed4b7)
  • Ajai Narayan

    Ajai Narayan 652cbea38993d32f0e745ebfd61a967815b07793

    Minor code lint + fetches average run time & next run time for an initial value and then starts polling for the same

    • cdap-ui/app/directives/my-pipeline-summary/my-pipeline-summary-ctrl.js (version 652cbea38993d32f0e745ebfd61a967815b07793)
    • cdap-ui/app/features/hydratorplusplus/controllers/detail/top-panel-ctrl.js (version 652cbea38993d32f0e745ebfd61a967815b07793)
  • Ajai Narayan

    Ajai Narayan 4c6b42c428254763740ae4f1d9e9ef36166357a5

    Adds run player dropdown. This will later have run time arguments that the user can enter to start/schedule a run in pipeline

    • cdap-ui/app/features/hydratorplusplus/controllers/detail/top-panel-ctrl.js (version 4c6b42c428254763740ae4f1d9e9ef36166357a5)
    • cdap-ui/app/features/hydratorplusplus/templates/detail/top-panel.html (version 4c6b42c428254763740ae4f1d9e9ef36166357a5)
    • cdap-ui/app/features/hydratorplusplus/toppanel.less (version 4c6b42c428254763740ae4f1d9e9ef36166357a5)
  • Ajai Narayan

    Ajai Narayan 4003bb610e412bbc2ff1f4b91bc636fb9a6af846

    Removes configuration & metrics controller & templates from bottom panel in published view

    • cdap-ui/app/features/hydratorplusplus/controllers/detail/bottom-panel-ctrl.js (version 4003bb610e412bbc2ff1f4b91bc636fb9a6af846)
    • cdap-ui/app/features/hydratorplusplus/controllers/detail/tabs/metrics-ctrl.js (version 4003bb610e412bbc2ff1f4b91bc636fb9a6af846)
    • cdap-ui/app/features/hydratorplusplus/controllers/detail/tabs/pipeline-config-tab-ctrl.js (version 4003bb610e412bbc2ff1f4b91bc636fb9a6af846)
    • cdap-ui/app/features/hydratorplusplus/templates/detail/tabs/configuration.html (version 4003bb610e412bbc2ff1f4b91bc636fb9a6af846)
    • cdap-ui/app/features/hydratorplusplus/templates/detail/tabs/metrics.html (version 4003bb610e412bbc2ff1f4b91bc636fb9a6af846)
  • Ajai Narayan

    Ajai Narayan 2eb142a79d5b3bb9d81fc82c528916c457062f8f

    Uses pipeline-export-modal for hydrator studio view to view and export pipeline config

    • cdap-ui/app/features/hydratorplusplus/controllers/create/toppanel-ctrl.js (version 2eb142a79d5b3bb9d81fc82c528916c457062f8f)
  • Ajai Narayan

    Ajai Narayan 289982220d6050858196e3a5b9e36cce25d1c7b6

    Fixes published pipeline to use pipeline-modal

    • cdap-ui/Gulpfile.js (version 289982220d6050858196e3a5b9e36cce25d1c7b6)
    • cdap-ui/app/features/hydratorplusplus/controllers/detail/top-panel-ctrl.js (version 289982220d6050858196e3a5b9e36cce25d1c7b6)
    • cdap-ui/app/features/hydratorplusplus/templates/detail/top-panel.html (version 289982220d6050858196e3a5b9e36cce25d1c7b6)
  • Ajai Narayan

    Ajai Narayan b35a249a33b441dc06d8b9567cec777fce610e89

    Adds pipelin export modal for viewing and exporting published pipelines

    • cdap-ui/app/services/pipeline-export-modal/pipeline-export-modal-template.html (version b35a249a33b441dc06d8b9567cec777fce610e89)
    • cdap-ui/app/services/pipeline-export-modal/pipeline-export-modal.js (version b35a249a33b441dc06d8b9567cec777fce610e89)
  • Ajai Narayan

    Ajai Narayan e2c5783fd835c9c3bc1ccf3d71f417771888695a

    Fixes hydratorplusplus top panel controller based on separating pipeline-summary directive

    • cdap-ui/app/features/hydratorplusplus/adapters.less (version e2c5783fd835c9c3bc1ccf3d71f417771888695a)
    • cdap-ui/app/features/hydratorplusplus/controllers/detail/top-panel-ctrl.js (version e2c5783fd835c9c3bc1ccf3d71f417771888695a)
    • cdap-ui/app/features/hydratorplusplus/services/detail/actions/pipeline-detail-actions.js (version e2c5783fd835c9c3bc1ccf3d71f417771888695a)
    • cdap-ui/app/services/hydrator/my-pipeline-detailed-common-api.js (version e2c5783fd835c9c3bc1ccf3d71f417771888695a)
  • Ajai Narayan

    Ajai Narayan bbfeacb3632c2067bbf4cc2bdff2834cc3ae7923

    Removes un-used templates in hydratorplusplus

    • cdap-ui/app/features/hydratorplusplus/templates/detail/tabs/instance.html (version bbfeacb3632c2067bbf4cc2bdff2834cc3ae7923)
    • cdap-ui/app/features/hydratorplusplus/templates/detail/tabs/schedule.html (version bbfeacb3632c2067bbf4cc2bdff2834cc3ae7923)
    • cdap-ui/app/features/hydratorplusplus/templates/detail/top-panel.html (version bbfeacb3632c2067bbf4cc2bdff2834cc3ae7923)
    • cdap-ui/app/features/hydratorplusplus/templates/partial/error-template.html (version bbfeacb3632c2067bbf4cc2bdff2834cc3ae7923)
  • Ajai Narayan

    Ajai Narayan 789e6d022ac1b97c25d3fe7111687c8cdab7524f

    Moves polling/requests as part of the pipeline summary to the respective directives

    • cdap-ui/app/directives/my-pipeline-summary/my-pipeline-summary-ctrl.js (version 789e6d022ac1b97c25d3fe7111687c8cdab7524f)
    • cdap-ui/app/directives/my-pipeline-summary/my-pipeline-summary.js (version 789e6d022ac1b97c25d3fe7111687c8cdab7524f)
  • Ajai Narayan

    Ajai Narayan 29a8bb0fd51feb9cb14ffe434140b37138402fb3

    Adds history + summary cards to top panel

    • cdap-ui/app/directives/my-pipeline-summary/my-pipeline-summary-ctrl.js (version 29a8bb0fd51feb9cb14ffe434140b37138402fb3)
    • cdap-ui/app/directives/my-pipeline-summary/my-pipeline-summary.html (version 29a8bb0fd51feb9cb14ffe434140b37138402fb3)
    • cdap-ui/app/directives/my-pipeline-summary/my-pipeline-summary.less (version 29a8bb0fd51feb9cb14ffe434140b37138402fb3)
    • cdap-ui/app/lib/global-lib.js (version 29a8bb0fd51feb9cb14ffe434140b37138402fb3)
  • Ajai Narayan

    Ajai Narayan af520534a0d463518cff9fe5eea9ba2705d616b2

    Removes history tab from bottom panel & adds my-pipeline-summary to top panel

    • cdap-ui/Gulpfile.js (version af520534a0d463518cff9fe5eea9ba2705d616b2)
    • cdap-ui/app/features/hydratorplusplus/templates/detail/tabs/history.html (version af520534a0d463518cff9fe5eea9ba2705d616b2)
    • cdap-ui/app/features/hydratorplusplus/templates/detail/top-panel.html (version af520534a0d463518cff9fe5eea9ba2705d616b2)
  • Ajai Narayan

    Ajai Narayan b1f88fe20ceccad2a402ec1cbd6144591a1eac6f

    Removes history controller from hydrator detailed view

    • cdap-ui/app/features/hydratorplusplus/controllers/detail/bottom-panel-ctrl.js (version b1f88fe20ceccad2a402ec1cbd6144591a1eac6f)
    • cdap-ui/app/features/hydratorplusplus/controllers/detail/tabs/history-ctrl.js (version b1f88fe20ceccad2a402ec1cbd6144591a1eac6f)
    • cdap-ui/app/features/hydratorplusplus/controllers/detail/top-panel-ctrl.js (version b1f88fe20ceccad2a402ec1cbd6144591a1eac6f)
  • Ajai Narayan

    Ajai Narayan ffc11a1b9fc0e80aa931e6396bf2afcdbc64e33d

    Adds my-pipeline-summar directive for top panel in hydrator

    • cdap-ui/app/directives/my-pipeline-summary/my-pipeline-summary-ctrl.js (version ffc11a1b9fc0e80aa931e6396bf2afcdbc64e33d)
    • cdap-ui/app/directives/my-pipeline-summary/my-pipeline-summary.html (version ffc11a1b9fc0e80aa931e6396bf2afcdbc64e33d)
    • cdap-ui/app/directives/my-pipeline-summary/my-pipeline-summary.js (version ffc11a1b9fc0e80aa931e6396bf2afcdbc64e33d)
    • cdap-ui/app/directives/my-pipeline-summary/my-pipeline-summary.less (version ffc11a1b9fc0e80aa931e6396bf2afcdbc64e33d)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 7ca64082bb112e253a6dc5ba6dae1439679d737d

    Merge pull request #5979 from caskdata/feature/ui-fix-numberwidget-hydrator++
    [CDAP-6349] - Fixes number widget to honor max & min values from widget json

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 0faf9a1361e9e9c07472c9612f77d0d15493a3d5

    Merge pull request #6073 from caskdata/feature/auth-enforcer-changes
    (CDAP-6516) Added a filter method to AuthorizationEnforcer, that can …

  • Bhooshan Mogal

    Bhooshan Mogal b19739dc6aa4b0a1754d3428095f0fb6cc011867

    (CDAP-6516) Added a filter method to AuthorizationEnforcer, that can be used in any list/get API. This method filters the input set of entities to only return the ones that the user has access to. Also added a method to enforce multiple actions on the same entity.

    • cdap-client/src/main/java/co/cask/cdap/client/AuthorizationClient.java (version b19739dc6aa4b0a1754d3428095f0fb6cc011867)
    • cdap-security-spi/src/main/java/co/cask/cdap/security/spi/authorization/AuthorizationEnforcer.java (version b19739dc6aa4b0a1754d3428095f0fb6cc011867)
    • cdap-security-spi/src/main/java/co/cask/cdap/security/spi/authorization/NoOpAuthorizer.java (version b19739dc6aa4b0a1754d3428095f0fb6cc011867)
    • cdap-security-spi/src/main/java/co/cask/cdap/security/spi/authorization/UnauthorizedException.java (version b19739dc6aa4b0a1754d3428095f0fb6cc011867)
    • cdap-security/src/main/java/co/cask/cdap/security/authorization/DefaultAuthorizationEnforcementService.java (version b19739dc6aa4b0a1754d3428095f0fb6cc011867)
    • cdap-security/src/test/java/co/cask/cdap/security/authorization/AuthorizerInstantiatorTest.java (version b19739dc6aa4b0a1754d3428095f0fb6cc011867)
    • cdap-security/src/test/java/co/cask/cdap/security/authorization/DefaultAuthorizationEnforcementServiceTest.java (version b19739dc6aa4b0a1754d3428095f0fb6cc011867)
    • cdap-security/src/test/java/co/cask/cdap/security/authorization/InMemoryAuthorizer.java (version b19739dc6aa4b0a1754d3428095f0fb6cc011867)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 49a0f359f3d6dbdb3a92a76f250ba59e6d843abc

    (CDAP-6337) Exclude asm dependency in deploy pom (#6077)

    • cdap-examples/deploy_pom.xml (version 49a0f359f3d6dbdb3a92a76f250ba59e6d843abc)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 96140ed8183f6f8be70d7ab884e26a1ce77c4354

    Merge pull request #6035 from caskdata/feature/ui-top-panel-hydrator++-6
    Feature/ui top panel hydrator++ 6

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> d35d9611da333fde0f882bd04cf510e20859c1b2

    Merge pull request #6070 from caskdata/CDAP-6317-remove-debugging-output
    [CDAP-6317]: remove Log.Warn that printed out all configs in KafkaServerMain

  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> a9fa9e465d21593755db133cd0c5a70539df6d8a

    adds conditional truth meter info icon

    • cdap-ui/app/features/tracker/directives/truth-meter/truth-meter.html (version a9fa9e465d21593755db133cd0c5a70539df6d8a)
    • cdap-ui/app/features/tracker/directives/truth-meter/truth-meter.js (version a9fa9e465d21593755db133cd0c5a70539df6d8a)
    • cdap-ui/app/features/tracker/directives/truth-meter/truth-meter.less (version a9fa9e465d21593755db133cd0c5a70539df6d8a)
    • cdap-ui/app/features/tracker/templates/entity.html (version a9fa9e465d21593755db133cd0c5a70539df6d8a)
    • cdap-ui/app/features/tracker/tracker.less (version a9fa9e465d21593755db133cd0c5a70539df6d8a)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 72b3502d343210055941efb81e89ed42e1228d96

    Merge pull request #6064 from caskdata/feature/CDAP-6507-fix-hydrator-phase-splitting
    CDAP-6507 fix hydrator phase splitting bug

  • Chris Lu

    Chris Lu 5671aa5eb48e2e416c91d07069c2968325916f9f

    remove Log.Warn that printed out all configs in KafkaServerMain

    • cdap-kafka/src/main/java/co/cask/cdap/kafka/run/KafkaServerMain.java (version 5671aa5eb48e2e416c91d07069c2968325916f9f)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 13610d80984535738245485a094c2d36eee7b7c8

    Merge pull request #6053 from caskdata/feature/ui-tracker-change-min-datasets-number
    lowers min number of datasets from 3 to 1

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 36920e9738e79fb7d09381e4fe6dfc5eefb41c9e

    Merge pull request #6056 from caskdata/feature/ui-fix-usage-active-tab
    highlights Search tab when in usage state

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> def2d043ccc84e707fc35183ef48ee2a6d4d26cd

    Merge pull request #6055 from caskdata/feature/ui-styling-tracker-jump-button
    changes initial background color

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 00a7c49017c80600ae527b4fb437f8eeee4c8dd0

    CDAP-6507 fix bug with dag splitting on simple case
    Fix a bug where we try to add a dag without any nodes during
    dag splitting.

    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/planner/ConnectorDag.java (version 00a7c49017c80600ae527b4fb437f8eeee4c8dd0)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 466c4520528f3347bd244075ab1d59368a2d87a4

    Merge pull request #6038 from caskdata/feature/CDAP-6168-ds-read-write
    (CDAP-6168) Includes all program options during program execution

  • Terence Yim

    Terence Yim 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c

    (CDAP-6168) Includes all program options during program execution
    - Preserves all program options
      - Needed so that all artifact information and runtime information
        can easily accessible
      - Serialize the program options for MapReduce and Spark
    - Expose the artifact information from AbstractContext
    - Refactor the AbstractContext hierarchy
      - Every program context now extends from AbstractContext
    - Cleanup AbstractContext sub-classes to remove code duplication and
      proper common implmentation
    - Simplify sub-class implementation
    - Unify RunId construction from ProgramOptions

    • cdap-api/src/main/java/co/cask/cdap/api/workflow/WorkflowContext.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric-tests/src/test/java/co/cask/cdap/runtime/WorkflowTest.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/runtime/AbstractProgramRuntimeService.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/runtime/ProgramOptions.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/stream/DefaultStreamWriter.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/stream/StreamWriterFactory.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/AbstractContext.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/ProgramRunners.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/BasicMapReduceContext.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/BasicMapReduceTaskContext.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/MapReduceClassLoader.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/MapReduceContextConfig.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/MapReduceProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/MapReduceRuntimeService.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/MapReduceTaskContextProvider.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/customaction/BasicCustomActionContext.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/AbstractDistributedProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedFlowProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedMapReduceProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedServiceProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedWebappProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedWorkerProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/DistributedWorkflowProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/flow/BasicFlowletContext.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/flow/ConsumerSupplier.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/flow/FlowProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/flow/FlowletProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/service/ServiceProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/service/http/BasicHttpServiceContext.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/webapp/WebappProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/worker/BasicWorkerContext.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/worker/InMemoryWorkerRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/worker/WorkerProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/workflow/BasicWorkflowContext.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/workflow/CustomActionExecutor.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/workflow/WorkflowDriver.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/workflow/WorkflowProgramInfo.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/workflow/WorkflowProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/BasicHttpServiceContextFactory.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ServiceHttpServer.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/AppFabricTestHelper.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/batch/MapReduceRunnerTestBase.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/worker/WorkerProgramRunnerTest.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/runtime/FlowTest.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/runtime/MultiConsumerTest.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/runtime/OpenCloseDataSetTest.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-proto/src/main/java/co/cask/cdap/proto/id/ProgramId.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkMetricsReporter.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeContext.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeContextConfig.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeContextProvider.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeUtils.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-spark-core/src/main/java/co/cask/cdap/app/runtime/spark/distributed/DistributedSparkProgramRunner.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
    • cdap-watchdog-api/src/main/java/co/cask/cdap/api/metrics/NoopMetricsContext.java (version 17ad2a3afa99813e373f79bb8b1c5fe36c9b131c)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 5e35516c373c69da491aaf30aba8f16e8164bad3

    CDAP-6507 fix hydrator phase splitting bug
    Fixed bugs with phase splitting introduced when we added support
    for multiple inputs. After that change, the previous algorithm
    of splitting the dag on connector nodes could result in subdags
    that contained multiple reduce nodes.

    Changed the algorithm to ensure that each subdag contains at most
    a single reduce node.

    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/planner/ConnectorDag.java (version 5e35516c373c69da491aaf30aba8f16e8164bad3)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/planner/Dag.java (version 5e35516c373c69da491aaf30aba8f16e8164bad3)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/planner/PipelinePlanner.java (version 5e35516c373c69da491aaf30aba8f16e8164bad3)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/test/java/co/cask/cdap/etl/planner/ConnectorDagTest.java (version 5e35516c373c69da491aaf30aba8f16e8164bad3)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/test/java/co/cask/cdap/etl/planner/DagTest.java (version 5e35516c373c69da491aaf30aba8f16e8164bad3)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 9e5197dd68561e15039ca0c8fa9548c7050a1848

    Merge pull request #6034 from caskdata/fix/ca-hydrator-api
    API changes and corresponding implementation in the DataPipelineApp for supporting Action plugin.

  • sagarkapare <sagar@cask.co>

    sagarkapare <sagar@cask.co> 8d0d62d6b28d7c8b3489473cfc09eadafd04581c

    CDAP-6502 API changes and corresponding implementation int the DataPipelineApp for supporting Action plugin.

    • cdap-api/src/main/java/co/cask/cdap/api/customaction/AbstractCustomAction.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-api/src/main/java/co/cask/cdap/api/customaction/CustomActionConfigurer.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-api/src/main/java/co/cask/cdap/api/customaction/CustomActionContext.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-api/src/main/java/co/cask/cdap/api/workflow/WorkflowConditionConfigurer.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-api/src/main/java/co/cask/cdap/api/workflow/WorkflowForkConfigurer.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/customaction/DefaultCustomActionConfigurer.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/workflow/DefaultWorkflowConditionConfigurer.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/workflow/DefaultWorkflowConfigurer.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/workflow/DefaultWorkflowForkConfigurer.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/workflow/WorkflowNodeCreator.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/co/cask/cdap/datapipeline/BranchProgramAdder.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/co/cask/cdap/datapipeline/SmartWorkflow.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/co/cask/cdap/datapipeline/TrunkProgramAdder.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/co/cask/cdap/datapipeline/WorkflowProgramAdder.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/test/java/co/cask/cdap/datapipeline/DataPipelineTest.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/etl/api/action/Action.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/etl/api/action/ActionContext.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/etl/api/action/SettableArguments.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/customaction/BasicActionContext.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/customaction/BasicSettableArguments.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/etl/batch/customaction/PipelineAction.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/PipelinePhase.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/planner/PipelinePlanner.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/spec/PipelineSpecGenerator.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/hydrator-test/src/main/java/co/cask/cdap/etl/mock/action/MockAction.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
    • cdap-app-templates/cdap-etl/hydrator-test/src/main/java/co/cask/cdap/etl/mock/test/HydratorTestBase.java (version 8d0d62d6b28d7c8b3489473cfc09eadafd04581c)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> b0144949f1bfb7c78419c98cbf61019e00e93665

    Merge pull request #6039 from caskdata/feature/plugininstantiator-macro-support
    [CDAP-6358] Implementation of PluginInstantiator and MacroParser

  • Kashif Nazir

    Kashif Nazir a96d68635474e03b784706958d001df16980e54c

    [CDAP-6358] Added MacroParser and PluginInstantiator macro support

    • cdap-api/src/main/java/co/cask/cdap/api/plugin/PluginConfig.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/DefaultPluginContext.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/plugin/MacroParser.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/plugin/PluginInstantiator.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/plugin/TrackingMacroEvaluator.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/plugins/test/TestPlugin.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/artifact/ArtifactRepositoryTest.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/plugin/MacroParserTest.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/plugin/TestMacroEvaluator.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/test/java/co/cask/cdap/etl/batch/ETLBatchRuntimeDatasetTest.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/DefaultMacroEvaluator.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-templates/cdap-etl/hydrator-test/src/main/java/co/cask/cdap/etl/mock/batch/MockRuntimeDatasetSink.java (version a96d68635474e03b784706958d001df16980e54c)
    • cdap-app-templates/cdap-etl/hydrator-test/src/main/java/co/cask/cdap/etl/mock/batch/MockRuntimeDatasetSource.java (version a96d68635474e03b784706958d001df16980e54c)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> defd7c47f11ef4dc30a0332e247f6e1f505f0d4e

    Merge pull request #6058 from caskdata/feature/hdinsight-cherry-pick-from-rel34
    Feature/hdinsight cherry pick from rel34

  • Derek Wood

    Derek Wood 6afd452cc20c521bd663b37e1dc5e9a207f227f1

    convert to 2-space indentation

    • cdap-distributions/src/hdinsight/createUiDef.json (version 6afd452cc20c521bd663b37e1dc5e9a207f227f1)
    • cdap-distributions/src/hdinsight/mainTemplate.json (version 6afd452cc20c521bd663b37e1dc5e9a207f227f1)
  • Derek Wood

    Derek Wood a7c96991d91b65ac12494020bbc7dc67f93d77dd

    rename to required mainTemplate.json

    • cdap-distributions/src/hdinsight/cdap-deploy.json (version a7c96991d91b65ac12494020bbc7dc67f93d77dd)
    • cdap-distributions/src/hdinsight/mainTemplate.json (version a7c96991d91b65ac12494020bbc7dc67f93d77dd)
  • Derek Wood

    Derek Wood 54d57b65856d812843d934060254815dbd03a20a

    condense json formatting to 1-line where appropriate

    • cdap-distributions/src/hdinsight/createUiDef.json (version 54d57b65856d812843d934060254815dbd03a20a)
  • Derek Wood

    Derek Wood f12d5f1cfb9194b7f7668787ae61c65d0d92969e

    initial createUiDef, restricting it to the latest HBase cluster version

    • cdap-distributions/src/hdinsight/createUiDef.json (version f12d5f1cfb9194b7f7668787ae61c65d0d92969e)
  • Derek Wood

    Derek Wood 41c4c097326864f27e48a6c72ece82440552848e

    cleanup

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version 41c4c097326864f27e48a6c72ece82440552848e)
  • Derek Wood

    Derek Wood 85bc1862353e437a6c83eb84ad7b50624a583220

    find and query host_components to determine shutdown status

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version 85bc1862353e437a6c83eb84ad7b50624a583220)
  • Derek Wood

    Derek Wood c5e2e4d282e2a9f152442a37f3f58f259cd7047a

    quote credentials for curl, in case of special chars in the password, due to eval

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version c5e2e4d282e2a9f152442a37f3f58f259cd7047a)
  • Derek Wood

    Derek Wood 7b223ca88ad0ad80dc5bdabed879fc3244007f2a

    fix json syntax in generated attributes for cdap-cli install

    • cdap-distributions/src/hdinsight/install.sh (version 7b223ca88ad0ad80dc5bdabed879fc3244007f2a)
  • Derek Wood

    Derek Wood 070e960c21d75751adfcc5a2f3fc13c2bb0e7b71

    fix indentation

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version 070e960c21d75751adfcc5a2f3fc13c2bb0e7b71)
  • Derek Wood

    Derek Wood 92aebc0d796c3380e27d095a9816931a12924294

    compare as integers per PR feedback

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version 92aebc0d796c3380e27d095a9816931a12924294)
  • Derek Wood

    Derek Wood a338ae5739ba6518d79e5260602ef311117783e1

    cleanup

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version a338ae5739ba6518d79e5260602ef311117783e1)
  • Derek Wood

    Derek Wood 9f3d29df2b5e4ab2ea83c8a16bd3b8fb5efa2578

    cleanly restart services by confirming all components stopped before starting

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version 9f3d29df2b5e4ab2ea83c8a16bd3b8fb5efa2578)
  • Derek Wood

    Derek Wood d173a5d04d1289ccd655c07822bd88019cafcd05

    consistent indentation

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version d173a5d04d1289ccd655c07822bd88019cafcd05)
  • Derek Wood

    Derek Wood aa257de59eb83c4616d097ff8b8cbea35cd2da27

    better context messages, cleanup

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version aa257de59eb83c4616d097ff8b8cbea35cd2da27)
  • Derek Wood

    Derek Wood e73926943d26d4e317d4737870c3d551fdd4ace6

    more appropriately named function

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version e73926943d26d4e317d4737870c3d551fdd4ace6)
  • Derek Wood

    Derek Wood ac68687294d2216b66c1fe861ebfd1d23ae299cc

    lots of cleanup per PR feedback

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version ac68687294d2216b66c1fe861ebfd1d23ae299cc)
  • Derek Wood

    Derek Wood 08074ae2b26639de466b3e59207f75d8daf16236

    cdap solution template for v2 marketplace

    • cdap-distributions/src/hdinsight/cdap-deploy.json (version 08074ae2b26639de466b3e59207f75d8daf16236)
  • Derek Wood

    Derek Wood c3bc7fa741743d4ff3e20fbec80bee44b4400c49

    configure tez for cdap

    • cdap-distributions/src/hdinsight/cdap-conf.json (version c3bc7fa741743d4ff3e20fbec80bee44b4400c49)
  • Derek Wood

    Derek Wood e5629647687cb9bb72e8fe271a3d4ff562d9884e

    ntp now provided by HDinsight

    • cdap-distributions/src/hdinsight/install.sh (version e5629647687cb9bb72e8fe271a3d4ff562d9884e)
  • Derek Wood

    Derek Wood 774e3b0cb737b34a5e5bac78e1523ca1bf99a9df

    need to specify version for cli install, otherwise could end up with mixed versions

    • cdap-distributions/src/hdinsight/install.sh (version 774e3b0cb737b34a5e5bac78e1523ca1bf99a9df)
  • Derek Wood

    Derek Wood e577149cba437bfd45f5e2e2533811500b232b17

    remove ambari connectivity, update cdap/chef versions

    • cdap-distributions/src/hdinsight/install.sh (version e577149cba437bfd45f5e2e2533811500b232b17)
  • Derek Wood

    Derek Wood 8a31f70d6509827f320d68e6c510910c16d682d7

    add script to obtain Ambari credentials, configure pageblob support, and restart required services

    • cdap-distributions/src/hdinsight/pageblob-configure.sh (version 8a31f70d6509827f320d68e6c510910c16d682d7)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> aa099f4dc4fd955a9a5be31dfafdcc73fa13fbe9

    Merge pull request #6037 from caskdata/feature/logicalStartTime-macro
    porting logical start time macro from hydrator-plugins repo

  • Shankar Selvam

    Shankar Selvam 6b0698a769934d8478f1d035dc56b9f97a306287

    CDAP-6357 porting logical start time macro from hydrator-plugins repo

    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/DefaultMacroEvaluator.java (version 6b0698a769934d8478f1d035dc56b9f97a306287)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/macro/LogicalStartTimeMacro.java (version 6b0698a769934d8478f1d035dc56b9f97a306287)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/etl/common/macro/TimeParser.java (version 6b0698a769934d8478f1d035dc56b9f97a306287)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/test/java/co/cask/cdap/etl/common/macro/LogicalStartTimeMacroTest.java (version 6b0698a769934d8478f1d035dc56b9f97a306287)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> 975f5a14033931da0e9a5606ec1115e5bb4890aa

    highlights Search tab when in usage state

    • cdap-ui/app/features/tracker/routes.js (version 975f5a14033931da0e9a5606ec1115e5bb4890aa)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> 7cc120f7477f5b69381ad06d20eb3fe629acecd1

    changes initial background color

    • cdap-ui/app/features/tracker/directives/jump/jump.less (version 7cc120f7477f5b69381ad06d20eb3fe629acecd1)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> b3121da7d127f5cad7dfe544c144b345480763c6

    lowers min number of datasets from 3 to 1

    • cdap-ui/app/features/tracker/controllers/main-ctrl.js (version b3121da7d127f5cad7dfe544c144b345480763c6)
    • cdap-ui/app/features/tracker/templates/main.html (version b3121da7d127f5cad7dfe544c144b345480763c6)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 5c32088fe19847bfa314bbff1713073a1a5faad2

    Merge pull request #6049 from caskdata/docs/3.5_fix_doc_build_10
    Fix cdap-default.xml and broken build.

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 79932caaa2cd525ac8ab3c377e087c35bf8b1306

    Merge pull request #6050 from caskdata/revert-6048-feature/datasetExecutor
    Revert "Fix the problem of RemoteDatasetOpExecutor doesn't respect configurable read timeout."

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 3ee0c4bdf37fb2240a8ef549768677fa12d1ebc6

    Revert "Fix the problem of RemoteDatasetOpExecutor doesn't respect configurable read timeout."

    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/datafabric/dataset/service/executor/RemoteDatasetOpExecutor.java (version 3ee0c4bdf37fb2240a8ef549768677fa12d1ebc6)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> bca6aa52ab5df2edb8929c77f58b36d7ce124a2c

    Merge pull request #6048 from caskdata/feature/datasetExecutor
    Fix the problem of RemoteDatasetOpExecutor doesn't respect configurable read timeout.

  • John Jackson

    John Jackson c6427836f4cef85118ad1ddf1fac4b69a4cf6248

    Fix cdap-default.xml and broken build.

    • cdap-common/src/main/resources/cdap-default.xml (version c6427836f4cef85118ad1ddf1fac4b69a4cf6248)
    • cdap-docs/admin-manual/build.sh (version c6427836f4cef85118ad1ddf1fac4b69a4cf6248)
  • Yue Gao <Yue@Casks-MacBook-3.local>

    Yue Gao <Yue@Casks-MacBook-3.local> 736dfb0f589f519eca58f597d18ef478a7d500c9

    From DEFAULT to http.client.connection.timeout.ms

    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/datafabric/dataset/service/executor/RemoteDatasetOpExecutor.java (version 736dfb0f589f519eca58f597d18ef478a7d500c9)

cdap-clients/develop

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 9ebd5582630bca1be869849f4b9b3ff46273d01f

    Merge pull request #82 from caskdata/feature/compatiable-with-early-python-logging
    Fix to be compatible with earlier version of python-logging

  • lumig242 <lumig242@gmail.com>

    lumig242 <lumig242@gmail.com> 846dce85d26ef408c8ff1a3ee75220731fadeacc

    Fix to be compatiable with earlier version of python-logging

    • cdap-authentication-clients/python/cdap_auth_client/abstract_authentication_client.py (version 846dce85d26ef408c8ff1a3ee75220731fadeacc)
    • cdap-authentication-clients/python/cdap_auth_client/basic_authentication_client.py (version 846dce85d26ef408c8ff1a3ee75220731fadeacc)