Build #315

Assembles repository and secondary assemblies from primary CDAP-BUT artifacts (DO NOT RUN THIS MANUALLY, RUN CDAP-BUT)

Build: #315 was successful Child of CDAP-BUT-1335

Code commits

CDAP

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 4494b2ac00f01e681898352d20eec26f0ff61b45

    Merge pull request #10121 from caskdata/feature/CDAP-13246-provisioner-failure-handling
    CDAP-13246 provisioner failure handling

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 4e7e05a90c82b704c9c7edac788c1dfad6a36cba

    CDAP-13246 provisioner failure handling
    Adding logic to handle failures during provisioning.

    When a RetryableProvisionException is thrown, the method will
    be retried up to a time limit. The time limit is hardcoded today,
    but will be configurable per profile later.
    Also added handling for scenarios where a cluster is request to
    be created, but when polling for status, the cluster returns a
    non-running status. In these scenarios, the cluster is usually
    deleted, then the create is retried.

    Also added logic to pick up tasks that were being executed while
    CDAP was shut down. Each task will store state about what it is
    about to do. If CDAP is shut down in the middle of a task, when
    it comes back up, it will scan the state store and re-create
    tasks that were in progress.

    Also some cleanup to state transition logic by moving it out of
    AppMetadataStore and into the respective ProgramRunStatus and
    ProgramRunClusterStatus enums.

    Fixing a bad test that relied on an invalid state transition, and
    adding a test to make sure we can't go from pending to completed.

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ProgramNotificationSubscriberService.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/AppMetadataStore.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ClusterInfo.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ClusterOp.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/DeprovisionTask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/NoOpProvisioningTask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisionTask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisionerDataset.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisionerNotifier.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisioningOp.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisioningService.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisioningTask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisioningTaskInfo.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisioningTaskKey.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/task/ClusterCreateSubtask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/task/ClusterDeleteSubtask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/task/ClusterInitializeSubtask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/task/ClusterPollSubtask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/task/DeprovisionTask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/task/EndSubtask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/task/ProvisionTask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/task/ProvisioningSubtask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/task/ProvisioningTask.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/test/java/co/cask/cdap/gateway/handlers/OperationsDashboardHttpHandlerTest.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/http/handlers/ProgramLifecycleHttpHandlerTest.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/AppMetadataStoreTest.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/provision/MockProvisioner.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/provision/ProvisioningServiceTest.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/co/cask/cdap/datapipeline/SmartWorkflow.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-common/src/main/java/co/cask/cdap/common/async/KeyedExecutor.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-common/src/main/java/co/cask/cdap/common/service/Retries.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-common/src/main/java/co/cask/cdap/common/service/RetryStrategies.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-proto/src/main/java/co/cask/cdap/proto/ProgramRunClusterStatus.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
    • cdap-proto/src/main/java/co/cask/cdap/proto/ProgramRunStatus.java (version 4e7e05a90c82b704c9c7edac788c1dfad6a36cba)
  • sagarkapare <sagarkapare@google.com>

    sagarkapare <sagarkapare@google.com> 1512b3fb9bc6afdfd853b3853359a536dc6707b1

    Merge pull request #10197 from caskdata/feature/CDAP-fll-info-update
    CDAP-13267 Added ability to get the fields associated with the destination endpoints and summary in both incoming and outgoing direction.

  • sagarkapare <sagarkapare@google.com>

    sagarkapare <sagarkapare@google.com> 3677835470b588659a528d4115510ab5f7cb38d7 m

    CDAP-13267 Added ability to get the fields associated with the destination endpoints and summary in both incoming and outgoing direction.

    • cdap-app-fabric/src/main/java/co/cask/cdap/lineage/field/EndPointField.java (version 3677835470b588659a528d4115510ab5f7cb38d7)
    • cdap-app-fabric/src/main/java/co/cask/cdap/lineage/field/FieldLineageInfo.java (version 3677835470b588659a528d4115510ab5f7cb38d7)
    • cdap-app-fabric/src/test/java/co/cask/cdap/lineage/field/FieldLineageInfoTest.java (version 3677835470b588659a528d4115510ab5f7cb38d7)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 322c0e83c6892554366c8611a5c66c6f519b0e25

    Merge pull request #10218 from caskdata/feature/CDAP-13573-sandbox-secure-storage
    CDAP-13573 configure sandbox with secure storage

  • Ajai <1452845+ajainarayanan@users.noreply.github.com>

    Ajai <1452845+ajainarayanan@users.noreply.github.com> 2a71c8e63297b7b9b6ddf78cd6cbf30ae8276a53

    Merge pull request #10219 from caskdata/bugfix_release-ui/update-yarn-lock-file
    Updates yarn.lock file for moment-timezone

  • sagarkapare <sagarkapare@google.com>

    sagarkapare <sagarkapare@google.com> 35d24c97b05090c736dd57a58c7b6375097c0b04

    Merge pull request #10186 from caskdata/feature/fll-javadoc-proto
    CDAP-13269 Javadoc for the proto classes for Field Level Lineage.

  • Ajai Narayan

    Ajai Narayan 15b3beaf77b288aa2ffdb50b536edab10185907e

    Updates yarn.lock file for moment-timezone

    • cdap-ui/yarn.lock (version 15b3beaf77b288aa2ffdb50b536edab10185907e)
  • Albert Shau <ashau@desktobert.svl.corp.google.com>

    Albert Shau <ashau@desktobert.svl.corp.google.com> b8512c409630a9bead49df672d6253b65a0264c5

    CDAP-13573 configure sandbox with secure storage
    Include configuration in the sandbox such that the secure store
    APIs will be available by default. Though secure storage is not
    really a concern in local development environments, users may
    still want to try out secure macros in the sandbox.

    • cdap-standalone/src/main/resources/cdap-security.xml (version b8512c409630a9bead49df672d6253b65a0264c5)
    • cdap-standalone/src/main/resources/cdap-site.xml (version b8512c409630a9bead49df672d6253b65a0264c5)
  • Ajai <1452845+ajainarayanan@users.noreply.github.com>

    Ajai <1452845+ajainarayanan@users.noreply.github.com> c738e24b9fed37cedf407b2b299b337db52c9b0e

    Merge pull request #10196 from caskdata/bugfix_release-ui/CDAP-13128
    [MMDS][CDAP-13128] UX fixes in experiment detailed view in MMDS

  • Ajai Narayan

    Ajai Narayan bfd89bf04afad66e23f4453cd3d5e49061e5eb79

    [MMDS][CDAP-13128] UX fixes in experiment detailed view in MMDS
     - Adds an option to specify tooltip text for CopyableId if the test to copy is too long
     - Adds a Copy to Clipboard for the directives in model
     - Adds the ability to hide tooltip on hover for copyableid component to show only the copied message:
     - Adds features count in features popover under model
     - Removes all references of "Deployed" info from experiments
     - Adds color range for experiment metrics bar chart in experiments detailed view
     - Adds color scheme for variable model status for pie chart in experiment detailed view
     - Modifies variables.scss to export colors to be used in js world
     - Modifies IconSVG to allow to accept style tag for cases when required in js world
     - Adds an alias for styles in cdap webpack config

    • cdap-ui/app/cdap/components/CopyableID/index.js (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/components/Experiments/DetailedView/ExperimentMetricsDropdown/ModelStatusesDistribution.js (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/components/Experiments/DetailedView/ExperimentMetricsDropdown/index.js (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/components/Experiments/DetailedView/MetricChartWithLegend/index.js (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/components/Experiments/DetailedView/ModelStatusIndicator/index.js (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/components/Experiments/DetailedView/ModelsTable/DetailedViewModelsTable.scss (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/components/Experiments/DetailedView/ModelsTable/index.js (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/components/Experiments/DetailedView/TopPanel/index.js (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/components/Experiments/ListView/ExperimentsListBarChart/index.js (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/components/Experiments/ListView/ListView.scss (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/components/Experiments/ListView/ListViewWrapper.js (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/components/IconSVG/index.js (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/app/cdap/styles/variables.scss (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
    • cdap-ui/webpack.config.cdap.js (version bfd89bf04afad66e23f4453cd3d5e49061e5eb79)
  • sagarkapare <sagarkapare@google.com>

    sagarkapare <sagarkapare@google.com> 7074b20a9f01f5fa0ff2bf30ec9d46e1fadc16dc m

    CDAP-13269 Javadoc for the proto classes for Field Level Lineage.

    • cdap-app-fabric/src/main/java/co/cask/cdap/metadata/LineageHandler.java (version 7074b20a9f01f5fa0ff2bf30ec9d46e1fadc16dc)
    • cdap-proto/src/main/java/co/cask/cdap/proto/metadata/lineage/DatasetField.java (version 7074b20a9f01f5fa0ff2bf30ec9d46e1fadc16dc)
    • cdap-proto/src/main/java/co/cask/cdap/proto/metadata/lineage/FieldLineageDetails.java (version 7074b20a9f01f5fa0ff2bf30ec9d46e1fadc16dc)
    • cdap-proto/src/main/java/co/cask/cdap/proto/metadata/lineage/FieldLineageSummary.java (version 7074b20a9f01f5fa0ff2bf30ec9d46e1fadc16dc)
    • cdap-proto/src/main/java/co/cask/cdap/proto/metadata/lineage/FieldLineageSummaryRecord.java (version 7074b20a9f01f5fa0ff2bf30ec9d46e1fadc16dc)
    • cdap-proto/src/main/java/co/cask/cdap/proto/metadata/lineage/FieldOperationInfo.java (version 7074b20a9f01f5fa0ff2bf30ec9d46e1fadc16dc)
    • cdap-proto/src/main/java/co/cask/cdap/proto/metadata/lineage/FieldOperationInput.java (version 7074b20a9f01f5fa0ff2bf30ec9d46e1fadc16dc)
    • cdap-proto/src/main/java/co/cask/cdap/proto/metadata/lineage/FieldOperationOutput.java (version 7074b20a9f01f5fa0ff2bf30ec9d46e1fadc16dc)
    • cdap-proto/src/main/java/co/cask/cdap/proto/metadata/lineage/ProgramFieldOperationInfo.java (version 7074b20a9f01f5fa0ff2bf30ec9d46e1fadc16dc)
  • Ajai <1452845+ajainarayanan@users.noreply.github.com>

    Ajai <1452845+ajainarayanan@users.noreply.github.com> d8409eedab28a614303d679053629e407ce81d1b

    Merge pull request #10208 from caskdata/bugfix_release-ui/CDAP-13536
    [CDAP-13536] CDAP UI Header and Footer Changes

  • Ajai Narayan

    Ajai Narayan 4ed39337d091e496282462679ff9139b5efe9913 m

    Asd'
    [CDAP-13536] CDAP UI Header and Footer Changes

     - Fixes footer to change copyright information
     - Removes 'Product Website' and 'Support' links from CDAP dropdown in header

    • cdap-ui/app/cdap/components/Footer/index.js (version 4ed39337d091e496282462679ff9139b5efe9913)
    • cdap-ui/app/cdap/components/Header/ProductDropdown/index.js (version 4ed39337d091e496282462679ff9139b5efe9913)
    • cdap-ui/app/cdap/main.js (version 4ed39337d091e496282462679ff9139b5efe9913)
    • cdap-ui/app/cdap/text/text-en.yaml (version 4ed39337d091e496282462679ff9139b5efe9913)
  • Tony Bach <tonybach@google.com>

    Tony Bach <tonybach@google.com> d8d4a24f5861569a29fa3d6786fe6fcd98447a0a

    Merge pull request #10210 from caskdata/feature-ui/CDAP-13471-dashboard-chart-table-improvements
    [CDAP-13471][CDAP-13520] Adds legends to runs chart, and other improvements in Reports

  • tonybach <tonybach@google.com>

    tonybach <tonybach@google.com> 81109863fe251d1e871b952a61dff99b276816b2

    [CDAP-13471][CDAP-13520] Adds legends to runs chart, and other improvements in Reports - Makes runs list grid sortable, and removes highlight on hovering over a row, since it's not clickable - Adds start time column to runs table, and uses it as the default column to sort by - Adds legends on x-axis and left-right y axes - Removes the runs list toggle, to always show runs list - Converts values to more user-friendly format, and changes last 24 hours btn color - Adds moment-timezone library to be able to show time zone on x-axis legend, and addresses code comments - Changes type selector checkbox color to blue, and adds colored circles next to statuses in runs table - Adds last updated label - Adds 'across # namespaces' label - Adds vertical separator between two dates - Disables last 24 hours once clicked on - Fixes sorting by status

    • cdap-ui/app/cdap/components/OpsDashboard/OpsDashboard.scss (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/OpsDashboardColors.scss (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/RunsGraph/Legends/index.js (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/RunsGraph/RunsGraph.scss (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/RunsGraph/ToggleRunsList.js (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/RunsGraph/TypeSelector/TypeSelector.scss (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/RunsGraph/TypeSelector/index.js (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/RunsGraph/graphRenderer.js (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/RunsGraph/index.js (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/RunsList/RunsList.scss (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/RunsList/index.js (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/store/ActionCreator.js (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/OpsDashboard/store/DashboardStore.js (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/components/SortableStickyGrid/index.js (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/app/cdap/text/text-en.yaml (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/package.json (version 81109863fe251d1e871b952a61dff99b276816b2)
    • cdap-ui/yarn.lock (version 81109863fe251d1e871b952a61dff99b276816b2)
  • Ajai <1452845+ajainarayanan@users.noreply.github.com>

    Ajai <1452845+ajainarayanan@users.noreply.github.com> e51b7b38837338f678e1ecdfa73086fa54cd0fe5

    Merge pull request #10202 from caskdata/bugfix_release-ui/mmds-ui-fix-add-model-btn
    [MMDS][CDAP-13547] Fix button label while creating experiment vs adding a model in MMDS

  • Ajai Narayan

    Ajai Narayan af82ea9fd05745f0d1210426f0b4c707a5f35017 m

    [MMDS][CDAP-13547] Fix button label while creating experiment vs adding a model in MMDS
     - Switch UnControlledPopover with Popover for addmodel/create experiment popover
     - Fixes the label for add model btn to show appropriate label while creating experiment vs adding a model
     - Fixes the title of the filebrowser while choosing a file to experiment with
     - Fixes setting active step while creating an experiment
     - Automatically open the popover when the user chooses a file and lands in dataprep UI

    • cdap-ui/app/cdap/components/DataPrepConnections/index.js (version af82ea9fd05745f0d1210426f0b4c707a5f35017)
    • cdap-ui/app/cdap/components/Experiments/CreateView/Popovers/ExperimentPopovers.scss (version af82ea9fd05745f0d1210426f0b4c707a5f35017)
    • cdap-ui/app/cdap/components/Experiments/CreateView/index.js (version af82ea9fd05745f0d1210426f0b4c707a5f35017)
    • cdap-ui/app/cdap/components/Experiments/store/createExperimentStore.js (version af82ea9fd05745f0d1210426f0b4c707a5f35017)
    • cdap-ui/app/cdap/components/FileBrowser/index.js (version af82ea9fd05745f0d1210426f0b4c707a5f35017)
  • Ajai <1452845+ajainarayanan@users.noreply.github.com>

    Ajai <1452845+ajainarayanan@users.noreply.github.com> e86f0f406260be9fcf766c975915530c0954f9f2

    Merge pull request #10200 from caskdata/bugfix_release-ui/CDAP-13383
    [MMDS][CDAP-13383] Fix directives representation for a model consistent

  • Ajai Narayan

    Ajai Narayan 2f48556cbe9f63ad0dad042d5431457009201281 m

    [MMDS][CDAP-13383] Fix directives representation for a model consistent
     - Shows hint of directives applied to a model. Giving it similar treatment to features under a model

    • cdap-ui/app/cdap/components/Experiments/DetailedView/ModelsTable/index.js (version 2f48556cbe9f63ad0dad042d5431457009201281)
  • Ajai <1452845+ajainarayanan@users.noreply.github.com>

    Ajai <1452845+ajainarayanan@users.noreply.github.com> f016a7a3a9977c955b18cb0668fcbe4e43983ef2

    Merge pull request #10199 from caskdata/bugfix_release-ui/CDAP-13385
    [MMDS][CDAP-13385] Improve representation of model metrics

  • Ajai Narayan

    Ajai Narayan 827d8b15677b366ca2b02879cba651dfdf390d62 m

    [MMDS][CDAP-13385] Improve representation of model metrics
     - Adds an aditional option to format decimal numbers to humanReadableNumber utility function
     - Formats large numbers shown as part of model metrics in experiment detailed view

    • cdap-ui/app/cdap/components/Experiments/DetailedView/ModelsTable/index.js (version 827d8b15677b366ca2b02879cba651dfdf390d62)
    • cdap-ui/app/cdap/services/helpers.js (version 827d8b15677b366ca2b02879cba651dfdf390d62)
  • Terence Yim <885032+chtyim@users.noreply.github.com>

    Terence Yim <885032+chtyim@users.noreply.github.com> 4221cdbc1357f71caa6a49eb8f36c7e6f24b9fa3

    Merge pull request #10188 from caskdata/feature/CDAP-13252-ssl-auth
    (CDAP-13252) Enabling two-ways HTTPS authentication for runtime monitor

  • Terence Yim

    Terence Yim b292165c036718dfca7137e323d85528b5e81085 m

    (CDAP-13252) Enable two-ways HTTPS authentication for runtime monitor

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/DistributedProgramContainerModule.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/batch/distributed/DistributedMapReduceTaskContextProvider.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/AbstractProgramTwillRunnable.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillPreparer.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillRunnerService.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/monitor/RuntimeMonitor.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/monitor/RuntimeMonitorClient.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/monitor/RuntimeMonitorServer.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisioningService.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/SecureKeyInfo.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-app-fabric/src/test/java/co/cask/cdap/app/runtime/monitor/RuntimeMonitorTest.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-common/src/main/java/co/cask/cdap/common/ssh/DefaultSSHSession.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-runtime-spi/src/main/java/co/cask/cdap/runtime/spi/ssh/SSHSession.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-security/src/main/java/co/cask/cdap/security/tools/KeyStores.java (version b292165c036718dfca7137e323d85528b5e81085)
    • cdap-spark-core-base/src/main/java/co/cask/cdap/app/runtime/spark/SparkRuntimeContextProvider.java (version b292165c036718dfca7137e323d85528b5e81085)
  • Terence Yim

    Terence Yim 03791536414877c780991204893b439eb8ec1cea m

    (CDAP-13252) Added HttpsEnabler helper class
    - Helps enabling HTTPS in various server and client usage context

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/monitor/RuntimeMonitorServer.java (version 03791536414877c780991204893b439eb8ec1cea)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/AppFabricServer.java (version 03791536414877c780991204893b439eb8ec1cea)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/StandaloneAppFabricServer.java (version 03791536414877c780991204893b439eb8ec1cea)
    • cdap-security/src/main/java/co/cask/cdap/security/tools/HttpsEnabler.java (version 03791536414877c780991204893b439eb8ec1cea)
    • cdap-security/src/main/java/co/cask/cdap/security/tools/KeyStores.java (version 03791536414877c780991204893b439eb8ec1cea)
    • cdap-security/src/main/java/co/cask/cdap/security/tools/SSLHandlerFactory.java (version 03791536414877c780991204893b439eb8ec1cea)
    • cdap-security/src/test/java/co/cask/cdap/security/tools/HttpsEnablerTest.java (version 03791536414877c780991204893b439eb8ec1cea)
    • cdap-security/src/test/java/co/cask/cdap/security/tools/KeyStoresTest.java (version 03791536414877c780991204893b439eb8ec1cea)
  • Terence Yim

    Terence Yim 0a7112e304289c9741a812d28f9990e06bf3cc45 m

    (CDAP-13252) Rename SSHKeyInfo to SecureKeyInfo
    - Allow the class to store all secure key related information instead of just SSH

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillRunnerService.java (version 0a7112e304289c9741a812d28f9990e06bf3cc45)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ClusterInfo.java (version 0a7112e304289c9741a812d28f9990e06bf3cc45)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/DefaultSSHContext.java (version 0a7112e304289c9741a812d28f9990e06bf3cc45)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/DeprovisionTask.java (version 0a7112e304289c9741a812d28f9990e06bf3cc45)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisionTask.java (version 0a7112e304289c9741a812d28f9990e06bf3cc45)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisionerNotifier.java (version 0a7112e304289c9741a812d28f9990e06bf3cc45)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisioningService.java (version 0a7112e304289c9741a812d28f9990e06bf3cc45)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/SSHKeyInfo.java (version 0a7112e304289c9741a812d28f9990e06bf3cc45)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/SecureKeyInfo.java (version 0a7112e304289c9741a812d28f9990e06bf3cc45)
  • Terence Yim

    Terence Yim db945466929dd288ebfc1860998be731e7dd2d3e m

    (CDAP-13252) Not to store private key in field
    - Use Supplier instead

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/distributed/remote/RemoteExecutionTwillRunnerService.java (version db945466929dd288ebfc1860998be731e7dd2d3e)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/DefaultSSHContext.java (version db945466929dd288ebfc1860998be731e7dd2d3e)
    • cdap-common/src/main/java/co/cask/cdap/common/ssh/SSHConfig.java (version db945466929dd288ebfc1860998be731e7dd2d3e)
    • cdap-common/src/test/java/co/cask/cdap/common/ssh/SSHSessionTest.java (version db945466929dd288ebfc1860998be731e7dd2d3e)