Build #360

Build: #360 was successful Child of CDAP-DRC-3722

Code commits

CDAP

  • vinishavyasa <CuriousVini@users.noreply.github.com>

    vinishavyasa <CuriousVini@users.noreply.github.com> 28cc919a6a3e869550ae2859629dc261566f7bc7

    Merge pull request #10005 from caskdata/feature/runtime-monitor-service
    Adding server for polling client

  • Vinisha Shah

    Vinisha Shah ebeab4624de399077a8d5402327ca5442ee33a60

    Adding server for polling client

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/handler/RuntimeHandler.java (version ebeab4624de399077a8d5402327ca5442ee33a60)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/monitor/MonitorConsumeRequest.java (version ebeab4624de399077a8d5402327ca5442ee33a60)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/monitor/RuntimeMonitor.java (version ebeab4624de399077a8d5402327ca5442ee33a60)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/RuntimeServer.java (version ebeab4624de399077a8d5402327ca5442ee33a60)
    • cdap-app-fabric/src/test/java/co/cask/cdap/app/runtime/monitor/RuntimeMonitorTest.java (version ebeab4624de399077a8d5402327ca5442ee33a60)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version ebeab4624de399077a8d5402327ca5442ee33a60)
    • cdap-common/src/main/resources/cdap-default.xml (version ebeab4624de399077a8d5402327ca5442ee33a60)
  • Tony Bach

    Tony Bach 12790a99f2a7f412c9982635e517d0409c8d007d

    Merge pull request #10026 from caskdata/feature-ui/CDAP-13242-new-admin-page
    [CDAP-13242] Implements new Administration page

  • Tony Bach

    Tony Bach 29da0085e11abe30f4c87aaea943a05638abd20a

    [CDAP-13242] Implements new Administration page - Adds Management & Config tabs, moves current content to Management tab, removes admin config section, and minor styling changes - Initializes Configuration tab content, and moves components around a bit - Removes streams count from namespace details page, and uses one fewer API - Implements Namespaces accordion - Implements System Compute Profiles section, adds profile create view at system level, and handles expanding accordion from higher component - Implements System Preferences accordion - Removes no longer used component after the design change - Extracts ViewAllLabel, and standardizes link colors - Fixes js error when closing set preference modal, and avoid opening namespace details page when closing preferences saved success banner

    • cdap-ui/app/cdap/components/AdminConfigurePane/AdminConfigurePane.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/AdminConfigurePane/HttpExecutorLink.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/AdminConfigurePane/ReloadSystemArtifacts.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/AdminConfigurePane/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/AdminOverviewPane/AdminOverviewPane.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminConfigTabContent/AdminConfigTabContent.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminConfigTabContent/NamespacesAccordion/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminConfigTabContent/ReloadSystemArtifacts.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminConfigTabContent/SystemPrefsAccordion/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminConfigTabContent/SystemProfilesAccordion/SystemProfilesAccordion.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminConfigTabContent/SystemProfilesAccordion/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminConfigTabContent/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminManagementTabContent/AdminManagementTabContent.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminManagementTabContent/PlatformsDetails/Genericdetails.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminManagementTabContent/PlatformsDetails/Genericdetails.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminManagementTabContent/PlatformsDetails/PlatformDetails.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminManagementTabContent/PlatformsDetails/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminManagementTabContent/ServicesTable/ServicesTable.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminManagementTabContent/ServicesTable/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/AdminManagementTabContent/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/Administration.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/PlatformsDetails/Genericdetails.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/PlatformsDetails/Genericdetails.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/PlatformsDetails/PlatformDetails.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/PlatformsDetails/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/ServicesTable/ServicesTable.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/ServicesTable/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Administration/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/CaskWizards/AddNamespace/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Cloud/Profiles/CreateView/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Cloud/Profiles/ListView/ListView.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Cloud/Profiles/ListView/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/FastAction/SetPreferenceAction/SetPreferenceModal.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/Header/ControlCenterDropdown/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/NamespaceDetails/ComputeProfiles/ComputeProfiles.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/NamespaceDetails/EntityCounts/EntityCounts.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/NamespaceDetails/EntityCounts/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/NamespaceDetails/NamespaceDetails.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/NamespaceDetails/Preferences/Preferences.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/NamespaceDetails/Preferences/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/NamespaceDetails/store/ActionCreator.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/NamespaceDetails/store/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/NamespaceDropdown/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/ViewAllLabel/ViewAllLabel.scss (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/components/ViewAllLabel/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/main.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/services/global-events.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/services/helpers.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/services/metadata-parser/index.js (version 29da0085e11abe30f4c87aaea943a05638abd20a)
    • cdap-ui/app/cdap/text/text-en.yaml (version 29da0085e11abe30f4c87aaea943a05638abd20a)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> d78ac02e7ae81f7f572dd20254db367280e19056

    Merge pull request #10033 from caskdata/copy-dataproc-config-correctly
    fix path for copying dataproc config

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 7cf16394698c814c85549a51365b6511cd05843b

    fix path for copying dataproc config

    • cdap-standalone/pom.xml (version 7cf16394698c814c85549a51365b6511cd05843b)
  • Terence Yim

    Terence Yim 04a05e819b16cddfbc479d62dc73220f2d231bcb

    Merge pull request #10031 from caskdata/feature/CDAP-13234-runtime-refactor
    (CDAP-13234) Emits workflow state information to TMS in distributed mode

  • Edwin Elia

    Edwin Elia f6ccabd13d1ed956923740ff95d17ce8dd4dc29b

    Merge pull request #10022 from caskdata/feature-ui/CDAP-12901-reports-detail
    [CDAP-12901] Add Reports detail page

  • Edwin Elia

    Edwin Elia c9b5d11246d93ea791bb0872a13657f771d197f0

    Add Reports detail page

    • cdap-ui/app/cdap/api/reports.js (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Home/index.js (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Reports/Reports.scss (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Reports/ReportsDetail/ReportsDetail.scss (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Reports/ReportsDetail/Runs/Runs.scss (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Reports/ReportsDetail/Runs/index.js (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Reports/ReportsDetail/Summary/Summary.scss (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Reports/ReportsDetail/Summary/index.js (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Reports/ReportsDetail/index.js (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Reports/ReportsList/ReportsList.scss (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Reports/ReportsList/index.js (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Reports/index.js (version c9b5d11246d93ea791bb0872a13657f771d197f0)
    • cdap-ui/app/cdap/components/Reports/store/ReportsStore.js (version c9b5d11246d93ea791bb0872a13657f771d197f0)
  • Ajai Narayan

    Ajai Narayan 3f67ff2a284ccd17354c870058614e6ac836a396

    Merge pull request #10025 from caskdata/feature-ui/CDAP-13208-cloud-5-pipeline-schedule-profiles
    [CDAP-13208] Allow users to add profiles to schedules in pipeline

  • Ajai Narayan

    Ajai Narayan 3d4f2486f00f0a995b36397ac133bfd456401211

    [CDAP-13208] Allow users to add profiles to schedules in pipeline
      - Adds initial implementation of PipelineScheduler to list profiles
      - Fixes PipelineScheduler to treat Pipeline schedule from backend as the source of truth + udpate schedule when user hits 'Save Schedule'
      - Fixes PipelineScheduler to work both in pipeline detailed view and pipeline studio (Hides Profiles list dropdown in pipeline studio)

    • cdap-ui/app/cdap/components/PipelineScheduler/AdvancedView.js (version 3d4f2486f00f0a995b36397ac133bfd456401211)
    • cdap-ui/app/cdap/components/PipelineScheduler/BasicView/IntervalOption.js (version 3d4f2486f00f0a995b36397ac133bfd456401211)
    • cdap-ui/app/cdap/components/PipelineScheduler/BasicView/index.js (version 3d4f2486f00f0a995b36397ac133bfd456401211)
    • cdap-ui/app/cdap/components/PipelineScheduler/PipelineScheduler.scss (version 3d4f2486f00f0a995b36397ac133bfd456401211)
    • cdap-ui/app/cdap/components/PipelineScheduler/ProfilesForSchedule/ProfilesForSchedule.scss (version 3d4f2486f00f0a995b36397ac133bfd456401211)
    • cdap-ui/app/cdap/components/PipelineScheduler/ProfilesForSchedule/index.js (version 3d4f2486f00f0a995b36397ac133bfd456401211)
    • cdap-ui/app/cdap/components/PipelineScheduler/Store/ActionCreator.js (version 3d4f2486f00f0a995b36397ac133bfd456401211)
    • cdap-ui/app/cdap/components/PipelineScheduler/Store/index.js (version 3d4f2486f00f0a995b36397ac133bfd456401211)
    • cdap-ui/app/cdap/components/PipelineScheduler/ViewContainer.js (version 3d4f2486f00f0a995b36397ac133bfd456401211)
    • cdap-ui/app/cdap/components/PipelineScheduler/index.js (version 3d4f2486f00f0a995b36397ac133bfd456401211)
  • Ajai Narayan

    Ajai Narayan 21229ecf9e3c3f02a75a3eedb45b4e1b163e4b71

    Merge pull request #10009 from caskdata/feature/ui-cloud-4-CDAP-13212
    [CDAP-13212] Adds Profile Preview for historical runs of pipelines.

  • Ajai Narayan

    Ajai Narayan c991f245d581bd2fec67bbb90e50c58999c2d155

    [CDAP-13212] Adds Profile Preview for historical runs of pipelines
      - Initial version of profile preview in pipeline detailed view for historical runs
      - Adds a generic mixin to add ellipsis to multiline text

    • cdap-ui/app/cdap/api/cloud.js (version c991f245d581bd2fec67bbb90e50c58999c2d155)
    • cdap-ui/app/cdap/components/Cloud/Profiles/Preview/Preview.scss (version c991f245d581bd2fec67bbb90e50c58999c2d155)
    • cdap-ui/app/cdap/components/Cloud/Profiles/Preview/index.js (version c991f245d581bd2fec67bbb90e50c58999c2d155)
    • cdap-ui/app/cdap/components/PipelineDetails/RunLevelInfo/RunComputeProfile/RunComputeProfile.scss (version c991f245d581bd2fec67bbb90e50c58999c2d155)
    • cdap-ui/app/cdap/components/PipelineDetails/RunLevelInfo/RunComputeProfile/index.js (version c991f245d581bd2fec67bbb90e50c58999c2d155)
    • cdap-ui/app/cdap/components/PipelineDetails/RunLevelInfo/index.js (version c991f245d581bd2fec67bbb90e50c58999c2d155)
    • cdap-ui/app/cdap/components/Popover/index.js (version c991f245d581bd2fec67bbb90e50c58999c2d155)
    • cdap-ui/app/cdap/components/RulesEngineHome/RuleBook/RuleBook.scss (version c991f245d581bd2fec67bbb90e50c58999c2d155)
    • cdap-ui/app/cdap/styles/fonts/symbol-defs_new.svg (version c991f245d581bd2fec67bbb90e50c58999c2d155)
    • cdap-ui/app/cdap/styles/mixins.scss (version c991f245d581bd2fec67bbb90e50c58999c2d155)
  • Terence Yim

    Terence Yim 428c96702fe1396dac23ef00321b9e76b518ca20

    (CDAP-13234) Emits Workflow state information to TMS in distributed mode
    - Also removed all classes related to the Remote option service

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/AppFabricServiceRuntimeModule.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/DistributedProgramRunnableModule.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/preview/PreviewRunnerModule.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/store/RuntimeStore.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/store/Store.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteRuntimeStoreHandler.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteSystemOperationsService.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteSystemOperationsServiceModule.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/workflow/BasicWorkflowStateWriter.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/workflow/MessagingWorkflowStateWriter.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/workflow/WorkflowDriver.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/workflow/WorkflowProgramRunner.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/workflow/WorkflowStateWriter.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/AppMetadataStore.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/DefaultStore.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/remote/RemoteRuntimeStore.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/main/java/co/cask/cdap/metadata/MetadataSubscriberService.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/preview/DefaultPreviewManagerTest.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/http/AppFabricTestBase.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/guice/AppFabricTestModule.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-app-fabric/src/test/java/co/cask/cdap/metadata/MetadataSubscriberServiceTest.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/datafabric/dataset/RemoteSystemOperationServiceManager.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/MetadataMessage.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-gateway/src/main/java/co/cask/cdap/gateway/router/RouterPathLookup.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-gateway/src/test/java/co/cask/cdap/gateway/router/RouterPathTest.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/DatasetOpExecutorServerTwillRunnable.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
    • cdap-standalone/src/main/java/co/cask/cdap/StandaloneMain.java (version 428c96702fe1396dac23ef00321b9e76b518ca20)
  • Terence Yim

    Terence Yim 0a5dacbfccee3aeea6f1e5474007372118ab3b32

    (CDAP-13234) Refactor to have the generic MetadataMessage to always contain ProgramId and an optional run id
    - Shared between different metadata type
    - Allow validation from the runtime monitor to make sure a program run won’t emit messages for another program run

    • cdap-app-fabric/src/main/java/co/cask/cdap/metadata/MetadataSubscriberService.java (version 0a5dacbfccee3aeea6f1e5474007372118ab3b32)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/DataAccessLineage.java (version 0a5dacbfccee3aeea6f1e5474007372118ab3b32)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/MessagingLineageWriter.java (version 0a5dacbfccee3aeea6f1e5474007372118ab3b32)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/MetadataMessage.java (version 0a5dacbfccee3aeea6f1e5474007372118ab3b32)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/registry/DatasetUsage.java (version 0a5dacbfccee3aeea6f1e5474007372118ab3b32)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/registry/MessagingUsageWriter.java (version 0a5dacbfccee3aeea6f1e5474007372118ab3b32)
  • Terence Yim

    Terence Yim c7aae08565cf19596fe9f9cc98c2baad994f7281

    Merge pull request #10029 from caskdata/feature/CDAP-13234-runtime-refactor
    (CDAP-13234) Emits dataset usage information to TMS in distributed mode

  • Terence Yim

    Terence Yim 27d44d54e35eabd409d410ad6a8f667a97ac6ebb

    (CDAP-13234) Emits dataset usage information to TMS in distributed mode
    Here are all the changes:
      - Cleanup and unify AppMetadataStore upgrade code
      - Refactor to use single topic for various metadata messages
        - Use single thread to poll for various metadata messages
        - We could shard to multiple topics in future when there are a lot of metadata changes
      - Rename RuntimeUsageRegistry to UsageWriter
      - Remove the useless TopicMessageIdStore interface

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/DistributedProgramRunnableModule.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/stream/DefaultStreamWriter.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteSystemOperationsServiceModule.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteUsageRegistryHandler.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/flow/ConsumerSupplier.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/flow/FlowletProgramRunner.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/messaging/TopicMessageIdStore.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/schedule/queue/JobQueueDataset.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ProgramNotificationSubscriberService.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/AppMetadataStore.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/DefaultStore.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/remote/RemoteRuntimeUsageRegistry.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/main/java/co/cask/cdap/metadata/MetadataSubscriberService.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/schedule/queue/JobQueueDatasetTest.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/ProgramNotificationSubscriberServiceTest.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/http/AppFabricTestBase.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/AppMetadataStoreTest.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/remote/RemoteRuntimeUsageRegistryTest.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/test/java/co/cask/cdap/metadata/LineageAdminTest.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-app-fabric/src/test/java/co/cask/cdap/metadata/MetadataSubscriberServiceTest.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-common/src/main/resources/cdap-default.xml (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data/runtime/DataSetsModules.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data/runtime/preview/PreviewDataModules.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/lineage/LineageDataset.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/BasicLineageWriter.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/LineageWriterDatasetFramework.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/MessagingLineageWriter.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/MetadataMessage.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/registry/BasicUsageRegistry.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/registry/DatasetUsage.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/registry/DefaultUsageRegistry.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/registry/MessagingUsageWriter.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/registry/RuntimeUsageRegistry.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/registry/UsageDataset.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/registry/UsageRegistry.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/registry/UsageWriter.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/transaction/stream/FileStreamAdmin.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/registry/UsageRegistryTest.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-docs/admin-manual/build.sh (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/UpgradeTool.java (version 27d44d54e35eabd409d410ad6a8f667a97ac6ebb)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 8e299a0a72f2d570aa9585f3a7ba84bc9d923078

    Merge pull request #10010 from caskdata/feature/CDAP-13096-record-cluster-state
    CDAP-13096 record program run cluster state

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 5bcf664d3dbdb1796103628513fc9474170799cd

    remove unneeded code

    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/program/MessagingProgramStateWriter.java (version 5bcf664d3dbdb1796103628513fc9474170799cd)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ProgramNotificationSubscriberService.java (version 5bcf664d3dbdb1796103628513fc9474170799cd)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 0e8160946c586be679e01f71b4f766b8c1e22736

    CDAP-13096 record program run cluster state
    Changing the state writer to listen for cluster state
    events on TMS and record the state change. Also adding some fixes
    for program state when a run goes from provisioning to deprovisioning
    or deprovisioned due to some failure in provisioning.

    Also remove startTime as an argument to the method for recording
    provisioning state since the start time is encoded in the runid.

    • cdap-app-fabric-tests/src/test/java/co/cask/cdap/internal/app/services/http/handlers/WorkflowStatsSLAHttpHandlerTest.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric-tests/src/test/java/co/cask/cdap/runtime/WorkflowTest.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/store/Store.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/program/MessagingProgramStateWriter.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/ProgramOptionConstants.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ProgramLifecycleService.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/services/ProgramNotificationSubscriberService.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/AppMetadataStore.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/DefaultStore.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/schedule/constraint/ConcurrencyConstraintTest.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/runtime/schedule/constraint/LastRunConstraintTest.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/ProgramNotificationSubscriberServiceTest.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/services/RunRecordCorrectorServiceTest.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/AppMetadataStoreTest.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/DefaultStoreTest.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/test/java/co/cask/cdap/metadata/LineageAdminTest.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-app-fabric/src/test/java/co/cask/cdap/scheduler/CoreSchedulerServiceTest.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-gateway/src/test/java/co/cask/cdap/gateway/handlers/log/MockLogReader.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-integration-test/src/main/java/co/cask/cdap/test/remote/RemoteApplicationManager.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-unit-test/src/main/java/co/cask/cdap/test/internal/DefaultApplicationManager.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-unit-test/src/test/java/co/cask/cdap/security/AuthorizationTest.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
    • cdap-unit-test/src/test/java/co/cask/cdap/test/app/TestFrameworkTestRun.java (version 0e8160946c586be679e01f71b4f766b8c1e22736)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 992a4d595dbe4ddbf33000d5bd8104fa414e20af

    Merge pull request #9991 from caskdata/feature/CDAP-13094-dataproc-provisioner
    CDAP-13094 add gce dataproc provisioner

  • Yaojie Feng

    Yaojie Feng 7b96973238c6ca5aa23d5474e5ddf073b8770932

    Merge pull request #10023 from caskdata/feature/add-provisioner-handler-imp
    add provisioner config imp

  • Yaojie Feng

    Yaojie Feng 1f05b3bb7044801022d3d83535f77dc63314fe46 m

    add provisioner config imp

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/AppFabricServiceRuntimeModule.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/ProfileHttpHandler.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/ProvisionerHttpHandler.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/profile/ProfileStore.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/DefaultProvisionerConfigProvider.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisionerConfig.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisionerConfigProvider.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisionerModule.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/provision/ProvisioningService.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/preview/DefaultPreviewManagerTest.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/profile/ProfileStoreTest.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/provision/MockProvisionerConfigProvider.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/provision/MockProvisionerModule.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/provision/ProvisioningServiceTest.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/MasterServiceMain.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-proto/src/main/java/co/cask/cdap/proto/profile/Profile.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-proto/src/main/java/co/cask/cdap/proto/profile/ProfileCreateRequest.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-proto/src/main/java/co/cask/cdap/proto/profile/ProvisionerInfo.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-proto/src/main/java/co/cask/cdap/proto/profile/ProvisionerPropertyValue.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-proto/src/main/java/co/cask/cdap/proto/provisioner/ProvisionerDetail.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-proto/src/main/java/co/cask/cdap/proto/provisioner/ProvisionerInfo.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-proto/src/main/java/co/cask/cdap/proto/provisioner/ProvisionerPropertyValue.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
    • cdap-standalone/src/main/java/co/cask/cdap/StandaloneMain.java (version 1f05b3bb7044801022d3d83535f77dc63314fe46)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> dff48b203697cff97bb76ffaac89cc9e1a0111ce

    Merge pull request #10021 from caskdata/feature/fix-unit-test-races
    deprecate and replace waitForStatus() calls in unit tests

  • Tony Bach

    Tony Bach c24c83f00a231d8a166f8ca201c17f319586a37a

    Merge pull request #10006 from caskdata/feature/ui-cdap-13236-update-keytab-uri
    [CDAP-13236] Allows editing of keytabURI of a namespace in UI

  • Tony Bach

    Tony Bach 1dd324ddb2707b69c77c0e1a527639a349908ebb

    [CDAP-13236] Allows editing of keytabURI of a namespace in UI - Adds Edit label, populates wizard when clicked on, and navigates to Security tab in wizard - Adds api to edit namespace when user clicks Finish in the wizard - Only allows editing of keytabURI if the specified some values for principal and keytabURI during namespace creation - Resets namespace wizard after finishing edit

    • cdap-ui/app/cdap/api/namespace.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/components/CaskWizards/AddNamespace/GeneralInfoStep/index.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/components/CaskWizards/AddNamespace/MappingStep/index.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/components/CaskWizards/AddNamespace/PreferencesStep/index.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/components/CaskWizards/AddNamespace/SecurityStep/index.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/components/CaskWizards/AddNamespace/index.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/components/KeyValuePairs/KeyValueStoreActions.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/components/NamespaceDetails/NamespaceDetails.scss (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/components/NamespaceDetails/Security/index.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/components/NamespaceDetails/store/ActionCreator.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/components/PipelineConfigurations/ConfigurationsContent/RuntimeArgsTabContent/index.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/components/Wizard/index.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/services/WizardStores/AddNamespace/ActionCreator.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/services/WizardStores/AddNamespace/AddNamespaceActions.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/services/WizardStores/AddNamespace/AddNamespaceStore.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
    • cdap-ui/app/cdap/services/helpers.js (version 1dd324ddb2707b69c77c0e1a527639a349908ebb)
  • Poorna Chandra

    Poorna Chandra bb4906d9f1d5e906e2db110b5a188ee1992491e9

    Merge pull request #10027 from caskdata/bugfix/CDAP-13281
    CDAP-13281 Fix Spark 2 delegation token issue by passing in credentials while saving an RDD

  • Sreevatsan Raman

    Sreevatsan Raman d5da901eff328f97d3d11d81e0103af67fe4c9e9

    Merge pull request #10028 from caskdata/feature/merge-release43-develop
    Feature/merge release43 develop

  • sreevatsanraman <sreevatsan@gmail.com>

    sreevatsanraman <sreevatsan@gmail.com> 9fae2069410f6b49f4e6ec471f6d2cc8743d0b36

    Resolve conflict

  • Terence Yim

    Terence Yim e7dfb1081446e9e43aeaad7b13ea4caf81de0dd6

    Merge pull request #10024 from caskdata/feature/CDAP-13234-runtime-refactor
    (CDAP-13234) Emits data access lineage to TMS in distributed mode

  • Poorna Chandra

    Poorna Chandra 4061b2c46c4f7173891edaa311ab60ae1cb31522

    CDAP-13281 Fix Spark 2 delegation token issue by passing in credentials while saving an RDD

    • cdap-spark-core2_2.11/src/main/scala/co/cask/cdap/app/runtime/spark/DefaultSparkExecutionContext.scala (version 4061b2c46c4f7173891edaa311ab60ae1cb31522)
  • Terence Yim

    Terence Yim 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9

    (CDAP-13234) Emits data access lineage to TMS in distributed mode
    - In distributed mode, lineage information are emitted to TMS instead of making remote call to master
    - Added MetadataSubscriberService for consuming from TMS and write to metadata
      - First started with lineage update. Other forms for metadata updates can be added here
    - Rename the LineageStore to DefaultLineageReader
      - Only retain the transactional read methods for LineageAdmin to use
    - All writing to LineageDataset is done with explicit transaction
      - BasicLineageWriter and the MetadataSubscriberService
    - Some code cleanup and refactoring of guice bindings and unit-tests

    • cdap-api-common/src/main/java/co/cask/cdap/api/common/Bytes.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/guice/DistributedProgramRunnableModule.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteLineageWriterHandler.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/meta/RemoteSystemOperationsServiceModule.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/store/remote/RemoteLineageWriter.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-app-fabric/src/main/java/co/cask/cdap/metadata/LineageAdmin.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-app-fabric/src/main/java/co/cask/cdap/metadata/MetadataSubscriberService.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-app-fabric/src/test/java/co/cask/cdap/internal/app/store/remote/RemoteLineageWriterTest.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-app-fabric/src/test/java/co/cask/cdap/metadata/LineageAdminTest.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-common/src/main/java/co/cask/cdap/common/conf/Constants.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-common/src/main/java/co/cask/cdap/common/service/Retries.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-common/src/main/resources/cdap-default.xml (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data/runtime/DataSetsModules.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data/runtime/preview/PreviewDataModules.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/audit/DefaultAuditPublisher.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/lineage/DefaultLineageStoreReader.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/lineage/LineageDataset.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/lineage/LineageStore.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/lineage/LineageStoreReader.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/lineage/LineageStoreWriter.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/BasicLineageWriter.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/DataAccessLineage.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/LineageWriter.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/metadata/writer/MessagingLineageWriter.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/main/java/co/cask/cdap/data2/transaction/metrics/TransactionManagerMetricsCollector.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/metadata/lineage/LineageDatasetTest.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-data-fabric/src/test/java/co/cask/cdap/data2/metadata/writer/BasicLineageWriterTest.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-docs/admin-manual/build.sh (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-master/src/main/java/co/cask/cdap/data/runtime/main/DatasetOpExecutorServerTwillRunnable.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-master/src/main/java/co/cask/cdap/data/tools/UpgradeTool.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-master/src/main/java/co/cask/cdap/master/startup/ConfigurationCheck.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
    • cdap-tms/src/main/java/co/cask/cdap/messaging/MessagingServices.java (version 5bdb601b6b25b8cc1f13ef7943707f9d3e07a6c9)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 633d8d777f561d0664eafc2e0dfc3b1af013e53d m

    look up cluster create time from an existing cluster

    • cdap-runtime-ext-dataproc/src/main/java/co/cask/cdap/runtime/spi/provisioner/dataproc/DataProcProvisioner.java (version 633d8d777f561d0664eafc2e0dfc3b1af013e53d)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 06e55efde55dd7f9d382c476bb2ed47663754fec m

    deprecate and replace waitForStatus() calls in unit tests
    This method is almost always subject to race conditions, where
    a program is starting but not yet running, and other parts of the
    unit test expect it to be running. The existing race conditions
    will become much more likely once the additional provisioning
    lifecycle stages are introduced, which causes programs to get to
    the running state a little slower now.

    • cdap-app-templates/cdap-data-quality/src/test/java/co/cask/cdap/dq/test/DataQualityAppTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/test/java/co/cask/cdap/datapipeline/DataPipelineTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/test/java/co/cask/cdap/datastreams/DataStreamsSparkSinkTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-app-templates/cdap-etl/cdap-data-streams/src/test/java/co/cask/cdap/datastreams/DataStreamsTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/DataCleansing/src/test/java/co/cask/cdap/examples/datacleansing/DataCleansingMapReduceTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/DecisionTreeRegression/src/test/java/co/cask/cdap/examples/dtree/DecisionTreeRegressionAppTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/FileSetExample/src/test/java/co/cask/cdap/examples/fileset/FileSetWordCountTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/HelloWorld/src/test/java/co/cask/cdap/examples/helloworld/HelloWorldTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/LogAnalysis/src/test/java/co/cask/cdap/examples/loganalysis/LogAnalysisAppTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/Purchase/src/test/java/co/cask/cdap/examples/purchase/PurchaseAppTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/SpamClassifier/src/test/java/co/cask/cdap/examples/sparkstreaming/SpamClassifierTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/SparkKMeans/src/test/java/co/cask/cdap/examples/sparkkmeans/SparkKMeansAppTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/SparkPageRank/src/test/java/co/cask/cdap/examples/sparkpagerank/SparkPageRankAppTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/SportResults/src/test/java/co/cask/cdap/examples/sportresults/SportResultsTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/UserProfiles/src/test/java/co/cask/cdap/examples/profiles/UserProfilesTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-examples/WordCount/src/test/java/co/cask/cdap/examples/wordcount/WordCountTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-integration-test/src/test/java/co/cask/cdap/test/IntegrationTestBaseTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-test/src/main/java/co/cask/cdap/test/AbstractProgramManager.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-test/src/main/java/co/cask/cdap/test/ProgramManager.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-unit-test-spark2_2.11/src/test/java/co/cask/cdap/spark/Spark2Test.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-unit-test/src/test/java/co/cask/cdap/mapreduce/service/MapReduceServiceIntegrationTestRun.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-unit-test/src/test/java/co/cask/cdap/partitioned/PartitionConsumingTestRun.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-unit-test/src/test/java/co/cask/cdap/security/AuthorizationTest.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-unit-test/src/test/java/co/cask/cdap/service/ServiceArtifactTestRun.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-unit-test/src/test/java/co/cask/cdap/service/ServiceLifeCycleTestRun.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-unit-test/src/test/java/co/cask/cdap/spark/service/SparkServiceIntegrationTestRun.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-unit-test/src/test/java/co/cask/cdap/test/app/TestAppWithCube.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
    • cdap-unit-test/src/test/java/co/cask/cdap/test/app/TestFrameworkTestRun.java (version 06e55efde55dd7f9d382c476bb2ed47663754fec)
  • Sreevatsan Raman

    Sreevatsan Raman 64d3d09990fa51a9766e9a15b41d92e6293280fc m

    Merge pull request #9997 from caskdata/feature/update-hash
    add images

  • sreevatsanraman <sreevatsan@gmail.com>

    sreevatsanraman <sreevatsan@gmail.com> 18119e6749e8d479a6cca55b57fedf343d0062e5 m

    add images

    • cdap-docs/integrations/source/_images/ranger-case-study-create-ns.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-create-ns2.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-create-ns3.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-create-ns4.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-deploy-fail1.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-deploy-fail2.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-keytabs.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-no-access.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-policy-apps.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-policy-datasets.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-policy-namespace.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-policy-principals.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-policy-programs.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-start-fail.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
    • cdap-docs/integrations/source/_images/ranger-case-study-start-success.png (version 18119e6749e8d479a6cca55b57fedf343d0062e5)
  • Sreevatsan Raman

    Sreevatsan Raman 034ae6697c78827eaa8b249c175d8e68cb5fabbc m

    Merge pull request #9996 from caskdata/feature/update-hash
    Update hash

  • sreevatsanraman <sreevatsan@gmail.com>

    sreevatsanraman <sreevatsan@gmail.com> 0d65cb3d274b87d276c2de4adf6d549467dd8b2e m

    Update hash

    • cdap-docs/integrations/build.sh (version 0d65cb3d274b87d276c2de4adf6d549467dd8b2e)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 3787baef49c7cda029ab5cfe933be96ba2933936 m

    cleanup around the DataProcClient
    Using Optional instead of nulls, adding javadocs, and fixing
    exception handling.

    • cdap-runtime-ext-dataproc/src/main/java/co/cask/cdap/runtime/spi/provisioner/dataproc/DataProcClient.java (version 3787baef49c7cda029ab5cfe933be96ba2933936)
    • cdap-runtime-ext-dataproc/src/main/java/co/cask/cdap/runtime/spi/provisioner/dataproc/DataProcProvisioner.java (version 3787baef49c7cda029ab5cfe933be96ba2933936)
    • cdap-runtime-ext-dataproc/src/main/java/co/cask/cdap/runtime/spi/provisioner/dataproc/DataProcTool.java (version 3787baef49c7cda029ab5cfe933be96ba2933936)
  • Sreevatsan Raman

    Sreevatsan Raman 4153024b53f37eba514cc94169b340d7864457ed m

    Merge pull request #9994 from caskdata/feature/update-hash
    Update hash based on recent changes

  • sreevatsanraman <sreevatsan@gmail.com>

    sreevatsanraman <sreevatsan@gmail.com> db5a0f81c482a806122b26c17c9757e1a8981885 m

    Update hash based on recent changes

    • cdap-docs/integrations/build.sh (version db5a0f81c482a806122b26c17c9757e1a8981885)
  • Shankar <gowrishankar1988@gmail.com>

    Shankar <gowrishankar1988@gmail.com> ca31b59ad6dfbfa27ee2dd3773ddd65c4eaa9dd3 m

    Merge pull request #9992 from caskdata/fix/docs-build-hash
    update hash

  • Shankar Selvam

    Shankar Selvam dca16180ded3977f1be89407d78ddf565e55618c m

    update hash

    • cdap-docs/integrations/build.sh (version dca16180ded3977f1be89407d78ddf565e55618c)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 7932febd43a1774789487cf028f9f348a31fe2ad m

    CDAP-13094 add gce dataproc provisioner

    • cdap-master/pom.xml (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • cdap-runtime-ext-dataproc/pom.xml (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • cdap-runtime-ext-dataproc/src/main/java/co/cask/cdap/runtime/spi/provisioner/dataproc/DataProcClient.java (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • cdap-runtime-ext-dataproc/src/main/java/co/cask/cdap/runtime/spi/provisioner/dataproc/DataProcConf.java (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • cdap-runtime-ext-dataproc/src/main/java/co/cask/cdap/runtime/spi/provisioner/dataproc/DataProcProvisioner.java (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • cdap-runtime-ext-dataproc/src/main/java/co/cask/cdap/runtime/spi/provisioner/dataproc/DataProcTool.java (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • cdap-runtime-ext-dataproc/src/main/resources/META-INF/services/co.cask.cdap.runtime.spi.provisioner.Provisioner (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • cdap-runtime-ext-dataproc/src/main/resources/gce-dataproc.json (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • cdap-runtime-ext-dataproc/src/test/java/co/cask/cdap/runtime/spi/provisioner/dataproc/DataProcProvisionerTest.java (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • cdap-runtime-spi/src/main/java/co/cask/cdap/runtime/spi/provisioner/Provisioner.java (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • cdap-runtime-spi/src/main/java/co/cask/cdap/runtime/spi/provisioner/RetryableProvisionException.java (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • cdap-standalone/pom.xml (version 7932febd43a1774789487cf028f9f348a31fe2ad)
    • pom.xml (version 7932febd43a1774789487cf028f9f348a31fe2ad)
  • sagarkapare <sagar@cask.co>

    sagarkapare <sagar@cask.co> 24600400b19d51630100536d0a99c58bf73cd169 m

    Merge pull request #9990 from caskdata/fix/md5
    Update hash in the ranger-extension readme.

  • sagarkapare <sagar@cask.co>

    sagarkapare <sagar@cask.co> bc41701212bf8a4bf4212c7fe73765023ece3b82 m

    Update hash in the ranger-extension readme.

    • cdap-docs/integrations/build.sh (version bc41701212bf8a4bf4212c7fe73765023ece3b82)
  • Sreevatsan Raman

    Sreevatsan Raman 0da0481a1c17b8f3720e0f79ace1a06975025c19 m

    Merge pull request #9989 from caskdata/feature/fix-md5-hash
    Update MD5

  • sreevatsanraman <sreevatsan@gmail.com>

    sreevatsanraman <sreevatsan@gmail.com> 4d224024e4d3461d1c244cc4cbb6fc85cd37bc13 m

    Update MD5

    • cdap-docs/admin-manual/build.sh (version 4d224024e4d3461d1c244cc4cbb6fc85cd37bc13)
    • cdap-docs/integrations/build.sh (version 4d224024e4d3461d1c244cc4cbb6fc85cd37bc13)
  • Sreevatsan Raman

    Sreevatsan Raman 45f0301d263936bb7cec34bc132aa886c6e8b095 m

    Merge pull request #9988 from caskdata/feature/release-notes-4.3.4
    Update release notes

  • Sreevatsan Raman

    Sreevatsan Raman d4a98b0b20a3b2d92697aedfb941d5150e809cac m

    Update release-notes.rst

    • cdap-docs/reference-manual/source/release-notes.rst (version d4a98b0b20a3b2d92697aedfb941d5150e809cac)
  • Sreevatsan Raman

    Sreevatsan Raman 2e87f60874bc5be9ed0c8d5e0ca97e11d859ab39 m

    Update release-notes.rst

    • cdap-docs/reference-manual/source/release-notes.rst (version 2e87f60874bc5be9ed0c8d5e0ca97e11d859ab39)
  • Sreevatsan Raman

    Sreevatsan Raman f778a927a942db7e1a8f64a06e7e19df6cda0791 m

    Update release-notes.rst

    • cdap-docs/reference-manual/source/release-notes.rst (version f778a927a942db7e1a8f64a06e7e19df6cda0791)
  • sreevatsanraman <sreevatsan@gmail.com>

    sreevatsanraman <sreevatsan@gmail.com> 08b3b12a0a600aa6e33d31b3cf35156753e0a063 m

    Update release notes

    • cdap-docs/reference-manual/source/release-notes.rst (version 08b3b12a0a600aa6e33d31b3cf35156753e0a063)