Build #1,507

Build: #1507 failed Child of CDAP-DRC-5455

Code commits

caskdata/cdap

  • Vitalii Tymchyshyn

    Vitalii Tymchyshyn 9c309032c7e21823a40cce5f2d398ea139c2b736

    Merge pull request #13418 from cdapio/feature/access-cli-migrate
    Switch client/CLI to the new permission model

  • Vitalii Tymchyshyn

    Vitalii Tymchyshyn 44275790121934ae9511878842105a90e5f13992

    Switch client/CLI to the new permission model

    • cdap-app-fabric/src/main/java/io/cdap/cdap/gateway/handlers/AuthorizationHandler.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/gateway/handlers/util/AbstractAppFabricHttpHandler.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/gateway/handlers/AuthorizationHandlerTest.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli-tests/src/test/java/io/cdap/cdap/cli/AuthorizationCLITest.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli/src/main/java/io/cdap/cdap/cli/ArgumentName.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli/src/main/java/io/cdap/cdap/cli/command/security/GrantActionCommand.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli/src/main/java/io/cdap/cdap/cli/command/security/GrantPermissionCommand.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli/src/main/java/io/cdap/cdap/cli/command/security/ListPrivilegesCommand.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli/src/main/java/io/cdap/cdap/cli/command/security/RevokeActionCommand.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli/src/main/java/io/cdap/cdap/cli/command/security/RevokeActionForPrincipalCommand.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli/src/main/java/io/cdap/cdap/cli/command/security/RevokeEntityCommand.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli/src/main/java/io/cdap/cdap/cli/command/security/RevokePermissionCommand.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli/src/main/java/io/cdap/cdap/cli/command/security/RevokePermissionForPrincipalCommand.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli/src/main/java/io/cdap/cdap/cli/commandset/SecurityCommands.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-cli/src/main/java/io/cdap/cdap/cli/util/AbstractAuthCommand.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-client/src/main/java/io/cdap/cdap/client/ApplicationClient.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-client/src/main/java/io/cdap/cdap/client/AuthorizationClient.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-docs/reference-manual/source/http-restful-api/security.rst (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-proto/src/main/java/io/cdap/cdap/proto/security/AuthorizationRequest.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-proto/src/main/java/io/cdap/cdap/proto/security/GrantRequest.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-proto/src/main/java/io/cdap/cdap/proto/security/RevokeRequest.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-proto/src/test/java/io/cdap/cdap/proto/security/GrantRequestTest.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-proto/src/test/java/io/cdap/cdap/proto/security/RevokeRequestTest.java (version 44275790121934ae9511878842105a90e5f13992)
    • cdap-security/src/main/java/io/cdap/cdap/security/authorization/RemotePermissionManager.java (version 44275790121934ae9511878842105a90e5f13992)
  • Terence Yim <885032+chtyim@users.noreply.github.com>

    Terence Yim <885032+chtyim@users.noreply.github.com> 8452f58fe423624369573d8c001e4df3c102cd36

    Merge pull request #13447 from cdapio/feature/code-cleanup
    Code cleanup and simplification around application deployment

  • yaojiefeng <yaojie@google.com>

    yaojiefeng <yaojie@google.com> 508315088d293c37f78c28f1d9a8733452029218

    Merge pull request #13449 from cdapio/some-improvements-connector-api
    Add ConnectorConfigurer and ConnectorContext

  • Terence Yim

    Terence Yim 3b8d97fd396271ea66410ee00dca834f7ffd581c m

    Code refactoring and cleanup around application deployment
    - Simplify InMemoryConfigurator to have one constructor
    - Have all artifact ClassLoader logic inside InMemoryConfigurator
    - Remove unused fields
    - Cleanup the need of holding the Artifact ClassLoader during the deployment phase
    - Removed the ConfiguratorConfig class. The functionality is the same as AppDeploymentInfo
    - Added unit-tests for RemoteConfigurator
    - Use the netty default ByteBuf allocator for configurable and more efficient usage
    - Use RemoteTaskExecutor to unify running of remote task
    - Unified error handling and retry mechanism
    - Have exception from remote configurator come back nicely and shown in UI
    - Fix the TaskWorkerHttpHandlerInternal to count inflight correctly.

    • cdap-app-fabric/src/main/java/io/cdap/cdap/app/preview/PreviewApplicationManager.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/gateway/handlers/ArtifactHttpHandlerInternal.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/RemoteExecutionException.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/RemoteTaskException.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/RemoteTaskExecutor.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/deploy/InMemoryConfigurator.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/deploy/LocalApplicationManager.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/deploy/RemoteConfigurator.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/deploy/pipeline/AppDeploymentInfo.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/deploy/pipeline/ConfiguratorConfig.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/deploy/pipeline/DeployDatasetModulesStage.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/deploy/pipeline/LocalArtifactLoaderStage.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/runtime/artifact/RemoteArtifactRepositoryReader.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/services/ApplicationLifecycleService.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/ConfigResponseResult.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/ConfiguratorTask.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/ConfiguratorTaskModule.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/TaskWorkerHttpHandlerInternal.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/worker/TaskWorkerService.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/internal/AppFabricTestHelper.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/internal/app/deploy/ConfiguratorTest.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/internal/app/deploy/LocalApplicationManagerTest.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/internal/app/deploy/RemoteConfiguratorTest.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-common/src/main/java/io/cdap/cdap/common/conf/Constants.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
    • cdap-common/src/main/java/io/cdap/cdap/common/http/LocationBodyProducer.java (version 3b8d97fd396271ea66410ee00dca834f7ffd581c)
  • yaojie <yaojie@google.com>

    yaojie <yaojie@google.com> d903702c6c4e045df29405f182d5321e5c289f57 m

    add mock configurer and context so UI can use

    • cdap-app-templates/cdap-etl/cdap-data-pipeline-base/src/main/java/io/cdap/cdap/datapipeline/service/ConnectionHandler.java (version d903702c6c4e045df29405f182d5321e5c289f57)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/validation/SimpleFailureCollector.java (version d903702c6c4e045df29405f182d5321e5c289f57)
    • cdap-app-templates/cdap-etl/cdap-etl-proto/src/main/java/io/cdap/cdap/etl/proto/validation/SimpleFailureCollector.java (version d903702c6c4e045df29405f182d5321e5c289f57)
    • cdap-app-templates/cdap-etl/hydrator-test/src/main/java/io/cdap/cdap/etl/mock/common/MockConnectorConfigurer.java (version d903702c6c4e045df29405f182d5321e5c289f57)
    • cdap-app-templates/cdap-etl/hydrator-test/src/main/java/io/cdap/cdap/etl/mock/common/MockConnectorContext.java (version d903702c6c4e045df29405f182d5321e5c289f57)
  • yaojie <yaojie@google.com>

    yaojie <yaojie@google.com> 4214e83a6fa4183dc56e60b10c26d90ecda6ee9a m

    Add ConnectorConfigurer and ConnectorContext

    • cdap-app-templates/cdap-etl/cdap-data-pipeline-base/src/main/java/io/cdap/cdap/datapipeline/connection/DefaultConnectorConfigurer.java (version 4214e83a6fa4183dc56e60b10c26d90ecda6ee9a)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline-base/src/main/java/io/cdap/cdap/datapipeline/connection/DefaultConnectorContext.java (version 4214e83a6fa4183dc56e60b10c26d90ecda6ee9a)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline-base/src/main/java/io/cdap/cdap/datapipeline/connection/LimitingConnector.java (version 4214e83a6fa4183dc56e60b10c26d90ecda6ee9a)
    • cdap-app-templates/cdap-etl/cdap-data-pipeline-base/src/main/java/io/cdap/cdap/datapipeline/service/ConnectionHandler.java (version 4214e83a6fa4183dc56e60b10c26d90ecda6ee9a)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/io/cdap/cdap/etl/api/batch/BatchConnector.java (version 4214e83a6fa4183dc56e60b10c26d90ecda6ee9a)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/io/cdap/cdap/etl/api/connector/Connector.java (version 4214e83a6fa4183dc56e60b10c26d90ecda6ee9a)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/io/cdap/cdap/etl/api/connector/ConnectorConfigurer.java (version 4214e83a6fa4183dc56e60b10c26d90ecda6ee9a)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/io/cdap/cdap/etl/api/connector/ConnectorContext.java (version 4214e83a6fa4183dc56e60b10c26d90ecda6ee9a)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/io/cdap/cdap/etl/api/connector/DirectConnector.java (version 4214e83a6fa4183dc56e60b10c26d90ecda6ee9a)
    • cdap-app-templates/cdap-etl/hydrator-test/src/main/java/io/cdap/cdap/etl/mock/connector/FileConnector.java (version 4214e83a6fa4183dc56e60b10c26d90ecda6ee9a)