Build #954

Build: #954 was successful Child of CDAP-DRC-4695

Code commits

caskdata/cdap

  • Terence Yim <885032+chtyim@users.noreply.github.com>

    Terence Yim <885032+chtyim@users.noreply.github.com> 92707a9331d230e890d712e6c00ebb3bdc585ba7

    Merge pull request #11741 from cdapio/release/6.1
    Merge release 6.1 to develop

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 2fcccaea2f6ae03851c18edcbde988ac6588f122 m

    Merge pull request #11730 from cdapio/bugfix_release/CDAP-16110-pipeline-preview-limit
    CDAP-16110 limit reads for batch pipeline previews

  • Edwin Elia <edwinelia@google.com>

    Edwin Elia <edwinelia@google.com> b7f5f65742a7f3cb3a5af1fab576fdc7ffdb0e2b m

    Merge pull request #11740 from cdapio/bugfix-ui/import-schema-on-wrangler-apply-pipelines
    [UI][Wrangler]Fixes wrangler in pipeline to properly populate schema on clicking ap…

  • Terence Yim <885032+chtyim@users.noreply.github.com>

    Terence Yim <885032+chtyim@users.noreply.github.com> f8405c5c03dda81e399c32ca6f835f04f2c06f6d m

    Merge pull request #11737 from cdapio/feature_release/CDAP-16112-app-fabric-perf
    (CDAP-16112) Introduce multiRead to Storage SPI

  • Ajai Narayan

    Ajai Narayan e51ca5ee75fd64615faa0261c005e8e08717ebc9 m

    Fixes wrangler in pipeline to properly populate schema on clicking apply in wrangler modal in pipelines

    • cdap-ui/app/cdap/components/AbstractWidget/WranglerEditor/index.tsx (version e51ca5ee75fd64615faa0261c005e8e08717ebc9)
    • cdap-ui/app/directives/widget-container/widget-complex-schema-editor/widget-complex-schema-editor.js (version e51ca5ee75fd64615faa0261c005e8e08717ebc9)
  • Terence Yim <885032+chtyim@users.noreply.github.com>

    Terence Yim <885032+chtyim@users.noreply.github.com> 48b6fe3f91727b9ce97ebbfa29788e98fde8f8ed m

    Merge pull request #11738 from cdapio/feature_release/CDAP-16056-firewall-check
    (CDAP-16056) Fix firewall rule check in Dataproc provisioner

  • Terence Yim

    Terence Yim 73e06151099291fc3d66a82cab4eb659d688a46e m

    (CDAP-16112) Introduce multiRead to Storage SPI
    - Use it in AppMetadataStore for efficient batch query

    • cdap-app-fabric/src/main/java/io/cdap/cdap/gateway/handlers/ProgramLifecycleHttpHandler.java (version 73e06151099291fc3d66a82cab4eb659d688a46e)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/store/AppMetadataStore.java (version 73e06151099291fc3d66a82cab4eb659d688a46e)
    • cdap-app-fabric/src/main/java/io/cdap/cdap/internal/app/store/DefaultStore.java (version 73e06151099291fc3d66a82cab4eb659d688a46e)
    • cdap-app-fabric/src/test/java/io/cdap/cdap/internal/app/store/AppMetadataStoreTest.java (version 73e06151099291fc3d66a82cab4eb659d688a46e)
    • cdap-data-fabric/src/main/java/io/cdap/cdap/spi/data/common/MetricStructuredTable.java (version 73e06151099291fc3d66a82cab4eb659d688a46e)
    • cdap-data-fabric/src/main/java/io/cdap/cdap/spi/data/nosql/NoSqlStructuredTable.java (version 73e06151099291fc3d66a82cab4eb659d688a46e)
    • cdap-data-fabric/src/main/java/io/cdap/cdap/spi/data/sql/PostgresSqlStructuredTable.java (version 73e06151099291fc3d66a82cab4eb659d688a46e)
    • cdap-storage-spi/src/main/java/io/cdap/cdap/spi/data/StructuredTable.java (version 73e06151099291fc3d66a82cab4eb659d688a46e)
  • yukiej <yukiej@gmail.com>

    yukiej <yukiej@gmail.com> 2cef97f66c959f787e1f312b399deab3a3a81b19 m

    Merge pull request #11736 from cdapio/bugfix-ui/scroll-edges
    Fix scrolling edges

  • Yuki Jung

    Yuki Jung aa20592cae07ad89053ef9ec8b9f61c7f763a9bf m

    Fix edges redrawing on scroll
    Fix View by changing grid-template-column

    Move date and condense date picker. Cal automatically opens for custom

    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/FllTable/FllField.tsx (version aa20592cae07ad89053ef9ec8b9f61c7f763a9bf)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/FllTable/FllMenu/index.tsx (version aa20592cae07ad89053ef9ec8b9f61c7f763a9bf)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/FllTable/index.tsx (version aa20592cae07ad89053ef9ec8b9f61c7f763a9bf)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/LineageSummary/index.tsx (version aa20592cae07ad89053ef9ec8b9f61c7f763a9bf)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/TimeRangePicker/index.tsx (version aa20592cae07ad89053ef9ec8b9f61c7f763a9bf)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/TopPanel/index.tsx (version aa20592cae07ad89053ef9ec8b9f61c7f763a9bf)
    • cdap-ui/app/cdap/components/TimeRangePicker/ExpandableTimeRange.js (version aa20592cae07ad89053ef9ec8b9f61c7f763a9bf)
    • cdap-ui/app/cdap/components/TimeRangePicker/TimeRangePicker.scss (version aa20592cae07ad89053ef9ec8b9f61c7f763a9bf)
    • cdap-ui/app/cdap/text/text-en.yaml (version aa20592cae07ad89053ef9ec8b9f61c7f763a9bf)
  • Ajai <1452845+ajainarayanan@users.noreply.github.com>

    Ajai <1452845+ajainarayanan@users.noreply.github.com> 6afb3a76c865765fbcdf13c31359a07b0c8bc97f m

    Merge pull request #11732 from cdapio/bugfix-ui/pipeline-triggers
    [UI] Bugfixes for pipelines list & Triggers view

  • Ajai <1452845+ajainarayanan@users.noreply.github.com>

    Ajai <1452845+ajainarayanan@users.noreply.github.com> 56350545bca0f458a835022cc7af938915b076dd m

    Merge pull request #11734 from cdapio/bugfix-ui/fix-preview-tag-market
    [UI] [Market] Fix beta tag to be preview in hub modal

  • Terence Yim

    Terence Yim 077a96301484eb6e153af84ee63930bac583885c m

    (CDAP-16056) Fix firewall rule check in Dataproc provisioner

    • cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/provisioner/dataproc/DataprocClient.java (version 077a96301484eb6e153af84ee63930bac583885c)
  • Ajai Narayan

    Ajai Narayan 5a7c4ab2f41abbc0e5ea00f2258c28c171d86492 m

    Fixes beta tag in market entities to be preview + listen to preview in addition to beta flag in market packages

    • cdap-ui/app/cdap/components/ExperimentalBanner/ExperimentalBanner.scss (version 5a7c4ab2f41abbc0e5ea00f2258c28c171d86492)
    • cdap-ui/app/cdap/components/ExperimentalBanner/index.js (version 5a7c4ab2f41abbc0e5ea00f2258c28c171d86492)
    • cdap-ui/app/cdap/components/Market/UsecaseTab/index.js (version 5a7c4ab2f41abbc0e5ea00f2258c28c171d86492)
    • cdap-ui/app/cdap/components/MarketPlaceUsecaseEntity/MarketPlaceUsecaseEntity.scss (version 5a7c4ab2f41abbc0e5ea00f2258c28c171d86492)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c m

    CDAP-16110 limit reads for batch pipeline previews
    Fixed a bug in batch pipeline previews where the full input data
    was still being read, though not all of it was being output.

    Wrapped the input format provided by sources to properly limit
    data read by the RecordReaders instead of only limiting the records
    output to subsequent stages.

    • cdap-app-templates/cdap-etl/cdap-data-pipeline/src/main/java/io/cdap/cdap/datapipeline/SmartWorkflow.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/io/cdap/cdap/etl/batch/mapreduce/MapReduceTransformExecutorFactory.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/io/cdap/cdap/etl/batch/mapreduce/TransformRunner.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/batch/mapreduce/MapReduceBatchContext.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/batch/preview/LimitingInputFormat.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/batch/preview/LimitingInputFormatProvider.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/batch/preview/LimitingRecordReader.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/common/AbstractStageContext.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/spec/PipelineSpecGenerator.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/spec/ValidatedPipeline.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/test/java/io/cdap/cdap/etl/spec/PipelineSpecGeneratorTest.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/cdap-etl-proto/src/main/java/io/cdap/cdap/etl/proto/v2/spec/StageSpec.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/batch/BatchSparkPipelineDriver.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/batch/SparkBatchSourceContext.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/function/BatchSourceFunction.java (version f56d9f380e6ae95c619ff7f5cdd9e0ce7e67939c)
  • Ajai Narayan

    Ajai Narayan 7f860949ccaea93aaf751d02f589326bf132d908 m

    Fixes i18n for pipeline delete modal

    • cdap-ui/app/cdap/text/text-en.yaml (version 7f860949ccaea93aaf751d02f589326bf132d908)
  • Ajai Narayan

    Ajai Narayan 050ffb2129e048d091003352a5002782e616cff5 m

    Fixes overflow in profile customization popover to not scroll the entire window

    • cdap-ui/app/cdap/components/PipelineDetails/ProfilesListView/ProfileCustomizePopover/ProfileCustomizePopover.scss (version 050ffb2129e048d091003352a5002782e616cff5)
    • cdap-ui/app/cdap/components/PipelineDetails/ProfilesListView/ProfileCustomizePopover/index.js (version 050ffb2129e048d091003352a5002782e616cff5)
  • Ajai Narayan

    Ajai Narayan e8cea7959ba481935587b73c7cc63039fecc93ab m

    Makes triggers payload config modal static to avoid closing it inadvertently while interacting with widgets

    • cdap-ui/app/cdap/components/PipelineTriggers/PayloadConfigModal/index.js (version e8cea7959ba481935587b73c7cc63039fecc93ab)
  • Anudeep Katragadda <51677126+itsanudeep@users.noreply.github.com>

    Anudeep Katragadda <51677126+itsanudeep@users.noreply.github.com> 9f0160ddc622dcbe0958dd12b938d573df3e5eb6 m

    Merge pull request #11729 from cdapio/feature-ui/CDAP-16105
    [CDAP-16105] [CDAP-16080] [CDAP-15103] validation messaging display changes

  • Anudeep Katragadda

    Anudeep Katragadda f4a722ceb9d9761037a21d02b1634d9f9a870d4e m

    validation messaging display changes

    • cdap-ui/app/cdap/components/AbstractWidget/GetSchemaWidget/index.tsx (version f4a722ceb9d9761037a21d02b1634d9f9a870d4e)
    • cdap-ui/app/directives/my-post-run-action-wizard/my-post-run-action-wizard-modal.html (version f4a722ceb9d9761037a21d02b1634d9f9a870d4e)
    • cdap-ui/app/directives/my-post-run-action-wizard/my-post-run-action-wizard.js (version f4a722ceb9d9761037a21d02b1634d9f9a870d4e)
    • cdap-ui/app/hydrator/controllers/create/partials/nodeconfig-ctrl.js (version f4a722ceb9d9761037a21d02b1634d9f9a870d4e)
    • cdap-ui/app/hydrator/hydrator-modal.less (version f4a722ceb9d9761037a21d02b1634d9f9a870d4e)
    • cdap-ui/app/hydrator/services/plugin-config-factory.js (version f4a722ceb9d9761037a21d02b1634d9f9a870d4e)
    • cdap-ui/app/hydrator/templates/partial/node-config-modal/popover.html (version f4a722ceb9d9761037a21d02b1634d9f9a870d4e)
  • yukiej <yukiej@gmail.com>

    yukiej <yukiej@gmail.com> 66bd2a5eaaabdb8471e1a3a138d339bac9ff9b84 m

    Merge pull request #11728 from cdapio/bugfix-ui/top-panel-pointers
    Field level lineage tweaks: Add cursor pointer and move date picker

  • Yuki Jung

    Yuki Jung 147dfce62106f7c23c4c5b925df688dafb0079d1 m

    Add cursor pointer to reset text and to non-active fields on hover
    Shift position of date picker to the right

    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/FllTable/FllField.tsx (version 147dfce62106f7c23c4c5b925df688dafb0079d1)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/FllTable/index.tsx (version 147dfce62106f7c23c4c5b925df688dafb0079d1)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/TimeRangePicker/index.tsx (version 147dfce62106f7c23c4c5b925df688dafb0079d1)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/TopPanel/index.tsx (version 147dfce62106f7c23c4c5b925df688dafb0079d1)
  • yukiej <yukiej@gmail.com>

    yukiej <yukiej@gmail.com> fff27af80cbac47d2cdd6c416fdd3536061504c8 m

    Merge pull request #11725 from cdapio/bugfix-ui/extra-scrollbar
    Removing extra horizontal scrollbar

  • yaojiefeng <yaojie@google.com>

    yaojiefeng <yaojie@google.com> f250e4484bfd901e859f442cfe946bf3d92feb76 m

    Merge pull request #11726 from cdapio/feature_release/CDAP-16102-support-FLL-error
    CDAP-16102 support fll for error transform

  • Yuki Jung

    Yuki Jung ac79f42982890ecfd12053370e11fc0e202f93ec m

    Fix height of View button and remove outer scrollbars

    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/FllTable/FllField.tsx (version ac79f42982890ecfd12053370e11fc0e202f93ec)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/FllTable/index.tsx (version ac79f42982890ecfd12053370e11fc0e202f93ec)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/LineageSummary/index.tsx (version ac79f42982890ecfd12053370e11fc0e202f93ec)
  • yaojie <yaojie@google.com>

    yaojie <yaojie@google.com> 66a45e5903c3fa1352444d78ff75236a4171a06f m

    CDAP-16102 support fll for error transform

    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/batch/PipelinePhasePreparer.java (version 66a45e5903c3fa1352444d78ff75236a4171a06f)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/common/plugin/WrappedErrorTransform.java (version 66a45e5903c3fa1352444d78ff75236a4171a06f)
  • Ajai <1452845+ajainarayanan@users.noreply.github.com>

    Ajai <1452845+ajainarayanan@users.noreply.github.com> c150640b2875698c96626b97ce265a75fc8b5378 m

    Merge pull request #11724 from cdapio/bugfix-ui/favicon
    [UI] [FAVICON] Adds profiles to head tag to define favicon

  • Ajai Narayan

    Ajai Narayan 8040669632005e418c37719d38848ef0059043ab m

    Adds profiles to head tag to define favicon

    • cdap-ui/app/cdap/cdap.html (version 8040669632005e418c37719d38848ef0059043ab)
    • cdap-ui/app/hydrator/hydrator.html (version 8040669632005e418c37719d38848ef0059043ab)
    • cdap-ui/app/tracker/tracker.html (version 8040669632005e418c37719d38848ef0059043ab)
  • yukiej <yukiej@gmail.com>

    yukiej <yukiej@gmail.com> fc7cd0ba6eada891f78b2df46cf087d4e3597b2f m

    Merge pull request #11716 from cdapio/bugfix-ui/CDAP-16073-long-names
    [CDAP-16073] Add ellipses for long dataset names

  • Yuki Jung

    Yuki Jung 5fec4d19395faba2c8c5b7088e3ae026ff0e2696 m

    Add ellipses to long dataset names in table and summary headings

    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/FllHeader/index.tsx (version 5fec4d19395faba2c8c5b7088e3ae026ff0e2696)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/FllTable/index.tsx (version 5fec4d19395faba2c8c5b7088e3ae026ff0e2696)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/LineageSummary/index.tsx (version 5fec4d19395faba2c8c5b7088e3ae026ff0e2696)
  • yukiej <yukiej@gmail.com>

    yukiej <yukiej@gmail.com> 5df10b5ca35a1746e8143ce4b379bfe94b70dc30 m

    Merge pull request #11689 from cdapio/bugfix-ui/CDAP-16006
    [CDAP-16006] Add loading indicator to FLL v2 UI

  • Yuki Jung

    Yuki Jung 21de753950cc1690c14c1f97c977e6ab0960c03b m

    Show loading indicator when waiting for backend response with lineage

    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/Context/FllContext.tsx (version 21de753950cc1690c14c1f97c977e6ab0960c03b)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/Context/FllContextHelper.ts (version 21de753950cc1690c14c1f97c977e6ab0960c03b)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/LineageSummary/index.tsx (version 21de753950cc1690c14c1f97c977e6ab0960c03b)
    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/OperationsModal/index.tsx (version 21de753950cc1690c14c1f97c977e6ab0960c03b)
  • Yuki Jung

    Yuki Jung f869da6adb13df865d0e4180d6323480754b1770 m

    Disable Done button in time range picker if end time is less than start time

    • cdap-ui/app/cdap/components/FieldLevelLineage/v2/LineageSummary/index.tsx (version f869da6adb13df865d0e4180d6323480754b1770)
    • cdap-ui/app/cdap/components/TimeRangePicker/ExpandableTimeRange.js (version f869da6adb13df865d0e4180d6323480754b1770)