Build #405

Code commits

Wrangler Transform

  • sechegaray <sechegaray@users.noreply.github.com>

    sechegaray <sechegaray@users.noreply.github.com> b8216f88438e78adc0294dad931ff3105f1a93ba

    Merge pull request #534 from data-integrations/feature/add-struct-array-datatype-to-wrangler
    Feature/add struct array datatype to wrangler

  • Sebastian Echegaray <sechegaray@google.com>

    Sebastian Echegaray <sechegaray@google.com> 0b4345cd18d0deebbf470141287b9d961e64d3d6

    Added record support to Wrangler. Converts nested structuredrecords into rows of rows. Added Json-like display for Structs. Added two directives (flatten and create) to deal with record types.

    • wrangler-core/src/main/java/io/cdap/directives/column/CreateRecord.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-core/src/main/java/io/cdap/directives/column/FlattenRecord.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-core/src/main/java/io/cdap/wrangler/utils/RecordConvertor.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-core/src/main/java/io/cdap/wrangler/utils/SchemaConverter.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-core/src/main/java/io/cdap/wrangler/utils/StructuredToRowTransformer.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-core/src/test/java/io/cdap/directives/column/CreateRecordTest.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-core/src/test/java/io/cdap/directives/column/FlattenRecordTest.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-core/src/test/java/io/cdap/wrangler/registry/CompositeDirectiveRegistryTest.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-core/src/test/java/io/cdap/wrangler/utils/SchemaConverterTest.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-core/src/test/java/io/cdap/wrangler/utils/StructuredToRowTransformerTest.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-service/src/main/java/io/cdap/wrangler/service/directive/AbstractDirectiveHandler.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-service/src/main/java/io/cdap/wrangler/service/directive/WranglerDisplaySerializer.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)
    • wrangler-service/src/test/java/io/cdap/wrangler/service/directive/WranglerDisplaySerializerTest.java (version 0b4345cd18d0deebbf470141287b9d961e64d3d6)