Build #209

Build: #209 failed Changes by albertshau <ashau@google.com>

Code commits

Hydrator Plugins

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> ccf436317626739294fd792aa1f21e5e93f81866

    Merge pull request #871 from cdapio/merge-release-2-1
    Merge release 2 1

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> e0e4d4d4ae4e96802d1cf2b0293466f963369d0d

    Merge branch 'release/2.1' into merge-release-2-1

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 8b127c6150e2e3006b1d98931591130733efca4a m

    Merge pull request #862 from caskdata/bump-kafka-plugins-version
    bump kafka plugins version to 2.0

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 76fd71cb7cb8a9b7a8cc6ac17c88497bb081bb30 m

    bump kafka plugins version to 2.0
    2.0.0 contains the switch to files instead of tables for offset
    storage and also has the packaging fix.

    • .gitmodules (version 76fd71cb7cb8a9b7a8cc6ac17c88497bb081bb30)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 3b614711c4268b9d2d48fae7e33ad69789215cb7 m

    Merge pull request #860 from caskdata/feature_release/CDAP-14442-refactor-input-formats
    CDAP-14442 refactoring input formats into plugins

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 29107eb7f2874b191f26305f84bc4ba13d8a5ca8 m

    CDAP-14442 refactoring input formats into plugins
    Moved file input formats into their own plugins to consolidate
    logic in to a single place and to fix classloading issues.

    As part of this refactoring, removed avro, parquet, and orc as
    dependencies in core-plugins.

    • core-plugins/pom.xml (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetDatasetAvroSink.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetDatasetParquetSink.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/FTPBatchSource.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/FileBatchSource.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/SnapshotFileBatchAvroSource.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/SnapshotFileBatchParquetSource.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/SnapshotFileBatchSource.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/SnapshotFileSetSourceConfig.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/TPFSConfig.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/TimePartitionedFileSetDatasetAvroSource.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/TimePartitionedFileSetDatasetParquetSource.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/TimePartitionedFileSetSource.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/FileSetUtil.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/Properties.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/SnapshotFileSetConfig.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/transform/StructuredRecordToGenericRecordTransform.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLBatchTestBase.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLFTPTestRun.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLMapReduceTestRun.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLSnapshotTestRun.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/source/FileBatchSourceTest.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/transform/AvroToStructuredTest.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/transform/StructuredRecordToGenericRecordTransformTest.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/transform/StructuredtoAvroTest.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-avro/pom.xml (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-avro/src/main/java/co/cask/format/avro/AvroOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-avro/src/main/java/co/cask/format/avro/AvroToStructuredTransformer.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-avro/src/main/java/co/cask/format/avro/StructuredAvroOutputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-avro/src/main/java/co/cask/format/avro/StructuredToAvroTransformer.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-avro/src/main/java/co/cask/format/avro/input/AvroInputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-avro/src/main/java/co/cask/format/avro/input/CombineAvroInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-avro/src/main/java/co/cask/format/avro/input/PathTrackingAvroInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-avro/src/main/java/co/cask/format/avro/output/AvroOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-avro/src/main/java/co/cask/format/avro/output/StructuredAvroOutputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-blob/pom.xml (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-blob/src/main/java/co/cask/format/blob/input/BlobInputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-blob/src/main/java/co/cask/format/blob/input/PathTrackingBlobInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/pom.xml (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/AvroToStructuredTransformer.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/FileFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/StructuredToAvroTransformer.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/AvroInputFormatter.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/AvroInputProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/BlobInputFormatter.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/BlobInputProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/CombineHeaderFileSplit.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/CombinePathTrackingInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/DelimitedInputProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/DelimitedTextInputFormatter.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/FileInputFormatter.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/FileInputFormatterProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/JsonInputFormatter.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/JsonInputProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/ParquetInputFormatter.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/ParquetInputProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/PathTrackingConfig.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/PathTrackingInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/PathTrackingInputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/TextInputFormatter.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/input/TextInputProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/plugin/AbstractFileSource.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-common/src/main/java/co/cask/hydrator/format/plugin/AbstractFileSourceConfig.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/CSVOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/DelimitedOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/StructuredDelimitedOutputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/TSVOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/input/CSVInputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/input/CombineDelimitedInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/input/DelimitedInputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/input/PathTrackingDelimitedInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/input/TSVInputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/output/CSVOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/output/DelimitedOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/output/StructuredDelimitedOutputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-delimited/src/main/java/co/cask/format/delimited/output/TSVOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-json/src/main/java/co/cask/format/json/JsonOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-json/src/main/java/co/cask/format/json/StructuredJsonOutputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-json/src/main/java/co/cask/format/json/input/CombineJsonInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-json/src/main/java/co/cask/format/json/input/JsonInputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-json/src/main/java/co/cask/format/json/input/PathTrackingJsonInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-json/src/main/java/co/cask/format/json/output/JsonOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-json/src/main/java/co/cask/format/json/output/StructuredJsonOutputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-orc/pom.xml (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-orc/src/main/java/co/cask/format/orc/OrcOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-orc/src/main/java/co/cask/format/orc/StructuredOrcOutputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-orc/src/main/java/co/cask/format/orc/output/OrcOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-orc/src/main/java/co/cask/format/orc/output/StructuredOrcOutputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-parquet/pom.xml (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-parquet/src/main/java/co/cask/format/parquet/ParquetOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-parquet/src/main/java/co/cask/format/parquet/StructuredParquetOutputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-parquet/src/main/java/co/cask/format/parquet/input/CombineParquetInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-parquet/src/main/java/co/cask/format/parquet/input/ParquetInputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-parquet/src/main/java/co/cask/format/parquet/input/PathTrackingParquetInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-parquet/src/main/java/co/cask/format/parquet/output/ParquetOutputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-parquet/src/main/java/co/cask/format/parquet/output/StructuredParquetOutputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-text/pom.xml (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-text/src/main/java/co/cask/format/text/input/CombineHeaderFileSplit.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-text/src/main/java/co/cask/format/text/input/CombineTextInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-text/src/main/java/co/cask/format/text/input/PathTrackingTextInputFormat.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • format-text/src/main/java/co/cask/format/text/input/TextInputFormatProvider.java (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
    • pom.xml (version 29107eb7f2874b191f26305f84bc4ba13d8a5ca8)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> b1ddf4293f7ae9c1c3b6effb5f8fc73f6d323b75 m

    Merge pull request #861 from caskdata/bugfix_release/CDAP-14560-remove-lzo-option
    CDAP-14560 remove lzo as a compression option

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 614d190191befd0fe8ff6f755c18eaec9ad0c05f m

    CDAP-14560 remove lzo as a compression option
    LZO is not packaged in the plugins due to licensing issues and
    should not be listed as a compression option, as it is guaranteed
    to break.

    • core-plugins/docs/SnapshotParquet-batchsink.md (version 614d190191befd0fe8ff6f755c18eaec9ad0c05f)
    • core-plugins/docs/TPFSParquet-batchsink.md (version 614d190191befd0fe8ff6f755c18eaec9ad0c05f)
    • core-plugins/widgets/SnapshotParquet-batchsink.json (version 614d190191befd0fe8ff6f755c18eaec9ad0c05f)
    • core-plugins/widgets/TPFSParquet-batchsink.json (version 614d190191befd0fe8ff6f755c18eaec9ad0c05f)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 2ea16ae554f879e4f86306f314fa5bb3ec3e91b1 m

    Merge pull request #857 from caskdata/feature_release/CDAP-14442-refactor-output-formats
    CDAP-14442 refactor file sink formats into plugins

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 5945d7b00e1487b2068ff4c4cbb95f138f021c56 m

    use avro and parquet code for determining codec validity
    Also fix a bug with tpfs and snapshot sinks where datasets created
    by a pervious version of the plugin would not be readable, due
    to differences in output format stored in the dataset properties.
    Changed the sinks to override any properties from dataset creation
    with those that the plugin knows are needed at runtime.

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchSink.java (version 5945d7b00e1487b2068ff4c4cbb95f138f021c56)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetSink.java (version 5945d7b00e1487b2068ff4c4cbb95f138f021c56)
    • format-avro/src/main/java/co/cask/format/avro/AvroOutputFormatProvider.java (version 5945d7b00e1487b2068ff4c4cbb95f138f021c56)
    • format-orc/src/main/java/co/cask/format/orc/OrcOutputFormatProvider.java (version 5945d7b00e1487b2068ff4c4cbb95f138f021c56)
    • format-parquet/src/main/java/co/cask/format/parquet/ParquetOutputFormatProvider.java (version 5945d7b00e1487b2068ff4c4cbb95f138f021c56)
  • sagarkapare <sagarkapare@google.com>

    sagarkapare <sagarkapare@google.com> 8b597b798240d863ebe20ebcafded560f43c7f46 m

    Merge pull request #856 from caskdata/fix/add-fll-for-table-src
    Record FLL for the Table source plugin.

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7 m

    CDAP-14442 refactor file sink formats into plugins
    This will fix the classloading issues we have when plugins from
    different artifacts are using avro or parquet.

    • core-plugins/pom.xml (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchAvroSink.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchParquetSink.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchSink.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchTextSink.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileSetBatchSinkConfig.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetDataSetORCSink.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetDatasetAvroSink.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetDatasetParquetSink.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetSink.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/FileSetUtil.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/StructuredToOrcTransformer.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLBatchTestBase.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLSnapshotTestRun.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/sink/FileSinkTestRun.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-avro/pom.xml (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-avro/src/main/java/co/cask/format/avro/AvroOutputFormatProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-avro/src/main/java/co/cask/format/avro/StructuredAvroOutputFormat.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/FileFormat.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/AvroOutputFormatter.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/AvroOutputProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/DelegatingOutputFormat.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/DelegatingRecordWriter.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/DelimitedTextOutputFormatter.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/DelimitedTextOutputProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/FileOutputFormatter.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/FileOutputFormatterProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/JsonOutputFormatter.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/JsonOutputProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/ParquetOutputFormatter.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/output/ParquetOutputProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/plugin/AbstractFileSink.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-common/src/main/java/co/cask/hydrator/format/plugin/AbstractFileSinkConfig.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-delimited/pom.xml (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-delimited/src/main/java/co/cask/format/delimited/CSVOutputFormatProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-delimited/src/main/java/co/cask/format/delimited/DelimitedOutputFormatProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-delimited/src/main/java/co/cask/format/delimited/StructuredDelimitedOutputFormat.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-delimited/src/main/java/co/cask/format/delimited/TSVOutputFormatProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-json/pom.xml (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-json/src/main/java/co/cask/format/json/JsonOutputFormatProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-json/src/main/java/co/cask/format/json/StructuredJsonOutputFormat.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-orc/pom.xml (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-orc/src/main/java/co/cask/format/orc/OrcOutputFormatProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-orc/src/main/java/co/cask/format/orc/StructuredOrcOutputFormat.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-orc/src/main/java/co/cask/format/orc/StructuredToOrcTransformer.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-parquet/pom.xml (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-parquet/src/main/java/co/cask/format/parquet/ParquetOutputFormatProvider.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • format-parquet/src/main/java/co/cask/format/parquet/StructuredParquetOutputFormat.java (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
    • pom.xml (version 4d4d9d02fa83359d5a954cd23c20d6a278c59fb7)
  • sagarkapare <sagarkapare@google.com>

    sagarkapare <sagarkapare@google.com> c5f998903a605b02be98f038f4126e43c4c05912 m

    Added fll for the Table source plugin.

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/TableSource.java (version c5f998903a605b02be98f038f4126e43c4c05912)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 51dd7d4ec519a699bf2c4825c00cf574cbb23878 m

    Merge pull request #854 from caskdata/bump-version-2-1-1
    bump to version 2.1.1-SNAPSHOT

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 49219d5ce0edae82945514c6d63729703ef4d268 m

    bump to version 2.1.1-SNAPSHOT

    • cassandra-plugins/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • core-plugins/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • database-plugins/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • format-common/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • hbase-plugins/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • hdfs-plugins/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • hive-plugins/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • http-plugins/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • hydrator-common/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • mongodb-plugins/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • solrsearch-plugins/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • spark-plugins/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
    • transform-plugins/pom.xml (version 49219d5ce0edae82945514c6d63729703ef4d268)
  • Rohit Sinha <rosinha@google.com>

    Rohit Sinha <rosinha@google.com> cae8f42efe85d21aa846d3922ca15881c4cae820 m

    Merge pull request #850 from caskdata/bump/drop-snap
    Update all submodules after submodules dropped snapshot

  • Rohit Sinha <rosinha@google.com>

    Rohit Sinha <rosinha@google.com> b0f90768e46966d839ee6589f47834548c6c0cf9 m

    Update all submodules after submodules dropped snapshot

    • amazon-s3-plugins (version b0f90768e46966d839ee6589f47834548c6c0cf9)
    • condition-plugins (version b0f90768e46966d839ee6589f47834548c6c0cf9)
    • google-cloud (version b0f90768e46966d839ee6589f47834548c6c0cf9)
    • kafka-plugins (version b0f90768e46966d839ee6589f47834548c6c0cf9)
    • realtime-stream-source (version b0f90768e46966d839ee6589f47834548c6c0cf9)
    • wrangler-transform (version b0f90768e46966d839ee6589f47834548c6c0cf9)
  • Rohit Sinha <rosinha@google.com>

    Rohit Sinha <rosinha@google.com> 88c34fde12556e4eaf3f8e40029ac520bc81c2ca m

    Merge pull request #849 from caskdata/bump/drop-version
    drop snapshot

  • Rohit Sinha <rosinha@google.com>

    Rohit Sinha <rosinha@google.com> d510e9db7df0db36c9cf93ed4135de016f56c3b8 m

    Drop snapshot

    • cassandra-plugins/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • core-plugins/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • database-plugins/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • format-common/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • hbase-plugins/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • hdfs-plugins/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • hive-plugins/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • http-plugins/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • hydrator-common/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • mongodb-plugins/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • solrsearch-plugins/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • spark-plugins/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
    • transform-plugins/pom.xml (version d510e9db7df0db36c9cf93ed4135de016f56c3b8)
  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 608e751fb62b64aad836f9deab881f147c54a023 m

    Merge pull request #848 from caskdata/fix-format-macro-npe
    fix npe when format contains a macro

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 7a8c02cce8c9b73a4ecc2b5663d7950d9117d1e0 m

    fix npe when format contains a macro

    • format-common/src/main/java/co/cask/hydrator/format/plugin/AbstractFileSource.java (version 7a8c02cce8c9b73a4ecc2b5663d7950d9117d1e0)