Build #2

Build: #2 was successful Changes by 13 people

Code commits

Showing 100 of 108 code changes

cdapio/hydrator-plugins

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 5131df900510933b601ef1a80ba0a127349259b3

    Merge pull request #418 from caskdata/release/1.4
    Merging release back to develop.

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 596237821d2be6dd6f9e0ce939f727afbd046a97

    [HYDRA-702] Remove non-text-input macros (#417)

    • cassandra-plugins/docs/Cassandra-batchsink.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • cassandra-plugins/docs/Cassandra-batchsource.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • cassandra-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/BatchCassandraSink.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • cassandra-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/BatchCassandraSource.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • copybookreader-plugins/docs/CopybookReader-batchsource.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • copybookreader-plugins/src/main/java/co/cask/hydrator/plugin/batch/CopybookSource.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • core-plugins/docs/Excel-batchsource.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • core-plugins/docs/XMLReader-batchsource.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/ExcelInputReader.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/XMLReaderBatchSource.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • database-plugins/docs/Database-batchsink.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • database-plugins/docs/Database-batchsource.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • database-plugins/src/main/java/co/cask/hydrator/plugin/ConnectionConfig.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • database-plugins/src/main/java/co/cask/hydrator/plugin/DBConfig.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • database-plugins/src/main/java/co/cask/hydrator/plugin/db/batch/sink/DBSink.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • hive-plugins/docs/Hive-batchsink.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • hive-plugins/docs/Hive-batchsource.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • hive-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/HiveSinkConfig.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • hive-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/HiveSourceConfig.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/docs/CSVFormatter-transform.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/docs/CSVParser-transform.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/docs/Compressor-transform.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/docs/Decoder-transform.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/docs/Decompressor-transform.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/docs/Decryptor-transform.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/docs/Encoder-transform.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/docs/Encryptor-transform.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/docs/Hasher-transform.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/docs/StreamFormatter-transform.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/docs/ValueMapper-transform.md (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/CSVFormatter.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/CSVParser.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Compressor.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Decoder.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Decompressor.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Decryptor.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Encoder.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Encryptor.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Hasher.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/StreamFormatter.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/ValueMapper.java (version 596237821d2be6dd6f9e0ce939f727afbd046a97)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 37e4828c7e40eb22a21e18a2b82750cc349d8c0e

    Merge pull request #415 from caskdata/fix/mock-action-context-secureStoreApi
    Update MockActionContext based on SecureStore api change

  • Christopher Lu <gogreen.chris@gmail.com>

    Christopher Lu <gogreen.chris@gmail.com> a52f2501c98039df9981301f269ec0d8ffb34248

    Updated MockActionContext to reflect Secure Store api change to return Map<String, String>

    • core-plugins/src/test/java/co/cask/hydrator/plugin/common/MockActionContext.java (version a52f2501c98039df9981301f269ec0d8ffb34248)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 695e3eb2b12159d357f80b471b0a92fb27dd9829

    Merge pull request #414 from caskdata/bugfix_release/HYDRA-693-fix-naivebayes-classifier
    HYDRA-693 fix naivebayes classifier for streaming pipelines

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 50e61e984db95ca10d84e335ec821700b13d1561

    Check for bounding and splitby only if split size is greater than 1 (#413)

    • database-plugins/src/main/java/co/cask/hydrator/plugin/db/batch/source/DBSource.java (version 50e61e984db95ca10d84e335ec821700b13d1561)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> f738d34eb42337f6c5e30b1e4035e00b46a9a9b1

    HYDRA-693 fix naivebayes classifier for streaming pipelines
    Loads the model in initialize so that it can be re-used for each
    RDD it gets.

    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/NaiveBayesClassifier.java (version f738d34eb42337f6c5e30b1e4035e00b46a9a9b1)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> a31d0ca729da90c755cf9902cf1a8a6b2ca5fbb4

    Merge pull request #411 from caskdata/fix/cdap-6034
    Use Apache Tephra instead of co.cask.tephra

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 88922c3d09308c22bf4d0e9595e946d881bb2813

    Removed cleanPartitionsOlderThan from Snapshot source (#412)

    • core-plugins/docs/SnapshotAvro-batchsource.md (version 88922c3d09308c22bf4d0e9595e946d881bb2813)
    • core-plugins/docs/SnapshotParquet-batchsource.md (version 88922c3d09308c22bf4d0e9595e946d881bb2813)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchAvroSink.java (version 88922c3d09308c22bf4d0e9595e946d881bb2813)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchParquetSink.java (version 88922c3d09308c22bf4d0e9595e946d881bb2813)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchSink.java (version 88922c3d09308c22bf4d0e9595e946d881bb2813)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/SnapshotFileBatchAvroSource.java (version 88922c3d09308c22bf4d0e9595e946d881bb2813)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/SnapshotFileBatchParquetSource.java (version 88922c3d09308c22bf4d0e9595e946d881bb2813)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/SnapshotFileSetConfig.java (version 88922c3d09308c22bf4d0e9595e946d881bb2813)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> bcdf5886fb708e667eda1c182259b20154532e64

    Added macros to core batch sources (#409)

    • core-plugins/docs/AzureBlobStore-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/Excel-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/FTP-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/File-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/KVTable-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/S3-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/SnapshotAvro-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/SnapshotParquet-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/Stream-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/TPFSAvro-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/TPFSParquet-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/Table-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/docs/XMLReader-batchsource.md (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/KVTableSink.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/AzureBatchSource.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/BatchReadableSource.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/ExcelInputReader.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/FTPBatchSource.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/FileBatchSource.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/KVTableSource.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/S3BatchSource.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/SnapshotFileBatchSource.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/TableSource.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/TimePartitionedFileSetSource.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/XMLReaderBatchSource.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/TableSourceConfig.java (version bcdf5886fb708e667eda1c182259b20154532e64)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/source/XMLReaderConfigTest.java (version bcdf5886fb708e667eda1c182259b20154532e64)
  • Gokul Gunasekaran

    Gokul Gunasekaran 73a3d6bb06bbaa3de538010b4af6c9326f3ea9b8

    Use Apache Tephra

    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLTPFSTestRun.java (version 73a3d6bb06bbaa3de538010b4af6c9326f3ea9b8)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/ReferenceStreamingSource.java (version 73a3d6bb06bbaa3de538010b4af6c9326f3ea9b8)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 911175cb9330df0e3aa993c4a1f4da2776ffdeeb

    Merge pull request #410 from caskdata/bugfix_release/HYDRA-692-export-window-package
    HYDRA-692 export package windower is in to make it visible

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> b9a4612c2a1c26ee387b7a9aad58a835997708d1

    HYDRA-692 export package windower is in to make it visible

    • core-plugins/pom.xml (version b9a4612c2a1c26ee387b7a9aad58a835997708d1)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/streaming/Window.java (version b9a4612c2a1c26ee387b7a9aad58a835997708d1)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> fe5482d08f40389850da74ad16c9c2058e247c94

    [HYDRA-682] Refactor spark plugins into spark directory (#408)

    • spark-plugins/pom.xml (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/KafkaConfig.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/KafkaStreamingSource.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/NaiveBayesClassifier.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/NaiveBayesTrainer.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/ReferenceStreamingSource.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/TwitterStreamingSource.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/KafkaConfig.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/KafkaStreamingSource.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/NaiveBayesClassifier.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/NaiveBayesTrainer.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/ReferenceStreamingSource.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/TwitterStreamingSource.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/batch/spark/test/KafkaConfigTest.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/batch/spark/test/SpamMessage.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/batch/spark/test/SparkPluginTest.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/KafkaConfigTest.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/SpamMessage.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/SparkPluginTest.java (version fe5482d08f40389850da74ad16c9c2058e247c94)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12

    Added macros to transform plugins (#398)

    • transform-plugins/docs/CSVFormatter-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/CSVParser-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/CloneRecord-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/Compressor-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/Decoder-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/Decompressor-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/Decryptor-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/Encoder-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/Encryptor-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/Hasher-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/StreamFormatter-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/ValueMapper-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/XMLParser-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/docs/XMLToJSON-transform.md (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/CSVFormatter.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/CSVParser.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/CloneRecord.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Compressor.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Decoder.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Decompressor.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Encoder.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Encryptor.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Hasher.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Normalize.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/StreamFormatter.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/ValueMapper.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/XMLParser.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/XMLToJSON.java (version 5ba4e2cb6cfab96f48178a118b6e53fd44bc6b12)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923

    Added macros to core batch sinks (#394)

    • core-plugins/docs/S3Avro-batchsink.md (version f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923)
    • core-plugins/docs/S3Parquet-batchsink.md (version f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923)
    • core-plugins/docs/SnapshotAvro-batchsink.md (version f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923)
    • core-plugins/docs/SnapshotParquet-batchsink.md (version f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923)
    • core-plugins/docs/TPFSAvro-batchsink.md (version f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923)
    • core-plugins/docs/TPFSParquet-batchsink.md (version f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/S3BatchSink.java (version f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchSink.java (version f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TPFSSinkConfig.java (version f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetSink.java (version f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/SnapshotFileSetConfig.java (version f0fb52ac5bd6c3eaf0be8d6c964d98da0f29d923)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> b9a64d7ca1531c3732739b516652ddde7553dd07

    Updated spark plugins with macros (#395)

    • spark-plugins/docs/Kafka-streamingsource.md (version b9a64d7ca1531c3732739b516652ddde7553dd07)
    • spark-plugins/docs/NaiveBayesClassifier-sparkcompute.md (version b9a64d7ca1531c3732739b516652ddde7553dd07)
    • spark-plugins/docs/NaiveBayesTrainer-sparksink.md (version b9a64d7ca1531c3732739b516652ddde7553dd07)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/KafkaConfig.java (version b9a64d7ca1531c3732739b516652ddde7553dd07)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/NaiveBayesClassifier.java (version b9a64d7ca1531c3732739b516652ddde7553dd07)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/NaiveBayesTrainer.java (version b9a64d7ca1531c3732739b516652ddde7553dd07)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> a6a711ab8b545f2a050270d30d857f537a927d69

    Enabled macros for other plugins (#396)

    • cassandra-plugins/docs/Cassandra-batchsink.md (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • cassandra-plugins/docs/Cassandra-batchsource.md (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • cassandra-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/BatchCassandraSink.java (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • cassandra-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/BatchCassandraSource.java (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • copybookreader-plugins/docs/CopybookReader-batchsource.md (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • copybookreader-plugins/src/main/java/co/cask/hydrator/plugin/batch/CopybookSource.java (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • elasticsearch-plugins/docs/Elasticsearch-batchsink.md (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • elasticsearch-plugins/docs/Elasticsearch-batchsource.md (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • elasticsearch-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/BatchElasticsearchSink.java (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • elasticsearch-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/ElasticsearchSource.java (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • hbase-plugins/docs/HBase-batchsink.md (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • hbase-plugins/docs/HBase-batchsource.md (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • hbase-plugins/src/main/java/co/cask/hydrator/plugin/HBaseConfig.java (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • hive-plugins/docs/Hive-batchsink.md (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • hive-plugins/docs/Hive-batchsource.md (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • hive-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/HiveSinkConfig.java (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • hive-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/HiveSourceConfig.java (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • http-plugins/src/main/java/co/cask/hydrator/plugin/batch/HTTPCallbackAction.java (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • mongodb-plugins/docs/MongoDB-batchsink.md (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • mongodb-plugins/docs/MongoDB-batchsource.md (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • mongodb-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/MongoDBBatchSink.java (version a6a711ab8b545f2a050270d30d857f537a927d69)
    • mongodb-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/MongoDBBatchSource.java (version a6a711ab8b545f2a050270d30d857f537a927d69)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 317f1037671d42a65e6d16f747a38f26153db4e5

    Merge pull request #385 from caskdata/fix/HYDRA-663-dbsource-join
    Fixing DBSource to setOutputSchema()

  • Vinisha Shah

    Vinisha Shah 0479a774a94ca2488baa7d6af8605b297572e368

    Fixing DBSource to setOutputSchema()

    • database-plugins/docs/Database-batchsink.md (version 0479a774a94ca2488baa7d6af8605b297572e368)
    • database-plugins/src/main/java/co/cask/hydrator/plugin/DBRecord.java (version 0479a774a94ca2488baa7d6af8605b297572e368)
    • database-plugins/src/main/java/co/cask/hydrator/plugin/DBUtils.java (version 0479a774a94ca2488baa7d6af8605b297572e368)
    • database-plugins/src/main/java/co/cask/hydrator/plugin/db/batch/source/DBSource.java (version 0479a774a94ca2488baa7d6af8605b297572e368)
    • database-plugins/widgets/Database-batchsource.json (version 0479a774a94ca2488baa7d6af8605b297572e368)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 8b2e67351ee0718c1215873728ea867ebc8ae0c6

    Added Twitter spark streaming source (#403)

    • core-plugins/docs/Twitter-realtimesource.md (version 8b2e67351ee0718c1215873728ea867ebc8ae0c6)
    • pom.xml (version 8b2e67351ee0718c1215873728ea867ebc8ae0c6)
    • spark-plugins/docs/Twitter-streamingsource.md (version 8b2e67351ee0718c1215873728ea867ebc8ae0c6)
    • spark-plugins/pom.xml (version 8b2e67351ee0718c1215873728ea867ebc8ae0c6)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/TwitterStreamingSource.java (version 8b2e67351ee0718c1215873728ea867ebc8ae0c6)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/batch/spark/test/SparkPluginTest.java (version 8b2e67351ee0718c1215873728ea867ebc8ae0c6)
    • spark-plugins/widgets/Twitter-streamingsource.json (version 8b2e67351ee0718c1215873728ea867ebc8ae0c6)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 5815f0d2812a0f72c121304db4efdbb5db9ebcc1

    [HYDRA-681] Remove redundant null checks for plugin config properties (#404)

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/BatchCubeSink.java (version 5815f0d2812a0f72c121304db4efdbb5db9ebcc1)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/BatchWritableSink.java (version 5815f0d2812a0f72c121304db4efdbb5db9ebcc1)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/KVTableSink.java (version 5815f0d2812a0f72c121304db4efdbb5db9ebcc1)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TableSink.java (version 5815f0d2812a0f72c121304db4efdbb5db9ebcc1)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/dataset/SnapshotFileSet.java (version 5815f0d2812a0f72c121304db4efdbb5db9ebcc1)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/realtime/sink/RealtimeTableSink.java (version 5815f0d2812a0f72c121304db4efdbb5db9ebcc1)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/realtime/source/JmsSource.java (version 5815f0d2812a0f72c121304db4efdbb5db9ebcc1)
    • kafka-plugins/src/main/java/co/cask/hydrator/plugin/realtime/KafkaSource.java (version 5815f0d2812a0f72c121304db4efdbb5db9ebcc1)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 461175a439a3b4fd6d9fd20c49ef3d61fb05a7e9

    Merge pull request #406 from caskdata/bugfix_release/database-widget-password
    change widget for database password to password

  • Edwin Elia

    Edwin Elia 46d54a4bd853e919e33b5f0d5f1c732e653deffd

    change widget for database password to password

    • database-plugins/widgets/Database-batchsource.json (version 46d54a4bd853e919e33b5f0d5f1c732e653deffd)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 8d140b4e179c1a70e91407f4af1453e73041a16b

    Merge pull request #405 from caskdata/feature/ORCSinkPlugin
    Adding the TPFSOrc sink Plugin, supporting the functionality to store data in ORC format

  • Abhinav <abhinavbansal246@gmail.com>

    Abhinav <abhinavbansal246@gmail.com> 7d9373c04e446a6b94efecabd6a897595c565d36

    Adding the TPFSOrc sink Plugin, supporting the functionality to store files in ORC format

    • core-plugins/docs/TPFSOrc-batchsink.md (version 7d9373c04e446a6b94efecabd6a897595c565d36)
    • core-plugins/pom.xml (version 7d9373c04e446a6b94efecabd6a897595c565d36)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetDataSetORCSink.java (version 7d9373c04e446a6b94efecabd6a897595c565d36)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/FileSetUtil.java (version 7d9373c04e446a6b94efecabd6a897595c565d36)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/StructuredToOrcTransformer.java (version 7d9373c04e446a6b94efecabd6a897595c565d36)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLBatchTestBase.java (version 7d9373c04e446a6b94efecabd6a897595c565d36)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLTPFSTestRun.java (version 7d9373c04e446a6b94efecabd6a897595c565d36)
    • core-plugins/widgets/TPFSOrc-batchsink.json (version 7d9373c04e446a6b94efecabd6a897595c565d36)
    • hydrator-common/src/main/java/co/cask/hydrator/common/HiveSchemaConverter.java (version 7d9373c04e446a6b94efecabd6a897595c565d36)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> c47adf06f7817de878d00f7f49d49147584818f3

    Merge pull request #361 from caskdata/feature/HYDRA-178-window-plugin
    HYDRA-178 adding a window plugin

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 59c0192cf6ac1a1c891ebbd706aa3bc662f046a8

    Merge pull request #402 from caskdata/fix-HYDRA-672-671
    [HYDRA-671-672]: fix docs for Decryptor and Encyrptor plugins

  • Christopher Lu <gogreen.chris@gmail.com>

    Christopher Lu <gogreen.chris@gmail.com> 314c0cd4bda6d1168f25ed132e2016778bc2edec

    [HYDRA-671-672]: fix docs for Decryptor and Encyrptor plugins
    Update Encryptor-transform.md

    • hydrator-common/src/main/java/co/cask/hydrator/common/KeystoreConf.java (version 314c0cd4bda6d1168f25ed132e2016778bc2edec)
    • transform-plugins/docs/Decryptor-transform.md (version 314c0cd4bda6d1168f25ed132e2016778bc2edec)
    • transform-plugins/docs/Encryptor-transform.md (version 314c0cd4bda6d1168f25ed132e2016778bc2edec)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Decryptor.java (version 314c0cd4bda6d1168f25ed132e2016778bc2edec)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Encryptor.java (version 314c0cd4bda6d1168f25ed132e2016778bc2edec)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 79495638beb259b578e5ac7b481da588b9847fdc

    HYDRA-178 clarify docs

    • core-plugins/docs/Window-windower.md (version 79495638beb259b578e5ac7b481da588b9847fdc)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 33f4708d97c3589375f2e5c4fc312f87d13aea1c

    HYDRA-178 adding a window plugin

    • core-plugins/docs/Window-windower.md (version 33f4708d97c3589375f2e5c4fc312f87d13aea1c)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/streaming/Window.java (version 33f4708d97c3589375f2e5c4fc312f87d13aea1c)
    • core-plugins/widgets/Window-windower.json (version 33f4708d97c3589375f2e5c4fc312f87d13aea1c)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 54e78f4431f69293995022975791442aa16944ab

    Merge pull request #399 from caskdata/bugfix_release/ui-improve-widget-jsons
    [HYDRA-485] [HYDRA-544] Bugfix release/ui improve widget jsons

  • Edwin Elia

    Edwin Elia a6afc64a7c50c5e45bbf9d6434577e39b27a2215

    fix delimiter name for CSVFormatter to CARET

    • transform-plugins/src/main/java/co/cask/hydrator/plugin/CSVFormatter.java (version a6afc64a7c50c5e45bbf9d6434577e39b27a2215)
    • transform-plugins/widgets/CSVFormatter-transform.json (version a6afc64a7c50c5e45bbf9d6434577e39b27a2215)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 9e986aa165e6671f5e1a4423b02194b172c2c907

    Merge pull request #393 from caskdata/feature/join-doc
    Adding Joiner markdown

  • Vinisha Shah

    Vinisha Shah dde272c77fd4ae7b98cbadc8d4e1e6fe4111861d

    Adding Joiner markdown

    • core-plugins/docs/Joiner-batchjoiner.md (version dde272c77fd4ae7b98cbadc8d4e1e6fe4111861d)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/joiner/JoinerConfig.java (version dde272c77fd4ae7b98cbadc8d4e1e6fe4111861d)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 0f6f3dbb942097a55ba7ef3b21eb3c7e28dc4fa4

    Merge pull request #400 from caskdata/fix-HYDRA-676
    [HYDRA-676]: fix Config UI issues

  • Christopher Lu <gogreen.chris@gmail.com>

    Christopher Lu <gogreen.chris@gmail.com> a270e2b0f3cd6910edb589c960acc89a995b575d

    file renaming

    • core-plugins/docs/HDFSAction-action.md (version a270e2b0f3cd6910edb589c960acc89a995b575d)
    • core-plugins/docs/HDFSFileMoveAction-action.md (version a270e2b0f3cd6910edb589c960acc89a995b575d)
    • core-plugins/widgets/HDFSAction-action.json (version a270e2b0f3cd6910edb589c960acc89a995b575d)
    • core-plugins/widgets/HDFSFileMoveAction-action.json (version a270e2b0f3cd6910edb589c960acc89a995b575d)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 804a3192560f992e4d5d6fd933829a9dc0836512

    Merge pull request #383 from caskdata/feature/typeTransform
    add TINIY AND SMALL INT transform

  • Yue Gao <Yue@Casks-MacBook-3.local>

    Yue Gao <Yue@Casks-MacBook-3.local> 90993ec0bc2aae4bcc3c20bf990273029e87eb6f

    use number istead of checking

    • database-plugins/src/main/java/co/cask/hydrator/plugin/DBRecord.java (version 90993ec0bc2aae4bcc3c20bf990273029e87eb6f)
  • Edwin Elia

    Edwin Elia f8ec0cf70613e0cc01a5e34364caa660a3eb5a38

    order dropdown alphabetically

    • core-plugins/widgets/Deduplicate-batchaggregator.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • core-plugins/widgets/Excel-batchsource.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • core-plugins/widgets/GroupByAggregate-batchaggregator.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • core-plugins/widgets/Projection-transform.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • core-plugins/widgets/RowDenormalizer-batchaggregator.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • core-plugins/widgets/XMLReader-batchsource.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • http-plugins/widgets/HTTPCallback-postaction.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • http-plugins/widgets/HTTPPoller-realtimesource.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • kafka-plugins/widgets/KafkaProducer-realtimesink.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • transform-plugins/widgets/CSVFormatter-transform.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • transform-plugins/widgets/CSVParser-transform.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • transform-plugins/widgets/Decoder-transform.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • transform-plugins/widgets/Encoder-transform.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
    • transform-plugins/widgets/XMLParser-transform.json (version f8ec0cf70613e0cc01a5e34364caa660a3eb5a38)
  • Edwin Elia

    Edwin Elia d859a2120a9919888c8bfd9bd4eb132b083189db

    update Joiner widget json to include field descriptions

    • core-plugins/widgets/Joiner-batchjoiner.json (version d859a2120a9919888c8bfd9bd4eb132b083189db)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 26b3d63cde01ceabe9c5bab9288e8bb5edc9eb99

    Merge pull request #380 from caskdata/fix/npe-join
    Fixing getOutputSchema for joins

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 2ecacc80a185fe101245573fccb4f00716f00913

    Merge pull request #357 from caskdata/hdfs-move-action
    HDFS Action Plugin

  • Christopher Lu <gogreen.chris@gmail.com>

    Christopher Lu <gogreen.chris@gmail.com> 054e990b6f65f94c8687d637a184fa4144e0836c

    HDFSMove Action for Hydrator Plugin

    • core-plugins/docs/HDFSAction-action.md (version 054e990b6f65f94c8687d637a184fa4144e0836c)
    • core-plugins/pom.xml (version 054e990b6f65f94c8687d637a184fa4144e0836c)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/action/HDFSFileMoveAction.java (version 054e990b6f65f94c8687d637a184fa4144e0836c)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/BatchPluginsTestSuite.java (version 054e990b6f65f94c8687d637a184fa4144e0836c)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/action/HDFSFileMoveActionTestRun.java (version 054e990b6f65f94c8687d637a184fa4144e0836c)
    • core-plugins/widgets/HDFSAction-action.json (version 054e990b6f65f94c8687d637a184fa4144e0836c)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 19b9b9a70ab31e8264243b776ce356f0a089cf62

    Merge pull request #353 from caskdata/fix-SSHActionDoc-CDAP-6672
    [CDAP-6672]: fix documentation issues for SSHAction

  • Christopher Lu <gogreen.chris@gmail.com>

    Christopher Lu <gogreen.chris@gmail.com> 1252b2d238105a906d161cd69168903d6e99f507

    [CDAP-6672]: fix documentation issues for SSHAction

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/action/SSHAction.java (version 1252b2d238105a906d161cd69168903d6e99f507)
  • sreevatsan raman <sreevatsan@gmail.com>

    sreevatsan raman <sreevatsan@gmail.com> 88dceea7364e92022fbdc9ee42fbb2c52c72d982

    add encryptor and decryptor transforms (#387)
    * add encryptor and decryptor transforms

    * Expose KeyStoreConf in unittest

    • hydrator-common/src/main/java/co/cask/hydrator/common/FieldEncryptor.java (version 88dceea7364e92022fbdc9ee42fbb2c52c72d982)
    • hydrator-common/src/main/java/co/cask/hydrator/common/KeystoreConf.java (version 88dceea7364e92022fbdc9ee42fbb2c52c72d982)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Decryptor.java (version 88dceea7364e92022fbdc9ee42fbb2c52c72d982)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/Encryptor.java (version 88dceea7364e92022fbdc9ee42fbb2c52c72d982)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/FileBasedFieldEncryptor.java (version 88dceea7364e92022fbdc9ee42fbb2c52c72d982)
    • transform-plugins/src/test/java/co/cask/hydrator/plugin/FieldEncryptorTest.java (version 88dceea7364e92022fbdc9ee42fbb2c52c72d982)
    • transform-plugins/src/test/java/co/cask/hydrator/plugin/TransformPluginsTestBase.java (version 88dceea7364e92022fbdc9ee42fbb2c52c72d982)
    • transform-plugins/widgets/Decryptor-transform.json (version 88dceea7364e92022fbdc9ee42fbb2c52c72d982)
    • transform-plugins/widgets/Encryptor-transform.json (version 88dceea7364e92022fbdc9ee42fbb2c52c72d982)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> fb913f913565bc2b115e289e25cd544a2a9a47d2

    Merge pull request #392 from caskdata/mockaction-compilation-fix
    Fix MockActionContext Compilation Errors

  • Kashif Nazir

    Kashif Nazir a3336587a5f4f163fb38f42264405b8b57491652

    Updated MockActionContext

    • core-plugins/src/test/java/co/cask/hydrator/plugin/common/MockActionContext.java (version a3336587a5f4f163fb38f42264405b8b57491652)
  • Yue Gao <Yue@Casks-MacBook-3.local>

    Yue Gao <Yue@Casks-MacBook-3.local> 07c0e65a50e209d33b0be345b5226f1463ec0509

    add some tests

    • database-plugins/src/test/java/co/cask/hydrator/plugin/DatabasePluginTestBase.java (version 07c0e65a50e209d33b0be345b5226f1463ec0509)
    • database-plugins/src/test/java/co/cask/hydrator/plugin/db/batch/sink/DBSourceTestRun.java (version 07c0e65a50e209d33b0be345b5226f1463ec0509)
  • Yue Gao <Yue@Casks-MacBook-3.local>

    Yue Gao <Yue@Casks-MacBook-3.local> 8b877ffca5bdbcf1acb920e8167e1725ff4ba426

    difference between sql server and mysql

    • database-plugins/src/main/java/co/cask/hydrator/plugin/DBRecord.java (version 8b877ffca5bdbcf1acb920e8167e1725ff4ba426)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> d31ba0836377205c7cbdd3ce449313d0cadf0429

    Added SSHAction unit test and fixed default port bug (#359)

    • core-plugins/pom.xml (version d31ba0836377205c7cbdd3ce449313d0cadf0429)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/action/SSHAction.java (version d31ba0836377205c7cbdd3ce449313d0cadf0429)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/action/SSHActionTest.java (version d31ba0836377205c7cbdd3ce449313d0cadf0429)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/common/EchoCommand.java (version d31ba0836377205c7cbdd3ce449313d0cadf0429)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/common/EchoCommandFactory.java (version d31ba0836377205c7cbdd3ce449313d0cadf0429)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/common/MockActionContext.java (version d31ba0836377205c7cbdd3ce449313d0cadf0429)
  • sreevatsan raman <sreevatsan@gmail.com>

    sreevatsan raman <sreevatsan@gmail.com> 5c1df85b38d7166a05ee5c0d6958773862ff86bd

    Revert "fix HYDRA-125 cannot read from TPFS Parquet source" (#384)

    • core-plugins/pom.xml (version 5c1df85b38d7166a05ee5c0d6958773862ff86bd)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/S3ParquetBatchSink.java (version 5c1df85b38d7166a05ee5c0d6958773862ff86bd)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchParquetSink.java (version 5c1df85b38d7166a05ee5c0d6958773862ff86bd)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/SnapshotFileBatchParquetSource.java (version 5c1df85b38d7166a05ee5c0d6958773862ff86bd)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/TimePartitionedFileSetDatasetParquetSource.java (version 5c1df85b38d7166a05ee5c0d6958773862ff86bd)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/FileSetUtil.java (version 5c1df85b38d7166a05ee5c0d6958773862ff86bd)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLBatchTestBase.java (version 5c1df85b38d7166a05ee5c0d6958773862ff86bd)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLSnapshotTestRun.java (version 5c1df85b38d7166a05ee5c0d6958773862ff86bd)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLTPFSTestRun.java (version 5c1df85b38d7166a05ee5c0d6958773862ff86bd)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 3eb069c847c40209a6267b81d4edff28ddc02470

    Add schema in runtime (#382)
    * Add schema in runtime

    * Update comment

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetDatasetAvroSink.java (version 3eb069c847c40209a6267b81d4edff28ddc02470)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetDatasetParquetSink.java (version 3eb069c847c40209a6267b81d4edff28ddc02470)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetSink.java (version 3eb069c847c40209a6267b81d4edff28ddc02470)
  • Yue Gao <Yue@Casks-MacBook-3.local>

    Yue Gao <Yue@Casks-MacBook-3.local> 9f00c880be9b341813fb2e94ee2f6cddeaa6b689

    add TINIY AND SMALL INT transform

    • database-plugins/src/main/java/co/cask/hydrator/plugin/DBRecord.java (version 9f00c880be9b341813fb2e94ee2f6cddeaa6b689)
  • sreevatsan raman <sreevatsan@gmail.com>

    sreevatsan raman <sreevatsan@gmail.com> 62ff855667b2886d91df7c8997474cbd08a84fb9

    [HYDRA-311] [HYDRA-312] Renamed Excel widget and reference files (#360)

    • core-plugins/docs/Excel-batchsource.md (version 62ff855667b2886d91df7c8997474cbd08a84fb9)
    • core-plugins/docs/ExcelInputReader-batchsource.md (version 62ff855667b2886d91df7c8997474cbd08a84fb9)
    • core-plugins/widgets/Excel-batchsource.json (version 62ff855667b2886d91df7c8997474cbd08a84fb9)
    • core-plugins/widgets/ExcelInputReader-batchsource.json (version 62ff855667b2886d91df7c8997474cbd08a84fb9)
  • sreevatsan raman <sreevatsan@gmail.com>

    sreevatsan raman <sreevatsan@gmail.com> f81f48ddc82e5b3c45adc8cf3fd3fcbe4cc3f46c

    Fix error dataset name (#350)

    • transform-plugins/widgets/XMLParser-transform.json (version f81f48ddc82e5b3c45adc8cf3fd3fcbe4cc3f46c)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 4b5a058a287ead4d3e35e7bfbb4f04e7b16f74ce

    Merge pull request #381 from caskdata/bugfix/HYDRA-665-fix-dbsource-conditions-check
    HYDRA-665 move runtime check for $CONDITIONS

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 166241d707ba34a3ad86cafe605d194e1da4774a

    Added macros to DBPlugin properties (#378)

    • database-plugins/src/main/java/co/cask/hydrator/plugin/ConnectionConfig.java (version 166241d707ba34a3ad86cafe605d194e1da4774a)
    • database-plugins/src/main/java/co/cask/hydrator/plugin/db/batch/action/QueryAction.java (version 166241d707ba34a3ad86cafe605d194e1da4774a)
    • database-plugins/src/main/java/co/cask/hydrator/plugin/db/batch/source/DBSource.java (version 166241d707ba34a3ad86cafe605d194e1da4774a)
    • database-plugins/widgets/Database-batchsource.json (version 166241d707ba34a3ad86cafe605d194e1da4774a)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 09a5699d9c2f8425a3c237ae6ab104446f1df354

    HYDRA-665 move runtime check for $CONDITIONS
    Moving the runtime check for $CONDITIONS in the import query so
    that it is only checked if numSplits is not set to 1.

    • database-plugins/src/main/java/co/cask/hydrator/plugin/db/batch/source/DBSource.java (version 09a5699d9c2f8425a3c237ae6ab104446f1df354)
  • Vinisha Shah

    Vinisha Shah bcd4a947ec6d48e74ad2b0982e8476f37d52c66b

    Fixing getOutputSchema for joins

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/joiner/Joiner.java (version bcd4a947ec6d48e74ad2b0982e8476f37d52c66b)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/joiner/JoinerConfigTest.java (version bcd4a947ec6d48e74ad2b0982e8476f37d52c66b)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 8881a97f2f1a6273ef76c00114428a67ae14293a

    Merge pull request #377 from caskdata/feature/AveroTransformer
    nested schema issue fix

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 2cd8610f85837a12b02fcc078c9c33b7ded798b9

    [CDAP-6535] Snapshot sink cleans up older snapshots (#375)

    • core-plugins/docs/SnapshotAvro-batchsink.md (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/docs/SnapshotAvro-batchsource.md (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/docs/SnapshotParquet-batchsink.md (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/docs/SnapshotParquet-batchsource.md (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchAvroSink.java (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchParquetSink.java (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchSink.java (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/SnapshotFileBatchAvroSource.java (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/SnapshotFileBatchParquetSource.java (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/SnapshotFileSetConfig.java (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/dataset/SnapshotFileSet.java (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/widgets/SnapshotAvro-batchsink.json (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/widgets/SnapshotAvro-batchsource.json (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/widgets/SnapshotParquet-batchsink.json (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
    • core-plugins/widgets/SnapshotParquet-batchsource.json (version 2cd8610f85837a12b02fcc078c9c33b7ded798b9)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 9029077b54a545919e3679bf7c9fee1df150a5cc

    Added macro support to kafka source and HDFSSink properties (#379)

    • hdfs-plugins/src/main/java/co/cask/hydrator/plugin/HDFSSink.java (version 9029077b54a545919e3679bf7c9fee1df150a5cc)
    • kafka-plugins/src/main/java/co/cask/hydrator/plugin/realtime/KafkaSource.java (version 9029077b54a545919e3679bf7c9fee1df150a5cc)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 68ea7434deac85a173d70c7f61a794f0008825e2

    [CDAP-5979] Allow CSVParser to accept nullable input field (#356)

    • transform-plugins/docs/CSVParser-transform.md (version 68ea7434deac85a173d70c7f61a794f0008825e2)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/CSVParser.java (version 68ea7434deac85a173d70c7f61a794f0008825e2)
    • transform-plugins/src/test/java/co/cask/hydrator/plugin/CSVParserTest.java (version 68ea7434deac85a173d70c7f61a794f0008825e2)
  • Yue Gao <Yue@Casks-MacBook-3.local>

    Yue Gao <Yue@Casks-MacBook-3.local> 4ac8b8034e30a01f985f1f437b28c4ea54366977

    recursive

    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/AvroToStructuredTransformer.java (version 4ac8b8034e30a01f985f1f437b28c4ea54366977)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/StructuredToAvroTransformer.java (version 4ac8b8034e30a01f985f1f437b28c4ea54366977)
    • hydrator-common/src/main/java/co/cask/hydrator/common/RecordConverter.java (version 4ac8b8034e30a01f985f1f437b28c4ea54366977)
  • Yue Gao <Yue@Casks-MacBook-3.local>

    Yue Gao <Yue@Casks-MacBook-3.local> eda9ddcf25162f55fdf844a0cc87c4fbab839a23

    fix nested record

    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/StructuredToAvroTransformer.java (version eda9ddcf25162f55fdf844a0cc87c4fbab839a23)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/transform/StructuredtoAvroTest.java (version eda9ddcf25162f55fdf844a0cc87c4fbab839a23)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 8d23ddcb465e079b8ae9f542fe9ec3bfe2fc8f98

    Merge pull request #367 from caskdata/feature/join-api-change
    Changes to StageConfigurer api for joins

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 1fde1ed64886f6e5653002fd3ae09751cc9a8963

    Merge pull request #374 from caskdata/fix/fix-csv-parser-passthrough
    fix pass through for csv parser

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> d40b9dac9fefd37dac3fe02fefb87a4c1d244c6a

    fix pass through for csv parser
    I resolved the conflict incorrectly for this class, causing pass
    through to work incorrectly. This fixes the behavior.

    • transform-plugins/src/main/java/co/cask/hydrator/plugin/CSVParser.java (version d40b9dac9fefd37dac3fe02fefb87a4c1d244c6a)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 416f3b5ca4596b8b855d4659ba2801cffaacfdd3

    Merge pull request #373 from caskdata/fix/checkstyle-fixes
    checkstyle fixes due to new checkstyle setting

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6

    checkstyle fixes due to new checkstyle setting

    • cassandra-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/BatchCassandraSink.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/aggregator/DedupConfig.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/aggregator/GroupByConfig.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/joiner/Joiner.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/common/StructuredRecordToCubeFact.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/realtime/source/SqsSourceTest.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/transform/CachingLookupTest.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • database-plugins/src/main/java/co/cask/hydrator/plugin/db/batch/sink/DBSink.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • database-plugins/src/test/java/co/cask/hydrator/plugin/DBConfigTest.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • hbase-plugins/src/main/java/co/cask/hydrator/plugin/sink/HBaseSink.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • hydrator-common/src/main/java/co/cask/hydrator/common/TimeParser.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • mongodb-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/MongoDBBatchSink.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/KafkaStreamingSource.java (version 6f3c71a8ad63dbb4b84e4c587d6e7c53ef6246c6)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> d462b1d1155e5f76d1a75e3815744f9065234ca9

    Uncomment RedundantModifier since this is the current active release (#371)

    • checkstyle.xml (version d462b1d1155e5f76d1a75e3815744f9065234ca9)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 7a5eb47025d14637155c76eceb6c902485b85cd7

    Merge pull request #372 from caskdata/fix/fix-merge-error
    fix compilation error due to merging

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 4da23b244a18159602e5b6ba8533d87f0b241da6

    fix compilation error due to merging

    • transform-plugins/src/main/java/co/cask/hydrator/plugin/XMLParser.java (version 4da23b244a18159602e5b6ba8533d87f0b241da6)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 864a1d7ba205e083162224021039127b62ee653a

    Merge pull request #370 from caskdata/fix/HYDRA-397-fix-tests
    Fix/hydra 397 fix tests

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 1638291ea318a20821d3aa4ebcd8a21968ac63ad

    Merge pull request #368 from caskdata/merge-1-3
    Merge 1 3

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 7437a267c07816d13e56a4c093ec881cc850b7bd

    Merge pull request #352 from caskdata/feature/HYDRA-177-kafka-streaming-source
    CDAP-6584 add kafka streaming source

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 2800564b76f1a3848f3cac685aae0bb1a2dcb82a

    HYDRA-177 source enhancements
    Adds reference name in order to provide tracking for the kafka
    brokers and topics configured in the source. Also adding config
    properties that allow users to include the message key and the
    batch timestamp in the output records.

    • spark-plugins/docs/Kafka-streamingsource.md (version 2800564b76f1a3848f3cac685aae0bb1a2dcb82a)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/KafkaConfig.java (version 2800564b76f1a3848f3cac685aae0bb1a2dcb82a)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/KafkaStreamingSource.java (version 2800564b76f1a3848f3cac685aae0bb1a2dcb82a)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/ReferenceStreamingSource.java (version 2800564b76f1a3848f3cac685aae0bb1a2dcb82a)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/batch/spark/test/KafkaConfigTest.java (version 2800564b76f1a3848f3cac685aae0bb1a2dcb82a)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/batch/spark/test/SparkPluginTest.java (version 2800564b76f1a3848f3cac685aae0bb1a2dcb82a)
    • spark-plugins/widgets/Kafka-streamingsource.json (version 2800564b76f1a3848f3cac685aae0bb1a2dcb82a)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 260d7527c0234ef65c1d41aa924d6f156f29ace0

    HYDRA-397 fix test suites
    Fix test suites after a CDAP change. Also ignoring xml and excel
    tests until their fixes are in, and removing explore enabled
    from DB tests since it is not needed.

    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/BatchPluginsTestSuite.java (version 260d7527c0234ef65c1d41aa924d6f156f29ace0)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/source/ExcelInputReaderTest.java (version 260d7527c0234ef65c1d41aa924d6f156f29ace0)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/source/XMLReaderBatchSourceTest.java (version 260d7527c0234ef65c1d41aa924d6f156f29ace0)
    • database-plugins/src/test/java/co/cask/hydrator/plugin/DatabasePluginTestBase.java (version 260d7527c0234ef65c1d41aa924d6f156f29ace0)
    • database-plugins/src/test/java/co/cask/hydrator/plugin/DatabasePluginTestSuite.java (version 260d7527c0234ef65c1d41aa924d6f156f29ace0)
    • http-plugins/src/test/java/co/cask/hydrator/plugin/batch/HttpCallbackActionTest.java (version 260d7527c0234ef65c1d41aa924d6f156f29ace0)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> f40a28b81676101aa19fd9b0450943b7b7a9b1a6

    HYDRA-397 remove BaseHttpTest
    Removing parent BaseHttpTest and moving logic into the only class
    that extends it. This fixes test errors due to the BaseTest having
    no runnable test methods.

    Also renaming HttpCallbackActionTestRun. Seems like these used to
    be part of a test suite or something, but they are now single tests.

    • http-plugins/src/test/java/co/cask/hydrator/plugin/BaseHttpTest.java (version f40a28b81676101aa19fd9b0450943b7b7a9b1a6)
    • http-plugins/src/test/java/co/cask/hydrator/plugin/batch/HttpCallbackActionTestRun.java (version f40a28b81676101aa19fd9b0450943b7b7a9b1a6)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 175dfa8d0bce57730e83637055b3335504424f1f

    Merge remote-tracking branch 'origin/release/1.3' into merge-1-3

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> bb44f8676b647e9580b32075a8ae24ad1aee917c

    Update checkstyle and comment RedundantModifier (#363)

    • checkstyle.xml (version bb44f8676b647e9580b32075a8ae24ad1aee917c)
    • pom.xml (version bb44f8676b647e9580b32075a8ae24ad1aee917c)
  • Vinisha Shah

    Vinisha Shah 755804f2caaa239030e2b7c135152aa04c450824

    Changes to StageConfigurer api for joins

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/joiner/Joiner.java (version 755804f2caaa239030e2b7c135152aa04c450824)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/sink/TableSinkTest.java (version 755804f2caaa239030e2b7c135152aa04c450824)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/realtime/sink/RealtimeTableSinkTest.java (version 755804f2caaa239030e2b7c135152aa04c450824)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/transform/MockPipelineConfigurer.java (version 755804f2caaa239030e2b7c135152aa04c450824)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/transform/ProjectionTransformTest.java (version 755804f2caaa239030e2b7c135152aa04c450824)
    • hbase-plugins/src/test/java/co/cask/hydrator/plugin/HBaseSinkTest.java (version 755804f2caaa239030e2b7c135152aa04c450824)
    • hydrator-common/src/main/java/co/cask/hydrator/common/MockPipelineConfigurer.java (version 755804f2caaa239030e2b7c135152aa04c450824)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> a5dab9eec2b4007aedb826db09e1eb70f167894d

    CDAP-6584 add kafka streaming source

    • pom.xml (version a5dab9eec2b4007aedb826db09e1eb70f167894d)
    • spark-plugins/docs/Kafka-streamingsource.md (version a5dab9eec2b4007aedb826db09e1eb70f167894d)
    • spark-plugins/pom.xml (version a5dab9eec2b4007aedb826db09e1eb70f167894d)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/batch/spark/KafkaStreamingSource.java (version a5dab9eec2b4007aedb826db09e1eb70f167894d)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/batch/spark/test/SparkPluginTest.java (version a5dab9eec2b4007aedb826db09e1eb70f167894d)
    • spark-plugins/widgets/Kafka-streamingsource.json (version a5dab9eec2b4007aedb826db09e1eb70f167894d)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 3c8f30bbcf6b33e70053352b0a845bc89ea50549

    Merge pull request #303 from caskdata/feature/bump133to134snap
    Bump release/1.3 version to 1.3.4-SNAPSHOT

  • Rohit Sinha

    Rohit Sinha c6e56f44b26725aba6bd3963bbbe5f6fd495f48d

    Bump release/1.3 version to 1.3.4-SNAPSHOT

    • cassandra-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • core-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • database-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • elasticsearch-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • hbase-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • hdfs-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • hive-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • http-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • hydrator-common/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • kafka-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • mongodb-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • spark-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
    • transform-plugins/pom.xml (version c6e56f44b26725aba6bd3963bbbe5f6fd495f48d)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> b2213ad49de698b694de9d81c6082bbfdb16e27a

    Merge pull request #299 from caskdata/feature/bump-133
    Bump version to 1.3.3

  • Rohit Sinha

    Rohit Sinha 900e0257c42f712d7e14a4c07cabc87abb680a3d

    Bump version to 1.3.3

    • cassandra-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • core-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • database-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • elasticsearch-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • hbase-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • hdfs-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • hive-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • http-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • hydrator-common/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • kafka-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • mongodb-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • spark-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
    • transform-plugins/pom.xml (version 900e0257c42f712d7e14a4c07cabc87abb680a3d)
  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> b08550eb593d8dd1cd31d6ec70525de7198821ea

    Merge pull request #298 from caskdata/bugfix/CDAP-6258
    CDAP-6258 Remove aliasing of batch sources/sinks.

  • GitHub <noreply@github.com>

    GitHub <noreply@github.com> 585c6462d5eb9842a15eb538650b7b8e067b5b0f

    Merge pull request #297 from caskdata/fix/backport-hydrator
    CDAP-6238 Use the configs for default file system and its implementation while configuring the job in plugin.

  • Ali Anwar

    Ali Anwar f3b98ee917848a477b1f5f63a9ea54320b7dde38

    CDAP-6258 Remove aliasing of batch sources/sinks.

    • cassandra-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/BatchCassandraSink.java (version f3b98ee917848a477b1f5f63a9ea54320b7dde38)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/S3AvroBatchSink.java (version f3b98ee917848a477b1f5f63a9ea54320b7dde38)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/S3BatchSink.java (version f3b98ee917848a477b1f5f63a9ea54320b7dde38)
    • database-plugins/src/main/java/co/cask/hydrator/plugin/db/batch/sink/DBSink.java (version f3b98ee917848a477b1f5f63a9ea54320b7dde38)
    • elasticsearch-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/BatchElasticsearchSink.java (version f3b98ee917848a477b1f5f63a9ea54320b7dde38)
    • elasticsearch-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/ElasticsearchSource.java (version f3b98ee917848a477b1f5f63a9ea54320b7dde38)
    • hbase-plugins/src/main/java/co/cask/hydrator/plugin/sink/HBaseSink.java (version f3b98ee917848a477b1f5f63a9ea54320b7dde38)
    • hbase-plugins/src/main/java/co/cask/hydrator/plugin/source/HBaseSource.java (version f3b98ee917848a477b1f5f63a9ea54320b7dde38)
    • hdfs-plugins/src/main/java/co/cask/hydrator/plugin/HDFSSink.java (version f3b98ee917848a477b1f5f63a9ea54320b7dde38)
    • hive-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/HiveBatchSink.java (version f3b98ee917848a477b1f5f63a9ea54320b7dde38)
  • sagarkapare <sagar@cask.co>

    sagarkapare <sagar@cask.co> 0a54fe3fff221316f88125ef37705a80e4d377ee

    CDAP-6238 Use the configs for default file system and its implementation while configuring the job in plugin.

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetDatasetAvroSink.java (version 0a54fe3fff221316f88125ef37705a80e4d377ee)
    • hydrator-common/src/main/java/co/cask/hydrator/common/SourceInputFormatProvider.java (version 0a54fe3fff221316f88125ef37705a80e4d377ee)
    • hydrator-common/src/main/java/co/cask/hydrator/common/batch/JobUtils.java (version 0a54fe3fff221316f88125ef37705a80e4d377ee)
  • Rohit Sinha

    Rohit Sinha cb6ae83aa20c74340b02754aace1c551b70a63e8

    Merge pull request #288 from caskdata/revert-280-rohitsinha54-patch-1
    Revert "Make hydrator 1.3.2 use cdap 3.4.1 temporarily"

  • Rohit Sinha

    Rohit Sinha f51322a12231ccfc383e966fdc521ac158a32d63

    Revert "Make hydrator 1.3.2 use cdap 3.4.1 temporarily"

    • pom.xml (version f51322a12231ccfc383e966fdc521ac158a32d63)
  • Gokul Gunasekaran

    Gokul Gunasekaran 655ee0c79cdfb89440aea8672304022e26b565d7

    Merge pull request #279 from caskdata/fix/release-build-failure
    CDAP-6140 binary is a reserved keyword. hence use backticks in explore

  • Rohit Sinha

    Rohit Sinha b854f289b8b110a964fe315507e38e63496db33f

    Merge pull request #280 from caskdata/rohitsinha54-patch-1
    Make hydrator 1.3.2 use cdap 3.4.1 temporarily

  • Rohit Sinha

    Rohit Sinha e94df29f527eeb459c7a0db9bf7ded506611e885

    Make hydrator 1.3.2 use cdap 3.4.1 temporarily
    Should use cdap 3.4.1 until 3.4.2  is out.

    • pom.xml (version e94df29f527eeb459c7a0db9bf7ded506611e885)
  • Rohit Sinha

    Rohit Sinha 679fe0cbb63fa4261ef2b9248ac5f1d43753381f

    Merge pull request #277 from caskdata/feature/bump-132
    Bump release/1.3 to 1.3.2 and use CDAP 3.4.2

  • Gokul Gunasekaran

    Gokul Gunasekaran 26b1cdce49a2900132f1eb464555b5976956efcc

    CDAP-6140 binary is a reserved keyword. hence use backticks in explore
    Using backticks for binary since it is a keyword

    • core-plugins/src/test/java/co/cask/hydrator/plugin/realtime/ETLWorkerTest.java (version 26b1cdce49a2900132f1eb464555b5976956efcc)