Build #103

Build: #103 was successful Changes by Sreevatsan Raman

Code commits

Hydrator Plugins

  • Sreevatsan Raman

    Sreevatsan Raman f1a6446210ee09387b0aeeb8338a72b6ec79f1a0

    Merge pull request #635 from caskdata/release-1.6-to-develop
    Release 1.6 to develop

  • Nishith Nand

    Nishith Nand 3ce6af4672fd7fa79441ff20d70a84ccc2a1561d m

    Resolved conflicts

  • Sreevatsan Raman

    Sreevatsan Raman f43fa9e22114ada0eb72d038a3a9f3cae1eb31ad m

    Merge pull request #632 from caskdata/remove-SNAPSHOT-from-1.6
    Bumping versions

  • Nishith Nand

    Nishith Nand 504e81c540afc9387288c9137aaade926241c96a m

    Bumping versions

    • cassandra-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • core-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • database-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • elasticsearch-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • hashing-tf-feature-generator (version 504e81c540afc9387288c9137aaade926241c96a)
    • hbase-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • hdfs-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • hive-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • http-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • hydrator-common/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • kafka-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • logistic-regression-analytics (version 504e81c540afc9387288c9137aaade926241c96a)
    • mongodb-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • realtime-stream-source (version 504e81c540afc9387288c9137aaade926241c96a)
    • skipgram-analytics (version 504e81c540afc9387288c9137aaade926241c96a)
    • solrsearch-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • spark-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • tokenizer-analytics (version 504e81c540afc9387288c9137aaade926241c96a)
    • transform-plugins/pom.xml (version 504e81c540afc9387288c9137aaade926241c96a)
    • wrangler-transform (version 504e81c540afc9387288c9137aaade926241c96a)
  • Bhooshan Mogal

    Bhooshan Mogal a11da68133e49ca4aaf9e36092f3113ff0719e0a m

    Merge pull request #631 from caskdata/fix/headers
    Added section headers to Excel, JavaScript, Python, RowDenormalizer, …

  • Bhooshan Mogal

    Bhooshan Mogal e641bceb37238e8f758a2a9b81476af8c55b32c4 m

    (CDAP-9365) Added section headers to Excel, Javascript, Python, RowDenormalizer, StreamFormatter, ValueMapper and XMLToJSON plugins

    • core-plugins/widgets/Excel-batchsource.json (version e641bceb37238e8f758a2a9b81476af8c55b32c4)
    • core-plugins/widgets/JavaScript-transform.json (version e641bceb37238e8f758a2a9b81476af8c55b32c4)
    • core-plugins/widgets/PythonEvaluator-transform.json (version e641bceb37238e8f758a2a9b81476af8c55b32c4)
    • core-plugins/widgets/RowDenormalizer-batchaggregator.json (version e641bceb37238e8f758a2a9b81476af8c55b32c4)
    • transform-plugins/widgets/StreamFormatter-transform.json (version e641bceb37238e8f758a2a9b81476af8c55b32c4)
    • transform-plugins/widgets/ValueMapper-transform.json (version e641bceb37238e8f758a2a9b81476af8c55b32c4)
    • transform-plugins/widgets/XMLToJSON-transform.json (version e641bceb37238e8f758a2a9b81476af8c55b32c4)
  • Bhooshan Mogal

    Bhooshan Mogal 1c9fb8b699b811669fa104e6c098e4d683e60283 m

    Merge pull request #629 from caskdata/fix/update-wrangler
    Updated branch for wrangler transform

  • Bhooshan Mogal

    Bhooshan Mogal 9d1cae44d83f475fba0f05f064a40184a7b70e33 m

    Updated branch for wrangler transform

    • .gitmodules (version 9d1cae44d83f475fba0f05f064a40184a7b70e33)
  • vinishavyasa <CuriousVini@users.noreply.github.com>

    vinishavyasa <CuriousVini@users.noreply.github.com> e2333fb738f35479dc0961219cd161f30d3bf83a m

    Merge pull request #627 from caskdata/fix/move-kafka-source
    Remove kafka source

  • Vinisha Shah

    Vinisha Shah 424a53a4c5e04768fe2331720243fd33a43ebbc8 m

    Fixing exception in the build

    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/SparkPluginTest.java (version 424a53a4c5e04768fe2331720243fd33a43ebbc8)
  • Vinisha Shah

    Vinisha Shah fb184cfe5725cc31bb3d37938c7219f3ab051d73 m

    Addressing comments

    • spark-plugins/pom.xml (version fb184cfe5725cc31bb3d37938c7219f3ab051d73)
  • Vinisha Shah

    Vinisha Shah 28a5de6e07dcd1f8e63e5c9377cfc8f9d727c5eb m

    Remove kafka source

    • spark-plugins/docs/Kafka-streamingsource.md (version 28a5de6e07dcd1f8e63e5c9377cfc8f9d727c5eb)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/KafkaConfig.java (version 28a5de6e07dcd1f8e63e5c9377cfc8f9d727c5eb)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/KafkaStreamingSource.java (version 28a5de6e07dcd1f8e63e5c9377cfc8f9d727c5eb)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/KafkaConfigTest.java (version 28a5de6e07dcd1f8e63e5c9377cfc8f9d727c5eb)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/SparkPluginTest.java (version 28a5de6e07dcd1f8e63e5c9377cfc8f9d727c5eb)
    • spark-plugins/widgets/Kafka-streamingsource.json (version 28a5de6e07dcd1f8e63e5c9377cfc8f9d727c5eb)
  • Deepak Wadhwani

    Deepak Wadhwani c71adba146c697f5009c84d99c7297195dd16b40 m

    CDAP-8924 Merge pull request #626 from caskdata/bugfix/improvelogs
    CDAP-8924 remove unnecessary logs

  • Deepak Wadhwani

    Deepak Wadhwani b5af14738471588b647d8687f7f60ecc1a5bc1b5 m

    remove unnecessary logs

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchSink.java (version b5af14738471588b647d8687f7f60ecc1a5bc1b5)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetSink.java (version b5af14738471588b647d8687f7f60ecc1a5bc1b5)
    • hive-plugins/src/main/java/org/apache/hadoop/hive/ql/io/avro/AvroGenericRecordReader.java (version b5af14738471588b647d8687f7f60ecc1a5bc1b5)
  • Sreevatsan Raman

    Sreevatsan Raman 4151fafa4790a8149607c1ca41b754435342b62e m

    Merge pull request #625 from caskdata/fix/improve-logs
    Change user irrelevant logs' level to DEBUG

  • Chengfeng <mao@cask.co>

    Chengfeng <mao@cask.co> c80161d23016c70c08ce33198de9f4018bcf7268 m

    Change user irrelevant logs' level to DEBUG

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/action/WindowsShareCopy.java (version c80161d23016c70c08ce33198de9f4018bcf7268)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchSink.java (version c80161d23016c70c08ce33198de9f4018bcf7268)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/TimePartitionedFileSetSink.java (version c80161d23016c70c08ce33198de9f4018bcf7268)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/StreamBatchSource.java (version c80161d23016c70c08ce33198de9f4018bcf7268)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> b728e3e521306a2091cee4e963baac5807e2d7de m

    Merge pull request #622 from caskdata/CDAP-9142-binary-format
    CDAP-9142 fix plugin to allow 'binary' format

  • Nishith Nand <nishith.nand@gmail.com>

    Nishith Nand <nishith.nand@gmail.com> 54d5a543edd4b02d9642ef38da885898a4fe3743 m

    Merge pull request #624 from caskdata/feature_release/bumping-version-to-1.6.1-SNAPSHOT
    Bumped version to 1.6.1-SNAPSHOT

  • Nishith Nand

    Nishith Nand d1f1d9c9537789469537b01cadcfa2623fd53296 m

    Bumped version to 1.6.1-SNAPSHOT

    • cassandra-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • core-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • database-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • elasticsearch-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • hashing-tf-feature-generator (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • hbase-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • hdfs-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • hive-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • http-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • hydrator-common/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • kafka-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • logistic-regression-analytics (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • mongodb-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • realtime-stream-source (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • skipgram-analytics (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • solrsearch-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • spark-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • tokenizer-analytics (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • transform-plugins/pom.xml (version d1f1d9c9537789469537b01cadcfa2623fd53296)
    • wrangler-transform (version d1f1d9c9537789469537b01cadcfa2623fd53296)
  • Gokul Gunasekaran

    Gokul Gunasekaran 5e44f937974e68f7848ae14fd1a572150df2fb43 m

    Merge pull request #623 from caskdata/bugfix_release/cdap-9271
    CDAP-9271 Add the MIN case

  • Gokul Gunasekaran

    Gokul Gunasekaran ffd444192bb47b1b8f54d782fb8531fe9140b6de m

    CDAP-9271 Add the MIN case

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/aggregator/DedupConfig.java (version ffd444192bb47b1b8f54d782fb8531fe9140b6de)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/aggregator/DedupConfigTest.java (version ffd444192bb47b1b8f54d782fb8531fe9140b6de)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> c75d24187293dbc3514b1136e7fb30b66dcf93ea m

    CDAP-9142 fix plugin to allow 'binary' format

    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/KafkaConfig.java (version c75d24187293dbc3514b1136e7fb30b66dcf93ea)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/KafkaStreamingSource.java (version c75d24187293dbc3514b1136e7fb30b66dcf93ea)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> da2a27b9ae5b51fe2d3a5c6b8b5d0c5bbd30240c m

    Merge pull request #620 from caskdata/bugfix_release/CDAP-9170-fix-xml-parser-unit-test
    CDAP-9170 fix bad xml parser unit tests

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 39ef7d2bb760f1d711d2d1fde2fd68e36f1dbeb6 m

    CDAP-9170 fix bad xml parser unit tests
    Fixing a unit test that was not changed when array handling was
    changed in the plugin. Also performing various unit test
    improvements. None of these tests need to deploy and run pipelines
    so changed them to just call transform methods. This reduces
    run time from minutes to one second. Also changing tests to
    compare records directly instead of comparing subsets of record
    fields and doing silly things like looping through a list and
    having an if statement for every different record in the list.

    • transform-plugins/src/test/java/co/cask/hydrator/plugin/XMLParserTest.java (version 39ef7d2bb760f1d711d2d1fde2fd68e36f1dbeb6)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> e503141019e0a6c2f799d076427055e3d19317f2 m

    Merge pull request #617 from caskdata/bugfix/windower-set-output-schema
    propagate schema

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 8b857d26861cf692a990829c4a5fd4b2e05db85e m

    propagate schema

    • core-plugins/src/main/java/co/cask/hydrator/plugin/streaming/Window.java (version 8b857d26861cf692a990829c4a5fd4b2e05db85e)