Build #65

Build: #65 was successful Changes by 9 people

Code commits

cdapio/hydrator-plugins

  • Ali Anwar

    Ali Anwar 6255da5d0582181bed6f3f7ab9d534c292eae030

    Merge pull request #544 from caskdata/release/1.5
    Release/1.5

  • sreevatsan raman <sreevatsan@gmail.com>

    sreevatsan raman <sreevatsan@gmail.com> 508cd649646a448ba8df4a6309606495f322bbfc

    Merge pull request #542 from caskdata/merge/release-1.4-into-release-1.5
    Merge/release 1.4 into release 1.5

  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> b1725cffbe69ec434867c1654c62c60b04f3a8fe

    Merge pull request #543 from caskdata/bugfix_release/HYDRATOR-1160-fix-failing-orc-test
    HYDRATOR-1160 fix failing orc test

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 307d9968e26fdfbc54494500fbc223c19b5e9ee2

    HYDRATOR-1160 fix failing orc test

    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLBatchTestBase.java (version 307d9968e26fdfbc54494500fbc223c19b5e9ee2)
  • Sree <sreevatsan@gmail.com>

    Sree <sreevatsan@gmail.com> d8612dac91ff6a330daef68ff45e6245da859d34

    Merge release/1.4 into release/1.5

  • sreevatsan raman <sreevatsan@gmail.com>

    sreevatsan raman <sreevatsan@gmail.com> cb8aa666c0126e48cb58008e263513c68beec18d

    Merge pull request #541 from caskdata/feature/remove-copybook-reader
    Remove copybook reader

  • Sree <sreevatsan@gmail.com>

    Sree <sreevatsan@gmail.com> 21849433b7a340ff7844c1e73fc4fad7a45dcb7c

    Remove copybook reader

    • copybookreader-plugins/docs/CopybookReader-batchsource.md (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
    • copybookreader-plugins/pom.xml (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
    • copybookreader-plugins/repo/net/sf/JRecord/JRecord/0.80.8/JRecord-0.80.8.jar (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
    • copybookreader-plugins/repo/net/sf/cb2xml/cb2xml/0.80.8-jrecord/cb2xml-0.80.8-jrecord.jar (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
    • copybookreader-plugins/src/main/java/co/cask/hydrator/plugin/batch/CopybookIOUtils.java (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
    • copybookreader-plugins/src/main/java/co/cask/hydrator/plugin/batch/CopybookInputFormat.java (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
    • copybookreader-plugins/src/main/java/co/cask/hydrator/plugin/batch/CopybookRecordReader.java (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
    • copybookreader-plugins/src/main/java/co/cask/hydrator/plugin/batch/CopybookSource.java (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
    • copybookreader-plugins/src/test/java/co/cask/hydrator/plugin/CopybookTest.java (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
    • copybookreader-plugins/src/test/resources/DTAR020_FB.bin (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
    • copybookreader-plugins/widgets/CopybookReader-batchsource.json (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
    • pom.xml (version 21849433b7a340ff7844c1e73fc4fad7a45dcb7c)
  • Yaser

    Yaser a49a443b8fbf9b51cfa9d82bb1bda4c87b8e0b92

    Merge pull request #539 from caskdata/feature/HYDRATOR-1072
    HYDRATOR-1072 Removed ScriptFilter Transform

  • Yaser

    Yaser 6e36b8b1f9668c207a32726d5140c4691ecb1d02

    Merge pull request #529 from shashankmoghe/bugfix/HYDRATOR-994-1.5
    [HYDRATOR-994] Fixed macro substitution issue in duration field of StreamSource

  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 486b7fc75c0abc9f51091eb1c95d433f9759d3e9

    Merge pull request #538 from ananya-bhattacharya/feature/HYDRATOR-521
    [HYDRATOR-521] - Removing deprecated methods and classes

  • Yaser

    Yaser 90b58547661f39d22ae1a2801ebaca0a76f97ba9

    Merge pull request #531 from romy-khetan/bugfix/HYDRATOR-1124
    [HYDRATOR-1124] Fixed record length calculations in cobol reader plugin

  • Yaser

    Yaser bcd0a92e2b68ae5031d79ef80a4f35a79b3ce06e

    Merge pull request #528 from shashankmoghe/bugfix/HYDRATOR-471-1.5
    [HYDRATOR-471] - conditions clause is excluded from the query in get schema request in DbSource

  • ananya-bhattacharya <ananya_bhattacharya@persistent.com>

    ananya-bhattacharya <ananya_bhattacharya@persistent.com> 7afdea5a7d960984d4af79b9053a83fbfca66b77

    Removing deprecated methods

    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLBatchTestBase.java (version 7afdea5a7d960984d4af79b9053a83fbfca66b77)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLSnapshotTestRun.java (version 7afdea5a7d960984d4af79b9053a83fbfca66b77)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLStreamConversionTestRun.java (version 7afdea5a7d960984d4af79b9053a83fbfca66b77)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/common/SnapshotFileSetTest.java (version 7afdea5a7d960984d4af79b9053a83fbfca66b77)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/realtime/source/SqsSourceTest.java (version 7afdea5a7d960984d4af79b9053a83fbfca66b77)
    • hive-plugins/src/main/java/org/apache/hadoop/hive/ql/io/avro/AvroGenericRecordReader.java (version 7afdea5a7d960984d4af79b9053a83fbfca66b77)
    • http-plugins/src/test/java/co/cask/hydrator/plugin/batch/HttpCallbackActionTest.java (version 7afdea5a7d960984d4af79b9053a83fbfca66b77)
    • http-plugins/src/test/java/co/cask/hydrator/plugin/realtime/HTTPPollTest.java (version 7afdea5a7d960984d4af79b9053a83fbfca66b77)
    • mongodb-plugins/src/test/java/co/cask/hydrator/plugin/test/MongoDBTest.java (version 7afdea5a7d960984d4af79b9053a83fbfca66b77)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/SparkPluginTest.java (version 7afdea5a7d960984d4af79b9053a83fbfca66b77)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> b01e1696ed132ee03abaf37fe9a472043e43c939

    Merge pull request #535 from caskdata/bugfix_release/CDAP-4121-remove-deprecated-methods
    CDAP-4121 remove more deprecated methods and classes

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> ea5f96dba5b7376e75e0670067d7a3a0c4493da7

    CDAP-4121 remove more deprecated methods and classes

    • cassandra-plugins/src/test/java/co/cask/hydrator/plugin/test/ETLCassandraTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/BatchWritableSink.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/sink/SnapshotFileBatchSink.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLBatchTestBase.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/realtime/ETLWorkerTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/realtime/RealtimeCubeSinkTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/realtime/sink/RealtimeKinesisStreamSinkTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • elasticsearch-plugins/src/test/java/co/cask/hydrator/plugin/test/ETLESTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • http-plugins/src/test/java/co/cask/hydrator/plugin/batch/HttpCallbackActionTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • mongodb-plugins/src/test/java/co/cask/hydrator/plugin/test/MongoDBTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • solrsearch-plugins/src/test/java/co/cask/hydrator/plugin/SolrSearchSinkTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/DecisionTreeRegressionTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/FeatureGeneratorTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/LogisticRegressionTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/NGramTransformTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/SparkPluginTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/TokenizerTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
    • transform-plugins/src/test/java/co/cask/hydrator/plugin/ValueMapperTest.java (version ea5f96dba5b7376e75e0670067d7a3a0c4493da7)
  • Yaser

    Yaser 93cda7e7d04c5e4af8503555109a35e0b54f5439

    Merge pull request #530 from shashankmoghe/bugfix/HYDRATOR-499-1.5
    [HYDRATOR-499] Flagged an error while getting schema for aggregator if there are duplicate names

  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 651fc1d347dfa4c764217edb1f625a784090132e

    Merge pull request #533 from caskdata/bugfix_release/HYDRATOR-699-remove-deprecated-classes
    HYDRATOR-699 remove use of etlbatch from tests

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6

    HYDRATOR-699 remove use of etlbatch from tests
    Replace all usages of old etlbatch app with datapipeline app in
    unit tests. Also replacing deprecated Id.Application with new
    ApplicationId.

    • cassandra-plugins/pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • cassandra-plugins/src/test/java/co/cask/hydrator/plugin/test/ETLCassandraTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • copybookreader-plugins/pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • copybookreader-plugins/src/test/java/co/cask/hydrator/plugin/CopybookTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLBatchTestBase.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLFTPTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLMapReduceTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLSnapshotTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLStreamConversionTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/ETLTPFSTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/action/EmailActionTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/action/HDFSActionTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/aggregator/DedupTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/aggregator/DistinctTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/aggregator/GroupByTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/aggregator/RowDenormalizerAggregatorTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/joiner/JoinerTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/sink/BatchCubeSinkTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/source/ExcelInputReaderTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/batch/source/XMLReaderBatchSourceTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • database-plugins/pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • database-plugins/src/test/java/co/cask/hydrator/plugin/DatabasePluginTestBase.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • database-plugins/src/test/java/co/cask/hydrator/plugin/db/batch/action/DBActionTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • database-plugins/src/test/java/co/cask/hydrator/plugin/db/batch/action/DBQueryActionTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • database-plugins/src/test/java/co/cask/hydrator/plugin/db/batch/sink/DBSourceTestRun.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • elasticsearch-plugins/pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • elasticsearch-plugins/src/test/java/co/cask/hydrator/plugin/test/ETLESTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • hbase-plugins/pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • hbase-plugins/src/test/java/co/cask/hydrator/plugin/HBaseTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • hdfs-plugins/pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • hdfs-plugins/src/test/java/co/cask/hydrator/plugin/HDFSSinkTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • http-plugins/pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • http-plugins/src/test/java/co/cask/hydrator/plugin/batch/HttpCallbackActionTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • kafka-plugins/src/test/java/co/cask/hydrator/sinks/KafkaPipelineTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • kafka-plugins/src/test/java/co/cask/hydrator/sinks/KafkaProducerTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • mongodb-plugins/pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • mongodb-plugins/src/test/java/co/cask/hydrator/plugin/test/MongoDBTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • solrsearch-plugins/pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • solrsearch-plugins/src/test/java/co/cask/hydrator/plugin/SolrSearchSinkTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/SparkPluginTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • transform-plugins/pom.xml (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • transform-plugins/src/test/java/co/cask/hydrator/plugin/NormalizeTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • transform-plugins/src/test/java/co/cask/hydrator/plugin/TransformPluginsTestBase.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • transform-plugins/src/test/java/co/cask/hydrator/plugin/ValueMapperTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
    • transform-plugins/src/test/java/co/cask/hydrator/plugin/XMLParserTest.java (version 70ad1e5622ef2b9f3efa7d33d5c6eda7c42faba6)
  • romy-khetan <romy_khetan@NGD11115.persistent.co.in>

    romy-khetan <romy_khetan@NGD11115.persistent.co.in> 5441a9da9d87636061bfe98837ae32452f089ed3

    [HYDRATOR-1124] Fixed record length calculations in cobol reader plugin

    • copybookreader-plugins/src/main/java/co/cask/hydrator/plugin/batch/CopybookIOUtils.java (version 5441a9da9d87636061bfe98837ae32452f089ed3)
  • Shashank Moghe <shashank_moghe@persistent.com>

    Shashank Moghe <shashank_moghe@persistent.com> 364cdbc204b33ffc2312dfa6824f473a08145db5

    HYDRATOR 499 Flagged an error while getting schema for aggregator if there are duplicate names

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/aggregator/GroupByAggregator.java (version 364cdbc204b33ffc2312dfa6824f473a08145db5)
  • Shashank Moghe <shashank_moghe@persistent.com>

    Shashank Moghe <shashank_moghe@persistent.com> 3ae46f0518c1bf11294066927f8ae0053a28607a

    HYDRATOR-994 Fixed macro substitution issue in duration field of StreamSource

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/StreamBatchSource.java (version 3ae46f0518c1bf11294066927f8ae0053a28607a)
  • Shashank Moghe <shashank_moghe@persistent.com>

    Shashank Moghe <shashank_moghe@persistent.com> a197f70e59309e0697ea6797ad9aaf83560bc57b

    HYDRATOR 471 - conditions clause is excluded from the query in get schema request in DbSource

    • database-plugins/src/main/java/co/cask/hydrator/plugin/db/batch/source/DBSource.java (version a197f70e59309e0697ea6797ad9aaf83560bc57b)