Build #95

Code commits

cdapio/hydrator-plugins

  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 74a3497e71659980760776288a167562661105cc

    Merge pull request #613 from caskdata/merge-1.6
    Merge 1.6

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 902bc56b97329032959f87992d49036068ad7af5

    Merge remote-tracking branch 'origin/release/1.6' into merge-1.6

  • Nitin Motgi <nitinmotgi@users.noreply.github.com>

    Nitin Motgi <nitinmotgi@users.noreply.github.com> dfaf435a623d21d228061b66fd73e63f1db54d17 m

    Update ErrorCollector-errortransform.json

    • core-plugins/widgets/ErrorCollector-errortransform.json (version dfaf435a623d21d228061b66fd73e63f1db54d17)
  • Nitin Motgi <nitinmotgi@users.noreply.github.com>

    Nitin Motgi <nitinmotgi@users.noreply.github.com> fe9dd404766a3d248bab89e809f9c52fba5a7aa0 m

    Update ErrorCollector.java

    • core-plugins/src/main/java/co/cask/hydrator/plugin/error/ErrorCollector.java (version fe9dd404766a3d248bab89e809f9c52fba5a7aa0)
  • Rohit Sinha

    Rohit Sinha b59dc33bd4f3668b6e7946bfa4edb84203453d5c m

    Merge pull request #609 from caskdata/hotfix/update-submodule
    Update submodules

  • Rohit Sinha

    Rohit Sinha 1f8112b24768cf0008e42a5ca57e73fce7d8e392 m

    Update submodules

    • hashing-tf-feature-generator (version 1f8112b24768cf0008e42a5ca57e73fce7d8e392)
    • logistic-regression-analytics (version 1f8112b24768cf0008e42a5ca57e73fce7d8e392)
    • naive-bayes-analytics (version 1f8112b24768cf0008e42a5ca57e73fce7d8e392)
    • realtime-stream-source (version 1f8112b24768cf0008e42a5ca57e73fce7d8e392)
    • skipgram-analytics (version 1f8112b24768cf0008e42a5ca57e73fce7d8e392)
    • tokenizer-analytics (version 1f8112b24768cf0008e42a5ca57e73fce7d8e392)
    • wrangler-transform (version 1f8112b24768cf0008e42a5ca57e73fce7d8e392)
  • Nishith Nand <nishith.nand@gmail.com>

    Nishith Nand <nishith.nand@gmail.com> 0062ce5015beced2cfa3f5b5ddcd3a4bbd8f2c05 m

    Merge pull request #606 from caskdata/bugfix_release/remove-snapshot-1.6
    Removed -SNAPSHOT from 1.6

  • Sreevatsan Raman

    Sreevatsan Raman 31a87b51701ecd53f899c69813ca031c167e9c0a m

    Merge pull request #604 from caskdata/bugfix_release/add-submodules
    Include submodules in build

  • Sree <sreevatsan@gmail.com>

    Sree <sreevatsan@gmail.com> d028386e775f4e70d77b104919a6b7d26b318009 m

    Merge branch 'release/1.6' into bugfix_release/add-submodules

  • Nishith Nand

    Nishith Nand 7166951d67c784eb1077d45b07f4d2fc82e1e278 m

    Removed -SNAPSHOT from 1.6

    • cassandra-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • core-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • database-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • elasticsearch-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • hbase-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • hdfs-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • hive-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • http-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • hydrator-common/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • kafka-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • mongodb-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • solrsearch-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • spark-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
    • transform-plugins/pom.xml (version 7166951d67c784eb1077d45b07f4d2fc82e1e278)
  • Nishith Nand <nishith.nand@gmail.com>

    Nishith Nand <nishith.nand@gmail.com> eb6a8d57b3d98c38312ad511f2c33009779dffb5 m

    Merge pull request #605 from caskdata/updating-submodules
    Updating submodules

  • Nishith Nand

    Nishith Nand 03e997171db4b07cc273e6ec689132c7f408022b m

    Updating submodules

    • hashing-tf-feature-generator (version 03e997171db4b07cc273e6ec689132c7f408022b)
    • logistic-regression-analytics (version 03e997171db4b07cc273e6ec689132c7f408022b)
    • realtime-stream-source (version 03e997171db4b07cc273e6ec689132c7f408022b)
    • skipgram-analytics (version 03e997171db4b07cc273e6ec689132c7f408022b)
    • wrangler-transform (version 03e997171db4b07cc273e6ec689132c7f408022b)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 44d4d4f615f05c9f40565ddeb13f7089312dc7b2 m

    Merge pull request #598 from caskdata/feature_release/HYDRATOR-1323-add-error-flattener
    Feature release/hydrator 1323 add error flattener

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 39eea3f655f10bd5dd4b7b270f5d491e27eb030b m

    HYDRATOR-1323 protect against NPE and clarify docs

    • core-plugins/docs/ErrorCollector-errortransform.md (version 39eea3f655f10bd5dd4b7b270f5d491e27eb030b)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/error/ErrorCollector.java (version 39eea3f655f10bd5dd4b7b270f5d491e27eb030b)
  • Gokul Gunasekaran

    Gokul Gunasekaran bd77e5a90b579d774401c49cf44645ce1f68ad5e m

    Merge pull request #603 from caskdata/bugfix_release/cdap-hydrator-1367
    Using SparkContext#registerLineage instead

  • Bhooshan Mogal

    Bhooshan Mogal 86788c0cc9cd93696224dcfa71b338b758e70e7a m

    Include submodules in build

    • pom.xml (version 86788c0cc9cd93696224dcfa71b338b758e70e7a)
    • wrangler-transform (version 86788c0cc9cd93696224dcfa71b338b758e70e7a)
  • Gokul Gunasekaran

    Gokul Gunasekaran 0cd840c3a64da50ef847eef2e6a4638adacd8c34 m

    Using SparkContext#registerLineage instead

    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/FileStreamingSource.java (version 0cd840c3a64da50ef847eef2e6a4638adacd8c34)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/KafkaStreamingSource.java (version 0cd840c3a64da50ef847eef2e6a4638adacd8c34)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/ReferenceStreamingSource.java (version 0cd840c3a64da50ef847eef2e6a4638adacd8c34)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/TwitterStreamingSource.java (version 0cd840c3a64da50ef847eef2e6a4638adacd8c34)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 634a7c2e22ed573720467382716bb1969e1f4a38 m

    HYDRATOR-1323 rename flattener to collector

    • core-plugins/docs/ErrorCollector-errortransform.md (version 634a7c2e22ed573720467382716bb1969e1f4a38)
    • core-plugins/docs/ErrorFlattener-errortransform.md (version 634a7c2e22ed573720467382716bb1969e1f4a38)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/error/ErrorCollector.java (version 634a7c2e22ed573720467382716bb1969e1f4a38)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/error/ErrorFlattener.java (version 634a7c2e22ed573720467382716bb1969e1f4a38)
    • core-plugins/widgets/ErrorCollector-errortransform.json (version 634a7c2e22ed573720467382716bb1969e1f4a38)
    • core-plugins/widgets/ErrorFlattener-errortransform.json (version 634a7c2e22ed573720467382716bb1969e1f4a38)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> ba46f88e14ccc7ea9d93e1405324f1e2b8a19827 m

    Merge pull request #602 from caskdata/bugfix/xml-xpath-encoding
    Fixing encoding issue in XPath mappings

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 110a9e6b10793179663b701d54527407ad20f3b4 m

    HYDRATOR-1323 fix javascript emit error bug
    javascript transform was assuming error records have the same
    schema as the output, when it actually has the same schema as
    the input.

    • core-plugins/src/main/java/co/cask/hydrator/plugin/transform/JavaScriptTransform.java (version 110a9e6b10793179663b701d54527407ad20f3b4)
    • core-plugins/src/test/java/co/cask/hydrator/plugin/transform/JavaScriptTransformTest.java (version 110a9e6b10793179663b701d54527407ad20f3b4)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 601b085718acb752051dd2d48f9b1a1ae0bbc56b m

    fix xml source and make xml parser more robust
    fixes a bug where the xml source was interpreting special
    characters, which would result in invalid xml, causing errors
    in following xml parsers. Also making the default behavior of the
    xml parser to take the first element in an array instead of
    erroring.

    • core-plugins/src/main/java/co/cask/hydrator/plugin/batch/source/XMLRecordReader.java (version 601b085718acb752051dd2d48f9b1a1ae0bbc56b)
    • core-plugins/src/test/resources/catalogLarge.xml (version 601b085718acb752051dd2d48f9b1a1ae0bbc56b)
    • transform-plugins/docs/XMLParser-transform.md (version 601b085718acb752051dd2d48f9b1a1ae0bbc56b)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/XMLParser.java (version 601b085718acb752051dd2d48f9b1a1ae0bbc56b)
    • transform-plugins/widgets/XMLParser-transform.json (version 601b085718acb752051dd2d48f9b1a1ae0bbc56b)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 6e4b405ed1259b5ba2cc7af51b2fbd448d35e69d m

    HYDRATOR-1323 add an error flattener
    The ErrorFlattener simply adds fields to all error records for
    the error message, code, and stage.

    • core-plugins/docs/ErrorFlattener-errortransform.md (version 6e4b405ed1259b5ba2cc7af51b2fbd448d35e69d)
    • core-plugins/pom.xml (version 6e4b405ed1259b5ba2cc7af51b2fbd448d35e69d)
    • core-plugins/src/main/java/co/cask/hydrator/plugin/error/ErrorFlattener.java (version 6e4b405ed1259b5ba2cc7af51b2fbd448d35e69d)
    • core-plugins/widgets/ErrorFlattener-errortransform.json (version 6e4b405ed1259b5ba2cc7af51b2fbd448d35e69d)
  • Nitin Motgi <nitin@MacBook-Pro.local>

    Nitin Motgi <nitin@MacBook-Pro.local> 646c6ae37ffcaaff2492b682dc6371eb98bb61d3 m

    Fixing encoding issue in XPath mappings

    • core-plugins/src/test/resources/catalogLarge.xml (version 646c6ae37ffcaaff2492b682dc6371eb98bb61d3)
    • transform-plugins/src/main/java/co/cask/hydrator/plugin/XMLParser.java (version 646c6ae37ffcaaff2492b682dc6371eb98bb61d3)
    • transform-plugins/widgets/XMLParser-transform.json (version 646c6ae37ffcaaff2492b682dc6371eb98bb61d3)
  • Sreevatsan Raman

    Sreevatsan Raman 0a3073fb24d82dda9d5f8c3a75f8e7ecff9303f2 m

    Merge pull request #601 from caskdata/feature/add-submodules-for-4.1
    Add git modules for hydrator plugins

  • Sree <sreevatsan@gmail.com>

    Sree <sreevatsan@gmail.com> 00937f199386e58b97a14a4ea98479c5bdb97c09 m

    Add git modules for hydrator plugins

    • .gitmodules (version 00937f199386e58b97a14a4ea98479c5bdb97c09)
    • hashing-tf-feature-generator (version 00937f199386e58b97a14a4ea98479c5bdb97c09)
    • logistic-regression-analytics (version 00937f199386e58b97a14a4ea98479c5bdb97c09)
    • naive-bayes-analytics (version 00937f199386e58b97a14a4ea98479c5bdb97c09)
    • realtime-stream-source (version 00937f199386e58b97a14a4ea98479c5bdb97c09)
    • skipgram-analytics (version 00937f199386e58b97a14a4ea98479c5bdb97c09)
    • tokenizer-analytics (version 00937f199386e58b97a14a4ea98479c5bdb97c09)
  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 363150d4c58a556d312b8375dc9da62f4b78b673 m

    Merge pull request #599 from caskdata/bugfix_release/HYDRATOR-1384-fix-jsonparser-doc
    HYDRATOR-1384 fix json parser doc

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 19dfa5b3565db1f7ba7108c4eb930c8e172c18cc m

    HYDRATOR-1384 fix json parser doc
    When specifying paths with brackets, elements in the bracket
    need to be enclosed in single quotes.

    • transform-plugins/docs/JSONParser-transform.md (version 19dfa5b3565db1f7ba7108c4eb930c8e172c18cc)
    • transform-plugins/src/test/java/co/cask/hydrator/plugin/JSONParserTest.java (version 19dfa5b3565db1f7ba7108c4eb930c8e172c18cc)