Build #53

Code commits

cdapio/hydrator-plugins

  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> f81e1877b66c61fc8f1659591cd6167be8fccc6e

    Merge pull request #492 from ananya-bhattacharya/feature/feature-generator
    [HYDRATOR-983] Feature Generator Plugins

  • ananya-bhattacharya <ananya_bhattacharya@persistent.com>

    ananya-bhattacharya <ananya_bhattacharya@persistent.com> feab5bfe21792da5ac4734ff7df617a01f8e10d6

    Changing the error message

    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SparkUtils.java (version feab5bfe21792da5ac4734ff7df617a01f8e10d6)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/SparkUtilsTest.java (version feab5bfe21792da5ac4734ff7df617a01f8e10d6)
  • ananya-bhattacharya <ananya_bhattacharya@persistent.com>

    ananya-bhattacharya <ananya_bhattacharya@persistent.com> 88ab79e8fbea4023d1b04a2522f94ddb0deaf190

    Addressing code review comments

    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/HashingTFFeatureGenerator.java (version 88ab79e8fbea4023d1b04a2522f94ddb0deaf190)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SkipGramFeatureGenerator.java (version 88ab79e8fbea4023d1b04a2522f94ddb0deaf190)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SparkUtils.java (version 88ab79e8fbea4023d1b04a2522f94ddb0deaf190)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/VectorUtils.java (version 88ab79e8fbea4023d1b04a2522f94ddb0deaf190)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/SparkUtilsFeatureGeneratorTest.java (version 88ab79e8fbea4023d1b04a2522f94ddb0deaf190)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/SparkUtilsTest.java (version 88ab79e8fbea4023d1b04a2522f94ddb0deaf190)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/FeatureGeneratorConfigTest.java (version 88ab79e8fbea4023d1b04a2522f94ddb0deaf190)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/FeatureGeneratorTest.java (version 88ab79e8fbea4023d1b04a2522f94ddb0deaf190)
  • ananya-bhattacharya <ananya_bhattacharya@persistent.com>

    ananya-bhattacharya <ananya_bhattacharya@persistent.com> f96b135a4f231947c7bbbb2fbd03ca1d8738fe77

    Merge remote-tracking branch 'parent/develop' into feature/feature-generator

  • ananya-bhattacharya <ananya_bhattacharya@persistent.com>

    ananya-bhattacharya <ananya_bhattacharya@persistent.com> a949f71aa062391d36359f77be99e00a9a9eabd8

    Removed test for checking hashing tf with array input

    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/FeatureGeneratorTest.java (version a949f71aa062391d36359f77be99e00a9a9eabd8)
  • ananya-bhattacharya <ananya_bhattacharya@persistent.com>

    ananya-bhattacharya <ananya_bhattacharya@persistent.com> d694fcb1aafd5558813dd32c1392990d856645dd

    Addressing code review comments

    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/HashingTFFeatureGenerator.java (version d694fcb1aafd5558813dd32c1392990d856645dd)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SkipGramFeatureGenerator.java (version d694fcb1aafd5558813dd32c1392990d856645dd)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SparkUtils.java (version d694fcb1aafd5558813dd32c1392990d856645dd)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/VectorUtils.java (version d694fcb1aafd5558813dd32c1392990d856645dd)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/SparkUtilsFeatureGeneratorTest.java (version d694fcb1aafd5558813dd32c1392990d856645dd)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/FeatureGeneratorTest.java (version d694fcb1aafd5558813dd32c1392990d856645dd)
  • ananya-bhattacharya <ananya_bhattacharya@persistent.com>

    ananya-bhattacharya <ananya_bhattacharya@persistent.com> 8a97eed5cc1e8e182d83f809a0ab3878b532a66e

    Merge remote-tracking branch 'parent/develop' into feature/feature-generator

  • ananya-bhattacharya <ananya_bhattacharya@persistent.com>

    ananya-bhattacharya <ananya_bhattacharya@persistent.com> 0ade175af8e6ea6a61627332bb07cc93468881c2

    Addressing code review comments

    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/HashingTFFeatureGenerator.java (version 0ade175af8e6ea6a61627332bb07cc93468881c2)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SkipGramFeatureGenerator.java (version 0ade175af8e6ea6a61627332bb07cc93468881c2)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SkipGramTrainer.java (version 0ade175af8e6ea6a61627332bb07cc93468881c2)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SparkUtils.java (version 0ade175af8e6ea6a61627332bb07cc93468881c2)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/VectorUtils.java (version 0ade175af8e6ea6a61627332bb07cc93468881c2)
  • ananya-bhattacharya <ananya_bhattacharya@persistent.com>

    ananya-bhattacharya <ananya_bhattacharya@persistent.com> 897687191c63026f05b60d9c3a872829e192c49c

    Addressing code review changes

    • spark-plugins/docs/HashingTFFeatureGenerator-sparkcompute.md (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/docs/SkipGramFeatureGenerator-sparkcompute.md (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/docs/SkipGramTrainer-sparksink.md (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/pom.xml (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/HashingTFFeatureGenerator.java (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SkipGramFeatureGenerator.java (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SkipGramTrainer.java (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SparkUtils.java (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/VectorUtils.java (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/FeatureGeneratorConfigTest.java (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/FeatureGeneratorTest.java (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/widgets/HashingTFFeatureGenerator-sparkcompute.json (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/widgets/SkipGramFeatureGenerator-sparkcompute.json (version 897687191c63026f05b60d9c3a872829e192c49c)
    • spark-plugins/widgets/SkipGramTrainer-sparksink.json (version 897687191c63026f05b60d9c3a872829e192c49c)
  • ananya-bhattacharya <ananya_bhattacharya@persistent.com>

    ananya-bhattacharya <ananya_bhattacharya@persistent.com> ece9233aba97aa5cad9a64a1f11152dd40e1a6c0

    Merge remote-tracking branch 'parent/develop' into feature/feature-generator

  • ananya-bhattacharya <ananya_bhattacharya@persistent.com>

    ananya-bhattacharya <ananya_bhattacharya@persistent.com> 619712ac54dcfe851ec194d8b385eebc0ebc18b7

    Feature Generator Plugins - Initial draft

    • spark-plugins/docs/HashingTFFeatureGenerator-sparkcompute.md (version 619712ac54dcfe851ec194d8b385eebc0ebc18b7)
    • spark-plugins/docs/SkipGramFeatureGenerator-sparkcompute.md (version 619712ac54dcfe851ec194d8b385eebc0ebc18b7)
    • spark-plugins/docs/SkipGramTrainer-sparksink.md (version 619712ac54dcfe851ec194d8b385eebc0ebc18b7)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/HashingTFFeatureGenerator.java (version 619712ac54dcfe851ec194d8b385eebc0ebc18b7)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SkipGramFeatureGenerator.java (version 619712ac54dcfe851ec194d8b385eebc0ebc18b7)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SkipGramTrainer.java (version 619712ac54dcfe851ec194d8b385eebc0ebc18b7)
    • spark-plugins/src/main/java/co/cask/hydrator/plugin/spark/SparkUtils.java (version 619712ac54dcfe851ec194d8b385eebc0ebc18b7)
    • spark-plugins/src/test/java/co/cask/hydrator/plugin/spark/test/FeatureGeneratorTest.java (version 619712ac54dcfe851ec194d8b385eebc0ebc18b7)
    • spark-plugins/widgets/HashingTFFeatureGenerator-sparkcompute.json (version 619712ac54dcfe851ec194d8b385eebc0ebc18b7)
    • spark-plugins/widgets/SkipGramFeatureGenerator-sparkcompute.json (version 619712ac54dcfe851ec194d8b385eebc0ebc18b7)
    • spark-plugins/widgets/SkipGramTrainer-sparksink.json (version 619712ac54dcfe851ec194d8b385eebc0ebc18b7)