Build #565

Cask Data Application Platform - Develop Build and Test

Build: #565 was successful Child of CDAP-DRC-905

Code commits

CDAP/develop

  • Ali Anwar

    Ali Anwar 2409da33beb2f3d48b2a31346e919c9bd536c8c6

    Merge pull request #2053 from caskdata/feature/mr-task-info-endpoint
    Use RunRecords for job-level state, start/end time.

  • Sreevatsan Raman

    Sreevatsan Raman 27cb635a9f736af6d95f1f1e0005de15a79e0a67

    Merge pull request #2067 from caskdata/feature/log-saver-metrics-plugin
    Feature/log saver metrics plugin

  • albertshau <albert@cask.co>

    albertshau <albert@cask.co> 5117274514a8fefac3fa8a4299cce235160ed05b

    Merge pull request #2087 from caskdata/feature-adapter/CDAP-2067-projection-transform
    CDAP-2067 projection transform for the etl template, which allows

  • Poorna Chandra

    Poorna Chandra 9b6f683f0c338373d95423f62bc454e475c6d471

    Merge pull request #2098 from caskdata/feature/log-kafka-file
    Refactoring to eliminate duplicate code

  • astewes <astewes@gmail.com>

    astewes <astewes@gmail.com> 59b40302bfc0019d5d41839a99fbeb5bc063d1d3

    Merge pull request #2097 from caskdata/feature/ui-styling-development-home
    Feature/ui styling development home

  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> 2ded7d24a84cceea497fc77bb5aeddaf4e4d64b1

    fixes close button in message panel

    • cdap-ui/app/features/overview/overview.less (version 2ded7d24a84cceea497fc77bb5aeddaf4e4d64b1)
  • Sreevatsan Raman

    Sreevatsan Raman 60591e0685f8bc349acd8187140710e72b75afec

    Add missing import

    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/LogMetricsPlugin.java (version 60591e0685f8bc349acd8187140710e72b75afec)
  • Sreevatsan Raman

    Sreevatsan Raman 902f7f5b0eb6490c0e64e75c66b4389b5a013095

    Code review comments

    • cdap-watchdog/src/main/java/co/cask/cdap/logging/context/LoggingContextHelper.java (version 902f7f5b0eb6490c0e64e75c66b4389b5a013095)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/LogMetricsPlugin.java (version 902f7f5b0eb6490c0e64e75c66b4389b5a013095)
  • Gokul Gunasekaran

    Gokul Gunasekaran 1560882d55f780d81099ce2cd065cead33d8ecd9

    Merge pull request #2074 from caskdata/feature/adapter-worker
    ETL Worker Adapter Driver

  • Gokul Gunasekaran

    Gokul Gunasekaran 7a4c2f55141a750f6ad09a0d602ae53004581aae

    Missing license header

    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/ETLConfig.java (version 7a4c2f55141a750f6ad09a0d602ae53004581aae)
  • Gokul Gunasekaran

    Gokul Gunasekaran bbda22ab854de7bb86f553a76f9e632f4052c0ad

    Addressing PR comments

    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/templates/etl/batch/ETLBatchTemplate.java (version bbda22ab854de7bb86f553a76f9e632f4052c0ad)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/templates/etl/batch/config/ETLBatchConfig.java (version bbda22ab854de7bb86f553a76f9e632f4052c0ad)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/ETLConfig.java (version bbda22ab854de7bb86f553a76f9e632f4052c0ad)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/ETLTemplate.java (version bbda22ab854de7bb86f553a76f9e632f4052c0ad)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/ETLRealtimeTemplate.java (version bbda22ab854de7bb86f553a76f9e632f4052c0ad)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/config/ETLRealtimeConfig.java (version bbda22ab854de7bb86f553a76f9e632f4052c0ad)
  • Poorna Chandra

    Poorna Chandra e124e54d6ac23965dab030d5efc8dcfe517de38b

    Refactoring to eliminate duplicate code

    • cdap-gateway/src/test/java/co/cask/cdap/gateway/handlers/log/MockLogReader.java (version e124e54d6ac23965dab030d5efc8dcfe517de38b)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/guice/LoggingModules.java (version e124e54d6ac23965dab030d5efc8dcfe517de38b)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/read/DistributedLogReader.java (version e124e54d6ac23965dab030d5efc8dcfe517de38b)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/read/FileLogReader.java (version e124e54d6ac23965dab030d5efc8dcfe517de38b)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/read/KafkaLogReader.java (version e124e54d6ac23965dab030d5efc8dcfe517de38b)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/read/LogReader.java (version e124e54d6ac23965dab030d5efc8dcfe517de38b)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/read/StandaloneLogReader.java (version e124e54d6ac23965dab030d5efc8dcfe517de38b)
    • cdap-watchdog/src/test/java/co/cask/cdap/logging/appender/TestResilientLogging.java (version e124e54d6ac23965dab030d5efc8dcfe517de38b)
    • cdap-watchdog/src/test/java/co/cask/cdap/logging/appender/file/TestFileLogging.java (version e124e54d6ac23965dab030d5efc8dcfe517de38b)
    • cdap-watchdog/src/test/java/co/cask/cdap/logging/appender/kafka/TestKafkaLogging.java (version e124e54d6ac23965dab030d5efc8dcfe517de38b)
  • Gokul Gunasekaran

    Gokul Gunasekaran 6bbd54d4c6cf412567bf804fc373973966084cb0

    Addressing PR comments

    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/EndPointStage.java (version 6bbd54d4c6cf412567bf804fc373973966084cb0)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/batch/BatchSink.java (version 6bbd54d4c6cf412567bf804fc373973966084cb0)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/batch/BatchSource.java (version 6bbd54d4c6cf412567bf804fc373973966084cb0)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/RealtimeSink.java (version 6bbd54d4c6cf412567bf804fc373973966084cb0)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/RealtimeSource.java (version 6bbd54d4c6cf412567bf804fc373973966084cb0)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/templates/etl/batch/ETLBatchTemplate.java (version 6bbd54d4c6cf412567bf804fc373973966084cb0)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/ETLTemplate.java (version 6bbd54d4c6cf412567bf804fc373973966084cb0)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/StageConfigurator.java (version 6bbd54d4c6cf412567bf804fc373973966084cb0)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/ETLRealtimeTemplate.java (version 6bbd54d4c6cf412567bf804fc373973966084cb0)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> 6cde446f87506fe83426cf731f3d060c4699509d

    reduces size of Welcome panel

    • cdap-ui/app/features/overview/overview.html (version 6cde446f87506fe83426cf731f3d060c4699509d)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> 5ba43991f967ae8042d003e8487a42d5a1c6c06d

    tweaks Dev start styling

    • cdap-ui/app/features/overview/overview.less (version 5ba43991f967ae8042d003e8487a42d5a1c6c06d)
    • cdap-ui/app/styles/themes/cdap/header.less (version 5ba43991f967ae8042d003e8487a42d5a1c6c06d)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> 2feb96502eb89bb7d549c961b509b9fdfb5e2057

    fixes button label

    • cdap-ui/app/directives/fileselect/fileselect.html (version 2feb96502eb89bb7d549c961b509b9fdfb5e2057)
  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 7f2fe66f5fe062451c1124d4ec6688cea3421a37

    CDAP-2067 making sure you cant rename one field to multiple fields, cant rename multiple fields to the same field, and cant convert one field to multiple types.

    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/transforms/ProjectionTransform.java (version 7f2fe66f5fe062451c1124d4ec6688cea3421a37)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/test/java/co/cask/cdap/templates/etl/transforms/ProjectionTransformTest.java (version 7f2fe66f5fe062451c1124d4ec6688cea3421a37)
  • Sreevatsan Raman

    Sreevatsan Raman 0f6b0a12a6c2e251cd5a0b8230081ff93ebda9be

    Code review comments

    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/LogMetricsPlugin.java (version 0f6b0a12a6c2e251cd5a0b8230081ff93ebda9be)
  • Andrew Westlund <astewes@gmail.com>

    Andrew Westlund <astewes@gmail.com> a70ca1330575bb85238f3cb834951607cbbbe10d

    resolving merge conflict

    • cdap-ui/app/features/overview/overview.html (version a70ca1330575bb85238f3cb834951607cbbbe10d)
    • cdap-ui/app/features/overview/overview.less (version a70ca1330575bb85238f3cb834951607cbbbe10d)
    • cdap-ui/app/features/overview/templates/data-apps.html (version a70ca1330575bb85238f3cb834951607cbbbe10d)
    • cdap-ui/app/features/streams/templates/tabs/status.html (version a70ca1330575bb85238f3cb834951607cbbbe10d)
    • cdap-ui/app/styles/common.less (version a70ca1330575bb85238f3cb834951607cbbbe10d)
  • Gokul Gunasekaran

    Gokul Gunasekaran f9be75d527febfe1301f4a4034171a6b81a6f017

    Merge remote-tracking branch 'origin/develop' into feature/adapter-worker

  • Gokul Gunasekaran

    Gokul Gunasekaran 015b43c6226ec60b8e7b9f1d64e300bb09e18575

    Merge remote-tracking branch 'origin/develop' into feature/adapter-worker

  • Ali Anwar

    Ali Anwar 448081666f579ef2a78d3e9aff181a9a289b80d9

    Apply information from RunRecord to MrJobInfo after it is returned by MRJobClient/MapReduceMetricsInfo class.

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/mapreduce/MRJobClient.java (version 448081666f579ef2a78d3e9aff181a9a289b80d9)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/mapreduce/MapReduceMetricsInfo.java (version 448081666f579ef2a78d3e9aff181a9a289b80d9)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/ProgramLifecycleHttpHandler.java (version 448081666f579ef2a78d3e9aff181a9a289b80d9)
    • cdap-app-fabric/src/test/java/co/cask/cdap/app/mapreduce/MapReduceMetricsInfoTest.java (version 448081666f579ef2a78d3e9aff181a9a289b80d9)
    • cdap-proto/src/main/java/co/cask/cdap/proto/MRJobInfo.java (version 448081666f579ef2a78d3e9aff181a9a289b80d9)
  • Ali Anwar

    Ali Anwar 8ba3a25527193543ddea4a62495a8215ab14fb75

    Use RunRecords for job-level state, start/end time. Add a field to the return object which returns if the return object is complete or not.

    • cdap-app-fabric/src/main/java/co/cask/cdap/app/mapreduce/MRJobClient.java (version 8ba3a25527193543ddea4a62495a8215ab14fb75)
    • cdap-app-fabric/src/main/java/co/cask/cdap/app/mapreduce/MapReduceMetricsInfo.java (version 8ba3a25527193543ddea4a62495a8215ab14fb75)
    • cdap-app-fabric/src/main/java/co/cask/cdap/gateway/handlers/ProgramLifecycleHttpHandler.java (version 8ba3a25527193543ddea4a62495a8215ab14fb75)
    • cdap-app-fabric/src/test/java/co/cask/cdap/app/mapreduce/MapReduceMetricsInfoTest.java (version 8ba3a25527193543ddea4a62495a8215ab14fb75)
    • cdap-proto/src/main/java/co/cask/cdap/proto/MRJobInfo.java (version 8ba3a25527193543ddea4a62495a8215ab14fb75)
    • cdap-ui/app/features/mapreduce/templates/tabs/runs/run-detail.html (version 8ba3a25527193543ddea4a62495a8215ab14fb75)
  • Gokul Gunasekaran

    Gokul Gunasekaran 59adf1cecff2f719fcce17c189303583f3ef8fab

    Adding resources to ETLRealtimeConfig

    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/ETLRealtimeTemplate.java (version 59adf1cecff2f719fcce17c189303583f3ef8fab)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/config/ETLRealtimeConfig.java (version 59adf1cecff2f719fcce17c189303583f3ef8fab)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/test/java/co/cask/cdap/templates/etl/realtime/ETLWorkerTest.java (version 59adf1cecff2f719fcce17c189303583f3ef8fab)
  • Gokul Gunasekaran

    Gokul Gunasekaran a172e7d0a895c7471738cb05a49cc6f1f8950615

    Addressing PR comments

    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/EndPointStage.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/Transform.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/batch/BatchSink.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/batch/BatchSource.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/RealtimeSink.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/RealtimeSource.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/templates/etl/batch/ETLBatchTemplate.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/templates/etl/batch/ETLMapReduce.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/StageConfigurator.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/realtime/sinks/NoOpSink.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/realtime/sources/JmsSource.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/realtime/sources/TwitterStreamSource.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/transforms/StreamToStructuredRecordTransform.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/test/java/co/cask/cdap/templates/etl/realtime/sources/JmsMessageToStringSourceTest.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/test/java/co/cask/cdap/templates/etl/transforms/StructuredRecordToCubeFactTransformTest.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/ETLRealtimeTemplate.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/ETLWorker.java (version a172e7d0a895c7471738cb05a49cc6f1f8950615)
  • Gokul Gunasekaran

    Gokul Gunasekaran b1b0fa7fe9fb3d2b4817a0f1985de91bc701baa3

    Merge remote-tracking branch 'origin/develop' into feature/adapter-worker

  • Gokul Gunasekaran

    Gokul Gunasekaran 419bc8bcfba40f8d8e8e56d5550c818a2e19d72a

    SinkWriter -> BatchSinkWriter

    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/batch/sinks/CubeSink.java (version 419bc8bcfba40f8d8e8e56d5550c818a2e19d72a)
  • Gokul Gunasekaran

    Gokul Gunasekaran 9554a8bc1780e32cee72beb6d23f665b9befbf02

    Merge remote-tracking branch 'origin/develop' into feature/adapter-worker

  • Albert Shau <albert@cask.co>

    Albert Shau <albert@cask.co> 537d10bbee5556aa97853825b1456d43fcd23565

    CDAP-2067 projection transform for the etl template, which allows dropping fields, renaming fields, and casting types.

    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/common/KeyValueListParser.java (version 537d10bbee5556aa97853825b1456d43fcd23565)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/transforms/ProjectionTransform.java (version 537d10bbee5556aa97853825b1456d43fcd23565)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/test/java/co/cask/cdap/templates/etl/transforms/ProjectionTransformTest.java (version 537d10bbee5556aa97853825b1456d43fcd23565)
  • Sreevatsan Raman

    Sreevatsan Raman f79c3d5aaa006adc8dedf4c7e2b78c53b77dfe12

    Implement doProcess method

    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/AbstractKafkaLogProcessor.java (version f79c3d5aaa006adc8dedf4c7e2b78c53b77dfe12)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/KafkaLogWriterPlugin.java (version f79c3d5aaa006adc8dedf4c7e2b78c53b77dfe12)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/LogMetricsPlugin.java (version f79c3d5aaa006adc8dedf4c7e2b78c53b77dfe12)
  • Gokul Gunasekaran

    Gokul Gunasekaran cbc39c7988382b5016cfbfafca79a0fc373f61e0

    Move MockAdapterConfigurer to etl-core

    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/test/java/co/cask/cdap/templates/etl/batch/BatchETLDBAdapterTest.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/test/java/co/cask/cdap/templates/etl/batch/ETLMapReduceTest.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/test/java/co/cask/cdap/templates/etl/batch/ETLStreamConversionTest.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/test/java/co/cask/cdap/templates/etl/batch/MockAdapterConfigurer.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-core/pom.xml (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/MockAdapterConfigurer.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/realtime/sinks/NoOpSink.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/realtime/sources/TestSource.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/ETLRealtimeTemplate.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/HelloSource.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/NoOpSink.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/test/java/co/cask/cdap/templates/etl/realtime/ETLWorkerTest.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/test/java/co/cask/cdap/templates/etl/realtime/MockAdapterConfigurer.java (version cbc39c7988382b5016cfbfafca79a0fc373f61e0)
  • Gokul Gunasekaran

    Gokul Gunasekaran 5abfac65a41074176835ae2c635588b1b9e674c8

    Merging develop

  • Gokul Gunasekaran

    Gokul Gunasekaran 42c7e3162cad677ad50576c3f4641c4fcd2c3d97

    Fix serialization, deserialization

    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/DefaultStageConfigurer.java (version 42c7e3162cad677ad50576c3f4641c4fcd2c3d97)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/ETLWorker.java (version 42c7e3162cad677ad50576c3f4641c4fcd2c3d97)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/HelloSource.java (version 42c7e3162cad677ad50576c3f4641c4fcd2c3d97)
  • Gokul Gunasekaran

    Gokul Gunasekaran 4b9e9bb6e6668acb3d39115be9b8d3761f037740

    Changes to API

    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/RealtimeConfigurer.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/RealtimeSink.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/RealtimeSource.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/RealtimeSpecification.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/SinkContext.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/SourceContext.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/templates/etl/batch/ETLBatchTemplate.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/DefaultRealtimeConfigurer.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/realtime/sources/JmsSource.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/main/java/co/cask/cdap/templates/etl/realtime/sources/TwitterStreamSource.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/test/java/co/cask/cdap/templates/etl/realtime/sources/JmsMessageToStringSourceTest.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-lib/src/test/java/co/cask/cdap/templates/etl/realtime/sources/TwitterStreamSourceTest.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/ETLRealtimeTemplate.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/ETLWorker.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/HelloSource.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/NoOpSink.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/WorkerSinkContext.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/WorkerSourceContext.java (version 4b9e9bb6e6668acb3d39115be9b8d3761f037740)
  • Gokul Gunasekaran

    Gokul Gunasekaran 347d86159a4c7a38e883cb7925be7daed6d3cee3

    Realtime Worker Driver logic

  • Gokul Gunasekaran

    Gokul Gunasekaran fedda628e1a0156e72b949bf9d30d80f266767a5

    ETL Worker Driver

    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/RealtimeSink.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-api/src/main/java/co/cask/cdap/templates/etl/api/realtime/RealtimeSource.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/templates/etl/batch/ETLBatchTemplate.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/templates/etl/batch/ETLMapReduce.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-batch/src/main/java/co/cask/cdap/templates/etl/batch/config/ETLBatchConfig.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/DefaultRealtimeConfigurer.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/DefaultStageConfigurer.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/co/cask/cdap/templates/etl/common/DefaultValueEmitter.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/pom.xml (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/ETLRealtimeTemplate.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/ETLWorker.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/HelloSource.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/NoOpSink.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/WorkerSinkContext.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/WorkerSourceContext.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/main/java/co/cask/cdap/templates/etl/realtime/config/ETLRealtimeConfig.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/test/java/co/cask/cdap/templates/etl/realtime/ETLWorkerTest.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/cdap-etl-realtime/src/test/java/co/cask/cdap/templates/etl/realtime/MockAdapterConfigurer.java (version fedda628e1a0156e72b949bf9d30d80f266767a5)
    • cdap-app-templates/cdap-etl/pom.xml (version fedda628e1a0156e72b949bf9d30d80f266767a5)
  • Sreevatsan Raman

    Sreevatsan Raman f12a0d382b2f3efd7674fc0e4e927d04238e8760

    Add plugin tests

    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/KafkaLogWriterPlugin.java (version f12a0d382b2f3efd7674fc0e4e927d04238e8760)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/LogSaver.java (version f12a0d382b2f3efd7674fc0e4e927d04238e8760)
    • cdap-watchdog/src/test/java/co/cask/cdap/logging/save/LogSaverPluginTest.java (version f12a0d382b2f3efd7674fc0e4e927d04238e8760)
  • Sreevatsan Raman

    Sreevatsan Raman 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28

    Plugin to process logs and emit metrics

    • cdap-watchdog/src/main/java/co/cask/cdap/logging/appender/kafka/KafkaTopic.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/appender/kafka/SimpleKafkaProducer.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/context/LoggingContextHelper.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/guice/LoggingModules.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/run/LogSaverTwillRunnable.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/AbstractKafkaLogProcessor.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/CheckPointWriter.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/CheckpointManager.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/KafkaLogProcessor.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/KafkaLogWriterPlugin.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/LogMetricsPlugin.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/main/java/co/cask/cdap/logging/save/LogSaver.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)
    • cdap-watchdog/src/test/java/co/cask/cdap/logging/save/LogSaverTest.java (version 7878f8eacd59766a9e7f9d28fa1cde4168ea2a28)