Build #1,474

Build: #1474 failed Child of CDAP-DRC-5408

Code commits

caskdata/cdap

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> b2157ec97d9adc50c15513bb2888f00fc4559746

    Merge pull request #13376 from cdapio/CDAP-17939-partition-tms-leveldb
    CDAP-17939 partition tms topics

  • albertshau <ashau@google.com>

    albertshau <ashau@google.com> 5b26ec25334e97804f52a7eef3b76b0052388ef4 m

    CDAP-17939 partition tms topics
    Partition the TMS topics so that each topic is partitioned into
    multiple leveldb tables. This allows the implementation of TTL logic
    to be much more efficient by dropping entire tables instead of
    deleting contents row by row.

    • cdap-common/src/main/java/io/cdap/cdap/common/conf/Constants.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-common/src/main/resources/cdap-default.xml (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/main/java/io/cdap/cdap/messaging/store/AbstractMessageTable.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/main/java/io/cdap/cdap/messaging/store/MessageTableKey.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/main/java/io/cdap/cdap/messaging/store/RawMessageTableEntry.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/main/java/io/cdap/cdap/messaging/store/RollbackRequest.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/main/java/io/cdap/cdap/messaging/store/ScanRequest.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/main/java/io/cdap/cdap/messaging/store/hbase/HBaseMessageTable.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/main/java/io/cdap/cdap/messaging/store/leveldb/LevelDBMessageTable.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/main/java/io/cdap/cdap/messaging/store/leveldb/LevelDBPartition.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/main/java/io/cdap/cdap/messaging/store/leveldb/LevelDBPartitionManager.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/main/java/io/cdap/cdap/messaging/store/leveldb/LevelDBTableFactory.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/main/java/io/cdap/cdap/messaging/store/leveldb/PartitionedDBScanIterator.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/test/java/io/cdap/cdap/messaging/store/MessageTableTest.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/test/java/io/cdap/cdap/messaging/store/TestMessageEntry.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/test/java/io/cdap/cdap/messaging/store/leveldb/LevelDBMessageTableTest.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/test/java/io/cdap/cdap/messaging/store/leveldb/LevelDBPartitionManagerTest.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
    • cdap-tms/src/test/java/io/cdap/cdap/messaging/store/leveldb/LevelDBTTLCleanupTest.java (version 5b26ec25334e97804f52a7eef3b76b0052388ef4)
  • Fernando Velasquez

    Fernando Velasquez 4a7e6addea060f9112dd86134bbf3846b2f110e6

    Fixed bug with Emitter emitting repeated values.

    • cdap-app-templates/cdap-etl/hydrator-spark-core-base/src/main/java/io/cdap/cdap/etl/spark/function/TransformFromPairFunction.java (version 4a7e6addea060f9112dd86134bbf3846b2f110e6)