Build #1,637

Build: #1637 was successful Child of CDAP-DRC-5618

Build result summary

Details

Completed
Duration
165 minutes
Labels
None
Agent
bamboo-agent06
Revision
123937edd307114bfea5797ccaa75213d8a225f4 123937edd307114bfea5797ccaa75213d8a225f4
Total tests
3149
Successful since
#1635 ()

Code commits

Author Commit Message Commit date
wyzhang <wyzhang@google.com> wyzhang <wyzhang@google.com> 123937edd307114bfea5797ccaa75213d8a225f4 123937edd307114bfea5797ccaa75213d8a225f4 Merge pull request #13753 from cdapio/feature/CDAP-18627/wyzhang-leveldb-preview
[CDAP-18627] Split preview leveldb store into 2 stores.
Wangyuan Zhang <wyzhang@google.com> Wangyuan Zhang <wyzhang@google.com> 925085c43fb0d80f4c08ac667a5c84383285f80e m 925085c43fb0d80f4c08ac667a5c84383285f80e [CDAP-18627] Split preview leveldb store into 2 stores.              One for data+metadata and the other for pending
Why:
Splitting into separate levelDB stores to minimize any potential
slow seek or scan operations, since this store has high deletion
rate, thus producing lots of deletion markers or tombstones.
As a result, it is fairly easy to cause very slow seek or scan
(e.g. calling seekToStart or using iterator.next() to find target row)
during implementation. Splitting minimizes/reduces the slowness.
Furthermore, a followup PR to enable compaction on these levelDB
will allow us compacting away these deletion markers frequently,
thus speeding up access operations.

JIRA issues

IssueDescriptionStatus
Unknown Issue TypeCDAP-18627Could not obtain issue details from JIRA