Build #5,595

License check with RAT and Checkstyle

Build: #5595 was successful Changes by wyzhang <wyzhang@google.com>

Build result summary

Details

Completed
Duration
7 minutes
Labels
None
Agent
bamboo-agent04
Revision
4ca718da41c6ecbd1ab644fba264572308ee4c54 4ca718da41c6ecbd1ab644fba264572308ee4c54
Successful since
#5446 ()

Code commits

Author Commit Message Commit date
wyzhang <wyzhang@google.com> wyzhang <wyzhang@google.com> 4ca718da41c6ecbd1ab644fba264572308ee4c54 4ca718da41c6ecbd1ab644fba264572308ee4c54 Merge pull request #13695 from cdapio/feature/CDAP-18542/wyzhang-metrics-levelDB-compaction
[CDAP-18542] Adding a periodic full compaction to LevelDBTableService.
Wangyuan Zhang <wyzhang@google.com> Wangyuan Zhang <wyzhang@google.com> 9702a5f9e821b227ef6bbbd1b5aea88cbb887ba4 m 9702a5f9e821b227ef6bbbd1b5aea88cbb887ba4 [CDAP-18542] Adding a periodic full compaction to LevelDBTableService.
What:
Adding a periodic full compaction across tables managed by LevelDBTableService.
This background periodic compaction is controlled by a cdap-site configuration.
Typically this the comapction interval should be a few days (e.g. 7 days) since
it could be a heavy disk operation depending on the size of the table.

Why:
LevelDB by default compacts across level N and subset of files in level N+1, this could
potentially lead to deletion-marker-masked values in N+1 or N+2 not being discarded
after the compaction, thus degrading read performance and causing disk overhead.

JIRA issues

IssueDescriptionStatus
Unknown Issue TypeCDAP-18542Could not obtain issue details from JIRA