[Filestore, merge to stable]: issue-1795: LargeDeletionMarkers, issue-1922: making background ops' read/writeblob requests async, issue-1922: avoiding Compaction loops, allow for some actions to ignore auth, add information about backpressure to the monpage, issue-1146: add setters for in-memory state #2020
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
allow for some actions to ignore auth
…r tables (#1961) * issue-1146: add setters for in-memory state, temporary get rid of _Ver tables
* issue-1795: LargeDeletionMarkers WIP * issue-1795: 1. making MaxFileBlocks configurable via StorageServiceConfig; 2. added a bunch of parameters which will control the way LargeDeletionMarkers work; 3. loading LargeDeletionMarkers upon tablet startup * issue-1795: writing LargeDeletionMarkers instead of normal DeletionMarkers if the deleted range is big enough and the corresponding StorageServiceConfig params are set * issue-1795: LargeDeletionMarkers data structure implementation + simple ut * issue-1795: LargeDeletionMarkers data structure implementation + simple ut - fix * issue-1795: LargeDeletionMarkers data structure implementation + simple ut - cleanup NodeId2Markers * issue-1795: extracted TSparseSegment from TLargeBlocks and added uts for it * issue-1795: implemented Cleanup for LargeDeletionMarkers * issue-1795: fixed Cleanup for LargeDeletionMarkers, added large file truncation ut * issue-1795: fixed Cleanup for LargeDeletionMarkers, added large file truncation ut - more ut fixes * issue-1795: actually applying LargeDeletionMarkers to the blobs not affected by regular DeletionMarkers upon Cleanup * issue-1795: fixed test - now UnlinkNode triggers FlushBytes op so the test is incorrect, to fix it we need to increase FlushBytesThreshold which actually requires making it ui64 instead of ui32 * issue-1795: LargeDeletionMarkers - added more docs, fixed some minor review issues * issue-1795: LargeDeletionMarkers - added more uts, fixed some bugs; changed MaxFileBlocks type from uint64 to uint32 in StorageServiceConfig to signal that values greater than 2^31 shouldn't be used without prior testing and logic review * issue-1795: fixed linking
…t made in AddBlob for Compaction requests by CompactionThreshold - 1 (#2011) * issue-1922: avoiding Compaction loops by limiting BlobsCount increment made in AddBlob for Compaction requests by CompactionThreshold - 1 * issue-1922: restoring stats.BlobsCount = 0 logic upon AddBlob_Compaction * issue-1922: simplified AddBlob_Compaction
debnatkh
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
3d84737 e3acdeb 5a2bae2 84329d3 ea883f6 4884287