cloud_storage: Add manifest operations fuzzer #25089
Open
+311
−0
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
The manifest mutator implements different manifest operations in the same way they are implemented in the ntp_archiver. The fuzz test uses this object to drive changes to the manifest and validates the consistency. Signed-off-by: Evgeny Lazin <[email protected]>
list of operations supported by the fuzzer. Signed-off-by: Evgeny Lazin <[email protected]>
CI test resultstest results on build#61878
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The PR adds a new component called
manifest_mutatorwhich contains apartition_manifestinstances and applies different operations to it. The examples of operations are 'add segment' or 'spill' or 'replace segment'. All operations are implemented similarly to how they are done in thentp_archiver. So basically, if the archiver replicates STM commands in certain order then the mutator is doing the same thing.The mutator is used to add two new fuzz tests which trigger different operations randomly. It can also be used to implement normal tests because it removes a lot of boilerplate. It's also used to add a new unit test that generates the data then triggers spillover then lets retention to remove all spillover manifests and all segments and then adds data again.
Backports Required
Release Notes