Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump RocksDB version from 6.20.3-ververica-2.0 to official 9.9.3 #487

Open
1 of 2 tasks
wuchong opened this issue Feb 25, 2025 · 0 comments
Open
1 of 2 tasks

Bump RocksDB version from 6.20.3-ververica-2.0 to official 9.9.3 #487

wuchong opened this issue Feb 25, 2025 · 0 comments
Assignees
Milestone

Comments

@wuchong
Copy link
Member

wuchong commented Feb 25, 2025

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

Currently, Fluss relies on 6.20.3-ververica-2.0 frocksdb, a fork of RocksDB, which is maintained by the Flink community. This specific version was chosen because it is a stable release widely adopted within the Flink ecosystem. The Flink community maintains frocksdb to incorporate patches required for Flink's state backend, which have not been upstreamed to the official RocksDB repository.

Solution

Since Fluss uses the native RocksDB API rather than being tied to frocksdb, we are not constrained by the Flink-specific fork. To take advantage of the latest improvements and optimizations, we plan to upgrade to the most recent official stable version of RocksDB: 9.9.3 (release notes ).

That said, this upgrade will require thorough benchmarking and stability testing, particularly around kv tables, to ensure compatibility and performance in Fluss. This process will help us validate the new version and mitigate any potential risks associated with the upgrade.

Anything else?

No response

Willingness to contribute

  • I'm willing to submit a PR!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants