Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[discovery] Split lakeFS packages with controllable dependencies #8362

Open
arielshaqed opened this issue Nov 12, 2024 · 1 comment
Open
Labels
discovery infrastructure build, deploy and release processes tech-debt

Comments

@arielshaqed
Copy link
Contributor

Modify lakeFS to allow using individual components in a controlled disciplined manner. The goal is to allow other these components to be used in external projects. On a small scale, think of logging, cache, maybe some config helpers. On a larger scale, think of extracting KV.

@arielshaqed
Copy link
Contributor Author

One way to do this might be to make it a multi-module workspace. Here's a brief tutorial on multi-module workspaces. In brief, this would create smaller modules which would have smaller dependencies - and no circular dependencies! As a first step, we might create a github.com/treeverse/lakefs/util that has no lakeFS dependencies, and includes logging, maybe some config helpers, cache, maybe testutil. #7616 was an earlier attempt to do this.

@arielshaqed arielshaqed added infrastructure build, deploy and release processes discovery labels Nov 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discovery infrastructure build, deploy and release processes tech-debt
Projects
None yet
Development

No branches or pull requests

2 participants