Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No speedup with pbzip2 #862

Open
scy opened this issue Jan 24, 2025 · 1 comment
Open

No speedup with pbzip2 #862

scy opened this issue Jan 24, 2025 · 1 comment

Comments

@scy
Copy link

scy commented Jan 24, 2025

According to the readme, "you can significantly speed up extracting using pbzip2 (recommended)". However, extracting the Photon database tarball with pbzip2 -cd is only using a single core on my machine.

The .bz2 file needs to be created with pbzip2 (instead of the normal bzip2) in order to allow for parallelized decompression. Are you sure you're doing this? Because to me it looks like the file isn't optimized for pbzip2.

@lonvia
Copy link
Collaborator

lonvia commented Feb 4, 2025

I'm 100% sure we are not doing this. 😉 I'll have a look if we can change the exports.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants