Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

It is strange and counterintuitive to see converting WIG to BigWig on loading simple WIG file. #39

Open
olegs opened this issue Oct 15, 2018 · 8 comments

Comments

@olegs
Copy link
Contributor

olegs commented Oct 15, 2018

Can we do the same as with plain BED files?

@iromeo
Copy link
Contributor

iromeo commented Oct 15, 2018

We can implement *.wig track view from the scratch but what for? Bed files are widely available, and *.wig files are less popular

@iromeo
Copy link
Contributor

iromeo commented Oct 15, 2018

Existing impl was the easiest way to support wig files using existing infrastructure and already exist trackview. At the moment we don’t have any user request to change this behaviour. Bigwig track view uses big library to summarise signal by region, as for *.wig files we will have to implement all summarising features in track view. Bed files are much easier to render.

@olegs
Copy link
Contributor Author

olegs commented Oct 15, 2018

Okay, so that can we create in-memory BIG file instead of creating physical one?

@iromeo
Copy link
Contributor

iromeo commented Oct 15, 2018

Big library doesn’t support such feature at the moment. Normally it doesn’t make sense because big files are supposed to be big

@iromeo
Copy link
Contributor

iromeo commented Oct 16, 2018

Please reopen this issue after we have got real use cases, users complain or perfomance issues.

@iromeo iromeo closed this as completed Oct 16, 2018
@olegs
Copy link
Contributor Author

olegs commented Oct 16, 2018

I don't agree, when I open wig file locally it's really strange to see some extra activities creating some intermediate cache files.

@olegs olegs changed the title Why do we convert WIG to BigWig on loading It is strange and counterintuitive to see converting WIG to BigWig on loading simple WIG file. Oct 16, 2018
@iromeo iromeo removed their assignment Oct 16, 2018
@iromeo
Copy link
Contributor

iromeo commented Oct 16, 2018

Ok, let's move it to the back log.

The fix requires a lot of work related to reimplementing Wig track view or hacking BigWig library to write/read Big files to RAM instead of regular files.

The profit of all these work is not evident for me. Conversion step is ours internal implementation details we don't ask users to convert files manually.

@iromeo iromeo reopened this Oct 16, 2018
@dievsky
Copy link

dievsky commented Oct 16, 2018

IGV creates an index for FASTA files on opening (and the index is in a file, not in RAM), so preprocessing (in the form of indexing and caching) is not unheard of in the genome browser world. Conversion to bigWig does exactly that: it creates an index and caches various resolution levels. I think that most people working with wigs know that, so we won't even be confusing them that much.

@olegs olegs transferred this issue from another repository Mar 22, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants