Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about pre-training a Task #267

Open
NataliaAlves13 opened this issue Aug 14, 2024 · 2 comments
Open

Question about pre-training a Task #267

NataliaAlves13 opened this issue Aug 14, 2024 · 2 comments
Assignees
Labels
stale Issue without activity, will be closed soon

Comments

@NataliaAlves13
Copy link

I have trained a model for a given task and now I want to pre-train the network with a large-scale data set to see if it improves performance. Is there an easy way to transfer all the pre-processing parameters from the original task to the pre-training task? The only difference is the detection classes. The original Task only has instances of one detection class (abdominal bleeding), while the pre-training task has instances of 21 different classes (organ landmarks).
Any help here would be very welcome!

@mibaumgartner
Copy link
Collaborator

Dear @NataliaAlves13 ,

there is currently no pre-implemented way to transferring model weights between tasks but it shouldn't be too difficult to implement that logic. The exact complexity will differ depending on what you are planning to transfer, i.e. encoder weights, encoder + decoder weights or the entire architecture (probably requires exchanging the detection and regression layers at the end of the detection head).

Best,
Michael

@mibaumgartner mibaumgartner self-assigned this Aug 16, 2024
Copy link

This issue is stale because it has been open for 30 days with no activity.

@github-actions github-actions bot added the stale Issue without activity, will be closed soon label Sep 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stale Issue without activity, will be closed soon
Projects
None yet
Development

No branches or pull requests

2 participants