Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

disjoint datasets merge model accuracy #2

Open
qsunyuan opened this issue Sep 19, 2022 · 3 comments
Open

disjoint datasets merge model accuracy #2

qsunyuan opened this issue Sep 19, 2022 · 3 comments

Comments

@qsunyuan
Copy link

Nice work.

The loss results for the test set are reported in Figure 5, but what about the accuracy.

In my experimental results, although the loss does drop, it seems that the accuracy is not very good (lower than the naive weight interp).

@samuela
Copy link
Owner

samuela commented Sep 22, 2022

Here's what I'm getting:

cifar100_resnet20_split_data_test_accuracy

@adampan0527
Copy link

Here's what I'm getting:

cifar100_resnet20_split_data_test_accuracy

Hi! I'm trying to use git-rebasin in my work about disjoint datasets merge, while my result looks like this
cifar10_resnet22_32_weight_matching_interp_accuracy_epoch
This experiment is using ResNet20 with 32x width-multiplier on CIFAR10 dataset, splited into two CIFAR5 dataset.
Can you tell me which model and dataset were you using? This is really important to me, thanks a lot!!

@samuela
Copy link
Owner

samuela commented Aug 2, 2024

Here is the code used to generate the plot in the paper: https://github.com/samuela/git-re-basin/blob/main/src/cifar100_resnet20_split_data_plot.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants