Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DINOv2 models with registers lose the ability to semantically represent similar objects when performing PCA across images. #469

Open
aenoca opened this issue Oct 2, 2024 · 2 comments

Comments

@aenoca
Copy link

aenoca commented Oct 2, 2024

It seems the DINOv2-S with registers does not display the same emergent behaviour as DINOv2 without registers for matching different semantically close elements across images. I've observed this consistently across different combinations of models.
image

@hiyyg
Copy link

hiyyg commented Oct 17, 2024

Does the plain Diniv2-s have such ability? Did you also observe similar results for larger models?

@data-ant
Copy link

data-ant commented Oct 17, 2024 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants