Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Linear Probing tools #1644

Open
AlbinSou opened this issue May 13, 2024 · 1 comment
Open

Linear Probing tools #1644

AlbinSou opened this issue May 13, 2024 · 1 comment
Assignees
Labels
Feature - Low Priority New feature or request, low priority

Comments

@AlbinSou
Copy link
Collaborator

I would like to add some linear probing tools since it has been a widely used technique in evaluation of continual learning and non continual learning methods. I don't know what is the best way to do it. I think we could have it as an external layer that we add onto an existing representation, maybe with an attached method that trains it or an external method that trains it. I have to think about it.

@AlbinSou AlbinSou added the Feature - Low Priority New feature or request, low priority label May 13, 2024
@AlbinSou AlbinSou self-assigned this May 13, 2024
@AntonioCarta
Copy link
Collaborator

Maybe the easiest way is to put a function here that computes the linear probe accuracy and add an example of plugin that publishes the probing accuracy. I'm guessing that the plugin may need to be adapted by the user to choose when/what to compute, but the probing itself is quite general, it just needs the model, stream and layer name.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature - Low Priority New feature or request, low priority
Projects
None yet
Development

No branches or pull requests

2 participants