Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Comparison across experiment runs and hyper parameters #19

Open
nitish1295 opened this issue Jul 30, 2023 · 0 comments · May be fixed by #23
Open

Comparison across experiment runs and hyper parameters #19

nitish1295 opened this issue Jul 30, 2023 · 0 comments · May be fixed by #23
Assignees

Comments

@nitish1295
Copy link
Collaborator

nitish1295 commented Jul 30, 2023

  1. Offer a way to compare 2 or more different runs of an experiment and show the metrics on on the same graph.
  2. Offer functionalities to filter runs of an experiment on a certain hyper param and show metrics associated with those runs.

A possible way to implement these could be as follows:

  • Over the course of time the number of experiments and runs will increase for a user, or they might have large set of experiments already. We should Offer a tables for experiments, and runs for users to choose from.
  • In the initial stage the filtering based on hyper param can also be done based on the same table.

Implementation:

  • A separate table located under a separate tab to select experiments from(instead of a drop down). The runs corresponding to these experiments show up on the graph page which includes another table, detailed in the next point
  • Make a table component which can enable selection from runs of an experiment/experiments, this component can live just below the graphs and show runs and associated hyper params. A possible example implementation for column freeze so that we can show multiple hyper params for a run https://www.material-react-table.com/docs/guides/column-pinning

Please feel free to add any suggestions

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging a pull request may close this issue.

1 participant