Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor evaluation code #8

Open
grantgasser opened this issue Oct 18, 2020 · 1 comment
Open

Refactor evaluation code #8

grantgasser opened this issue Oct 18, 2020 · 1 comment
Labels
enhancement New feature or request

Comments

@grantgasser
Copy link
Collaborator

  • Clean up evaluation.ipynb notebook
    • plug and play essentially (e.g. avoid thing where GT and EST sources getting mixed up/backwards)
    • make it easy for people to evaluate their results
  • Refactor plot_runs.py
    • so it stores data automatically when experiments are running
    • makes no assumptions (e.g. line assuming validation episodes every 5 episodes)
  • Anything else that makes it easier to evaluate the trained model
@grantgasser grantgasser added the enhancement New feature or request label Oct 18, 2020
@grantgasser
Copy link
Collaborator Author

#11 is a natural follow-up to this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant