Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use original RCP for RCP test if batch size and ALL hparams of submission match the RCP, otherwise used pruned RCPs. #214

Open
emizan76 opened this issue Mar 16, 2022 · 1 comment
Assignees
Labels

Comments

@emizan76
Copy link
Contributor

This is a comment made by the training committee, related to issue #206.

If the submission hyperparams match exactly to an RCP in the database, then we should compare against this RCP only.

If not, then we should compare to the pruned RCPs.

This is doable, but given the timeline, we may decide to implement it for the 2.1 round.

@emizan76 emizan76 changed the title Modify RCP checking rules yet again Use original RCP for RCP test if batch size and ALL hparams of submission match the RCP, otherwise used pruned RCPs. Mar 16, 2022
@emizan76 emizan76 self-assigned this Mar 22, 2022
@emizan76 emizan76 assigned shangw-nvidia and unassigned emizan76 Apr 1, 2022
@emizan76
Copy link
Contributor Author

emizan76 commented Apr 1, 2022

Shang, can you take a look?

I am swamped with all other tasks, and this is non-trivial.

However, we have not committed to implementing for this round, so it is optional.

Ritika suggested that, so you can talk to her if you have any questions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants