Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sync with master #1924

Closed
wants to merge 8 commits into from
Closed

Sync with master #1924

wants to merge 8 commits into from

Conversation

arjunsuresh
Copy link
Contributor

No description provided.

arjunsuresh and others added 8 commits October 31, 2024 00:05
#1887)

* Removed mlperf.conf check in submission checker, removed equal issue mode check in conf files

* Embed mlperf.conf as a binary string in the distribution

* Added package_dir for loadgen, added pypi loadgen test in github action

* Support impl in model-info.json

* Submission checker cleanup, support move/removal of invalid results

* Added compliance checks to preprocess submission, use logging for debug output

* Update test-submission-checker.yml to check inference_results_v4.1 from v4.0

* Added skip-accuarcy-files-check option to submission checker


---------

Co-authored-by: arjunsuresh <[email protected]>
)

* Update fid_score.py | Move the sys path update before the import. 

Currently the sys path is meaningless and this change was done by the automated code formatting

* Update format.yml



---------

Co-authored-by: arjunsuresh <[email protected]>
* Update GNN reference implementation: add DGL backend

* [Automated Commit] Format Codebase

* Update README.md
… error in DLRMv2 implementation #1909, fixes preprocess_submission (#1910)

* Update generate_final_report.py

* Fix sdxl (#1911)

* Fix typo in fid_score.py, fail_safe for SDXL short runs

* [Automated Commit] Format Codebase

* Fix typo in fid_score.py, fail_safe for SDXL short runs

* Fix dlrmv2 reference implementation | Update run_local.sh

* Fixes for filtering invalid results

* [Automated Commit] Format Codebase

* Update preprocess_submission.py

* Added an option to pass in sample_ids.txt for SDXL accuracy check

* [Automated Commit] Format Codebase

* Update accuracy_coco.py

* [Automated Commit] Format Codebase

* Fix typo

* Not use default for sample_ids.txt

---------

Co-authored-by: arjunsuresh <[email protected]>
Updating the pip packages
@arjunsuresh arjunsuresh requested a review from a team as a code owner November 14, 2024 23:14
Copy link

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

@github-actions github-actions bot locked and limited conversation to collaborators Nov 14, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants