Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sync <- Mlperf inference for November release #585

Merged
merged 75 commits into from
Nov 22, 2024
Merged

Sync <- Mlperf inference for November release #585

merged 75 commits into from
Nov 22, 2024

Commits on Nov 14, 2024

  1. take user conf and measurements json from scenario folder

    @anandhu-eng
    anandhu-eng authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    973e9c2 View commit details
    Browse the repository at this point in the history

  2. folder creation

    @anandhu-eng
    anandhu-eng authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    5e7f196 View commit details
    Browse the repository at this point in the history

  3. mlperf conf is not required

    @anandhu-eng
    anandhu-eng authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    4f8818e View commit details
    Browse the repository at this point in the history

  4. take system meta from sut root

    @anandhu-eng
    anandhu-eng authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    b046b5e View commit details
    Browse the repository at this point in the history

  5. get fromwork from sut info if not filled

    @anandhu-eng
    anandhu-eng authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    0c7a5d4 View commit details
    Browse the repository at this point in the history

  6. fix typo

    @anandhu-eng
    anandhu-eng authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    2cbb243 View commit details
    Browse the repository at this point in the history

  7. throw error if measurements or user conf is missing

    @anandhu-eng
    anandhu-eng authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    95e2634 View commit details
    Browse the repository at this point in the history

  8. paths to files rearranged 

    - user.conf and measurements.json to the scenario folder
- system_meta.json to root folder
    @anandhu-eng
    anandhu-eng authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    a563ef0 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2024

  1. commit for backwards compatibility

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    cb1a504 View commit details
    Browse the repository at this point in the history

  2. fix typo

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    3318471 View commit details
    Browse the repository at this point in the history

  3. update the repsonse

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    7f95181 View commit details
    Browse the repository at this point in the history

  4. commit to make user conf backward compatible

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    b6f07c0 View commit details
    Browse the repository at this point in the history

  5. optimize user conf copy logic

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    f90af77 View commit details
    Browse the repository at this point in the history

  6. measurements.json made backward compatible

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    8f07511 View commit details
    Browse the repository at this point in the history

  7. changes reverted

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    9481038 View commit details
    Browse the repository at this point in the history

  8. bug fix

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    c54f4ba View commit details
    Browse the repository at this point in the history

  9. code optimization

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    4fe0fbe View commit details
    Browse the repository at this point in the history

  10. eliminate checking in compliance folders

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    51963e2 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'mlperf-inference' into issue-#542

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    5980174 View commit details
    Browse the repository at this point in the history

  12. fix unmatched fstring

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    fd0904e View commit details
    Browse the repository at this point in the history

  13. test commit

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    c6e9d42 View commit details
    Browse the repository at this point in the history

  14. default division set to closed

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    751856f View commit details
    Browse the repository at this point in the history

  15. optimize system_meta part

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    4cc558b View commit details
    Browse the repository at this point in the history

  16. switch off submission preprocessing - short run

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    741c482 View commit details
    Browse the repository at this point in the history

  17. fix typo

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    10e5b1a View commit details
    Browse the repository at this point in the history

  18. fix typo

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    d7f46a5 View commit details
    Browse the repository at this point in the history

  19. test commit

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    48df9dc View commit details
    Browse the repository at this point in the history

  20. provided absolute path

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    c7f8c1b View commit details
    Browse the repository at this point in the history

  21. added extra run args

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    15196a0 View commit details
    Browse the repository at this point in the history

  22. added new case - closed

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    158d91a View commit details
    Browse the repository at this point in the history

  23. test case repo mapped to mlcommons

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    aa6df9c View commit details
    Browse the repository at this point in the history

  24. handle suts with different sut meta files

    @anandhu-eng
    anandhu-eng committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    17d6fb7 View commit details
    Browse the repository at this point in the history

  25. add extra run args for skipping sdxl accuracy checks

    @anandhu-eng
    anandhu-eng committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    a563476 View commit details
    Browse the repository at this point in the history

  26. added rest of test cases for closed division

    @anandhu-eng
    anandhu-eng committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    c3ba940 View commit details
    Browse the repository at this point in the history

  27. updated description

    @anandhu-eng
    anandhu-eng committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    0fb76e0 View commit details
    Browse the repository at this point in the history

  28. additional tag for dataset sampling

    @anandhu-eng
    anandhu-eng authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    ce74af3 View commit details
    Browse the repository at this point in the history

  29. Merge pull request #576 from mlcommons/mixtral-ghaction-patch 

    additional tag for dataset sampling - mixtral
    @arjunsuresh
    arjunsuresh authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    99b504a View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2024

  1. match test query count with sampled data

    @anandhu-eng
    anandhu-eng authored Nov 20, 2024
    Configuration menu
    Copy the full SHA
    71b0876 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #577 from mlcommons/patch-mixtral 

    match test query count with sampled data
    @arjunsuresh
    arjunsuresh authored Nov 20, 2024
    Configuration menu
    Copy the full SHA
    9efa46f View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2024

  1. Update default-config.yaml

    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    af749bd View commit details
    Browse the repository at this point in the history

  2. Update default-config.yaml

    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    ab3f900 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'mlperf-inference' into mlperf-inference

    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    3ce2b6a View commit details
    Browse the repository at this point in the history

  4. Merge pull request #578 from GATEOverflow/mlperf-inference 

    Update nvidia mlperf inference sdxl configs
    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    e27bede View commit details
    Browse the repository at this point in the history

  5. Fix sdxl ss model generation for Nvidia mlperf inference

    @arjunsuresh
    arjunsuresh committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    bb6154d View commit details
    Browse the repository at this point in the history

  6. Improvements to docker run command in detached mode

    @arjunsuresh
    arjunsuresh committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    fb2eb99 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'mlperf-inference' into mlperf-inference

    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    1fcec02 View commit details
    Browse the repository at this point in the history

  8. Merge pull request #579 from GATEOverflow/mlperf-inference 

    Improve docker detached mode error capture
    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    b770ea4 View commit details
    Browse the repository at this point in the history

  9. Use absolute paths for docker mounts

    @arjunsuresh
    arjunsuresh committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    255c63c View commit details
    Browse the repository at this point in the history

  10. Merge branch 'mlperf-inference' into mlperf-inference

    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    539e4a8 View commit details
    Browse the repository at this point in the history

  11. Merge pull request #580 from GATEOverflow/mlperf-inference 

    Use absolute paths for docker mounts
    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    974fdbc View commit details
    Browse the repository at this point in the history

  12. Add TEST04 for sdxl

    @arjunsuresh
    arjunsuresh committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    5863f42 View commit details
    Browse the repository at this point in the history

  13. Fixed the dependencies for MLPErf inference SDXL accuracy script

    @arjunsuresh
    arjunsuresh committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    bc3eb3f View commit details
    Browse the repository at this point in the history

  14. Added rerun option for SDXL accuracy script

    @arjunsuresh
    arjunsuresh committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    ab1b7b4 View commit details
    Browse the repository at this point in the history

  15. Update test-cm-based-submission-generation.yml

    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    c74c9c8 View commit details
    Browse the repository at this point in the history

  16. Added cm-deps.mmd and cm-deps.png to submission generation

    @arjunsuresh
    arjunsuresh committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    889d67b View commit details
    Browse the repository at this point in the history

  17. Merge pull request #574 from mlcommons/issue-#542 

    Issue #542 - folder structure rearrange - submission generation
    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    6638a79 View commit details
    Browse the repository at this point in the history

  18. Merge branch 'mlperf-inference' into mlperf-inference

    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    e55fdcc View commit details
    Browse the repository at this point in the history

  19. Merge pull request #582 from GATEOverflow/mlperf-inference 

    Fixes for SDXL accuracy run
    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    9a18419 View commit details
    Browse the repository at this point in the history

  20. Use edge as the default system in run-mlperf-inference-app

    @arjunsuresh
    arjunsuresh committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    d1525af View commit details
    Browse the repository at this point in the history

  21. Added use_model_from_host option for run-mlperf-inference-app

    @arjunsuresh
    arjunsuresh committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    42c0b6f View commit details
    Browse the repository at this point in the history

  22. Update test-nvidia-mlperf-inference-implementations.yml

    @arjunsuresh
    arjunsuresh authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    58cf0b8 View commit details
    Browse the repository at this point in the history

  23. Fix typo in benchmark-program

    @arjunsuresh
    arjunsuresh committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    29e0974 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2024

  1. Merge branch 'mlperf-inference' into mlperf-inference

    @arjunsuresh
    arjunsuresh authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    b37b7dd View commit details
    Browse the repository at this point in the history

  2. Merge pull request #583 from GATEOverflow/mlperf-inference 

    Fix a typo in benchmark-program
    @arjunsuresh
    arjunsuresh authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    94e127d View commit details
    Browse the repository at this point in the history

  3. Added _full for nvidia mlperf inference sdxl

    @arjunsuresh
    arjunsuresh committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    3061b78 View commit details
    Browse the repository at this point in the history

  4. Added auto clean of partial dataset for coco2014 for a full run

    @arjunsuresh
    arjunsuresh committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    dc86953 View commit details
    Browse the repository at this point in the history

  5. Added auto clean of partial dataset for coco2014 for a full run

    @arjunsuresh
    arjunsuresh committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    441859d View commit details
    Browse the repository at this point in the history

  6. Added auto clean of partial dataset for coco2014 for a full run

    @arjunsuresh
    arjunsuresh committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    3b466ad View commit details
    Browse the repository at this point in the history

  7. Added auto clean of partial dataset for coco2014 for a full run

    @arjunsuresh
    arjunsuresh committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    2c774da View commit details
    Browse the repository at this point in the history

  8. Renamed _cm.json files to _cm.yaml

    @arjunsuresh
    arjunsuresh committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    2fbabe6 View commit details
    Browse the repository at this point in the history

  9. Updated _cm.yaml contents from _cm.json

    @arjunsuresh
    arjunsuresh committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    61f312d View commit details
    Browse the repository at this point in the history

  10. Merge branch 'mlperf-inference' into mlperf-inference

    @arjunsuresh
    arjunsuresh authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    b12f055 View commit details
    Browse the repository at this point in the history

  11. Merge pull request #584 from GATEOverflow/mlperf-inference 

    _cm.json -> _cm.yaml
    @arjunsuresh
    arjunsuresh authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    9fd8d2d View commit details
    Browse the repository at this point in the history

  12. Merge branch 'main' into mlperf-inference

    @arjunsuresh
    arjunsuresh authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    2abf849 View commit details
    Browse the repository at this point in the history

  13. Update VERSION

    @arjunsuresh
    arjunsuresh authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    9f79f45 View commit details
    Browse the repository at this point in the history