Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Safetensors changes #913

Draft
wants to merge 10 commits into
base: main
Choose a base branch
from
Draft

Safetensors changes #913

wants to merge 10 commits into from

Commits on Jan 26, 2024

  1. remove deprecated ftz intrinsics

    @rainiwu
    rainiwu committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    5c532ec View commit details
    Browse the repository at this point in the history

  2. suppress spurious cargo clippy warning

    @rainiwu
    rainiwu committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    fb91f13 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. Merge pull request #1 from rainiwu/remove-ftz 

    Remove ftz
    @swfsql
    swfsql authored Feb 7, 2024
    Configuration menu
    Copy the full SHA
    24a8593 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. avoid conv1d bound for cudnn

    @swfsql
    swfsql committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    4e3f7c7 View commit details
    Browse the repository at this point in the history

  2. bump gemm

    @swfsql
    swfsql committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    a8bc54c View commit details
    Browse the repository at this point in the history

  3. clippy fix

    @swfsql
    swfsql committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    557687c View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2024

  1. Merge pull request #2 from swfsql/avoid-ci-errors 

    Avoid ci errors
    @swfsql
    swfsql authored Mar 1, 2024
    Configuration menu
    Copy the full SHA
    1175903 View commit details
    Browse the repository at this point in the history

  2. Update safetensors module and naming 

    - Makes the safetensors module private.
  - Doesn't get exported on the preamble, avoiding a naming clash with the safetensors external crate.
- Change how and when the period is inserted.
  - This should make it closer to how the fields are accessed in the code.
    @swfsql
    swfsql committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    d971e90 View commit details
    Browse the repository at this point in the history

  3. Added {load/read/save/write}_safetensor_with methods 

    This alternative method:
- Requires load/read to decide whether it should skip missing tensors;
- Requires load/read/save/write to decide how should keys be mapped.
    @swfsql
    swfsql committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    4b9824e View commit details
    Browse the repository at this point in the history

  4. allow to load safetensors from a byte array

    @swfsql
    swfsql committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    95e619f View commit details
    Browse the repository at this point in the history