Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

metal gpu matrix3D addition test #87

Open
wants to merge 39 commits into
base: main
Choose a base branch
from
Open

metal gpu matrix3D addition test #87

wants to merge 39 commits into from

Commits on Jan 15, 2024

  1. metal gpu matrix3D addition test

    @DerrickYLJ
    DerrickYLJ committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    4b38bb7 View commit details
    Browse the repository at this point in the history

  2. metal gpu matrix3D addition test 

    In the process of adding metal gpu support, created a folder named metal for element-wise addition of Matrix3D test.
    @DerrickYLJ
    DerrickYLJ committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    cb5419a View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2024

  1. add element-wise add test in swift

    @DerrickYLJ
    DerrickYLJ committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    d23203c View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2024

  1. metal c++ version inside cpp folder

    @DerrickYLJ
    DerrickYLJ committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    3005bb3 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2024

  1. minor fix

    @RaymondWang0
    RaymondWang0 committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    7cad520 View commit details
    Browse the repository at this point in the history

  2. speedup issue with metal

    @DerrickYLJ
    DerrickYLJ committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    69c929d View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2024

  1. minor fix

    @RaymondWang0
    RaymondWang0 committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    11fa7b6 View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2024

  1. reorganized clear version for metal main

    @DerrickYLJ
    DerrickYLJ committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    37ff487 View commit details
    Browse the repository at this point in the history

  2. matmul metal

    @DerrickYLJ
    DerrickYLJ committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    c3e3316 View commit details
    Browse the repository at this point in the history

  3. matmul correctness pass

    @DerrickYLJ
    DerrickYLJ committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    d55be07 View commit details
    Browse the repository at this point in the history

  4. matmul work

    @DerrickYLJ
    DerrickYLJ committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    ab446e7 View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2024

  1. header param

    @DerrickYLJ
    DerrickYLJ committed Jan 28, 2024
    Configuration menu
    Copy the full SHA
    69407d5 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2024

  1. metal matmul Int4 working

    @DerrickYLJ
    DerrickYLJ committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    dd9fda7 View commit details
    Browse the repository at this point in the history

  2. kernel minor change

    @DerrickYLJ
    DerrickYLJ committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    e8331c3 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2024

  1. add metal op

    @RaymondWang0
    RaymondWang0 committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    e79e702 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. interleave two versions equal

    @DerrickYLJ
    DerrickYLJ committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    bc5cad2 View commit details
    Browse the repository at this point in the history

  2. add matmulInt4_SIMD with different versions 

    Merge branch 'MetalGPU' of https://github.com/mit-han-lab/TinyChatEngine into MetalGPU
    @DerrickYLJ
    DerrickYLJ committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    3a3e97d View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. building metal interface, done with kernel ops

    @DerrickYLJ
    DerrickYLJ committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    17e90b6 View commit details
    Browse the repository at this point in the history

  2. update metal-cpp

    @RaymondWang0
    RaymondWang0 committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    a3f8852 View commit details
    Browse the repository at this point in the history

  3. everything except for TODO

    @DerrickYLJ
    DerrickYLJ committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    246744b View commit details
    Browse the repository at this point in the history

  4. rms_norm done

    @DerrickYLJ
    DerrickYLJ committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    1b5d027 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. done with softmax, rope and minor fix on opparam struct

    @DerrickYLJ
    DerrickYLJ committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    c5fb54f View commit details
    Browse the repository at this point in the history

  2. update for test

    @DerrickYLJ
    DerrickYLJ committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    189ed98 View commit details
    Browse the repository at this point in the history

Commits on Feb 4, 2024

  1. updated matmulf32 + test script

    @DerrickYLJ
    DerrickYLJ committed Feb 4, 2024
    Configuration menu
    Copy the full SHA
    3217635 View commit details
    Browse the repository at this point in the history

  2. new test script on normalization

    @DerrickYLJ
    DerrickYLJ committed Feb 4, 2024
    Configuration menu
    Copy the full SHA
    06c472a View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. more metal ops (TODO needed)

    @DerrickYLJ
    DerrickYLJ committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    0c38582 View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2024

  1. All basic operations and matmul are included

    @DerrickYLJ
    DerrickYLJ committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    962266e View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2024

  1. update llama matmul parameter and test

    @DerrickYLJ
    DerrickYLJ committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    cd416a3 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2024

  1. new format for metal in general

    @DerrickYLJ
    DerrickYLJ committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    67ea0cc View commit details
    Browse the repository at this point in the history

  2. fix matmul

    @RaymondWang0
    RaymondWang0 committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    2b71f9f View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. add new kernels and reorganize

    @DerrickYLJ
    DerrickYLJ committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    f792a1b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'MetalGPU' of https://github.com/mit-han-lab/TinyChatEngine 

     into MetalGPU
    @DerrickYLJ
    DerrickYLJ committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    2440e9e View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2024

  1. fix parameters

    @RaymondWang0
    RaymondWang0 committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    0b094ad View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. draft llama.cpp model

    @DerrickYLJ
    DerrickYLJ committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    926dd0d View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. update rope

    @DerrickYLJ
    DerrickYLJ committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    3ac955c View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. update makefile

    @RaymondWang0
    RaymondWang0 committed May 1, 2024
    Configuration menu
    Copy the full SHA
    46d9627 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2024

  1. reorganize metal

    @DerrickYLJ
    DerrickYLJ committed May 12, 2024
    Configuration menu
    Copy the full SHA
    0d4cd66 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. minor fix

    @DerrickYLJ
    DerrickYLJ committed May 16, 2024
    Configuration menu
    Copy the full SHA
    562d32a View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. add op source

    @DerrickYLJ
    DerrickYLJ committed May 24, 2024
    Configuration menu
    Copy the full SHA
    a269001 View commit details
    Browse the repository at this point in the history