Skip to content

Pull requests: mit-han-lab/llm-awq

New pull request New
7 Open 46 Closed
7 Open 46 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Replace FasterTransformers like KV cache layout and kernel with flash attention for better support for longer sequence
#239 opened Nov 16, 2024 by JerryGJX Loading…
Fix illegal memory access of GEMV kernel
#201 opened Jun 12, 2024 by xutianming Loading…
Add phi3 support
#183 opened May 8, 2024 by pprp Loading…
4
Add Mistral & Mixtral support
#174 opened Apr 13, 2024 by Sakits Loading…
SM_75 (Turing) Support
#161 opened Mar 15, 2024 by 28Smiles Loading…
support video frames.
#151 opened Mar 4, 2024 by Lyken17 Loading…
Suggest: Add Bayesian optimization support for ratio search
#104 opened Oct 26, 2023 by trotsky1997 Loading…
6
ProTip! Follow long discussions with comments:>50.