Skip to content

Pull requests: vllm-project/llm-compressor

New pull request New
27 Open 203 Closed
27 Open 203 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add recipe check vllm e2e
#929 opened Nov 21, 2024 by horheynm Loading…
1
Load Compressed Tensors Models with run_compressed=False
#923 opened Nov 18, 2024 by horheynm • Draft
10
[1/2] Expand e2e testing to prepare for lm-eval ready When a PR is ready for review
#922 opened Nov 17, 2024 by dsikka Loading…
4
Move SparseGPTModifier location with backwards compatibility
#919 opened Nov 16, 2024 by kylesayrs • Draft
@kylesayrs
2
[Bugfix] Support model offloading SparseGPTQ
#918 opened Nov 16, 2024 by kylesayrs Loading…
@kylesayrs
1
Implement HooksMixin
#917 opened Nov 14, 2024 by kylesayrs Loading…
@kylesayrs
8
Kylesayrs/gptq partition
#914 opened Nov 13, 2024 by kylesayrs • Draft
fix consecutive oneshot
#898 opened Nov 5, 2024 by horheynm Loading…
7
Allow Shortcutting Min-max Observer
#887 opened Nov 1, 2024 by kylesayrs Loading…
@kylesayrs
2
[BugFix] Fix Remaining Sparsity Test failures
#884 opened Nov 1, 2024 by dsikka • Draft
1
[DO NOT MERGE] Increase Sparsity Threshold to 50% for sparse compression
#876 opened Oct 30, 2024 by rahul-tuli Loading…
5
[WIP] Adding un-/semi-structured pruning via ALPS
#874 opened Oct 29, 2024 by kayhanbehdin • Draft
FSDP utils cleanup
#854 opened Oct 19, 2024 by kylesayrs Loading…
@kylesayrs
[Bugfix] DisableKVCache Context
#834 opened Oct 9, 2024 by kylesayrs Loading…
1
@kylesayrs
9
Awq re implementation
#824 opened Oct 7, 2024 by rahul-tuli • Draft
1
Enable Sparse compression
#822 opened Oct 7, 2024 by rahul-tuli Loading…
1 of 3 tasks
19
Extend usability of calculate_offload_device_map
#768 opened Oct 2, 2024 by kylesayrs • Draft
e2e tests
#742 opened Oct 1, 2024 by horheynm Loading…
5
Add: Weight clipping to AWQModifier
#184 opened Sep 18, 2024 by rahul-tuli Loading…
1 task
AWQ modifier implementation
#183 opened Sep 18, 2024 by rahul-tuli Loading…
2
Add: Some utility functions needed for AWQ Modifier
#182 opened Sep 18, 2024 by rahul-tuli Loading…
3 tasks
Feature Branch for AWQ Modifier
#181 opened Sep 18, 2024 by rahul-tuli Loading…
4 tasks
@rahul-tuli
2
fp8 config for original, default, default kv"
#144 opened Sep 5, 2024 by horheynm • Draft
2
[KV Cache] kv-cache end to end tests ready When a PR is ready for review
#141 opened Sep 4, 2024 by horheynm Loading…
17
Refactor Recipe creation flow: Directly convert Modifier Instances to Recipe
#48 opened Aug 1, 2024 by rahul-tuli Loading…
@rahul-tuli
6
ProTip! Adding no:label will show everything without a label.