INT8 LLMs for vLLM
Collection
Accurate INT8 quantized models by Neural Magic, ready for use with vLLM!
• 47 items • Updated
• 18
Zheng Han
traphix
·
AI & ML interests
None yet
Recent Activity
new activity
3 days ago
RedHatAI/MiniMax-M2.5:INT4 w4a16 quantinization？ liked
a model 3 days ago
RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic new activity
4 days ago
RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic:Quantization code for int4(w4a16) ? Organizations
None yet
upvoted a collection over 1 year ago