Ben Kelly PRO
YellowjacketGames
AI & ML interests
None yet
Recent Activity
replied to
danielhanchen's
post
about 8 hours ago
You can now run Kimi K2.5 locally! ๐ฅ
We shrank the 1T model to 240GB (-60%) via Dynamic 1-bit.
Get >40 tok/s on 242GB or 622GB VRAM/RAM for near full precision.
GGUF: https://huggingface.co/unsloth/Kimi-K2.5-GGUF
Guide: https://unsloth.ai/docs/models/kimi-k2.5
replied to
danielhanchen's
post
about 9 hours ago
You can now run Kimi K2.5 locally! ๐ฅ
We shrank the 1T model to 240GB (-60%) via Dynamic 1-bit.
Get >40 tok/s on 242GB or 622GB VRAM/RAM for near full precision.
GGUF: https://huggingface.co/unsloth/Kimi-K2.5-GGUF
Guide: https://unsloth.ai/docs/models/kimi-k2.5
updated
a collection
about 11 hours ago
[mixed] ORCAssist "Work's Done!"