Sinensis
/

Cydonia-v4.1-MS3.2-Magnum-Diamond-24B-FP8-Dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

FP8-Dynamic (llmcompressor oneshot) quant of knifeayumu/Cydonia-v4.1-MS3.2-Magnum-Diamond-24B

Downloads last month: 5

Safetensors

Model size

24B params

Tensor type

BF16

·

F8_E4M3

·

Model tree for Sinensis/Cydonia-v4.1-MS3.2-Magnum-Diamond-24B-FP8-Dynamic

Base model

knifeayumu/Cydonia-v4.1-MS3.2-Magnum-Diamond-24B

Quantized

(9)

this model