NM Testing

company

AI & ML interests

None defined yet.

Recent Activity

nm-autobot updated a model about 16 hours ago

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Static-Asym-e2e

nm-autobot updated a model about 16 hours ago

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Asym-e2e

nm-autobot updated a model about 16 hours ago

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-e2e

View all activity

nm-testing 's models 505

nm-testing/llama2.c-stories42M-quantized-fp8-Dynamic

58.1M • Updated Jan 14, 2025

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-uncompressed

1B • Updated Jan 14, 2025 • 82

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-compressed

1B • Updated Jan 14, 2025 • 306

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-uncompressed

1B • Updated Jan 14, 2025 • 215

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-compressed

0.4B • Updated Jan 14, 2025 • 685

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-uncompressed

1B • Updated Jan 14, 2025 • 81

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-compressed

0.3B • Updated Jan 14, 2025 • 304

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-uncompressed

1B • Updated Jan 14, 2025 • 181

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-compressed

1B • Updated Jan 14, 2025 • 735

nm-testing/granite-3.1-3b-a800m-instruct-w4a16

3B • Updated Jan 9, 2025

nm-testing/DeepSeek-V2.5-1210-quantized.w4a16

32B • Updated Jan 7, 2025 • 1

nm-testing/llama-2-7b-sparse2of4

7B • Updated Jan 4, 2025

nm-testing/test-w4a16-mixtral-actorder-group

6B • Updated Dec 26, 2024 • 1.56k

nm-testing/llama2.c-stories15M-gsm8k-pruned.2of4-BitMask

22.2M • Updated Dec 19, 2024

nm-testing/llama2.c-stories15M-gsm8k-pruned.2of4-Uncompressed

24.4M • Updated Dec 19, 2024

nm-testing/gemma-2-9b-it-FP8-dynamic-KV

10B • Updated Dec 18, 2024 • 3

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_tensor_act_int8-BitM

5B • Updated Dec 17, 2024

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_tensor_act_fp8-BitM

5B • Updated Dec 17, 2024

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_int8-BitM

5B • Updated Dec 17, 2024

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_fp8-BitM

5B • Updated Dec 17, 2024

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_tensor_act_int8-BitM

5B • Updated Dec 17, 2024

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_tensor_act_fp8-BitM

5B • Updated Dec 17, 2024

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_tensor_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 9

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_int8-BitM

5B • Updated Dec 17, 2024

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_tensor_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 13

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 15

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_fp8-BitM

5B • Updated Dec 17, 2024

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 12

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_tensor_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 10

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_tensor_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 13