-
Shears: Unstructured Sparsity with Neural Low-rank Adapter Search
Paper • 2404.10934 • Published -
Low-Rank Adapters Meet Neural Architecture Search for LLM Compression
Paper • 2501.16372 • Published • 12 -
IntelLabs/shears-llama-7b-50-math-super-adapter
Updated • 6 • 3 -
IntelLabs/shears-llama-7b-50-math-heuristic-adapter
Updated • 9 • 3
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
Shears Models (Shears: Unstructured Sparsity with Neural Low-rank Adapter Search)
Compressed Mamba Models via Mamba-Shedder (Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models)
-
Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models
Paper • 2501.17088 • Published • 2 -
IntelLabs/Mamba-Shedder-Mamba-2.2B
2B • Updated • 874 • 3 -
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM
3B • Updated • 847 • 2 -
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM-Alpaca
3B • Updated • 833 • 2
Shears Models (Shears: Unstructured Sparsity with Neural Low-rank Adapter Search)
-
Shears: Unstructured Sparsity with Neural Low-rank Adapter Search
Paper • 2404.10934 • Published -
Low-Rank Adapters Meet Neural Architecture Search for LLM Compression
Paper • 2501.16372 • Published • 12 -
IntelLabs/shears-llama-7b-50-math-super-adapter
Updated • 6 • 3 -
IntelLabs/shears-llama-7b-50-math-heuristic-adapter
Updated • 9 • 3
Compressed Mamba Models via Mamba-Shedder (Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models)
-
Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models
Paper • 2501.17088 • Published • 2 -
IntelLabs/Mamba-Shedder-Mamba-2.2B
2B • Updated • 874 • 3 -
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM
3B • Updated • 847 • 2 -
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM-Alpaca
3B • Updated • 833 • 2
models
52
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM-Alpaca
3B
•
Updated
•
833
•
2
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM
3B
•
Updated
•
847
•
2
IntelLabs/sqft-phi-3.5-mini-instruct-wikitext2-awq-64g-ppl10.41
Text Generation
•
4B
•
Updated
•
2
IntelLabs/lonas-bloomz-7b-math
Updated
•
3
IntelLabs/lonas-bert-base-glue
Updated
•
3
IntelLabs/lonas-llama-7b-commonsense-adapter
Updated
•
4
IntelLabs/sqft-mistral-7b-v0.3-50-base
Text Generation
•
7B
•
Updated
•
903
•
2
IntelLabs/shears-llama-7b-50-math-heuristic-adapter
Updated
•
9
•
3
IntelLabs/shears-llama-7b-50-math-super-adapter
Updated
•
6
•
3
IntelLabs/shears-mpt-7b-50-gsm8k-heuristic-adapter
Updated
•
7
•
3
datasets
7
IntelLabs/Intel_Robotic_Welding_Multimodal_Dataset
Updated
•
23
•
15
IntelLabs/AI-Peer-Review-Detection-Benchmark
Preview
•
Updated
•
238
•
1
IntelLabs/SynthClinicalNotes
Viewer
•
Updated
•
1.41k
•
13
IntelLabs/BlueLens
Updated
•
2.2k
•
2
IntelLabs/Perovs-Dopants
Updated
•
22
IntelLabs/FloorSet
Viewer
•
Updated
•
46.2k
•
138
IntelLabs/WAT-WorldAcrossTime
Preview
•
Updated
•
11
•
4