Inference Optimization

inference-optimization's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

kylesayrs 

updated a collection about 1 hour ago

Models in CI

Collection

Models used in CI tests across llm-compressor, compressed-tensors, and vllm repositories. • 23 items • Updated about 1 hour ago

nm-research 

updated a model about 1 hour ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt10

2B • Updated about 1 hour ago

nm-research 

published a model about 1 hour ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt10

2B • Updated about 1 hour ago

nm-research 

updated a model about 23 hours ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt9

2B • Updated about 23 hours ago

nm-research 

published a model about 23 hours ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt9

2B • Updated about 23 hours ago

nm-research 

updated a model 1 day ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt8

2B • Updated 1 day ago • 1

nm-research 

published a model 1 day ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt8

2B • Updated 1 day ago • 1

nm-research 

updated a model 1 day ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt7

2B • Updated 1 day ago • 4

nm-research 

published a model 1 day ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt7

2B • Updated 1 day ago • 4

nm-research 

updated a model 1 day ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt6

2B • Updated 1 day ago • 9

nm-research 

published a model 1 day ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt6

2B • Updated 1 day ago • 9

nm-research 

updated a model 2 days ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt5

2B • Updated 2 days ago • 10

nm-research 

published a model 2 days ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt5

2B • Updated 2 days ago • 10

kylesayrs 

updated a model 2 days ago

inference-optimization/Qwen3.8-1.0B-A0.6B-NVFP4-FP8

1.0B • Updated 2 days ago • 113

kylesayrs 

published a model 2 days ago

inference-optimization/Qwen3.8-1.0B-A0.6B-NVFP4-FP8

1.0B • Updated 2 days ago • 113

nm-research 

updated a model 2 days ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt4

2B • Updated 2 days ago • 8

nm-research 

published a model 2 days ago

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt4

2B • Updated 2 days ago • 8

nm-research 

published a dataset 2 days ago

inference-optimization/Dataset-Qwen3-235B-Instruct

Updated Mar 10 • 17 • 1

kylesayrs 

updated a collection 2 days ago

Tiny Models

Collection

Tiny models used for testing • 18 items • Updated 2 days ago • 2

kylesayrs 

updated a model 2 days ago

inference-optimization/Qwen3.8-1.0B-A0.6B

Text Generation • 1.0B • Updated 2 days ago • 1.81k • 2