BitNet Distillation
Paper
•
2510.13998
•
Published
•
52
Eyera PRO
Orenguteng
AI & ML interests
AI EQ (Humanized) & (un)Alignment
Discord @eyeraofficial
Recent Activity
upvoted
a
paper
14 days ago
BitNet Distillation
new activity
28 days ago
Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2:Not uncensored model
new activity
about 1 month ago
Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2:Not Uncensored
Organizations
upvoted
a
paper
14 days ago
Not uncensored model
1
#16 opened about 1 month ago
by
MarianoDAcosta
Not Uncensored
13
#1 opened about 1 year ago
by
SicariusSicariiStuff
reacted to
danielhanchen's
post with 🤗👍❤️
about 1 month ago
Post
3772
We fixed more issues! Use
* Fixed Nanonets OCR-s unsloth/Nanonets-OCR-s-GGUF
* Fixed THUDM GLM-4 unsloth/GLM-4-32B-0414-GGUF
* DeepSeek Chimera v2 is uploading! unsloth/DeepSeek-TNG-R1T2-Chimera-GGUF
--jinja for all!* Fixed Nanonets OCR-s unsloth/Nanonets-OCR-s-GGUF
* Fixed THUDM GLM-4 unsloth/GLM-4-32B-0414-GGUF
* DeepSeek Chimera v2 is uploading! unsloth/DeepSeek-TNG-R1T2-Chimera-GGUF
reacted to
danielhanchen's
post with 🤯🔥
about 1 month ago
Post
3632
reacted to
danielhanchen's
post with 🔥❤️🤗
about 1 month ago
Post
3373
It's Qwen3 week! 💜 We uploaded Dynamic 2-bit GGUFs for:
Qwen3-Coder: unsloth/Qwen3-Coder-480B-A35B-Instruct-GGUF
Qwen3-2507: unsloth/Qwen3-235B-A22B-Instruct-2507-GGUF
So you can run them both locally!
Guides are in model cards.
Qwen3-Coder: unsloth/Qwen3-Coder-480B-A35B-Instruct-GGUF
Qwen3-2507: unsloth/Qwen3-235B-A22B-Instruct-2507-GGUF
So you can run them both locally!
Guides are in model cards.
- 1 reply
reacted to
danielhanchen's
post with 🚀🔥❤️
about 1 month ago
Post
5172
Run OpenAI's new gpt-oss models locally with Unsloth GGUFs! 🔥🦥
20b GGUF: unsloth/gpt-oss-20b-GGUF
120b GGUF: unsloth/gpt-oss-120b-GGUF
Model will run on 14GB RAM for 20b and 66GB for 120b.
20b GGUF: unsloth/gpt-oss-20b-GGUF
120b GGUF: unsloth/gpt-oss-120b-GGUF
Model will run on 14GB RAM for 20b and 66GB for 120b.
- 2 replies
reacted to
danielhanchen's
post with 🚀🔥❤️
about 1 month ago
Post
5934
Run DeepSeek-V3.1 locally on 170GB RAM with Dynamic 1-bit GGUFs!🐋
GGUFs: unsloth/DeepSeek-V3.1-GGUF
The 715GB model gets reduced to 170GB (-80% size) by smartly quantizing layers.
The 1-bit GGUF passes all our code tests & we fixed the chat template for llama.cpp supported backends.
Guide: https://docs.unsloth.ai/basics/deepseek-v3.1
GGUFs: unsloth/DeepSeek-V3.1-GGUF
The 715GB model gets reduced to 170GB (-80% size) by smartly quantizing layers.
The 1-bit GGUF passes all our code tests & we fixed the chat template for llama.cpp supported backends.
Guide: https://docs.unsloth.ai/basics/deepseek-v3.1
liked
3
models
about 1 month ago
