huawei-csl
/

Qwen3-1.7B-3bit-SINQ

Text Generation

efficient-inference

Model card Files Files and versions

chiaraboretti commited on 13 days ago

Commit

3741fc2

·

verified ·

1 Parent(s): 749841a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -61,7 +61,7 @@ You can load and use the model with our wrapper based on the 🤗 Transformers l
 from transformers import AutoTokenizer
 from sinq.patch_model import AutoSINQHFModel
-model_name = "huawei-cls/Qwen3-1.7B-3bit-SINQ"
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 sinq_model = AutoSINQHFModel.from_quantized_safetensors(
     model_name,

 from transformers import AutoTokenizer
 from sinq.patch_model import AutoSINQHFModel
+model_name = "huawei-csl/Qwen3-1.7B-3bit-SINQ"
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 sinq_model = AutoSINQHFModel.from_quantized_safetensors(
     model_name,