Hugging Face's logo

fbaldassarri
/
HuggingFaceTB_SmolLM2-135M-Instruct-auto_round-int4-gs128-asym

Text Generation
Transformers
Safetensors
PyTorch
ONNX
Transformers.js
English
llama
autoround
auto-round
intel
gptq
woq
conversational
text-generation-inference
4-bit precision
intel/auto-round
Model card Files
xet
Community
fbaldassarri commited on
Commit
60abd12
·
verified ·
1 Parent(s): a4597d6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -10
README.md CHANGED
@@ -1,24 +1,19 @@
1
  ---
2
  language:
3
  - en
4
- - de
5
- - fr
6
- - it
7
- - pt
8
- - hi
9
- - es
10
- - th
11
  license: apache-2.0
12
  library_name: transformers
13
  tags:
14
  - autoround
15
  - auto-round
16
- - intel-autoround
17
  - gptq
18
  - woq
19
  - pytorch
20
  - transformers
21
- - intel
 
 
22
  model_name: SmolLM2 135M Instruct
23
  base_model: HuggingFaceTB/SmolLM2-135M-Instruct
24
  inference: false
@@ -28,7 +23,6 @@ prompt_template: '{prompt}
28
  '
29
  quantized_by: fbaldassarri
30
  ---
31
-
32
  ## Model Information
33
 
34
  Quantized version of [HuggingFaceTB/SmolLM2-135M-Instruct](HuggingFaceTB/SmolLM2-135M-Instruct) using torch.float32 for quantization tuning.
 
1
  ---
2
  language:
3
  - en
 
 
 
 
 
 
 
4
  license: apache-2.0
5
  library_name: transformers
6
  tags:
7
  - autoround
8
  - auto-round
9
+ - intel
10
  - gptq
11
  - woq
12
  - pytorch
13
  - transformers
14
+ - safetensors
15
+ - onnx
16
+ - transformers.js
17
  model_name: SmolLM2 135M Instruct
18
  base_model: HuggingFaceTB/SmolLM2-135M-Instruct
19
  inference: false
 
23
  '
24
  quantized_by: fbaldassarri
25
  ---
 
26
  ## Model Information
27
 
28
  Quantized version of [HuggingFaceTB/SmolLM2-135M-Instruct](HuggingFaceTB/SmolLM2-135M-Instruct) using torch.float32 for quantization tuning.