Hugging Face's logo

aur0307
/
llama2-7b-classification-lora

PEFT
Model card Files
xet
Community
1
aur0307 commited on
Commit
33289ea
·
1 Parent(s): a338c61

Upload model

Browse files
Files changed (2) hide show
  1. README.md +14 -1
  2. adapter_model.bin +1 -1
README.md CHANGED
@@ -16,6 +16,19 @@ The following `bitsandbytes` quantization config was used during training:
16
  - bnb_4bit_use_double_quant: True
17
  - bnb_4bit_compute_dtype: bfloat16
18
 
 
 
 
 
 
 
 
 
 
 
 
19
  ### Framework versions
20
 
21
- - PEFT 0.5.0.dev0
 
 
 
16
  - bnb_4bit_use_double_quant: True
17
  - bnb_4bit_compute_dtype: bfloat16
18
 
19
+ The following `bitsandbytes` quantization config was used during training:
20
+ - quant_method: bitsandbytes
21
+ - load_in_8bit: False
22
+ - load_in_4bit: True
23
+ - llm_int8_threshold: 6.0
24
+ - llm_int8_skip_modules: None
25
+ - llm_int8_enable_fp32_cpu_offload: False
26
+ - llm_int8_has_fp16_weight: False
27
+ - bnb_4bit_quant_type: nf4
28
+ - bnb_4bit_use_double_quant: True
29
+ - bnb_4bit_compute_dtype: bfloat16
30
  ### Framework versions
31
 
32
+ - PEFT 0.6.0.dev0
33
+
34
+ - PEFT 0.6.0.dev0
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aa0171f0f4d92124ba5174f0eed9a1d1d68f0709f90343ade36605f54586357f
3
  size 8434381
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69ca8a425e3fcfc66d1564b6443575ce04df0bc022dc1f475d05898322a45cf4
3
  size 8434381