cicdatopea commited on
Commit
57f41c1
·
verified ·
1 Parent(s): 9150dc2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -1
README.md CHANGED
@@ -76,4 +76,21 @@ The image is a close-up shot of a vibrant garden scene, focusing on a pink cosmo
76
 
77
  * **Cosmos Flower:** The central focus is a large, pink cosmos flower with broad petals. It's in full bloom and appears healthy.
78
  * **Bumblebee:**"""
79
- ~~~
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
76
 
77
  * **Cosmos Flower:** The central focus is a large, pink cosmos flower with broad petals. It's in full bloom and appears healthy.
78
  * **Bumblebee:**"""
79
+ ~~~
80
+
81
+
82
+ ## Generate the model
83
+
84
+ Here is the sample command to reproduce the model.
85
+
86
+ ```bash
87
+ pip install git+https://github.com/intel/auto-round.git@main
88
+ auto-round-mllm \
89
+ --model google/gemma-3-12b-it \
90
+ --device 0 \
91
+ --bits 4 \
92
+ --batch_size 1 \
93
+ --gradient_accumulate_steps 8 \
94
+ --format 'auto_round' \
95
+ --output_dir "./tmp_autoround"
96
+ ```