anikifoss
/

DeepSeek-R1-0528-DQ4_K_R4

Text Generation

Model card Files Files and versions

anikifoss commited on May 31

Commit

7d87b0a

·

verified ·

1 Parent(s): bcd921f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -23,7 +23,7 @@ Use the following command lines to run the model (tweak the command to further c
     --temp 0.5 --top-k 0 --top-p 1.0 --min-p 0.1 --repeat-penalty 1.0 \
     --ctx-size 75000 \
     -ctk f16 \
-    -mla 3 -fa \
     -amb 1024 \
     -b 2048 -ub 2048 \
     -fmoe \

     --temp 0.5 --top-k 0 --top-p 1.0 --min-p 0.1 --repeat-penalty 1.0 \
     --ctx-size 75000 \
     -ctk f16 \
+    -mla 2 -fa \
     -amb 1024 \
     -b 2048 -ub 2048 \
     -fmoe \