jester6136
/

Phi-3.5-mini-instruct-awq

4-bit precision

Model card Files Files and versions

jester6136 commited on Sep 4, 2024

Commit

b28c9f1

·

verified ·

1 Parent(s): 5d7c6dd

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ inputs = [
     "Can you speak Indonesian?"
 ]
 # Initialize the LLM model
-llm = LLM(model="jester6136/SeaLLMs-v3-1.5B-Chat-AWQ",
           quantization="AWQ",
           gpu_memory_utilization=0.9,
           max_model_len=2000,

     "Can you speak Indonesian?"
 ]
 # Initialize the LLM model
+llm = LLM(model="jester6136/Phi-3.5-mini-instruct-awq",
           quantization="AWQ",
           gpu_memory_utilization=0.9,
           max_model_len=2000,