Update README.md
Browse filesAdded UI compatibility.
README.md
CHANGED
|
@@ -132,6 +132,22 @@ Example response:
|
|
| 132 |
{"choices":[{"finish_reason":"stop","index":0,"logprobs":null,"message":{"content":"A retrovirus is a type of virus that uses an enzyme called reverse transcriptase to convert its RNA genome into DNA, which then integrates into the host cell's DNA. This integration allows the virus to replicate within the host cell for extended periods, often leading to chronic infections or even cancer. Here's a breakdown: * **RNA Genome:** Retroviruses have an RNA (ribonucleic acid) genome instead of DNA. * **Reverse Transcriptase:** This enzyme is unique to retroviruses and allows them to convert their RNA into DNA. It essentially acts as a molecular "copy machine" for the virus's genetic material. * **Integration:** The newly synthesized DNA integrates into the host cell's genome, becoming part of its DNA. This integration can be permanent or semi-permanent. * **Replication:** Once integrated, the viral DNA can be transcribed back into RNA, which is then used to produce new virus particles. These particles are released from the infected cell, infecting other cells. **Key Characteristics and Implications:** * **Chronic Infections:** Because retroviruses integrate their genetic material into the host's genome, they can cause chronic infections that persist for years or even a lifetime. * **Cancer:** Retroviral integration can disrupt normal cellular processes, leading to uncontrolled cell growth and cancer development. * **Examples:** Some well-known examples of retroviruses include HIV (Human Immunodeficiency Virus), which causes AIDS, and HTLV (Human T-lymphotropic virus), which can cause adult T-cell leukemia. In summary, a retrovirus is a unique type of virus that uses reverse transcriptase to integrate its RNA genome into the host cell's DNA, leading to chronic infections and potential cancer development. ","role":"assistant"}}],"created":null,"id":"rkllm_chat","object":"rkllm_chat","usage":{"completion_tokens":null,"prompt_tokens":null,"total_tokens":null}}
|
| 133 |
```
|
| 134 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 135 |
# License
|
| 136 |
|
| 137 |
This conversion follows the license of the source model:
|
|
|
|
| 132 |
{"choices":[{"finish_reason":"stop","index":0,"logprobs":null,"message":{"content":"A retrovirus is a type of virus that uses an enzyme called reverse transcriptase to convert its RNA genome into DNA, which then integrates into the host cell's DNA. This integration allows the virus to replicate within the host cell for extended periods, often leading to chronic infections or even cancer. Here's a breakdown: * **RNA Genome:** Retroviruses have an RNA (ribonucleic acid) genome instead of DNA. * **Reverse Transcriptase:** This enzyme is unique to retroviruses and allows them to convert their RNA into DNA. It essentially acts as a molecular "copy machine" for the virus's genetic material. * **Integration:** The newly synthesized DNA integrates into the host cell's genome, becoming part of its DNA. This integration can be permanent or semi-permanent. * **Replication:** Once integrated, the viral DNA can be transcribed back into RNA, which is then used to produce new virus particles. These particles are released from the infected cell, infecting other cells. **Key Characteristics and Implications:** * **Chronic Infections:** Because retroviruses integrate their genetic material into the host's genome, they can cause chronic infections that persist for years or even a lifetime. * **Cancer:** Retroviral integration can disrupt normal cellular processes, leading to uncontrolled cell growth and cancer development. * **Examples:** Some well-known examples of retroviruses include HIV (Human Immunodeficiency Virus), which causes AIDS, and HTLV (Human T-lymphotropic virus), which can cause adult T-cell leukemia. In summary, a retrovirus is a unique type of virus that uses reverse transcriptase to integrate its RNA genome into the host cell's DNA, leading to chronic infections and potential cancer development. ","role":"assistant"}}],"created":null,"id":"rkllm_chat","object":"rkllm_chat","usage":{"completion_tokens":null,"prompt_tokens":null,"total_tokens":null}}
|
| 133 |
```
|
| 134 |
|
| 135 |
+
### 4) UI compatibility
|
| 136 |
+
|
| 137 |
+
This server exposes an **OpenAI-compatible Chat Completions API**.
|
| 138 |
+
|
| 139 |
+
You can connect it to any OpenAI-compatible client or UI (for example: [Open WebUI](https://github.com/open-webui/open-webui?utm_source=chatgpt.com))
|
| 140 |
+
- Configure your client with the API base: `http://<SERVER_IP_ADDRESS>:8080` and use the endpoint: `/rkllm_chat`
|
| 141 |
+
- Make sure the `model` field matches the converted model’s name, for example:
|
| 142 |
+
|
| 143 |
+
```json
|
| 144 |
+
{
|
| 145 |
+
"model": "llama-3.1-8b-instruct",
|
| 146 |
+
"messages": [{"role":"user","content":"Hello!"}],
|
| 147 |
+
"stream": false
|
| 148 |
+
}
|
| 149 |
+
```
|
| 150 |
+
|
| 151 |
# License
|
| 152 |
|
| 153 |
This conversion follows the license of the source model:
|