Spaces:
Running
on
Zero
Running
on
Zero
Y Phung Nguyen
commited on
Commit
·
e93ecc8
1
Parent(s):
d202679
Upd DT and README:
Browse files
README.md
CHANGED
|
@@ -43,9 +43,11 @@ tags:
|
|
| 43 |
|
| 44 |
|
| 45 |
### 🧠 **MedSwin Medical Specialist Models**
|
| 46 |
-
- **MedSwin
|
| 47 |
-
- **MedSwin
|
| 48 |
-
- **MedSwin
|
|
|
|
|
|
|
| 49 |
- Models download on-demand for efficient resource usage
|
| 50 |
- Fine-tuned on MedAlpaca-7B for medical domain expertise
|
| 51 |
|
|
@@ -106,7 +108,7 @@ Sample [conversation](sample.md) between MAC-system and patient are recorded.
|
|
| 106 |
2. **Configure Settings**:
|
| 107 |
- Enable/disable Document RAG
|
| 108 |
- Enable/disable Web Search (MCP)
|
| 109 |
-
- Select medical model (MedSwin SFT/KD/TA)
|
| 110 |
3. **Ask Questions**: Type your medical question in any language
|
| 111 |
4. **Get Answers**: Receive comprehensive answers based on:
|
| 112 |
- Your uploaded documents (if RAG enabled)
|
|
@@ -116,7 +118,7 @@ Sample [conversation](sample.md) between MAC-system and patient are recorded.
|
|
| 116 |
|
| 117 |
## 🔧 Technical Details
|
| 118 |
|
| 119 |
-
- **Medical Models**: MedSwin/MedSwin-7B-SFT, MedSwin-7B-KD, MedSwin-Merged-TA-SFT-0.7
|
| 120 |
- **Architecture**: MAC (Multi-Agent Collaboration) - Gemini Supervisor + MedSwin Specialist
|
| 121 |
- **Translation**: Gemini MCP (gemini-2.5-flash-lite)
|
| 122 |
- **Document Parsing**: Gemini MCP (PDF, Word, TXT, MD, JSON, XML, CSV)
|
|
|
|
| 43 |
|
| 44 |
|
| 45 |
### 🧠 **MedSwin Medical Specialist Models**
|
| 46 |
+
- **MedSwin DT** (85% acc) - DaRE-TIES merged model from SFT and KD.
|
| 47 |
+
- **MedSwin NSL** (85% acc) - NuSLERP merged model from SFT and KD.
|
| 48 |
+
- **MedSwin TA** (84% acc) - Task-Arimethic merged model from SFT and KD.
|
| 49 |
+
- **MedSwin SFT** - (82% acc) Supervised Fine-Tuned model.
|
| 50 |
+
- **MedSwin KD** - (83% acc) Knowledge Distillation from MedGemma-27b-it.
|
| 51 |
- Models download on-demand for efficient resource usage
|
| 52 |
- Fine-tuned on MedAlpaca-7B for medical domain expertise
|
| 53 |
|
|
|
|
| 108 |
2. **Configure Settings**:
|
| 109 |
- Enable/disable Document RAG
|
| 110 |
- Enable/disable Web Search (MCP)
|
| 111 |
+
- Select medical model (MedSwin SFT/KD/TA/DT/NSL)
|
| 112 |
3. **Ask Questions**: Type your medical question in any language
|
| 113 |
4. **Get Answers**: Receive comprehensive answers based on:
|
| 114 |
- Your uploaded documents (if RAG enabled)
|
|
|
|
| 118 |
|
| 119 |
## 🔧 Technical Details
|
| 120 |
|
| 121 |
+
- **Medical Models**: MedSwin/MedSwin-7B-SFT, MedSwin-7B-KD, MedSwin-Merged-TA-SFT-0.7, MedSwin-Merged-NuSLERP-KD-0.7, MedSwin-Merged-DaRE-TIES-KD-0.7
|
| 122 |
- **Architecture**: MAC (Multi-Agent Collaboration) - Gemini Supervisor + MedSwin Specialist
|
| 123 |
- **Translation**: Gemini MCP (gemini-2.5-flash-lite)
|
| 124 |
- **Document Parsing**: Gemini MCP (PDF, Word, TXT, MD, JSON, XML, CSV)
|
config.py
CHANGED
|
@@ -8,6 +8,7 @@ MEDSWIN_MODELS = {
|
|
| 8 |
"MedSwin KD": "MedSwin/MedSwin-7B-KD",
|
| 9 |
"MedSwin TA": "MedSwin/MedSwin-Merged-TA-SFT-0.7",
|
| 10 |
"MedSwin DT": "MedSwin/MedSwin-Merged-DaRE-TIES-KD-0.7",
|
|
|
|
| 11 |
}
|
| 12 |
DEFAULT_MEDICAL_MODEL = "MedSwin TA"
|
| 13 |
EMBEDDING_MODEL = "abhinand/MedEmbed-large-v0.1"
|
|
|
|
| 8 |
"MedSwin KD": "MedSwin/MedSwin-7B-KD",
|
| 9 |
"MedSwin TA": "MedSwin/MedSwin-Merged-TA-SFT-0.7",
|
| 10 |
"MedSwin DT": "MedSwin/MedSwin-Merged-DaRE-TIES-KD-0.7",
|
| 11 |
+
"MedSwin NSL": "MedSwin/MedSwin-Merged-NuSLERP-KD-0.7",
|
| 12 |
}
|
| 13 |
DEFAULT_MEDICAL_MODEL = "MedSwin TA"
|
| 14 |
EMBEDDING_MODEL = "abhinand/MedEmbed-large-v0.1"
|