Y Phung Nguyen commited on
Commit
e93ecc8
·
1 Parent(s): d202679

Upd DT and README:

Browse files
Files changed (2) hide show
  1. README.md +7 -5
  2. config.py +1 -0
README.md CHANGED
@@ -43,9 +43,11 @@ tags:
43
 
44
 
45
  ### 🧠 **MedSwin Medical Specialist Models**
46
- - **MedSwin TA** (default) - Task-Aware merged model
47
- - **MedSwin SFT** - Supervised Fine-Tuned model
48
- - **MedSwin KD** - Knowledge Distillation model
 
 
49
  - Models download on-demand for efficient resource usage
50
  - Fine-tuned on MedAlpaca-7B for medical domain expertise
51
 
@@ -106,7 +108,7 @@ Sample [conversation](sample.md) between MAC-system and patient are recorded.
106
  2. **Configure Settings**:
107
  - Enable/disable Document RAG
108
  - Enable/disable Web Search (MCP)
109
- - Select medical model (MedSwin SFT/KD/TA)
110
  3. **Ask Questions**: Type your medical question in any language
111
  4. **Get Answers**: Receive comprehensive answers based on:
112
  - Your uploaded documents (if RAG enabled)
@@ -116,7 +118,7 @@ Sample [conversation](sample.md) between MAC-system and patient are recorded.
116
 
117
  ## 🔧 Technical Details
118
 
119
- - **Medical Models**: MedSwin/MedSwin-7B-SFT, MedSwin-7B-KD, MedSwin-Merged-TA-SFT-0.7
120
  - **Architecture**: MAC (Multi-Agent Collaboration) - Gemini Supervisor + MedSwin Specialist
121
  - **Translation**: Gemini MCP (gemini-2.5-flash-lite)
122
  - **Document Parsing**: Gemini MCP (PDF, Word, TXT, MD, JSON, XML, CSV)
 
43
 
44
 
45
  ### 🧠 **MedSwin Medical Specialist Models**
46
+ - **MedSwin DT** (85% acc) - DaRE-TIES merged model from SFT and KD.
47
+ - **MedSwin NSL** (85% acc) - NuSLERP merged model from SFT and KD.
48
+ - **MedSwin TA** (84% acc) - Task-Arimethic merged model from SFT and KD.
49
+ - **MedSwin SFT** - (82% acc) Supervised Fine-Tuned model.
50
+ - **MedSwin KD** - (83% acc) Knowledge Distillation from MedGemma-27b-it.
51
  - Models download on-demand for efficient resource usage
52
  - Fine-tuned on MedAlpaca-7B for medical domain expertise
53
 
 
108
  2. **Configure Settings**:
109
  - Enable/disable Document RAG
110
  - Enable/disable Web Search (MCP)
111
+ - Select medical model (MedSwin SFT/KD/TA/DT/NSL)
112
  3. **Ask Questions**: Type your medical question in any language
113
  4. **Get Answers**: Receive comprehensive answers based on:
114
  - Your uploaded documents (if RAG enabled)
 
118
 
119
  ## 🔧 Technical Details
120
 
121
+ - **Medical Models**: MedSwin/MedSwin-7B-SFT, MedSwin-7B-KD, MedSwin-Merged-TA-SFT-0.7, MedSwin-Merged-NuSLERP-KD-0.7, MedSwin-Merged-DaRE-TIES-KD-0.7
122
  - **Architecture**: MAC (Multi-Agent Collaboration) - Gemini Supervisor + MedSwin Specialist
123
  - **Translation**: Gemini MCP (gemini-2.5-flash-lite)
124
  - **Document Parsing**: Gemini MCP (PDF, Word, TXT, MD, JSON, XML, CSV)
config.py CHANGED
@@ -8,6 +8,7 @@ MEDSWIN_MODELS = {
8
  "MedSwin KD": "MedSwin/MedSwin-7B-KD",
9
  "MedSwin TA": "MedSwin/MedSwin-Merged-TA-SFT-0.7",
10
  "MedSwin DT": "MedSwin/MedSwin-Merged-DaRE-TIES-KD-0.7",
 
11
  }
12
  DEFAULT_MEDICAL_MODEL = "MedSwin TA"
13
  EMBEDDING_MODEL = "abhinand/MedEmbed-large-v0.1"
 
8
  "MedSwin KD": "MedSwin/MedSwin-7B-KD",
9
  "MedSwin TA": "MedSwin/MedSwin-Merged-TA-SFT-0.7",
10
  "MedSwin DT": "MedSwin/MedSwin-Merged-DaRE-TIES-KD-0.7",
11
+ "MedSwin NSL": "MedSwin/MedSwin-Merged-NuSLERP-KD-0.7",
12
  }
13
  DEFAULT_MEDICAL_MODEL = "MedSwin TA"
14
  EMBEDDING_MODEL = "abhinand/MedEmbed-large-v0.1"