Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -15,67 +15,20 @@ https://huggingface.co/spaces/awacke1/ZeroHot
|
|
| 15 |
|
| 16 |
|
| 17 |
# AI Multimodal Media Workflows and Pipelines
|
|
|
|
| 18 |
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
```
|
| 32 |
-
|
| 33 |
-
```mermaid
|
| 34 |
-
%% Workflow 2: Medical Documentation to Multimedia
|
| 35 |
-
subgraph "Workflow 2: Medical Case Study"
|
| 36 |
-
DOC[PDF Document] --> RAG[Arxiv RAG QA]
|
| 37 |
-
RAG --> TTS[Edge TTS]
|
| 38 |
-
RAG --> IMG2[DALL-E 3]
|
| 39 |
-
TTS --> FINAL[Final Presentation]
|
| 40 |
-
IMG2 --> FINAL
|
| 41 |
-
end
|
| 42 |
-
```
|
| 43 |
-
|
| 44 |
-
```mermaid
|
| 45 |
-
%% Workflow 3: Real-time Patient Interaction
|
| 46 |
-
subgraph "Workflow 3: Patient Communication"
|
| 47 |
-
SPEECH[Real-Time ASR] --> CLAUDE[Claude 3.5]
|
| 48 |
-
CLAUDE --> TRANS[Edge TTS]
|
| 49 |
-
CLAUDE --> VIS[Stable Cascade]
|
| 50 |
-
TRANS --> OUT[Patient Output]
|
| 51 |
-
VIS --> OUT
|
| 52 |
-
end
|
| 53 |
-
```
|
| 54 |
-
|
| 55 |
-
```mermaid
|
| 56 |
-
%% Workflow 4: Medical Training Content
|
| 57 |
-
subgraph "Workflow 4: Training Material"
|
| 58 |
-
PROMPT[Course Outline] --> LLM[Claude 3.5]
|
| 59 |
-
LLM --> MESH[InstantMesh]
|
| 60 |
-
LLM --> SVID[Stable Video]
|
| 61 |
-
MESH --> SVID
|
| 62 |
-
LLM --> AUDIO[AudioGen]
|
| 63 |
-
SVID --> FINAL2[Training Module]
|
| 64 |
-
AUDIO --> FINAL2
|
| 65 |
-
end
|
| 66 |
-
```
|
| 67 |
-
|
| 68 |
-
```mermaid
|
| 69 |
-
%% Workflow 5: Interactive Medical Visualization
|
| 70 |
-
subgraph "Workflow 5: Interactive Visualization"
|
| 71 |
-
DATA[Medical Data] --> PLOT[AutoML Plotly]
|
| 72 |
-
PLOT --> IMG3[ControlNet]
|
| 73 |
-
IMG3 --> VID2[Video Generation]
|
| 74 |
-
DATA --> VOICE[Voice Clone]
|
| 75 |
-
VID2 --> PRESENT[Interactive Presentation]
|
| 76 |
-
VOICE --> PRESENT
|
| 77 |
-
end
|
| 78 |
-
```
|
| 79 |
|
| 80 |
Zero GPU and GPU Spaces of note:
|
| 81 |
|
|
|
|
| 15 |
|
| 16 |
|
| 17 |
# AI Multimodal Media Workflows and Pipelines
|
| 18 |
+
https://github.com/AaronCWacker/Yggdrasil/blob/main/Mermaid/MultimodalAIPipelines.md
|
| 19 |
|
| 20 |
+

|
| 21 |
+
|
| 22 |
+

|
| 23 |
+
|
| 24 |
+

|
| 25 |
+
|
| 26 |
+

|
| 27 |
+
|
| 28 |
+

|
| 29 |
+
|
| 30 |
+
|
| 31 |
+
# AI Multimodal Model Spaces
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
|
| 33 |
Zero GPU and GPU Spaces of note:
|
| 34 |
|