Update README.md
#7
by hinairo - opened
README.md
CHANGED
|
@@ -287,15 +287,15 @@ We have evaluated the models using the Hugging Face Open ASR Leaderboard methodo
|
|
| 287 |
|
| 288 |
We measured RTFx (Real-Time Factor) for each model size on various GPUs. RTFx indicates how many times faster than real-time the model transcribes audio. Higher RTFx is better.
|
| 289 |
|
| 290 |
-
 for each model size on various GPUs. RTFx in
|
|
| 303 |
|
| 304 |
| **GPU/Model Size**| **S**| **M**| **L**| **XL**| **Original** |
|
| 305 |
| --- | --- | --- | --- | --- | --- |
|
| 306 |
-
| **RTX 4090 (bs=24)** | 355 | 353 | 335 |
|
| 307 |
-
| **L40s (bs=32)** |
|
| 308 |
-
| **RTX 5090 (bs=32)** |
|
| 309 |
-
| **H100 (bs=64)** |
|
| 310 |
|
| 311 |
|
| 312 |
## Benchmarking Methodology
|
|
|
|
| 287 |
|
| 288 |
We measured RTFx (Real-Time Factor) for each model size on various GPUs. RTFx indicates how many times faster than real-time the model transcribes audio. Higher RTFx is better.
|
| 289 |
|
| 290 |
+

|
| 291 |
|
| 292 |
### RTFx, batch size 1
|
| 293 |
|
| 294 |
| **GPU/Model Size**| **S**| **M**| **L**| **XL**| **Original** |
|
| 295 |
| --- | --- | --- | --- | --- | --- |
|
| 296 |
+
| **H100** | 68.9 | 68.4 | 64.3 | 63.8 | 26.1 |
|
| 297 |
+
| **L40s** | 59.4 | 59.4 | 58.3 | 54.6 | 18.1 |
|
| 298 |
+
| **GeForce RTX 5090** | 72 | 70 | 70 | 67 | 25 |
|
| 299 |
| **GeForce RTX 4090** | 69.3 | 67.9 | 67.2 | 64.3 | 38.5 |
|
| 300 |
|
| 301 |
|
|
|
|
| 303 |
|
| 304 |
| **GPU/Model Size**| **S**| **M**| **L**| **XL**| **Original** |
|
| 305 |
| --- | --- | --- | --- | --- | --- |
|
| 306 |
+
| **RTX 4090 (bs=24)** | 355 | 353 | 335 | 320 | 302 |
|
| 307 |
+
| **L40s (bs=32)** | 288 | 288 | 285 | 279 | 238 |
|
| 308 |
+
| **RTX 5090 (bs=32)** | 425 | 422 | 419 | 416 | 287 |
|
| 309 |
+
| **H100 (bs=64)** | 567 | 567 | 567 | 567 | 415 |
|
| 310 |
|
| 311 |
|
| 312 |
## Benchmarking Methodology
|