Local Installation Video and Testing - Step by Step
#10
by
fahdmirzac
- opened
Hi,
Kudos on producing such a sublime model. I did a local installation and testing video :
https://youtu.be/PYfLYoYwyxY?si=IytVbohWVR5a6XgZ
Thanks and regards,
Fahd
thank you for this video
Hey, I am trying to use this model for one of my real-time use cases. I can see that even after running on a 48GB VRAM, there's still latency. Is this the least latency possible, or is there any room to improve it further for better latency?