vLLM support
#3
by
vcerny
- opened
Hi! Basically what the title says.. Is vLLM support planned? Thanks.
Yes, vLLM is in progress. Hope we could roll it out as early as possible.
Hi!
Is it already possible or is there a vague timeline when it will be compatible? I would love to use it, the embedding model is so nice :)
Thank you and blessings!