Text Generation
LiteRT-LM

Plans for open-sourcing conversion scripts?

#4
by CCRss - opened

Thanks for the great work. 🤗

Is there are any plans of open souring the implementation details?

litert-lm works very fast on the OnePlus 13 with Snapdragon 8 Elite, it works very fast in google-ai-edge/gallery.

That will be great if you can share scripts such that we will contribute and add support for other models like Qwen or even new MOE models, I wonder if MOE will run even faster on phones.

Sign up or log in to comment