NPU?
Hi, how can I use the 42tops of my NPU?
I'm using google AI edge gallery and can only see CPU-GPU options.
Hi @Alexspeed8888 ,
To utilize your NPU with the Google AI Edge Gallery models, you generally need to target the LiteRT-LM runtime. The inference code needs to use the LiteRT-LM runtime and specifically set the NPU delegate (or accelerator delegate). The delegate is the component that tells the runtime.
You need to enroll the Google’s “NPU acceleration with LiteRT Next” is in Early Access. If you aren’t already enrolled, apply/sign up. Once you have access you’ll get the necessary libraries, delegates, and documentation to integrate NPU support. Can see “NPU acceleration with LiteRT Next.
Kindly follow this official Google AI Edge documentation is the primary source for understanding how to configure the NPU delegate and runtime for optimal performance. if you have any concerns let us know will assist you.
Thank you.