Ion local speech โ€” Parakeet TDT-CTC 110M Q8

This repository distributes the exact GGUF used by Ion's local desktop dictation. It is a format conversion of NVIDIA/Suno.ai's English hybrid checkpoint, with the TDT decoder selected and portable blockwise Q8_0 quantization. It is not fine-tuned.

Artifact

  • Filename: ion-parakeet-110m-tdt-q8-v1.gguf
  • Size: 146029600 bytes
  • SHA-256: 21ca92b8f0299c6e7d28eb9caa25235bf0a55eaa6511e8e46fbbc27e96900876
  • Runtime: NVIDIA NeMo-Speech.cpp 0.1.0 CPU. Compatibility with other GGUF runtimes is not implied by the file extension.
  • Source revision: 431a349f3051ab85c22b9b7a2741b5fe77065665
  • Converter revision: caa3f47c7c75fa2e9e6340272ebad57c1647dd44

Input is 16 kHz mono audio. The model supports English dictation with punctuation and capitalization; multilingual/streaming accuracy is not claimed.

Attribution and license

NVIDIA Parakeet TDT-CTC 110M

Model by NVIDIA NeMo and Suno.ai, https://huggingface.co/nvidia/parakeet-tdt_ctc-110m . Licensed under Creative Commons Attribution 4.0 International: https://creativecommons.org/licenses/by/4.0/ .

Ion converts upstream revision 431a349f3051ab85c22b9b7a2741b5fe77065665 to GGUF with NVIDIA NeMo-Speech.cpp converter revision caa3f47c7c75fa2e9e6340272ebad57c1647dd44, explicitly selecting TDT and portable Q8_0 block layout. These are format conversion and quantization changes; the weights are not fine-tuned. The artifact includes the auxiliary CTC tensors but inference uses TDT.

The native runtime is NVIDIA NeMo-Speech.cpp, https://github.com/NVIDIA/NeMo-Speech.cpp , under Apache-2.0. Its bundled license/third-party notices remain included in the installed runtime. The manifest pins the converted artifact bytes and SHA-256.

The manifest download URL is the intended release location, not proof it is published. Release requires uploading the exact artifact to that HTTPS URL and verifying it before distribution.

Downloads last month
24
GGUF
Model size
0.1B params
Architecture
asr
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for amit-ksh/ion-stt

Quantized
(33)
this model