Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

aoi-ot
/
VibeVoice-Large

Text-to-Speech
VibeVoice
Safetensors
English
Chinese
Podcast
Model card Files Files and versions
xet
Community
7

Instructions to use aoi-ot/VibeVoice-Large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • VibeVoice

    How to use aoi-ot/VibeVoice-Large with VibeVoice:

    import torch, soundfile as sf, librosa, numpy as np
    from vibevoice.processor.vibevoice_processor import VibeVoiceProcessor
    from vibevoice.modular.modeling_vibevoice_inference import VibeVoiceForConditionalGenerationInference
    
    # Load voice sample (should be 24kHz mono)
    voice, sr = sf.read("path/to/voice_sample.wav")
    if voice.ndim > 1: voice = voice.mean(axis=1)
    if sr != 24000: voice = librosa.resample(voice, sr, 24000)
    
    processor = VibeVoiceProcessor.from_pretrained("aoi-ot/VibeVoice-Large")
    model = VibeVoiceForConditionalGenerationInference.from_pretrained(
        "aoi-ot/VibeVoice-Large", torch_dtype=torch.bfloat16
    ).to("cuda").eval()
    model.set_ddpm_inference_steps(5)
    
    inputs = processor(text=["Speaker 0: Hello!\nSpeaker 1: Hi there!"],
                       voice_samples=[[voice]], return_tensors="pt")
    audio = model.generate(**inputs, cfg_scale=1.3,
                           tokenizer=processor.tokenizer).speech_outputs[0]
    sf.write("output.wav", audio.cpu().numpy().squeeze(), 24000)
  • Notebooks
  • Google Colab
  • Kaggle
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

How do we use this in Python?

#6 opened 9 months ago by
saipc

Duplicate of aoi-ot/VibeVoice-7B

#5 opened 9 months ago by
owao

Anyone know how to install this VibeVoice-Large model?

2
#4 opened 9 months ago by
Narutoplus

voice

#3 opened 9 months ago by
vds33

If anyone wonders, sha256 hashes match the modelscope ones.

#2 opened 9 months ago by
Galunid

Not all heros wear capes

🔥 5
2
#1 opened 9 months ago by
iluvecats11
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs