Update model card to Hunyuan3D 2.5
#54
by
nielsr
HF Staff
- opened
README.md
CHANGED
|
@@ -1,15 +1,15 @@
|
|
| 1 |
---
|
|
|
|
|
|
|
|
|
|
| 2 |
library_name: hunyuan3d-2
|
| 3 |
license: other
|
| 4 |
license_name: tencent-hunyuan-community
|
| 5 |
license_link: https://huggingface.co/tencent/Hunyuan3D-2/blob/main/LICENSE.txt
|
| 6 |
-
language:
|
| 7 |
-
- en
|
| 8 |
-
- zh
|
| 9 |
-
tags:
|
| 10 |
-
- image-to-3d
|
| 11 |
-
- text-to-3d
|
| 12 |
pipeline_tag: image-to-3d
|
|
|
|
|
|
|
|
|
|
| 13 |
---
|
| 14 |
|
| 15 |
<p align="center">
|
|
@@ -21,56 +21,64 @@ pipeline_tag: image-to-3d
|
|
| 21 |
<a href=https://huggingface.co/spaces/tencent/Hunyuan3D-2 target="_blank"><img src=https://img.shields.io/badge/%F0%9F%A4%97%20Demo-276cb4.svg height=22px></a>
|
| 22 |
<a href=https://huggingface.co/tencent/Hunyuan3D-2 target="_blank"><img src=https://img.shields.io/badge/%F0%9F%A4%97%20Models-d96902.svg height=22px></a>
|
| 23 |
<a href=https://3d-models.hunyuan.tencent.com/ target="_blank"><img src= https://img.shields.io/badge/Page-bb8a2e.svg?logo=github height=22px></a>
|
| 24 |
-
<a href=https://discord.gg/
|
| 25 |
-
|
|
|
|
|
|
|
| 26 |
</div>
|
| 27 |
|
| 28 |
-
|
| 29 |
-
[//]: # ( <a href=# target="_blank"><img src=https://img.shields.io/badge/Report-b5212f.svg?logo=arxiv height=22px></a>)
|
| 30 |
-
|
| 31 |
-
[//]: # ( <a href=# target="_blank"><img src= https://img.shields.io/badge/Colab-8f2628.svg?logo=googlecolab height=22px></a>)
|
| 32 |
-
|
| 33 |
-
[//]: # ( <a href="#"><img alt="PyPI - Downloads" src="https://img.shields.io/pypi/v/mulankit?logo=pypi" height=22px></a>)
|
| 34 |
-
|
| 35 |
<br>
|
| 36 |
<p align="center">
|
| 37 |
β Living out everyoneβs imagination on creating and manipulating 3D assets.β
|
| 38 |
</p>
|
| 39 |
|
| 40 |
-
This repository contains the models of the paper [Hunyuan3D 2.
|
| 41 |
For code and more details on how to use it, refer to the [Github repository](https://github.com/Tencent/Hunyuan3D-2).
|
| 42 |
|
| 43 |
## π₯ News
|
| 44 |
|
| 45 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
|
| 47 |
## **Abstract**
|
| 48 |
|
| 49 |
-
|
| 50 |
-
This system includes two foundation components: a large-scale shape generation model - Hunyuan3D-DiT, and a large-scale
|
| 51 |
-
texture synthesis model - Hunyuan3D-Paint.
|
| 52 |
-
The shape generative model, built on a scalable flow-based diffusion transformer, aims to create geometry that properly
|
| 53 |
-
aligns with a given condition image, laying a solid foundation for downstream applications.
|
| 54 |
-
The texture synthesis model, benefiting from strong geometric and diffusion priors, produces high-resolution and vibrant
|
| 55 |
-
texture maps for either generated or hand-crafted meshes.
|
| 56 |
-
Furthermore, we build Hunyuan3D-Studio - a versatile, user-friendly production platform that simplifies the re-creation
|
| 57 |
-
process of 3D assets. It allows both professional and amateur users to manipulate or even animate their meshes
|
| 58 |
-
efficiently.
|
| 59 |
-
We systematically evaluate our models, showing that Hunyuan3D 2.0 outperforms previous state-of-the-art models,
|
| 60 |
-
including the open-source models and closed-source models in geometry details, condition alignment, texture quality, and
|
| 61 |
-
e.t.c.
|
| 62 |
|
| 63 |
<p align="center">
|
| 64 |
<img src="assets/images/system.jpg">
|
| 65 |
</p>
|
| 66 |
|
| 67 |
-
## β―οΈ **Hunyuan3D 2.
|
| 68 |
|
| 69 |
### Architecture
|
| 70 |
|
| 71 |
-
Hunyuan3D 2.
|
| 72 |
-
synthesis of a texture map for that mesh. This strategy is effective for decoupling the difficulties of shape and
|
| 73 |
-
texture generation and also provides flexibility for texturing either generated or handcrafted meshes.
|
| 74 |
|
| 75 |
<p align="left">
|
| 76 |
<img src="assets/images/arch.jpg">
|
|
@@ -78,8 +86,8 @@ texture generation and also provides flexibility for texturing either generated
|
|
| 78 |
|
| 79 |
### Performance
|
| 80 |
|
| 81 |
-
We have evaluated Hunyuan3D 2.
|
| 82 |
-
The numerical results indicate that Hunyuan3D 2.
|
| 83 |
and the condition following ability.
|
| 84 |
|
| 85 |
| Model | CMMD(β¬) | FID_CLIP(β¬) | FID(β¬) | CLIP-score(β¬) |
|
|
@@ -88,25 +96,61 @@ and the condition following ability.
|
|
| 88 |
| Top Close-source Model1 | 3.600 | 55.866 | 305.922 | 0.779 |
|
| 89 |
| Top Close-source Model2 | 3.368 | 49.744 | 294.628 | 0.806 |
|
| 90 |
| Top Close-source Model3 | 3.218 | 51.574 | 295.691 | 0.799 |
|
| 91 |
-
| Hunyuan3D 2.
|
| 92 |
|
| 93 |
-
Generation results of Hunyuan3D 2.
|
| 94 |
<p align="left">
|
| 95 |
-
<img src="assets/images/e2e-1.gif" height=
|
| 96 |
-
<img src="assets/images/e2e-2.gif" height=
|
| 97 |
</p>
|
| 98 |
|
| 99 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 100 |
|
| 101 |
-
| Model | Date | Huggingface
|
| 102 |
-
|
| 103 |
-
| Hunyuan3D-DiT-v2-
|
| 104 |
-
| Hunyuan3D-Paint-v2-
|
| 105 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 106 |
|
| 107 |
## π€ Get Started with Hunyuan3D 2.0
|
| 108 |
|
| 109 |
-
You may follow the next steps to use Hunyuan3D 2.0 via
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 110 |
|
| 111 |
### Install Requirements
|
| 112 |
|
|
@@ -114,15 +158,16 @@ Please install Pytorch via the [official](https://pytorch.org/) site. Then insta
|
|
| 114 |
|
| 115 |
```bash
|
| 116 |
pip install -r requirements.txt
|
|
|
|
| 117 |
# for texture
|
| 118 |
cd hy3dgen/texgen/custom_rasterizer
|
| 119 |
python3 setup.py install
|
| 120 |
cd ../../..
|
| 121 |
cd hy3dgen/texgen/differentiable_renderer
|
| 122 |
-
|
| 123 |
```
|
| 124 |
|
| 125 |
-
###
|
| 126 |
|
| 127 |
We designed a diffusers-like API to use our shape generation model - Hunyuan3D-DiT and texture synthesis model -
|
| 128 |
Hunyuan3D-Paint.
|
|
@@ -153,18 +198,66 @@ pipeline = Hunyuan3DPaintPipeline.from_pretrained('tencent/Hunyuan3D-2')
|
|
| 153 |
mesh = pipeline(mesh, image='assets/demo.png')
|
| 154 |
```
|
| 155 |
|
| 156 |
-
Please visit [
|
|
|
|
| 157 |
for handcrafted mesh**.
|
| 158 |
|
| 159 |
### Gradio App
|
| 160 |
|
| 161 |
You could also host a [Gradio](https://www.gradio.app/) App in your own computer via:
|
| 162 |
|
|
|
|
|
|
|
| 163 |
```bash
|
| 164 |
-
|
| 165 |
-
python3 gradio_app.py
|
|
|
|
|
|
|
|
|
|
|
|
|
| 166 |
```
|
| 167 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 168 |
Don't forget to visit [Hunyuan3D](https://3d.hunyuan.tencent.com) for quick use, if you don't want to host yourself.
|
| 169 |
|
| 170 |
## π Open-Source Plan
|
|
@@ -172,14 +265,25 @@ Don't forget to visit [Hunyuan3D](https://3d.hunyuan.tencent.com) for quick use,
|
|
| 172 |
- [x] Inference Code
|
| 173 |
- [x] Model Checkpoints
|
| 174 |
- [x] Technical Report
|
| 175 |
-
- [
|
|
|
|
| 176 |
- [ ] TensorRT Version
|
| 177 |
|
| 178 |
## π BibTeX
|
| 179 |
|
| 180 |
-
If you found this repository helpful, please cite our
|
| 181 |
|
| 182 |
```bibtex
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 183 |
@misc{hunyuan3d22025tencent,
|
| 184 |
title={Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation},
|
| 185 |
author={Tencent Hunyuan3D Team},
|
|
@@ -189,8 +293,8 @@ If you found this repository helpful, please cite our report:
|
|
| 189 |
primaryClass={cs.CV}
|
| 190 |
}
|
| 191 |
|
| 192 |
-
@misc{
|
| 193 |
-
title={
|
| 194 |
author={Tencent Hunyuan3D Team},
|
| 195 |
year={2024},
|
| 196 |
eprint={2411.02293},
|
|
@@ -203,15 +307,19 @@ If you found this repository helpful, please cite our report:
|
|
| 203 |
|
| 204 |
Thanks for the contributions of community members, here we have these great extensions of Hunyuan3D 2.0:
|
| 205 |
|
|
|
|
| 206 |
- [ComfyUI-Hunyuan3DWrapper](https://github.com/kijai/ComfyUI-Hunyuan3DWrapper)
|
| 207 |
- [Hunyuan3D-2-for-windows](https://github.com/sdbds/Hunyuan3D-2-for-windows)
|
| 208 |
-
- [π¦ A bundle for running on Windows | ζ΄εε
](https://github.com/YanWenKun/
|
|
|
|
|
|
|
| 209 |
|
| 210 |
## Acknowledgements
|
| 211 |
|
| 212 |
We would like to thank the contributors to
|
| 213 |
-
the [DINOv2](https://github.com/facebookresearch/dinov2), [Stable Diffusion](https://github.com/Stability-AI/stablediffusion), [FLUX](https://github.com/black-forest-labs/flux), [diffusers](https://github.com/huggingface/diffusers)
|
| 214 |
-
and [
|
|
|
|
| 215 |
|
| 216 |
## Star History
|
| 217 |
|
|
|
|
| 1 |
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
- zh
|
| 5 |
library_name: hunyuan3d-2
|
| 6 |
license: other
|
| 7 |
license_name: tencent-hunyuan-community
|
| 8 |
license_link: https://huggingface.co/tencent/Hunyuan3D-2/blob/main/LICENSE.txt
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
pipeline_tag: image-to-3d
|
| 10 |
+
tags:
|
| 11 |
+
- image-to-3d
|
| 12 |
+
- text-to-3d
|
| 13 |
---
|
| 14 |
|
| 15 |
<p align="center">
|
|
|
|
| 21 |
<a href=https://huggingface.co/spaces/tencent/Hunyuan3D-2 target="_blank"><img src=https://img.shields.io/badge/%F0%9F%A4%97%20Demo-276cb4.svg height=22px></a>
|
| 22 |
<a href=https://huggingface.co/tencent/Hunyuan3D-2 target="_blank"><img src=https://img.shields.io/badge/%F0%9F%A4%97%20Models-d96902.svg height=22px></a>
|
| 23 |
<a href=https://3d-models.hunyuan.tencent.com/ target="_blank"><img src= https://img.shields.io/badge/Page-bb8a2e.svg?logo=github height=22px></a>
|
| 24 |
+
<a href=https://discord.gg/dNBrdrGGMa target="_blank"><img src= https://img.shields.io/badge/Discord-white.svg?logo=discord height=22px></a>
|
| 25 |
+
<a href=https://arxiv.org/abs/2506.16504 target="_blank"><img src=https://img.shields.io/badge/Report-b5212f.svg?logo=arxiv height=22px></a>
|
| 26 |
+
<a href=https://x.com/TencentHunyuan target="_blank"><img src=https://img.shields.io/badge/Hunyuan-black.svg?logo=x height=22px></a>
|
| 27 |
+
<a href="#community-resources" target="_blank"><img src=https://img.shields.io/badge/Community-lavender.svg?logo=homeassistantcommunitystore height=22px></a>
|
| 28 |
</div>
|
| 29 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
<br>
|
| 31 |
<p align="center">
|
| 32 |
β Living out everyoneβs imagination on creating and manipulating 3D assets.β
|
| 33 |
</p>
|
| 34 |
|
| 35 |
+
This repository contains the models of the paper [Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Details](https://huggingface.co/papers/2506.16504).
|
| 36 |
For code and more details on how to use it, refer to the [Github repository](https://github.com/Tencent/Hunyuan3D-2).
|
| 37 |
|
| 38 |
## π₯ News
|
| 39 |
|
| 40 |
+
- June 23, 2025: π Release the system technical report of [Hunyuan3D 2.5](https://arxiv.org/abs/2506.16504).
|
| 41 |
+
- June 13, 2025: π€ Release [Hunyuan3D-2.1](https://github.com/Tencent-Hunyuan/Hunyuan3D-2.1), fully open-sourced with new PBR model, VAE encoder, and all training code.
|
| 42 |
+
- Apr 1, 2025: π€ Release turbo paint model [Hunyuan3D-Paint-v2-0-Turbo](https://huggingface.co/tencent/Hunyuan3D-2/tree/main/hunyuan3d-paint-v2-0-turbo), and multiview texture generation pipeline, try it [here](examples/fast_texture_gen_multiview.py)! Stay tuned for our new texture generation model [RomanTex](https://github.com/oakshy/RomanTex) and PBR material generation [MaterialMVP](https://github.com/ZebinHe/MaterialMVP/)!
|
| 43 |
+
- Mar 19, 2025: π€ Release turbo model [Hunyuan3D-2-Turbo](https://huggingface.co/tencent/Hunyuan3D-2/), [Hunyuan3D-2mini-Turbo](https://huggingface.co/tencent/Hunyuan3D-2mini/) and [FlashVDM](https://github.com/Tencent/FlashVDM).
|
| 44 |
+
- Mar 18, 2025: π€ Release multiview shape model [Hunyuan3D-2mv](https://huggingface.co/tencent/Hunyuan3D-2mv) and 0.6B
|
| 45 |
+
shape model [Hunyuan3D-2mini](https://huggingface.co/tencent/Hunyuan3D-2mini).
|
| 46 |
+
- Feb 14, 2025: π οΈ Release texture enhancement module, please obtain high-definition textures
|
| 47 |
+
via [here](minimal_demo.py)!
|
| 48 |
+
- Feb 3, 2025: π
|
| 49 |
+
Release [Hunyuan3D-DiT-v2-0-Fast](https://huggingface.co/tencent/Hunyuan3D-2/tree/main/hunyuan3d-dit-v2-0-fast), our
|
| 50 |
+
guidance distillation model that could half the dit inference time, see [here](minimal_demo.py) for usage.
|
| 51 |
+
- Jan 27, 2025: π οΈ Release Blender addon for Hunyuan3D 2.0, Check it out [here](#blender-addon).
|
| 52 |
+
- Jan 23, 2025: π¬ We thank community members for
|
| 53 |
+
creating [Windows installation tool](https://github.com/YanWenKun/Hunyuan3D-2-WinPortable), ComfyUI support
|
| 54 |
+
with [ComfyUI-Hunyuan3DWrapper](https://github.com/kijai/ComfyUI-Hunyuan3DWrapper)
|
| 55 |
+
and [ComfyUI-3D-Pack](https://github.com/MrForExample/ComfyUI-3D-Pack) and other
|
| 56 |
+
awesome [extensions](#community-resources).
|
| 57 |
+
- Jan 21, 2025: π¬ Enjoy exciting 3D generation on our website [Hunyuan3D Studio](https://3d.hunyuan.tencent.com)!
|
| 58 |
+
- Jan 21, 2025: π€ Release inference code and pretrained models
|
| 59 |
+
of [Hunyuan3D 2.0](https://huggingface.co/tencent/Hunyuan3D-2). Please give it a try
|
| 60 |
+
via [huggingface space](https://huggingface.co/spaces/tencent/Hunyuan3D-2) and
|
| 61 |
+
our [official site](https://3d.hunyuan.tencent.com)!
|
| 62 |
+
|
| 63 |
+
> Join our **[Wechat](#)** and **[Discord](https://discord.gg/dNBrdrGGMa)** group to discuss and find help from us.
|
| 64 |
+
|
| 65 |
+
| Wechat Group | Xiaohongshu | X | Discord |
|
| 66 |
+
|--------------------------------------------------|-------------------------------------------------------|---------------------------------------------|---------------------------------------------------|
|
| 67 |
+
| <img src="assets/qrcode/wechat.png" height=140> | <img src="assets/qrcode/xiaohongshu.png" height=140> | <img src="assets/qrcode/x.png" height=140> | <img src="assets/qrcode/discord.png" height=140> |
|
| 68 |
|
| 69 |
## **Abstract**
|
| 70 |
|
| 71 |
+
In this report, we present Hunyuan3D 2.5, a robust suite of 3D diffusion models aimed at generating high-fidelity and detailed textured 3D assets. Hunyuan3D 2.5 follows two-stages pipeline of its previous version Hunyuan3D 2.0, while demonstrating substantial advancements in both shape and texture generation. In terms of shape generation, we introduce a new shape foundation model -- LATTICE, which is trained with scaled high-quality datasets, model-size, and compute. Our largest model reaches 10B parameters and generates sharp and detailed 3D shape with precise image-3D following while keeping mesh surface clean and smooth, significantly closing the gap between generated and handcrafted 3D shapes. In terms of texture generation, it is upgraded with phyiscal-based rendering (PBR) via a novel multi-view architecture extended from Hunyuan3D 2.0 Paint model. Our extensive evaluation shows that Hunyuan3D 2.5 significantly outperforms previous methods in both shape and end-to-end texture generation.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
|
| 73 |
<p align="center">
|
| 74 |
<img src="assets/images/system.jpg">
|
| 75 |
</p>
|
| 76 |
|
| 77 |
+
## β―οΈ **Hunyuan3D 2.5**
|
| 78 |
|
| 79 |
### Architecture
|
| 80 |
|
| 81 |
+
Hunyuan3D 2.5 follows two-stages pipeline of its previous version Hunyuan3D 2.0, while demonstrating substantial advancements in both shape and texture generation
|
|
|
|
|
|
|
| 82 |
|
| 83 |
<p align="left">
|
| 84 |
<img src="assets/images/arch.jpg">
|
|
|
|
| 86 |
|
| 87 |
### Performance
|
| 88 |
|
| 89 |
+
We have evaluated Hunyuan3D 2.5 with other open-source as well as close-source 3d-generation methods.
|
| 90 |
+
The numerical results indicate that Hunyuan3D 2.5 surpasses all baselines in the quality of generated textured 3D assets
|
| 91 |
and the condition following ability.
|
| 92 |
|
| 93 |
| Model | CMMD(β¬) | FID_CLIP(β¬) | FID(β¬) | CLIP-score(β¬) |
|
|
|
|
| 96 |
| Top Close-source Model1 | 3.600 | 55.866 | 305.922 | 0.779 |
|
| 97 |
| Top Close-source Model2 | 3.368 | 49.744 | 294.628 | 0.806 |
|
| 98 |
| Top Close-source Model3 | 3.218 | 51.574 | 295.691 | 0.799 |
|
| 99 |
+
| Hunyuan3D 2.5 | **3.193** | **49.165** | **282.429** | **0.809** |
|
| 100 |
|
| 101 |
+
Generation results of Hunyuan3D 2.5:
|
| 102 |
<p align="left">
|
| 103 |
+
<img src="assets/images/e2e-1.gif" height=250>
|
| 104 |
+
<img src="assets/images/e2e-2.gif" height=250>
|
| 105 |
</p>
|
| 106 |
|
| 107 |
+
## π Models Zoo
|
| 108 |
+
|
| 109 |
+
It takes 6 GB VRAM for shape generation and 16 GB for shape and texture generation in total.
|
| 110 |
+
|
| 111 |
+
Hunyuan3D-2-1 Series
|
| 112 |
|
| 113 |
+
| Model | Description | Date | Size | Huggingface |
|
| 114 |
+
|----------------------|----------------Π½ΠΎΠ²ΠΎΠΉ---------------|------------|------|-----------------------------------------------------------------------------------------|
|
| 115 |
+
| Hunyuan3D-DiT-v2-1 | Mini Image to Shape Model | 2025-06-13 | 3.0B | [Download](https://huggingface.co/tencent/Hunyuan3D-2.1/tree/main/hunyuan3d-dit-v2-1) |
|
| 116 |
+
| Hunyuan3D-Paint-v2-1 | Texture Generation Model | 2025-06-13 | 1.3B | [Download](https://huggingface.co/tencent/Hunyuan3D-2.1/tree/main/hunyuan3d-paintpbr-v2-1) |
|
| 117 |
+
|
| 118 |
+
Hunyuan3D-2mini Series
|
| 119 |
+
|
| 120 |
+
| Model | Description | Date | Size | Huggingface |
|
| 121 |
+
|-----------------------------|-------------------------------|------------|------|--------------------------------------------------------------------------------------------------|
|
| 122 |
+
| Hunyuan3D-DiT-v2-mini-Turbo | Step Distillation Version | 2025-03-19 | 0.6B | [Download](https://huggingface.co/tencent/Hunyuan3D-2mini/tree/main/hunyuan3d-dit-v2-mini-turbo) |
|
| 123 |
+
| Hunyuan3D-DiT-v2-mini-Fast | Guidance Distillation Version | 2025-03-18 | 0.6B | [Download](https://huggingface.co/tencent/Hunyuan3D-2mini/tree/main/hunyuan3d-dit-v2-mini-fast) |
|
| 124 |
+
| Hunyuan3D-DiT-v2-mini | Mini Image to Shape Model | 2025-03-18 | 0.6B | [Download](https://huggingface.co/tencent/Hunyuan3D-2mini/tree/main/hunyuan3d-dit-v2-mini) |
|
| 125 |
+
|
| 126 |
+
Hunyuan3D-2mv Series
|
| 127 |
+
|
| 128 |
+
| Model | Description | Date | Size | Huggingface |
|
| 129 |
+
|---------------------------|--------------------------------|------------|------|----------------------------------------------------------------------------------------------|
|
| 130 |
+
| Hunyuan3D-DiT-v2-mv-Turbo | Step Distillation Version | 2025-03-19 | 1.1B | [Download](https://huggingface.co/tencent/Hunyuan3D-2mv/tree/main/hunyuan3d-dit-v2-mv-turbo) |
|
| 131 |
+
| Hunyuan3D-DiT-v2-mv-Fast | Guidance Distillation Version | 2025-03-18 | 1.1B | [Download](https://huggingface.co/tencent/Hunyuan3D-2mv/tree/main/hunyuan3d-dit-v2-mv-fast) |
|
| 132 |
+
| Hunyuan3D-DiT-v2-mv | Multiview Image to Shape Model | 2025-03-18 | 1.1B | [Download](https://huggingface.co/tencent/Hunyuan3D-2mv/tree/main/hunyuan3d-dit-v2-mv) |
|
| 133 |
+
|
| 134 |
+
Hunyuan3D-2 Series
|
| 135 |
+
|
| 136 |
+
| Model | Description | Date | Size | Huggingface |
|
| 137 |
+
|----------------------------|-----------------------------|------------|------|-------------------------------------------------------------------------------------------|
|
| 138 |
+
| Hunyuan3D-DiT-v2-0-Turbo | Step Distillation Model | 2025-03-19 | 1.1B | [Download](https://huggingface.co/tencent/Hunyuan3D-2/tree/main/hunyuan3d-dit-v2-0-turbo) |
|
| 139 |
+
| Hunyuan3D-DiT-v2-0-Fast | Guidance Distillation Model | 2025-02-03 | 1.1B | [Download](https://huggingface.co/tencent/Hunyuan3D-2/tree/main/hunyuan3d-dit-v2-0-fast) |
|
| 140 |
+
| Hunyuan3D-DiT-v2-0 | Image to Shape Model | 2025-01-21 | 1.1B | [Download](https://huggingface.co/tencent/Hunyuan3D-2/tree/main/hunyuan3d-dit-v2-0) |
|
| 141 |
+
| Hunyuan3D-Paint-v2-0 | Texture Generation Model | 2025-01-21 | 1.3B | [Download](https://huggingface.co/tencent/Hunyuan3D-2/tree/main/hunyuan3d-paint-v2-0) |
|
| 142 |
+
| Hunyuan3D-Paint-v2-0-Turbo | Distillation Texure Model | 2025-04-01 | 1.3B | [Download](https://huggingface.co/tencent/Hunyuan3D-2/tree/main/hunyuan3d-paint-v2-0-turbo) |
|
| 143 |
+
| Hunyuan3D-Delight-v2-0 | Image Delight Model | 2025-01-21 | 1.3B | [Download](https://huggingface.co/tencent/Hunyuan3D-2/tree/main/hunyuan3d-delight-v2-0) |
|
| 144 |
|
| 145 |
## π€ Get Started with Hunyuan3D 2.0
|
| 146 |
|
| 147 |
+
Hunyuan3D 2.0 supports Macos, Windows, Linux. You may follow the next steps to use Hunyuan3D 2.0 via:
|
| 148 |
+
|
| 149 |
+
- [Code](#code-usage)
|
| 150 |
+
- [Gradio App](#gradio-app)
|
| 151 |
+
- [API Server](#api-server)
|
| 152 |
+
- [Blender Addon](#blender-addon)
|
| 153 |
+
- [Official Site](#official-site)
|
| 154 |
|
| 155 |
### Install Requirements
|
| 156 |
|
|
|
|
| 158 |
|
| 159 |
```bash
|
| 160 |
pip install -r requirements.txt
|
| 161 |
+
pip install -e .
|
| 162 |
# for texture
|
| 163 |
cd hy3dgen/texgen/custom_rasterizer
|
| 164 |
python3 setup.py install
|
| 165 |
cd ../../..
|
| 166 |
cd hy3dgen/texgen/differentiable_renderer
|
| 167 |
+
python3 setup.py install
|
| 168 |
```
|
| 169 |
|
| 170 |
+
### Code Usage
|
| 171 |
|
| 172 |
We designed a diffusers-like API to use our shape generation model - Hunyuan3D-DiT and texture synthesis model -
|
| 173 |
Hunyuan3D-Paint.
|
|
|
|
| 198 |
mesh = pipeline(mesh, image='assets/demo.png')
|
| 199 |
```
|
| 200 |
|
| 201 |
+
Please visit [examples](examples) folder for more advanced usage, such as **multiview image to 3D generation** and *
|
| 202 |
+
*texture generation
|
| 203 |
for handcrafted mesh**.
|
| 204 |
|
| 205 |
### Gradio App
|
| 206 |
|
| 207 |
You could also host a [Gradio](https://www.gradio.app/) App in your own computer via:
|
| 208 |
|
| 209 |
+
Standard Version
|
| 210 |
+
|
| 211 |
```bash
|
| 212 |
+
# Hunyuan3D-2mini
|
| 213 |
+
python3 gradio_app.py --model_path tencent/Hunyuan3D-2mini --subfolder hunyuan3d-dit-v2-mini --texgen_model_path tencent/Hunyuan3D-2 --low_vram_mode
|
| 214 |
+
# Hunyuan3D-2mv
|
| 215 |
+
python3 gradio_app.py --model_path tencent/Hunyuan3D-2mv --subfolder hunyuan3d-dit-v2-mv --texgen_model_path tencent/Hunyuan3D-2 --low_vram_mode
|
| 216 |
+
# Hunyuan3D-2
|
| 217 |
+
python3 gradio_app.py --model_path tencent/Hunyuan3D-2 --subfolder hunyuan3d-dit-v2-0 --texgen_model_path tencent/Hunyuan3D-2 --low_vram_mode
|
| 218 |
```
|
| 219 |
|
| 220 |
+
Turbo Version
|
| 221 |
+
|
| 222 |
+
```bash
|
| 223 |
+
# Hunyuan3D-2mini
|
| 224 |
+
python3 gradio_app.py --model_path tencent/Hunyuan3D-2mini --subfolder hunyuan3d-dit-v2-mini-turbo --texgen_model_path tencent/Hunyuan3D-2 --low_vram_mode --enable_flashvdm
|
| 225 |
+
# Hunyuan3D-2mv
|
| 226 |
+
python3 gradio_app.py --model_path tencent/Hunyuan3D-2mv --subfolder hunyuan3d-dit-v2-mv-turbo --texgen_model_path tencent/Hunyuan3D-2 --low_vram_mode --enable_flashvdm
|
| 227 |
+
# Hunyuan3D-2
|
| 228 |
+
python3 gradio_app.py --model_path tencent/Hunyuan3D-2 --subfolder hunyuan3d-dit-v2-0-turbo --texgen_model_path tencent/Hunyuan3D-2 --low_vram_mode --enable_flashvdm
|
| 229 |
+
```
|
| 230 |
+
|
| 231 |
+
### API Server
|
| 232 |
+
|
| 233 |
+
You could launch an API server locally, which you could post web request for Image/Text to 3D, Texturing existing mesh,
|
| 234 |
+
and e.t.c.
|
| 235 |
+
|
| 236 |
+
```bash
|
| 237 |
+
python api_server.py --host 0.0.0.0 --port 8080
|
| 238 |
+
```
|
| 239 |
+
|
| 240 |
+
A demo post request for image to 3D without texture.
|
| 241 |
+
|
| 242 |
+
```bash
|
| 243 |
+
img_b64_str=$(base64 -i assets/demo.png)
|
| 244 |
+
curl -X POST "http://localhost:8080/generate" \
|
| 245 |
+
-H "Content-Type: application/json" \
|
| 246 |
+
-d '{
|
| 247 |
+
"image": "'"$img_b64_str"'",
|
| 248 |
+
}' \
|
| 249 |
+
-o test2.glb
|
| 250 |
+
```
|
| 251 |
+
|
| 252 |
+
### Blender Addon
|
| 253 |
+
|
| 254 |
+
With an API server launched, you could also directly use Hunyuan3D 2.0 in your blender with
|
| 255 |
+
our [Blender Addon](blender_addon.py). Please follow our tutorial to install and use.
|
| 256 |
+
|
| 257 |
+
https://github.com/user-attachments/assets/8230bfb5-32b1-4e48-91f4-a977c54a4f3e
|
| 258 |
+
|
| 259 |
+
### Official Site
|
| 260 |
+
|
| 261 |
Don't forget to visit [Hunyuan3D](https://3d.hunyuan.tencent.com) for quick use, if you don't want to host yourself.
|
| 262 |
|
| 263 |
## π Open-Source Plan
|
|
|
|
| 265 |
- [x] Inference Code
|
| 266 |
- [x] Model Checkpoints
|
| 267 |
- [x] Technical Report
|
| 268 |
+
- [x] ComfyUI
|
| 269 |
+
- [x] Finetuning
|
| 270 |
- [ ] TensorRT Version
|
| 271 |
|
| 272 |
## π BibTeX
|
| 273 |
|
| 274 |
+
If you found this repository helpful, please cite our reports:
|
| 275 |
|
| 276 |
```bibtex
|
| 277 |
+
@misc{lai2025hunyuan3d25highfidelity3d,
|
| 278 |
+
title={Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Details},
|
| 279 |
+
author={Tencent Hunyuan3D Team},
|
| 280 |
+
year={2025},
|
| 281 |
+
eprint={2506.16504},
|
| 282 |
+
archivePrefix={arXiv},
|
| 283 |
+
primaryClass={cs.CV},
|
| 284 |
+
url={https://arxiv.org/abs/2506.16504},
|
| 285 |
+
}
|
| 286 |
+
|
| 287 |
@misc{hunyuan3d22025tencent,
|
| 288 |
title={Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation},
|
| 289 |
author={Tencent Hunyuan3D Team},
|
|
|
|
| 293 |
primaryClass={cs.CV}
|
| 294 |
}
|
| 295 |
|
| 296 |
+
@misc{yang2024hunyuan3d,
|
| 297 |
+
title={Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generation},
|
| 298 |
author={Tencent Hunyuan3D Team},
|
| 299 |
year={2024},
|
| 300 |
eprint={2411.02293},
|
|
|
|
| 307 |
|
| 308 |
Thanks for the contributions of community members, here we have these great extensions of Hunyuan3D 2.0:
|
| 309 |
|
| 310 |
+
- [ComfyUI-3D-Pack](https://github.com/MrForExample/ComfyUI-3D-Pack)
|
| 311 |
- [ComfyUI-Hunyuan3DWrapper](https://github.com/kijai/ComfyUI-Hunyuan3DWrapper)
|
| 312 |
- [Hunyuan3D-2-for-windows](https://github.com/sdbds/Hunyuan3D-2-for-windows)
|
| 313 |
+
- [π¦ A bundle for running on Windows | ζ΄εε
](https://github.com/YanWenKun/Hunyuan3D-2-WinPortable)
|
| 314 |
+
- [Hunyuan3D-2GP](https://github.com/deepbeepmeep/Hunyuan3D-2GP)
|
| 315 |
+
- [Kaggle Notebook](https://github.com/darkon12/Hunyuan3D-2GP_Kaggle)
|
| 316 |
|
| 317 |
## Acknowledgements
|
| 318 |
|
| 319 |
We would like to thank the contributors to
|
| 320 |
+
the [Trellis](https://github.com/microsoft/TRELLIS), [DINOv2](https://github.com/facebookresearch/dinov2), [Stable Diffusion](https://github.com/Stability-AI/stablediffusion), [FLUX](https://github.com/black-forest-labs/flux), [diffusers](https://github.com/huggingface/diffusers), [HuggingFace](https://huggingface.co), [CraftsMan3D](https://github.com/wyysf-98/CraftsMan3D),
|
| 321 |
+
and [Michelangelo](https://github.com/NeuralCarver/Michelangelo/tree/main) repositories, for their open research and
|
| 322 |
+
exploration.
|
| 323 |
|
| 324 |
## Star History
|
| 325 |
|