nielsr HF Staff commited on
Commit
df66959
·
verified ·
1 Parent(s): 9ffc5c7

Add model card for Mixture of Horizons in Action Chunking

Browse files

This PR adds a comprehensive model card for the "Mixture of Horizons in Action Chunking" model.

It includes:
- Relevant metadata such as `pipeline_tag`, `license`, and descriptive `tags`.
- A concise introduction to the model based on the paper abstract and GitHub README.
- Links to the paper, project page, and GitHub repository.
- Key figures and a summary of the model's benefits.
- Acknowledgment and citation information.

Please review and merge if everything looks good!

Files changed (1) hide show
  1. README.md +75 -0
README.md ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: robotics
3
+ license: apache-2.0
4
+ tags:
5
+ - reinforcement-learning
6
+ - robotic-manipulation
7
+ - action-chunking
8
+ ---
9
+
10
+ # Mixture of Horizons in Action Chunking
11
+
12
+ This repository hosts the official implementation of **Mixture of Horizons (MoH)**, introduced in the paper [Mixture of Horizons in Action Chunking](https://huggingface.co/papers/2511.19433).
13
+
14
+ Vision-language-action (VLA) models for robotic manipulation are highly sensitive to the chosen **action chunk length**, or **horizon**. A fixed horizon presents an inherent trade-off: longer horizons offer superior global foresight but compromise fine-grained accuracy, while shorter ones provide precise local control but struggle with long-term tasks.
15
+
16
+ To address this challenge, we propose **Mixture of Horizons (MoH)**, a novel, plug-and-play strategy that fuses multiple horizons within a single policy. MoH processes action chunks in parallel segments with different horizons and integrates their outputs. This approach simultaneously leverages long-term foresight and short-term precision with minimal overhead, and enables **Dynamic Inference** through cross-horizon consensus for enhanced efficiency and robustness in complex robotic tasks.
17
+
18
+ - 📄 [Paper](https://huggingface.co/papers/2511.19433)
19
+ - 📝 [Project Page](https://timsty1.github.io/moh/)
20
+ - 💻 [Code](https://github.com/Timsty1/MixtureOfHorizons/tree/main)
21
+
22
+ ## Introduction
23
+
24
+ <div align="center">
25
+ <table border="0" cellspacing="0" cellpadding="0">
26
+ <tr>
27
+ <td align="center" width="50%">
28
+ <img src="https://github.com/Timsty1/MixtureOfHorizons/raw/main/figure/study_of_horizons_pi0.png" alt="Trade-off Effect" width="100%">
29
+ </td>
30
+ <td align="center" width="50%">
31
+ <img src="https://github.com/Timsty1/MixtureOfHorizons/raw/main/figure/intro_motivation_v2.png" alt="Mixture of Horizons" width="100%">
32
+ </td>
33
+ </tr>
34
+ <tr>
35
+ <td align="center" valign="top">
36
+ Figure 1: Trade-off between long-term foresight and short-term precision induced by single horizon
37
+ </td>
38
+ <td align="center" valign="top">
39
+ Figure 2: Overview of the proposed mixture-of-horizons strategy
40
+ </td>
41
+ </tr>
42
+ </table>
43
+ </div>
44
+
45
+ <br>
46
+
47
+ * **Mitigates Trade-off**: Addresses the inherent trade-off between long-term foresight and short-term precision induced by single action chunk horizons.
48
+ * **Plug-and-Play**: Easily integrates into existing full-attention action modules with minimal training or inference overhead.
49
+ * **Dynamic Inference**: Achieves higher efficiency and robustness by selecting stable actions through cross-horizon consensus.
50
+
51
+ #### More results on LIBERO
52
+ <div align="center">
53
+ <img src="https://github.com/Timsty1/MixtureOfHorizons/raw/main/figure/libero_main.jpg" width="90%" />
54
+ </div>
55
+
56
+ ## Usage
57
+
58
+ For detailed instructions on environment setup, training, and evaluation, please refer to the [GitHub repository](https://github.com/Timsty1/MixtureOfHorizons/tree/main).
59
+
60
+ ## ❤️ Acknowledgment
61
+
62
+ We express our gratitude to [OpenPi](https://github.com/Physical-Intelligence/openpi/tree/main), [LIBERO](https://github.com/Lifelong-Robot-Learning/LIBERO), and [RoboTwin](https://robotwin-platform.github.io/) for their open-source contributions.
63
+
64
+ ## 📝 Citation
65
+
66
+ If you feel that this paper, models, or codes are helpful, please cite our paper, thanks for your support!
67
+
68
+ ```bibtex
69
+ @article{jing2025mixture_of_horizons,
70
+ title={Mixture of Horizons in Action Chunking},
71
+ author={Jing, Dong and Wang, Gang and Liu, Jiaqi and Tang, Weiliang and Sun, Zelong and Yao, Yunchao and Wei, Zhenyu and Liu, Yunhui and Lu, Zhiwu and Ding, Mingyu},
72
+ journal={arXiv preprint arXiv:2511.19433},
73
+ year={2025}
74
+ }
75
+ ```