Add model card for Mixture of Horizons in Action Chunking
Browse filesThis PR adds a comprehensive model card for the "Mixture of Horizons in Action Chunking" model.
It includes:
- Relevant metadata such as `pipeline_tag`, `license`, and descriptive `tags`.
- A concise introduction to the model based on the paper abstract and GitHub README.
- Links to the paper, project page, and GitHub repository.
- Key figures and a summary of the model's benefits.
- Acknowledgment and citation information.
Please review and merge if everything looks good!
README.md
ADDED
|
@@ -0,0 +1,75 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
pipeline_tag: robotics
|
| 3 |
+
license: apache-2.0
|
| 4 |
+
tags:
|
| 5 |
+
- reinforcement-learning
|
| 6 |
+
- robotic-manipulation
|
| 7 |
+
- action-chunking
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
+
# Mixture of Horizons in Action Chunking
|
| 11 |
+
|
| 12 |
+
This repository hosts the official implementation of **Mixture of Horizons (MoH)**, introduced in the paper [Mixture of Horizons in Action Chunking](https://huggingface.co/papers/2511.19433).
|
| 13 |
+
|
| 14 |
+
Vision-language-action (VLA) models for robotic manipulation are highly sensitive to the chosen **action chunk length**, or **horizon**. A fixed horizon presents an inherent trade-off: longer horizons offer superior global foresight but compromise fine-grained accuracy, while shorter ones provide precise local control but struggle with long-term tasks.
|
| 15 |
+
|
| 16 |
+
To address this challenge, we propose **Mixture of Horizons (MoH)**, a novel, plug-and-play strategy that fuses multiple horizons within a single policy. MoH processes action chunks in parallel segments with different horizons and integrates their outputs. This approach simultaneously leverages long-term foresight and short-term precision with minimal overhead, and enables **Dynamic Inference** through cross-horizon consensus for enhanced efficiency and robustness in complex robotic tasks.
|
| 17 |
+
|
| 18 |
+
- 📄 [Paper](https://huggingface.co/papers/2511.19433)
|
| 19 |
+
- 📝 [Project Page](https://timsty1.github.io/moh/)
|
| 20 |
+
- 💻 [Code](https://github.com/Timsty1/MixtureOfHorizons/tree/main)
|
| 21 |
+
|
| 22 |
+
## Introduction
|
| 23 |
+
|
| 24 |
+
<div align="center">
|
| 25 |
+
<table border="0" cellspacing="0" cellpadding="0">
|
| 26 |
+
<tr>
|
| 27 |
+
<td align="center" width="50%">
|
| 28 |
+
<img src="https://github.com/Timsty1/MixtureOfHorizons/raw/main/figure/study_of_horizons_pi0.png" alt="Trade-off Effect" width="100%">
|
| 29 |
+
</td>
|
| 30 |
+
<td align="center" width="50%">
|
| 31 |
+
<img src="https://github.com/Timsty1/MixtureOfHorizons/raw/main/figure/intro_motivation_v2.png" alt="Mixture of Horizons" width="100%">
|
| 32 |
+
</td>
|
| 33 |
+
</tr>
|
| 34 |
+
<tr>
|
| 35 |
+
<td align="center" valign="top">
|
| 36 |
+
Figure 1: Trade-off between long-term foresight and short-term precision induced by single horizon
|
| 37 |
+
</td>
|
| 38 |
+
<td align="center" valign="top">
|
| 39 |
+
Figure 2: Overview of the proposed mixture-of-horizons strategy
|
| 40 |
+
</td>
|
| 41 |
+
</tr>
|
| 42 |
+
</table>
|
| 43 |
+
</div>
|
| 44 |
+
|
| 45 |
+
<br>
|
| 46 |
+
|
| 47 |
+
* **Mitigates Trade-off**: Addresses the inherent trade-off between long-term foresight and short-term precision induced by single action chunk horizons.
|
| 48 |
+
* **Plug-and-Play**: Easily integrates into existing full-attention action modules with minimal training or inference overhead.
|
| 49 |
+
* **Dynamic Inference**: Achieves higher efficiency and robustness by selecting stable actions through cross-horizon consensus.
|
| 50 |
+
|
| 51 |
+
#### More results on LIBERO
|
| 52 |
+
<div align="center">
|
| 53 |
+
<img src="https://github.com/Timsty1/MixtureOfHorizons/raw/main/figure/libero_main.jpg" width="90%" />
|
| 54 |
+
</div>
|
| 55 |
+
|
| 56 |
+
## Usage
|
| 57 |
+
|
| 58 |
+
For detailed instructions on environment setup, training, and evaluation, please refer to the [GitHub repository](https://github.com/Timsty1/MixtureOfHorizons/tree/main).
|
| 59 |
+
|
| 60 |
+
## ❤️ Acknowledgment
|
| 61 |
+
|
| 62 |
+
We express our gratitude to [OpenPi](https://github.com/Physical-Intelligence/openpi/tree/main), [LIBERO](https://github.com/Lifelong-Robot-Learning/LIBERO), and [RoboTwin](https://robotwin-platform.github.io/) for their open-source contributions.
|
| 63 |
+
|
| 64 |
+
## 📝 Citation
|
| 65 |
+
|
| 66 |
+
If you feel that this paper, models, or codes are helpful, please cite our paper, thanks for your support!
|
| 67 |
+
|
| 68 |
+
```bibtex
|
| 69 |
+
@article{jing2025mixture_of_horizons,
|
| 70 |
+
title={Mixture of Horizons in Action Chunking},
|
| 71 |
+
author={Jing, Dong and Wang, Gang and Liu, Jiaqi and Tang, Weiliang and Sun, Zelong and Yao, Yunchao and Wei, Zhenyu and Liu, Yunhui and Lu, Zhiwu and Ding, Mingyu},
|
| 72 |
+
journal={arXiv preprint arXiv:2511.19433},
|
| 73 |
+
year={2025}
|
| 74 |
+
}
|
| 75 |
+
```
|