Instructions to use OpenDriveLab-org/RISE_Assets with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use OpenDriveLab-org/RISE_Assets with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("OpenDriveLab-org/RISE_Assets", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
| license: cc-by-nc-sa-4.0 | |
| # π RISE | |
| <div id="top" align="left"> | |
| <a href="https://opendrivelab.com/rise/"><img src="https://img.shields.io/badge/Proj_Page-blue" alt="Project Page"></a> | |
| <a href="https://arxiv.org/abs/2602.11075"><img src="https://img.shields.io/badge/arXiv-2602.11075-b31b1b" alt="arXiv"></a> | |
| </div> | |
| Please refer to [RISE repo](https://github.com/OpenDriveLab/RISE_release) for detailed instructions. | |
| ## π₯ Highlights | |
| <!-- RISE is a self-improving robot policy framework that turns world models into a practical learning environment for real-world manipulation. In short, we make the following three key contributions: --> | |
| - **A compositional world model.** | |
| A principled design that combines a controllable multi-view dynamics model with a progress value model, yielding informative advantages for robust policy improvement. | |
| - **RL in imagination.** | |
| A scalable self-improving framework that bootstraps robot policies through imaginary rollouts, avoiding the hardware cost and laborious reset of real-world interactions. | |
| - **Real-world manipulation gains.** | |
| Large performance improvements on challenging dexterous tasks, including +35% on dynamic brick sorting, +45% on backpack packing, and +35% on box closing. | |
| ## π’ News | |
| - [2026/05/14] Released sample data in HDF5 and LeRobot formats. | |
| - [2026/04/22] Training code and pre-trained dynamics model are released. | |
| - [2026/02/11] Paper released on [arXiv](https://arxiv.org/abs/2602.11075). | |
| ## π License and Citation | |
| All assets and code in this repository are under the Apache 2.0 license unless specified otherwise. The data and checkpoint are under CC BY-NC-SA 4.0. Other modules inherit their own distribution licenses. | |
| ```bibtex | |
| @article{rise2026, | |
| title={RISE: Self-Improving Robot Policy with Compositional World Model}, | |
| author={Yang, Jiazhi and Lin, Kunyang and Li, Jinwei and Zhang, Wencong and Lin, Tianwei and Wu, Longyan and Su, Zhizhong and Zhao, Hao and Zhang, Ya-Qin and Chen, Li and Luo, Ping and Yue, Xiangyu and Li, Hongyang}, | |
| journal={arXiv preprint arXiv:2602.11075}, | |
| year={2026} | |
| } | |
| ``` | |