PyVision-Video-7B-RL

PyVision-RL: Forging Open Agentic Vision Models via RL

PyVision-Video-7B-RL is an open-weight agentic multimodal model post-trained from Qwen2.5-VL-7B using reinforcement learning.

Overview

Reinforcement learning for agentic multimodal models often suffers from interaction collapse, where models learn to reduce tool usage and multi-turn reasoning. PyVision-RL is a framework designed to stabilize training and sustain interaction by combining an oversampling-filtering-ranking rollout strategy with an accumulative tool reward.

PyVision-Video specifically addresses the challenge of video reasoning using on-demand context construction. It selectively samples task-relevant frames during the reasoning process to significantly reduce visual token usage while maintaining high performance on complex multimodal agentic tasks.

Citation

@article{zhao2026pyvisionrl,
  title={PyVision-RL: Forging Open Agentic Vision Models via RL.},
  author={Zhao, Shitian and Lin, Shaoheng and Li, Ming and Zhang, Haoquan and Peng, Wenshuo and Zhang, Kaipeng and Wei, Chen},
  journal={arxiv preprint arxiv:2602.20739},
  year={2026},
}
Downloads last month
29
Safetensors
Model size
8B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including Agents-X/PyVision-Video-7B-RL

Paper for Agents-X/PyVision-Video-7B-RL