collabllm / docs /api /single_controller.rst
hour1's picture
Upload folder using huggingface_hub
9114cf2 verified
Single Controller interface
============================
Last updated: 05/27/2025 (API docstrings are auto-generated).
The Single Controller provides a unified interface for managing distributed workers
using Ray or other backends and executing functions across them.
It simplifies the process of dispatching tasks and collecting results, particularly
when dealing with data parallelism or model parallelism.
Core APIs
~~~~~~~~~~~~~~~~~
.. autoclass:: verl.single_controller.Worker
:members: __init__, __new__, get_master_addr_port, get_cuda_visible_devices, world_size, rank
.. autoclass:: verl.single_controller.WorkerGroup
:members: __init__, world_size
.. autoclass:: verl.single_controller.ClassWithInitArgs
:members: __init__, __call__
.. autoclass:: verl.single_controller.ResourcePool
:members: __init__, world_size, local_world_size_list, local_rank_list
.. autoclass:: verl.single_controller.ray.RayWorkerGroup
:members: __init__
.. autofunction:: verl.single_controller.ray.create_colocated_worker_cls