[RLlib; docs] Docs do-over (new API stack): ConnectorV2 documentation (part II).

[sven1977]

Docs do-over (new API stack): ConnectorV2 documentation (part II).

• Add batch construction phases and formats to generic connector overview page.
• 3 additional figures illustrating the different batch phases.

Why are these changes needed?

Related issue number

Checks

• I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
• I've run scripts/format.sh to lint the changes in this PR.
• I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've added any new APIs to the API Reference. For example, if I added a
    method in Tune, I've added it in doc/source/tune/api/ under the
    corresponding .rst file.
• I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
• Testing Strategy
  • Unit tests
  • Release tests
  • This PR is not tested :(

[Copilot]

Pull Request Overview

This PR continues the ConnectorV2 documentation overhaul by filling out the generic connector overview with batch phases and adding three illustrative figures, while also refining implementation details to better handle rl_module=None cases and improving fallback logic in algorithm_config.

• Added "Batch construction phases and formats" section with three new SVG figures in connector-v2.rst.
• Refined connector implementations (numpy_to_tensor, add_time_dim_to_batch_and_zero_pad, add_states_from_episodes_to_batch) to guard on rl_module=None.
• Improved environment/action space inference in AlgorithmConfig, fixed typos, and expanded documentation across multiple .rst files.

Reviewed Changes

Copilot reviewed 13 out of 26 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
rllib/examples/connectors/multi_agent_observation_preprocessor.py	Clarified multi-agent preprocessor comment.
rllib/connectors/connector_v2.py	Fixed backticks around self in docstrings.
rllib/connectors/common/numpy_to_tensor.py	Removed unused as_learner_connector and added rl_module=None handling.
rllib/connectors/common/add_time_dim_to_batch_and_zero_pad.py	Early-out when rl_module is None before padding.
rllib/connectors/common/add_states_from_episodes_to_batch.py	Early-out when rl_module is None before state injection.
rllib/algorithms/algorithm_config.py	Corrected typo, unified space inference (env/spaces/self), expanded spec logic.
doc/source/rllib/user-guides.rst	Added connector-v2 entry to user guides.
doc/source/rllib/single-agent-episode.rst	Updated connector pipeline links to use :ref: roles.
doc/source/rllib/rl-modules.rst	Added anchor for custom MultiRLModules.
doc/source/rllib/package_ref/index.rst	Included new connector-v2.rst in package reference.
doc/source/rllib/package_ref/connector-v2.rst	Added API reference for ConnectorV2.
doc/source/rllib/env-to-module-connector.rst	Introduced full env-to-module pipeline docs with figures.
doc/source/rllib/connector-v2.rst	Added generic ConnectorV2 overview and batch phases section.

Comments suppressed due to low confidence (1)

rllib/connectors/common/numpy_to_tensor.py:67

• The docstring still references the removed as_learner_connector parameter; please update the Args section to remove or adjust this entry to match the current signature.

        Args:

[Copilot]

Grammar: change "each agents' individual observations" to "each agent's individual observations" for correct possessive singular form.

Suggested change

	# enhances each agents' individual observations through adding the
	# enhances each agent's individual observations through adding the

[Copilot]

[nitpick] The logic for inferring obs_space and act_space from env, spaces, or self appears in multiple places; consider extracting this fallback sequence into a shared helper function to reduce duplication and ensure consistency.