[<Ray component: Core|RLlib|etc...>] ray.init() cannot connect to ray-cluster using the runtime_env parameter

[Hxinyue]

What happened + What you expected to happen

Configuration situation: On end A, A Ray-cluster is started using docker run. On end B, the connection is made through Ray.init (address="ray://"). However, due to network security issues, A and B are unable to connect via the network. The current approach is to configure two agents, A Agent and B Agent, at both ends A and B respectively, and connect them through the agents and ports.

Versions / Dependencies

ray：2.40.0

Reproduction script

Question: A normal connection can be made using Ray.init (address="ray://< proxy IP:port>"), but using Ray.init (address="ray://< proxy IP:port>",runtime_env={"py_modules": ["py_modules"]}) The following error occurs:

ray.init('ray://< proxy IP:port>', ignore_reinit_error=True, runtime_env={"py_modules": ["py_modules"]})
2025-04-27 13:53:45,346 INFO client_builder.py:244 -- Passing the following kwargs to ray.init() on the server: ignore_reinit_error, log_to_driver
2025-04-27 13:53:45,561 INFO packaging.py:601 -- Creating a file package for local module '/root/app/common/ray_init_test.py'.
2025-04-27 13:53:45,562 INFO packaging.py:393 -- Pushing file package 'gcs://_ray_pkg_234f8386c58d4211.zip' (0.00MiB) to Ray cluster...
2025-04-27 13:53:45,564 INFO packaging.py:406 -- Successfully pushed file package 'gcs://_ray_pkg_234f8386c58d4211.zip'.
Traceback (most recent call last):
File "", line 1, in
File "/home/ray/anaconda3/lib/python3.10/site-packages/ray/_private/client_mode_hook.py", line 103, in wrapper
return func(*args, **kwargs)
File "/home/ray/anaconda3/lib/python3.10/site-packages/ray/_private/worker.py", line 1521, in init
ctx = builder.connect()
File "/home/ray/anaconda3/lib/python3.10/site-packages/ray/client_builder.py", line 175, in connect
client_info_dict = ray.util.client_connect.connect(
File "/home/ray/anaconda3/lib/python3.10/site-packages/ray/util/client_connect.py", line 55, in connect
conn = ray.connect(
File "/home/ray/anaconda3/lib/python3.10/site-packages/ray/util/client/init.py", line 233, in connect
conn = self.get_context().connect(*args, **kw_args)
File "/home/ray/anaconda3/lib/python3.10/site-packages/ray/util/client/init.py", line 97, in connect
self.client_worker._server_init(job_config, ray_init_kwargs)
File "/home/ray/anaconda3/lib/python3.10/site-packages/ray/util/client/worker.py", line 860, in _server_init
raise ConnectionAbortedError(
ConnectionAbortedError: Initialization failure from server:
Traceback (most recent call last):
File "/home/ray/anaconda3/lib/python3.10/site-packages/ray/util/client/server/proxier.py", line 704, in Datapath
if not self.proxy_manager.start_specific_server(
File "/home/ray/anaconda3/lib/python3.10/site-packages/ray/util/client/server/proxier.py", line 305, in start_specific_server
serialized_runtime_env_context = self._create_runtime_env(
File "/home/ray/anaconda3/lib/python3.10/site-packages/ray/util/client/server/proxier.py", line 252, in _create_runtime_env
response = urllib.request.urlopen(req, timeout=None)
File "/home/ray/anaconda3/lib/python3.10/urllib/request.py", line 216, in urlopen
return opener.open(url, data, timeout)
File "/home/ray/anaconda3/lib/python3.10/urllib/request.py", line 519, in open
response = self._open(req, data)
File "/home/ray/anaconda3/lib/python3.10/urllib/request.py", line 536, in _open
result = self._call_chain(self.handle_open, protocol, protocol +
File "/home/ray/anaconda3/lib/python3.10/urllib/request.py", line 496, in _call_chain
result = func(*args)
File "/home/ray/anaconda3/lib/python3.10/urllib/request.py", line 1377, in http_open
return self.do_open(http.client.HTTPConnection, req)
File "/home/ray/anaconda3/lib/python3.10/urllib/request.py", line 1352, in do_open
r = h.getresponse()
File "/home/ray/anaconda3/lib/python3.10/http/client.py", line 1375, in getresponse
response.begin()
File "/home/ray/anaconda3/lib/python3.10/http/client.py", line 318, in begin
version, status, reason = self._read_status()
File "/home/ray/anaconda3/lib/python3.10/http/client.py", line 300, in _read_status
raise BadStatusLine(line)
http.client.BadStatusLine: -NOAUTH Authentication required.

Issue Severity

None

[kevin85421]

Are you using Ray client (by default port 10001)? I would recommending use ray job submit (RayJobSubmission) instead.

[Hxinyue]

Are you using Ray client (by default port 10001)? I would recommending use ray job submit (RayJobSubmission) instead.您是否使用 Ray 客户端（默认端口 10001）？我建议改用 ray job submit （RayJobSubmission）。

Using the default port 10001 of the client, it is exposed to 31000. Currently, the client connection still needs to be established using the ray.init() method, but the runtime_env cannot be submitted when ray.init(). What is the reason? Or when using the ray.init() method, is there a better way to submit runtime_env?

[kevin85421]

You can try https://docs.ray.io/en/latest/cluster/running-applications/job-submission/index.html instead.

runtime_env={"py_modules": ["py_modules"]}

where is "py_modules"? Does it already exist in end A?

[Hxinyue]

"py_modules"

"py_modules" is located at end B. We want to submit "py_modules" to end B through the ray client method using Ray.init ().