[core][gpu-objects] Ability to register custom types for GPU data #52340
Description
Description
When Ray actors return data, Ray serialization extracts all torch.Tensors and stores them in an "in-actor object store", avoiding serialization in the Ray shared-memory object store. Currently, this PoC only works for torch.Tensors. Ideally, we should support users passing different data types such as torch.TensorDict or JAX arrays.
Use case
No response