💡 [REQUEST] - tutorial on torchrl LLM API

[vmoens]

🚀 Describe the improvement or the new tutorial

I’d like to write a tutorial about TorchRL LLM post-training API including data formatting for RL, multi-turn conversation handling, tool usage etc

@svekars what’s the policy on open-source models usage? Can I load and use a small model (0.5B) freely?

Existing tutorials on this topic

I don’t think there are any

Additional context

No response

[svekars]

@albanD wdyt?

[albanD]

Sounds great!
For model use, I think we have other tutorials relying on vision or other domain libs right? So anything similar to that should be good

[vmoens]

Yeah i just want to be mindful of resources since it's going to run several times / day
I'll submit something, you'll let me know what you think!