Skip to content

Debug the Miniwob example #48

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 74 commits into
base: main
Choose a base branch
from
Open

Debug the Miniwob example #48

wants to merge 74 commits into from

Conversation

@NicolasAG
Copy link
Collaborator

@NicolasAG NicolasAG commented Jun 16, 2025 •
edited
Loading

  • move the Miniwob agent example to domains/
  • update miniwob config to not use tool calling. Instead it uses json step predictions
  • scale up the number of env servers similarly to the number of actor vllm servers

@NicolasAG NicolasAG self-assigned this Jun 16, 2025
@NicolasAG NicolasAG marked this pull request as ready for review July 11, 2025 14:40
@NicolasAG NicolasAG requested review from AlexPiche and ollmer July 11, 2025 14:40
NicolasAG added 24 commits August 28, 2025 19:47
@NicolasAG
update massimo cfg to grpo
9e61c35
@NicolasAG
test with ppo
ef884f2
@NicolasAG
update configs
537ec7a
@NicolasAG
add retry mechanism for agent loop
7a4e73f
@NicolasAG
add 30min timeout to rollout function
42e811e
@NicolasAG
upd configs
a4e8f5f
@NicolasAG
upd
95b735b
@NicolasAG
upd configs
8616303
@NicolasAG
reduce n_env
923cf6a
@NicolasAG
boost preprocess power
44a033f
@NicolasAG
pop old data
2918d1f
@NicolasAG
do not save playwright traces & screenshots
dacaa1f
@NicolasAG
return empty aggregate stats if empty stats
fcee5ee
@NicolasAG
increase preprocessor power
631389f
@NicolasAG
better error handling
f791211
@NicolasAG
fix
c54d900
@NicolasAG
reduce timeouts
ea4918a
@NicolasAG
log number of groups done so far
e5fca10
@NicolasAG
log everything if populate_rl_data fails
df66a88
@NicolasAG
monitor env servers and reset if needed
c8d0171
@NicolasAG
better health message
981cd85
@NicolasAG
small fix
9c755ed
@NicolasAG
better logs
0b8a24d
@NicolasAG
always check the worker before launching the agent on it + more detai…
cd27e30 
…led logs
ollmer
ollmer reviewed Sep 29, 2025
View reviewed changes
ollmer
ollmer reviewed Sep 29, 2025
View reviewed changes
@NicolasAG NicolasAG requested a review from ollmer October 14, 2025 13:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexPiche AlexPiche Awaiting requested review from AlexPiche

@ollmer ollmer Awaiting requested review from ollmer

Assignees

@NicolasAG NicolasAG

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@NicolasAG @ollmer