Skip to content

Conversation

PT-10
Copy link

@PT-10 PT-10 commented May 27, 2025

  • Evaluates model predictions using IoU-based matching and multiple AP thresholds.
  • Calculates key detection metrics: Precision, Recall, F1 Score, [email protected], [email protected], [email protected]
  • Outputs results to both console logs and a evaluation_results.txt file for reproducibility.

Additional Dependencies:

  • numpy, but not added in requirements.txt since installing torch should cover it.

@sergiopaniego
Copy link
Collaborator

Thanks for the PR!
Since we received previously a PR for the same task, maybe we can coordinate about this task in that PR. Could you both coordinate in order to contribute?

@PT-10
Copy link
Author

PT-10 commented Jun 29, 2025

Thanks for the PR! Since we received previously a PR for the same task, maybe we can coordinate about this task in that PR. Could you both coordinate in order to contribute?

I believe the PR has gone dormant, I can take it over, also do you want me to include the baseline evaluation metrics of the gemma model loaded in a quantized form or metrics for the smol-vlm model

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants