Request to add DEIM object detector

[tcourat]

Model description

DEIM is a SOTA real-time object detector based on DETR architecture and even beat the recent D-FINE on checkpoints that were not pretrained on object365. DEIM accelerates the convergence by improving the quantity and quality of matching with Dense O2O (one to-one) and MAL (Matchability-Aware Loss) respectively.
It can be used to improve existing object detectors.

Open source status

• The model implementation is available
• The model weights are available

Provide useful links for the implementation

Paper : https://arxiv.org/abs/2412.04234
Code : https://github.com/ShihuaHuang95/DEIM

[qubvel]

Hey @tcourat, as far as I understand it's based on D-FINE, so we can wait for D-FINE to be merged to leverage modular architecture, however, anyone can start working on it in parallel (based on the PR)

[saswatmeher]

Hi @qubvel @tcourat, I noticed that D-FINE was merged last week. If no one is currently working on DEIM, I’d be glad to contribute!

[qubvel]

Hey @saswatmeher, not merged yet, but approved and expected to be merged early next week. Feel free to start with DEIM 🤗

[saswatmeher]

Due to some unforeseen commitments, I will not be able to continue working on this task at this time. If anyone is interested in taking it up, please feel free to do so.

[sushmanthreddy]

@qubvel I would like to take this up issue ,will raise a pr soon ,because already d-fine model has been added in transformers lib today.I will start pr today

[qubvel]

Sounds great @sushmanthreddy!