fix: only use extension to differentiate between source or binary dependencies (#4737)

Co-authored-by: Wolf Vollprecht <[email protected]>
Co-authored-by: Julian Hofer <[email protected]>

Author: 3 people