Skip to content

Conversation

@9cb14c1ec0
Copy link

Remove some restrictions that prevent successful use of AMD iGPUs. This has been tested on a AMD Ryzen 7 PRO 5850U

@basxto
Copy link

basxto commented Feb 10, 2025

Are you sure these changes are required?

With my Sapphire Nitro+ Radeon RX 580 I still get:

amdgpu too old gfx803
no compatible amdgpu devices detected

But the Vulkan part works because it's independent of it. If upstream Ollama changes its mind that could lead to conflicts with ROCm support.

The changes in discover/amd_linux.go should be irrelevant for Vulkan and IGPUMemLimit is also only used in discover/amd_linux.go and discover/amd_windows.go as far as I can tell.

@9cb14c1ec0
Copy link
Author

Are you sure these changes are required?

With my Sapphire Nitro+ Radeon RX 580 I still get:

amdgpu too old gfx803
no compatible amdgpu devices detected

But the Vulkan part works because it's independent of it. If upstream Ollama changes its mind that could lead to conflicts with ROCm support.

The changes in discover/amd_linux.go should be irrelevant for Vulkan and IGPUMemLimit is also only used in discover/amd_linux.go and discover/amd_windows.go as far as I can tell.

That was the change that made the difference for me between using CPU and iGPU.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants