RX 5400/5500 series — ROCm does not officially support gfx1034. Force compatibility with HSA_OVERRIDE_GFX_VERSION=10.3.0 (treats card as gfx1030). Token generation is slow but functional for small models.
ENV vars
export HSA_OVERRIDE_GFX_VERSION=10.3.0
Install hints
- Set HSA_OVERRIDE before launching the Ollama service
- Limit to small models (<=7B Q4) due to lower memory bandwidth
No data yet for: Axolotl, ComfyUI, ExLlamaV2, faster-whisper, llama.cpp, Stable Diffusion WebUI, vLLM