2026-09-08 · local LLM · RTX 5080 · coding

Quality tied — speed and VRAM decide

Four identical coding tasks on the Rumble desktop (RTX 5080 16GB).

What happened

Tasks: merge intervals, fix-from-traceback, multi-file wire, mini SWE.

Same quality score. Different daily-driver feel.

Takeaway

On 16GB, keep the snappy 12B as the interactive default. Keep the bigger IQ4 around for more brain / less headroom. House aliases now expose both.

Numbers from a single bake-off stack (Ollama, thinking off). Not a claim about other GPUs.

← All Builds