NVIDIA RTX 4090

Introduction I tested five current local vision-language models on one NVIDIA RTX 4090 across Ollama and direct llama.cpp, centered on Qwen3.8-27B and Gemma 4 26B A4B. The work covered installation, model downloads, coding-harness configuration, practical text and vision context ceilings, multi-token prediction (MTP), short and filled-context throughput, CPU offload, matched runtime performance, and 360 W versus 450 W GPU power limits. The two-model daily result is summarized next. The complete setup and all five-model evidence remain below so the conclusions are reproducible. ...

How to Set NVIDIA GPU Power Limit Modern GPUs, such as the NVIDIA RTX 4090, often consume more power than necessary, even during low workloads. By optimizing power limits and undervolting, you can reduce GPU energy consumption, lower system heat, and even run high-performance graphics cards with smaller PSUs, such as 750W, without compromising stability. This guide will show you how to reduce GPU power usage effectively while maintaining performance. ...