Can Your PC Run a Local AI Model?
A transparent memory estimate for current local models. Choose a checkpoint, quantization, context length, and graphics card to see whether the weights and working memory fit the selected target.
Selection models released 12 May 2026 to 12 Aug 2026 (frozen cohort) Newest model carried 11 Aug 2026 Sources re-checked 15 Sep 2026 Register data changed 15 Sep 2026
The release selection is a frozen cohort, not a rolling window: models already checked stay in the register when their release window passes, and releases after 12 Aug 2026 are not added automatically.
CHECK A CONFIGURATION
9 MODELS / 8 PROFILESGemma 4 12B on GeForce RTX 4060
Google describes this as a local multimodal model and publishes downloadable checkpoints.
A memory check, not a speed promise
Methodology: The calculator estimates checkpoint weight memory from total parameter count and the selected bit depth. It adds a 10% packing margin, a model-specific working-memory allowance, and a context reserve. Mixture-of-experts models still need their total checkpoint weights available even when only some parameters are active per token.
The estimate follows the practical distinctions described in Ollama's GPU support documentation and the llama.cpp quantization notes. It does not estimate tokens per second, quality, thermals, driver compatibility, or whether a particular backend supports every quantization.
The weight precision selector uses generic bit-width buckets (Q4-Q8, FP16) for memory estimation. Several vendors publish named formats that do not map exactly to these buckets: Nemotron 3.5 Lightning ships NVFP4, Kimi K3 ships MXFP4 weights with MXFP8 activations, Kimi K2.7 Code ships native INT4, and DeepSeek-V4-Flash ships FP8. A user picking 'Q4' is modelling a bucket, not the vendor's published checkpoint.
What the result cannot tell you
Limitations: A passing estimate is not a compatibility guarantee; runtime, driver, backend, thermals, and context behavior can change the result.
- A pass means the memory estimate fits the selected target after a 10% reserve. It does not guarantee that the model will load.
- Long contexts can consume substantially more memory, and the actual KV cache depends on architecture and runtime.
- GPU, unified-memory, CPU-offload, driver, and backend behavior differ. Check the model card and runtime documentation before downloading.
- The model register is intentionally dated. When a release or specification changes, this page should be updated and re-verified.
Three checks before you download
- Choose a model whose source entry matches the kind of workload you want to run.
- Set the quantization and context length you actually plan to use, because both change the memory estimate.
- Compare the result with the model card and runtime documentation before treating a pass as a setup guarantee.
Memory is only the first constraint
A model can fit in the estimated memory and still be a poor match for a particular backend, driver, operating system, or workload. The register links each entry to its source and keeps specialized models labelled so they are not mistaken for general chat checkpoints.
If the question is hosted model access rather than local hardware, compare provider plans, model reach, and published limits instead.
REGISTER SOURCES
RELEASES 12 May 2026 TO 12 Aug 2026Models
- Gemma 4 12B 2026-06-03, Official release, source checked 15 Sep 2026
- NVIDIA Nemotron 3 Ultra 2026-06-04, Official release, source checked 15 Sep 2026
- NVIDIA Nemotron 3.5 Lightning 30B-A3B 2026-08-11, Official release, weights: NVFP4, source checked 15 Sep 2026
- NVIDIA Nemotron 3.5 Content Safety 2026-06-02, Official release, weights: BF16, source checked 15 Sep 2026
- NVIDIA Nemotron 3.5 ASR Streaming 0.6B 2026-06-04, Official release, weights: BF16, source checked 15 Sep 2026
- DeepSeek-V4-Flash-0731 2026-07-31, Official release, weights: FP8 (FP4 cache options), source checked 15 Sep 2026
- Kimi K3 2026-07-16, Official release, weights: MXFP4 weights / MXFP8 activations (QAT), source checked 15 Sep 2026
- Kimi K2.7 Code 2026-07-16, Official release, weights: Native INT4, source checked 15 Sep 2026
- Qwen3 12B, E-AI compressed V1.5 2026-07-01, Community release, source checked 15 Sep 2026
Hardware profiles
- GeForce RTX 4060 8 GiB VRAM, source checked 15 Sep 2026
- GeForce RTX 4060 Ti 16GB 16 GiB VRAM, source checked 15 Sep 2026
- GeForce RTX 4070 SUPER 12 GiB VRAM, source checked 15 Sep 2026
- GeForce RTX 4080 SUPER 16 GiB VRAM, source checked 15 Sep 2026
- GeForce RTX 4090 24 GiB VRAM, source checked 15 Sep 2026
- GeForce RTX 5090 32 GiB VRAM, source checked 15 Sep 2026
- Radeon RX 7900 XTX 24 GiB VRAM, source checked 15 Sep 2026
- Radeon RX 9070 XT 16 GiB VRAM, source checked 15 Sep 2026