What is the minimum hardware to run 671B DeepSeek 3.1

2 roscas 3 8/26/2025, 9:32:53 PM

URL for Ollama is https://ollama.com/library/deepseek-v3.1/tags

So has anyone put this model to run and with what hardware?

Comments (3)

bigyabai · 2h ago

There is no minimal hardware besides the basic requirements of being able to store/load the weights for inference.

roscas · 1h ago

Error: 500 Internal Server Error: model requires more system memory (34.1 GiB) than is available (27.2 GiB)

This is ollama run deepseek-r1:70b with size of 43gb.

32GB desktop.

magicalhippo · 25m ago

Yes, as GP said you'll need enough memory to load the weights (and KV cache).

Beyond that it's just how fast you want to go. Pure CPU will be slow, but will work. There has been a few stories and comments here[1] about people running this model.

[1]: https://hn.algolia.com/?q=671B+DeepSeek

Building Invincible APIs (jkebertz.medium.com)

Holga 120-degree Wide Pinhole Camera (lomography.com)

Show HN: I made PromptMask, a local-first privacy layer for LLMs (github.com)

AI 'deadbots' are persuasive and primed for monetization (text.npr.org)

So many conferences are mid. Why was BSC 2025 so good? (bgthompson.codeberg.page)

Glass bottles found to contain more microplastics than plastic bottles (phys.org)

Apple and the Ghosts of Companies Past (stratechery.com)

Drama Model Inference Efficiency Boosted by 1.7x-2.3x (pytorch.org)

Wayback Machine Save Page (web.archive.org)

2-D Sparse Parallelism for Deep Learning Recommendation Model Training (arxiv.org)

Show HN: ProStore BETA – The best app store for iOS just got better

Show HN: ProStore – The best alternative app store for iOS (prostore.free.nf)

Outperforming cuBLAS on H100 [video] (youtube.com)

Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents (arxiv.org)

Google X Head on Moonshots: 10x Is Easier Than 10 Percent (2013) (wired.com)

Spotify Launches In-App Messaging, Hoping New DM Feature Will Boost Listening (variety.com)

Tooltips and Toggletips (2017) (inclusive-components.design)

Starship Launch #10 stream T-00:01:00 (twitter.com)

What is the optimal speed of email response? by Tyler Cowen (marginalrevolution.com)

Starship 10T minus 10 min (spacex.com)

Google is killing first and second gen Nest Thermostats (support.google.com)

The evolution of LLM tool calling (youtube.com)

Pdf to Text .NET transcriber CLI app using Ollama (github.com)

AI Climate Costs Efficiency (washingtonpost.com)

Turn old slide decks into an API that builds new ones (blinkslides.com)

Nothing bought my photo and used it to cheat the buyers (geekzone.co.nz)

Comparing ADC Performance of Espressif SoCs (developer.espressif.com)

Anthropic Settles High-Profile AI Copyright Lawsuit Brought by Book Authors (wired.com)

x

Tombi TOML Formatter / Linter / LSP (tombi-toml.github.io)

Show HN: CashLedger – Offline-first PWA for cash tracking (cashflow-friend-pwa.vercel.app)

Watch two AI robots roast me while I play video games (twitch.tv)

DHH: The full tour of Omarchy 2.0 [video] (youtube.com)

Ignore All Previous Instructions (ignoreallpreviousinstructions.net)

How the N.Y.P.D.'S Facial Recognition Tool Landed the Wrong Man in Jail (nytimes.com)

Netflix Guidelines for Using Generative AI in Content Production (partnerhelp.netflixstudios.com)

Vibe Coding in Prod Responsibly [video] (youtube.com)

US banks lobby to block stablecoin interest over fears of deposit flight (ft.com)

Onionlike Space Explosion May Be a New Type of Supernova (nytimes.com)

Five Span wants NYT to use Bullshit Machine for profit (bloomberg.com)

As Many Head Back to the Office, Where Could Investors See Changes? (inspiredinvestor.rbcdirectinvesting.com)

What Opposition? Dems' Urged Not to Talk About Trump's Military Takeover (rollingstone.com)

Apple Watch not a 'CO2-neutral product,' German court finds (reuters.com)

Company receives probation and fine for workers suffocated in nitrogen leak (wsws.org)

I rescued 42 ChatGPT conversations from digital lock-in (technical guide)

Show HN: Satori MCP Server – Generate Images from React Components (github.com)

A universal rhythm guides how we speak: analysis reveals 'intonation units' (phys.org)

Blindfold Review: Scratching the Surface of the Darkest of Subject Matter (uploadvr.com)

We Are Being Sludged (inkengray.medium.com)

Librem Post Quantum Cryptography Comms Server (puri.sm)

What is the minimum hardware to run 671B DeepSeek 3.1

Comments (3)