What is the minimum hardware to run 671B DeepSeek 3.1

2 roscas 3 8/26/2025, 9:32:53 PM

URL for Ollama is https://ollama.com/library/deepseek-v3.1/tags

So has anyone put this model to run and with what hardware?

Comments (3)

bigyabai · 5h ago

There is no minimal hardware besides the basic requirements of being able to store/load the weights for inference.

roscas · 4h ago

Error: 500 Internal Server Error: model requires more system memory (34.1 GiB) than is available (27.2 GiB)

This is ollama run deepseek-r1:70b with size of 43gb.

32GB desktop.

magicalhippo · 3h ago

Yes, as GP said you'll need enough memory to load the weights (and KV cache).

Beyond that it's just how fast you want to go. Pure CPU will be slow, but will work. There has been a few stories and comments here[1] about people running this model.

[1]: https://hn.algolia.com/?q=671B+DeepSeek

Ask HN: Why hasn't x86 caught up with Apple M series?

Ask HN: What is the biggest problem LLMs solved in your life/work?

Ask HN: Any experienced devs who use AI extensively in their work?

Ask HN: How can I recover and run my old mobile game from the 2010s?

Out of curiosity: what kind of people use this "forum" (I mean Hacker News)?

Ask HN: Do You Believe in Aliens?

Ask HN: Why are so many services rejecting Google Voice numbers for signups?

Ask HN: What to Do with Old iPads?

Ask HN: Is there a temp phone number like temp email?

Ask HN: How are you attributing your AI usage when developing software?

Patient Lisp Hacker Seeks Same for Long Walks Through IPL-V Code

Ask HN: Has anyone else used online communities that are archetypically "savvy"?

High rate of LLM (GPT5) hallucinations in dense stats domains (cricket)

Stop squashing your commits. You're squashing your AI too

429 Too Many Requests from registry.npmjs.org

Ask HN: Why does the US Visa application website do a port-scan of my network?

Ask HN: Best codebases to study to learn software design?

Ask HN: Why do people hate on Sabine Hossenfelder so much?

How can a mutex in Wine be faster than a native one on Linux

Ask HN: What is wrong with modern software development

Ask HN: Recommandation for an Ergonomic Keyboard?

Ask HN: Someone has committed 20K+ LoC to a PR, exhausting my CI & AI workflows

Ask HN: Are AI filters becoming stricter than society itself?

Ask HN: I just abandoned my PyCharm subscription, what should I use now?

Ask HN: How can I trace what user queries make AI bots crawl my site?

ASK HN: AI in high school. Will teachers and schools have to compensate?

Ask HN: What is your source for answers?

Ask HN: Best Marketplaces for Used Servers?

Ask HN: Devices to allow children to listen to podcasts on my local network?

DSPy GEPA Example: Listwise Reranker

Ask HN: How do you find early stage startups to join

Ask HN: No easy way for tvOS to display long documents (e.g., terms of service)?

Problem with Payment Gateways

Ask HN: Does using public transportation make you more creative than driving?

HeartWatch: A Proactive Child Safety System

Gemini in Gmail Is Pretty Well Useless

Ask HN: Why is Apple so far behind with Siri?

Ask HN: What's Hacker News's vision for the future?

What is the minimum hardware to run 671B DeepSeek 3.1

Comments (3)