Ask HN: People with new Macs / computers with GPU's, do you run LLM's locally?

3 vishalontheline 2 5/9/2025, 4:42:25 AM

I am considering finally upgrading to a new computer - most likely an M4 Mac with the primary goal of running coding assistants and training my own models locally.

Is this a good idea? Have you tried it? How's the performance?

Thank you!

Comments (2)

fiiv · 16h ago

I do this. Ollama makes it very easy - just pull the model you want. The great thing is the ability to test them in the same tasks, there's a huge difference in comparable models.

You can set it up in your editor of choice - I use Zed, and it's just listed as one of the providers you can choose.

In terms of performance - it works decently well.

bookworm123 · 14h ago

Cool idea, however when I have to create an account for a service just to test it out, I will naturally decline to do so. Maybe you could upload a sample document for people to play with?

Ask HN: RAG or shared memory for task planning across physical agents?

Ask HN: Anyone using knowledge graphs for LLM agent memory/context management?

Ask HN: What are good high-information density UIs (screenshots, apps, sites)?

Ask HN: How to get good at marketing your product and SEO?

Ask HN: How much better are AI IDEs vs. copy pasting into chat apps?

If you could only keep one app on your phone, what would it be?

Ask HN: AI-Filtering Browser Extension?

Blazeio.SharpEvent: A Python Async Primitive That Scales to 1M Waiters with O(1)

Ask HN: How could vibe coding show the code at a high level to non-programmers?

AI Summarizer: Summarize Web, YouTube and PDFs in Seconds–Free

Ask HN: My company is forcing 1 week sprints. What should I do?

Ask HN: Are you using AI coding assistance?

OSUniverse: Building a Better OSWorld

Ask HN: Nvidia GeForce RTX 5060 arrives May 19 at $299 revive PC builds?

Why do websites prevent pasting via onpaste="return false;"

Ask HN: How do you obtain software development contracts?

Ask HN: Help us validate our idea of an administrative app for small businesses

Ask HN: Hackathons feel fake now

Ask HN: How are you managing LLM inference at the edge?

We built an AI-powered voice tool to boost sales

Ask HN: Azure Open AI Issues?

Ask HN: Privacy concerns when using AI assistants for coding?

Getting tired of Helm – any better way to handle deployments in Kubernetes?

Ask HN: Did Aliexpress stop shipping to US?

Ask HN: Which Firefox add-ons are you using in 2025?

Ask HN: Why is the sender chat box always on the right?

Is a Smaller Internet Better?

Ask HN: Have you used Claude Code? Is it any good?

Ask HN: Has anyone managed to pass Meta's Access Verification?

Ask HN: Advice wanted – director distrusting of our team?

Ask HN: Jaded with AI – Alternatives?

Ask HN: Theory to industry: where do academics fit in?

Ask HN: People with new Macs / computers with GPU's, do you run LLM's locally?

Comments (2)