Ask HN: Is Prompt Engineering Just Overfitting?

Whenever I see people doing prompt engineering they start with some kind of evaluation dataset, then they refine their prompt to perform well on that evaluation dataset. But isn't this just like training on a test dataset i.e. overfitting?

The Fed says this is a cube of $1M. They're off by half a million (calvin.sh)

More on Apple's Trust-Eroding 'F1 the Movie' Wallet Ad (daringfireball.net)

Nvidia won, we all lost (blog.sebin-nyshkim.net)

The new skill in AI is not prompting, it's context engineering (philschmid.de)

My open source project was relicensed by a YC company [license updated] (twitter.com)

Introducing tmux-rs (richardscollin.github.io)

Local-first software (2019) (inkandswitch.com)

Writing Code Was Never the Bottleneck (ordep.dev)

Being too ambitious is a clever form of self-sabotage (maalvika.substack.com)

I made my VM think it has a CPU fan (wbenny.github.io)

Proton joins suit against Apple for practices that harm developers and consumers (proton.me)

Xfinity using WiFi signals in your house to detect motion (xfinity.com)

Are we the baddies? (geohot.github.io)

Bitchat – A decentralized messaging app that works over Bluetooth mesh networks (github.com)

The Rise of Whatever (eev.ee)

Adding a feature because ChatGPT incorrectly thinks it exists (holovaty.com)

Websites hosting major US climate reports taken down (apnews.com)

Exploiting the IKKO Activebuds “AI powered” earbuds (2024) (blog.mgdproductions.com)

Cloudflare to introduce pay-per-crawl for AI bots (blog.cloudflare.com)

Hidden interface controls that affect usability (interactions.acm.org)

Don’t use “click here” as link text (2001) (w3.org)

ICEBlock, an app for anonymously reporting ICE sightings, goes viral (techcrunch.com)

Private sector lost 33k jobs, badly missing expectations of 100k increase (cnbc.com)

Figma files for proposed IPO (figma.com)

I extracted the safety filters from Apple Intelligence models (github.com)

Nobody has a personality anymore: we are products with labels (freyaindia.co.uk)

There are no new ideas in AI, only new datasets (blog.jxmo.io)

Jane Street barred from Indian markets as regulator freezes $566M (cnbc.com)

Major reversal in ocean circulation detected in the Southern Ocean (icm.csic.es)

Show HN: I wrote a "web OS" based on the Apple Lisa's UI, with 1-bit graphics (alpha.lisagui.com)

YouTube No Translation (addons.mozilla.org)

Mini NASes marry NVMe to Intel's efficient chip (jeffgeerling.com)

Ask HN: What Are You Working On? (June 2025)

The force-feeding of AI features on an unwilling public (honest-broker.com)

Gridfinity: The modular, open-source grid storage system (gridfinity.xyz)

Cloudflare Introduces Default Blocking of A.I. Data Scrapers (nytimes.com)

Show HN: Spegel, a Terminal Browser That Uses LLMs to Rewrite Webpages (simedw.com)

Hannah Cairo: 17-year-old teen refutes a math conjecture proposed 40 years ago (english.elpais.com)

OBBB signed: Reinstates immediate expensing for U.S.-based R&D (kbkg.com)

I'm dialing back my LLM usage (zed.dev)

Show HN: CSS generator for a high-def glass effect (glass3d.dev)

Many ransomware strains will abort if they detect a Russian keyboard installed (2021) (krebsonsecurity.com)

Fakespot shuts down today after 9 years of detecting fake product reviews (blog.truestar.pro)

I write type-safe generic data structures in C (danielchasehooper.com)

Melbourne man discovers extensive model train network underneath house (sbs.com.au)

A non-anthropomorphized view of LLMs (addxorrol.blogspot.com)

The Moat of Low Status (usefulfictions.substack.com)

What a Hacker Stole from Me (mynoise.net)

Claude Code now supports hooks (docs.anthropic.com)

OpenFLOW – Quickly make beautiful infrastructure diagrams local to your machine (github.com)

Ask HN: Is Prompt Engineering Just Overfitting?

Comments (0)