Ask HN: What's the Point of llms.txt?

2 nonvibecoding 2 7/16/2025, 5:41:44 PM

I’m starting to see more sites add llms.txt, giving LLMs clean, structured access to their entire content. But LLMs already drive little to no traffic back.

Are sites just giving up and accepting the tradeoff? What's the real benefit here for publishers?

llms.txt examples:

- https://developers.cloudflare.com/llms-full.txt

- https://searchengineland.com/llms.txt

Comments (2)

waldopat · 22h ago

I recently added an llms.txt. I have heard anecdotally that some peers in my ecosystem have seen my startup recommended. Oddly enough, ChatGPT recommended a blog article I had written back to me when I was trying to edit another blog article. But I am not getting any significant traffic from the AIs, at least according to Google Analytics.

mattl · 22h ago

I'm starting to see more and more sites want to block them too.

Systemd's Nuts and Bolts – A Visual Guide to Systemd (medium.com)

Hackers exploit a blind spot by hiding malware inside DNS records (arstechnica.com)

Show HN: Rastion – Autonomous Monitoring Systems (rastion.com)

Daniel Kahneman: Algorithms Make Better Decisions Than You [the Knowledge (fs.blog)

My Blogroll Is Now My RSS Feed Reader (susam.net)

Healthy babies born after scientists used DNA from three people (apnews.com)

Crawling a billion web pages in just over 24 hours, in 2025 (andrewkchan.dev)

Denmark aims to host most powerful quantum computer (reuters.com)

Chinese hackers breached National Guard to steal network configurations (bleepingcomputer.com)

Superhuman is being acquired by Grammarly to build the future of work (blog.superhuman.com)

US tells automakers they face no fuel economy penalties for last three years (reuters.com)

Y Combinator alum launched a new $34M fund dedicated to YC startups (techcrunch.com)

Breaking Gemini 2.5 Pro Multimodal in audio and vision mode (enkryptai.com)

Patagonian Giants (static-prod.lib.princeton.edu)

Ask HN: How vibe coding apps are retaining users?

Firefox dev says Intel Raptor Lake crashes are increasing with rising temperatu (tomshardware.com)

Molecule produced by gut bacteria causes atherosclerosis (english.elpais.com)

Ask HN: What are your current programming pet peeves?

Does Airport Security Even Work? [video] (youtube.com)

DOJ drops charges against Utah doctor accused of destroying Covid vaccines (theguardian.com)

OpenAI says it will use Google's cloud for ChatGPT (cnbc.com)

When .999 Isn't 1 (mathenchant.wordpress.com)

We built a real-time service that handles 20k updates per second (trigger.dev)

The Joy of Sanskrit (press-files.anu.edu.au)

TTAM Research Institute, Nonprofit Public Benefit Corp. Acquires 23andMe Assets (investors.23andme.com)

The Architecture of Open Source Applications (Volume 1) Battle for Wesnoth (aosabook.org)

A stand-alone dev/test/prod env bootstrapper on repo clone in pure `Python`?

The First Weight Loss Drugs (asimov.press)

Your Infra Isn't Special: Why Open Source Infrastructure as Code (IaC) Wins (masterpoint.io)

Anduril raises $2.5B at $30.5B valuation led by Founders Fund (techcrunch.com)

New in Gemini Code Assist: Agent Mode and IDE Enhancements (blog.google)

Cookies Having Independent Partitioned State (Chips) (developer.mozilla.org)

Show HN: RunAgent; Multi-Framework Agent Deployment and Rust,Go,JS SDKs(+others) (github.com)

Tell Me Again About Neurons Now (science.org)

New colors without shooting lasers into your eyes (dynomight.net)

Max severity Cisco ISE bug allows pre-auth command execution, patch now (bleepingcomputer.com)

Tell HN: Notion Desktop is monitoring your audio and network

Why do some autistic people walk differently? (theconversation.com)

A Top Engineer Reveals OpenAI's Culture of Secrets and Chaos (gizmodo.com)

St. Sunniva – Irish Queen and Norwegian Patron Saint (uib.no)

AI-powered co-pilot for tech and finance interviews (linkjob.ai)

Pigeon Whistles (presentandcorrect.com)

These Remote control racers aren't hobbyists. They're pros (latimes.com)

A foundation model to predict and capture human cognition (nature.com)

Synthetic Fuels from Offshore Wind Park (kit.edu)

Grigoriev 1: New eclipsing variable star discovered in the Pegasus constellation (phys.org)

Honest Abe: Anti-BS Epistemology (austinross.xyz)

Numerai – Crowdsourced AI hedge fund doing token buyback (blog.numer.ai)

Trump's defunding of NASA would be catastrophic (engadget.com)

Parallel book generation in 3.5 minutes instead of 60 (stateless architecture) (github.com)

Ask HN: What's the Point of llms.txt?

Comments (2)