Pay per crawl: Enabling content owners to charge AI crawlers

Comments (1)

mmarian · 8h ago

Wrote a blog post on why I don't think it'll be adopted: https://developerwithacat.com/blog/202507/cloudflare-pay-per...

tldr - motivated scrapers can pass Cloudflare, content owners won't be happy with the market price, and enterprise licensing agreements already fill whatever gaps there are

LLM Inevitabilism (tomrenner.com)

Do not download the app, use the website (idiallo.com)

CARA – High precision robot dog using rope (aaedmusa.com)

Kiro: A new agentic IDE (kiro.dev)

Show HN: Tinder but it's only pictures of my wife and I can only swipe right (trytender.app)

Study mode (openai.com)

Linux Reaches 5% Desktop Market Share in USA (ostechnix.com)

EU age verification app to ban any Android system not licensed by Google (reddit.com)

Copyparty – Turn almost any device into a file server (github.com)

Dumb Pipe (dumbpipe.dev)

‘I witnessed war crimes’ in Gaza – former worker at GHF aid site [video] (bbc.com)

Enough AI copilots, we need AI HUDs (geoffreylitt.com)

Valve confirms credit card companies pressured it to delist certain adult games (pcgamer.com)

Performance and telemetry analysis of Trae IDE, ByteDance's VSCode fork (github.com)

Hyatt Hotels are using algorithmic Rest “smoking detectors” (twitter.com)

Show HN: Use Their ID – Use your local UK MP’s ID for the Online Safety Act (use-their-id.com)

How to Firefox (kau.sh)

Global hack on Microsoft Sharepoint hits U.S., state agencies, researchers say (washingtonpost.com)

M8.7 earthquake in Western Pacific, tsunami warning issued (earthquake.usgs.gov)

Reflections on OpenAI (calv.info)

Qwen3-Coder: Agentic coding in the world (qwenlm.github.io)

AI overviews cause massive drop in search clicks (arstechnica.com)

Graphene OS: a security-enhanced Android build (lwn.net)

It's time for modern CSS to kill the SPA (jonoalderson.com)

Ukrainian hackers destroyed the IT infrastructure of Russian drone manufacturer (prm.ua)

ChatGPT agent: bridging research and action (openai.com)

VPN use surges in UK as new online safety rules kick in (ft.com)

Windsurf employee #2: I was given a payout of only 1% what my shares where worth (twitter.com)

Mistral Releases Deep Research, Voice, Projects in Le Chat (mistral.ai)

Cops say criminals use a Google Pixel with GrapheneOS – I say that's freedom (androidauthority.com)

Tom Lehrer has died (nytimes.com)

The United States withdraws from UNESCO (state.gov)

Steam, Itch.io are pulling ‘porn’ games. Critics say it's a slippery slope (wired.com)

XMLUI (blog.jonudell.net)

TrackWeight: Turn your MacBook's trackpad into a digital weighing scale (github.com)

My Self-Hosting Setup (codecaptured.com)

Show HN: Shoggoth Mini – A soft tentacle robot powered by GPT-4o and RL (matthieulc.com)

Ozzy Osbourne has died (bbc.co.uk)

Coding with LLMs in the summer of 2025 – an update (antirez.com)

Rust running on every GPU (rust-gpu.github.io)

Visa and Mastercard are getting overwhelmed by gamer fury over censorship (polygon.com)

Claude Code weekly rate limits

Oakland cops gave ICE license plate data; SFPD also illegally shared with feds (sfstandard.com)

Cloudflare 1.1.1.1 Incident on July 14, 2025 (blog.cloudflare.com)

Death by AI (davebarry.substack.com)

You can now disable all AI features in Zed (zed.dev)

New colors without shooting lasers into your eyes (dynomight.net)

Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic (github.com)

Women dating safety app 'Tea' breached, users' IDs posted to 4chan (404media.co)

UK backing down on Apple encryption backdoor after pressure from US (arstechnica.com)

Pay per crawl: Enabling content owners to charge AI crawlers

Comments (1)