Pay per crawl: Enabling content owners to charge AI crawlers

Comments (1)

mmarian · 4h ago

Wrote a blog post on why I don't think it'll be adopted: https://developerwithacat.com/blog/202507/cloudflare-pay-per...

tldr - motivated scrapers can pass Cloudflare, content owners won't be happy with the market price, and enterprise licensing agreements already fill whatever gaps there are

M8.7 earthquake in Western Pacific, tsunami warning issued (earthquake.usgs.gov)

Sleep all comes down to the mitochondria (science.org)

Study mode (openai.com)

RIP Shunsaku Tamiya, the man who made plastic model kits a global obsession (japanesenostalgiccar.com)

Launch HN: Hyprnote (YC S25) – An open-source AI meeting notetaker

URL-Driven State in HTMX (lorenstew.art)

iPhone 16 cameras vs. traditional digital cameras (candid9.com)

A major AI training data set contains millions of examples of personal data (technologyreview.com)

Show HN: The Aria Programming Language (github.com)

Learning basic electronics by building fireflies (a64.in)

ACM Transitions to Full Open Access (acm.org)

Two Birds with One Tone: I/Q Signals and Fourier Transform (wirelesspi.com)

Show HN: Cant, rust nn lib for learning (github.com)

Analoguediehard (analoguediehard.com)

USB-C for Lightning iPhones (obsoless.com)

How the brain increases blood flow on demand (hms.harvard.edu)

FoundationDB: From idea to Apple acquisition [video] (youtube.com)

Show HN: Terminal-Bench-RL: Training long-horizon terminal agents with RL (github.com)

Irrelevant facts about cats added to math problems increase LLM errors by 300% (science.org)

Show HN: I built an AI that turns any book into a text adventure game (kathaaverse.com)

A month using XMPP (using Snikket) for every call and chat (2023) (neilzone.co.uk)

My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air) (simonwillison.net)

Elements of System Design (github.com)

Structuring large Clojure codebases with Biff (biffweb.com)

Observable Notebooks 2.0 Technology Preview (observablehq.com)

Microsoft Flight Simulator 2024: WebAssembly SDK (docs.flightsimulator.com)

Supervised fine tuning on curated data is reinforcement learning (arxiv.org)

Playing with more user-friendly methods for multi-factor authentication (tesseral.com)

The Sail instruction-set semantics specification language (alasdair.github.io)

CodeCrafters (YC S22) is hiring first Marketing Person (ycombinator.com)

More honey bees dying, even as antibiotic use halves (news.uoguelph.ca)

Seriously, Why Do Some AI Chatbot Subscriptions Cost More Than $200? (wired.com)

Playing with Open Source LLMs (alicegg.tech)

State Capacity and Eight Parking Spaces (brethorsting.com)

Maru OS – Use your phone as your PC (maruos.com)

Show HN: A GitHub Action that quizzes you on a pull request (github.com)

Linux Performance Analysis (2015) (netflixtechblog.com)

A grand tour through the essays of Lewis H. Lapham (laphamsquarterly.org)

Project Zero – Policy and Disclosure: 2025 Edition (googleprojectzero.blogspot.com)

Measuring Engineering (fffej.substack.com)

The Making of Dario Amodei (bigtechnology.com)

Dropbox Passwords discontinuation (help.dropbox.com)

Phenome-wide analysis of diseases in relation to sleep traits (spj.science.org)

The Convenience Trap: Why Seamless Banking Access Can Turn 2FA into 1FA (blog.opencore.ch)

Revontuli Colorscheme Collection (codeberg.org)

Enough AI copilots, we need AI HUDs (geoffreylitt.com)

Microsoft Introduces 'Copilot Mode' in Edge (blogs.windows.com)

Pkgbase Removes FreeBSD Base System Feature (lists.freebsd.org)

Cucumber lets you write automated tests in plain language (cucumber.io)

The Saltgator: A Desktop SoftGel Injection Molding Machine (core77.com)

Pay per crawl: Enabling content owners to charge AI crawlers

Comments (1)