Combined with the fact that a lot of their self-hosted stuff, including the Reddit front-ends, are in the Certificate Transparency logs [1], it's not hugely surprising that web crawlers would run into them.

[1]: https://crt.sh/?q=ext4.xyz

udev4096 · 47m ago

I am definitely not surprised. It's quite normal, as I stated. What I was trying to say was they are abusing the private frontends to get around legal restrictions of aggressively scraping the web

unstablediffusi · 2h ago

that's not scraping, that's web search.

their scrapers wouldn't identify themselves

The Dogs of Chernobyl Are Experiencing Rapid Evolution, Study Suggests (popularmechanics.com)

Building Unreal Engine 5.6 from the GitHub Source Code on GNU/Linux (youtube.com)

Show HN: FansFinder – A Search Engine for OnlyFans Creators

Big Bets (jackdanger.com)

The USB-C Dream is Dead (androidauthority.com)

How I Program with Agents (sketch.dev)

Rkyv (archive) is a zero-copy deserialization framework for Rust (rkyv.org)

Microsoft Needs a SteamOS Competitor, and It Needs It Yesterday (howtogeek.com)

Binghamton researchers make dissolvable battery using probiotics (binghamton.edu)

Your Smartphone Is a Parasite, According to Evolution (nakedcapitalism.com)

Comma v0.1 1T and 2T–7B LLMs trained on openly licensed text (simonwillison.net)

How to run LLMs locally on mobile devices (with Gemma and On-Device AI tools) (annjose.com)

Meme Stocks Made Him a Fortune. Now He's Betting on Flying Taxis (wsj.com)

AI-Generated Code Statistics 2025: Is Your Developer Job Safe? (elitebrains.com)

Tech giants in the Gulf are building super-apps to dominate digital life (restofworld.org)

Ask HN: How long do you ever leave your server running without updates?

How to Annotate Everything (beepb00p.xyz)

OpenAI's dirty secret: AI models eating each other

MSU author aims to break cycle of nightmares, insomnia (msstate.edu)

AI tool turns invoices into live inventory dashboards (useflowtrack.io)

Ex_sugar review: failure in 9 days (exfatloss.com)

Designing Semantically-Resonant Abstract Patterns for Data Visualization (arxiv.org)

Ask HN: What is your favorite quote from a book?

AI Is About to Get Physical [video] (youtube.com)

Coral reefs face an uncertain recovery from the 4th global mass bleaching event (theconversation.com)

Parallel AI Coding with Git Worktrees and Custom Claude Code Commands (docs.agentinterviews.com)

I made FoundersWall – a public board where I log everything I'm building

Death Clock (death-clock.org)

Generative Artificial Intelligence in K12 Education (mit-cml.github.io)

Show HN: Unified.nvim – A Neovim plugin for inline Git diffs (github.com)

The Myst Graph, 4: What's Next? (glthr.com)

Show HN: Built a 9MB GPU kernel achieving 43M ops/SEC with deterministic replay

Show HN: Slick&Moonro new SML web app framework (atreides-host.net)

Rents fall in most U.S. metros since 2023, demand struggles to match supply (seekingalpha.com)

The ATS programming language: unleashing the potential of types and templates (cs.bu.edu)

Racoon in Grow a Garden Pls

College Students Are Using 'No Contact Orders' to Block Each Other in Real Life (wsj.com)

Where will international students go if not the US? (theweek.com)

Ask HN: Looking for an open source AI chat agent with a local task panel?

New lab could help space industry dodge a bullet (gla.ac.uk)

Anna, the Universal Library (engramma.it)

EmotionSense Pro detects emotions in Google Meet, instantly and privately (emotionsense.pro)

It's Not "Just a Button" (candrewlee.com)

How did East German semiconductor manufacturing technology fail? (gigazine.net)

Armin Ronacher – Claude Code Fixes Two MiniJinja Issues [video] (youtube.com)

The New Dark Age (theatlantic.com)

New MCP-Ready Coding LLM Benchmark Structure (feat. Internet Based on Matrix) (blog.hermesloom.org)

Water – a minimal multi-agent framework that's agent-agnostic (github.com)

What Game Theory Reveals About AI (psychologytoday.com)

Show HN: Chaum Pedersen ZK Protocol Using gRPC (github.com)

OpenAI scraping Reddit through redlib instances

Comments (3)