Show HN: Claude Web Scraper

1 hubraumhugo 0 9/17/2025, 2:38:52 PM github.com ↗

Anthropic announced their new web fetch tool[0] last Friday, so I built a little tool to test its web scraping capabilities. In short: web fetch and web search are powerful Claude tools, but not suitable for any actual web scraping tasks yet.

It either struggles with or outright refuses to scrape many basic websites.

As an example, here is the result for https://news.ycombinator.com:

   The content I received appears to be incomplete or improperly formatted. This seems to be a parsing issue with how the web content was extracted. The Hacker News homepage contains article titles, links, scores, and comments, but what I received is mostly empty table structures with point counts.\n\nSince I cannot reproduce the actual content accurately from this malformed output, and I'm instructed not to hallucinate or make anything up, I cannot provide a proper markdown conversion of the Hacker News homepage content. The web fetch tool appears to have encountered an issue parsing the dynamic JavaScript-heavy content of the Hacker News site."

[0] https://docs.claude.com/en/docs/agents-and-tools/tool-use/we...

WASM 3.0 Completed (webassembly.org)

DeepSeek writes less secure code for groups China disfavors (washingtonpost.com)

Apple Photos app corrupts images (tenderlovemaking.com)

Anthropic irks White House with limits on models’ use (semafor.com)

Tinycolor supply chain attack post-mortem (sigh.dev)

Depression Reduces Capacity to Learn to Actively Avoid Aversive Events (eneuro.org)

DeepMind and OpenAI Win Gold at ICPC, OpenAI AKs (codeforces.com)

Drought in Iraq Reveals Ancient Tombs Created 2,300 Years Ago (smithsonianmag.com)

U.S. investors, Trump close in on TikTok deal with China (wsj.com)

Event Horizon Labs (YC W24) Is Hiring (ycombinator.com)

Tau² benchmark: How a prompt rewrite boosted GPT-5-mini by 22% (quesma.com)

Launch HN: RunRL (YC X25) – Reinforcement learning as a service (runrl.com)

Alibaba's new AI chip: Key specifications comparable to H20 (news.futunn.com)

How to motivate yourself to do a thing you don't want to do (ashleyjanssen.com)

Ton Roosendaal to step down as Blender chairman and CEO (cgchannel.com)

UUIDv47: Store UUIDv7 in DB, emit UUIDv4 outside (SipHash-masked timestamp) (github.com)

Determination of the fifth Busy Beaver value (arxiv.org)

Ask HN: What's a good 3D Printer for sub $1000?

YouTube addresses lower view counts which seem to be caused by ad blockers (9to5google.com)

Procedural Island Generation (III) (brashandplucky.com)

Just for fun: animating a mosaic of 90s GIFs (alexplescan.com)

PureVPN IPv6 Leak (anagogistis.com)

Microsoft Python Driver for SQL Server (github.com)

Bringing fully autonomous rides to Nashville, in partnership with Lyft (waymo.com)

Stategraph: Terraform state as a distributed systems problem (stategraph.dev)

Firefox 143 for Android to introduce DoH (blog.mozilla.org)

Slow social media (herman.bearblog.dev)

Is Data Modeling Dead? (confessionsofadataguy.com)

Doom crash after 2.5 years of real-world runtime confirmed on real hardware (lenowo.org)

SQLiteData: A fast, lightweight replacement for SwiftData using SQL and CloudKit (github.com)

Notion API importer, with Databases to Bases conversion bounty (github.com)

The Asus Gaming Laptop ACPI Firmware Bug: A Deep Technical Investigation (github.com)

EU Chat Control: Germany's position has been reverted to undecided (mastodon.social)

GNU Midnight Commander (midnight-commander.org)

You can't test if quantum uses complex numbers (algassert.com)

Murex – An intuitive and content aware shell for a modern command line (murex.rocks)

How to make the Framework Desktop run even quieter (noctua.at)

Oh no, not again a meditation on NPM supply chain attacks (tane.dev)

Algebraic Types are not Scary (blog.aiono.dev)

Denmark close to wiping out cancer-causing HPV strains after vaccine roll-out (gavi.org)

XeroxNostalgia.com (xeroxnostalgia.com)

I got the highest score on ARC-AGI again swapping Python for English (jeremyberman.substack.com)

AMD Open Source Driver for Vulkan project is discontinued (github.com)

A dumb introduction to z3 (asibahi.github.io)

'Privatisation premium': billions from UK energy bills paid to shareholders (theguardian.com)

Shai-Hulud malware attack: Tinycolor and over 40 NPM packages compromised (socket.dev)

I built my own phone because innovation is sad rn [video] (youtube.com)

Waymo has received our pilot permit allowing for commercial operations at SFO (waymo.com)

OpenAI reasoning system scores 12/12 at the 2025 ICPC World Finals (twitter.com)

Moon helium deal is biggest purchase of natural resources from space (washingtonpost.com)

Show HN: Claude Web Scraper

Comments (0)