3D Printed RC Plane Designs (flightory.com)

1 points by akshaykarthik 35s ago 0 comments

The Law Firms That Appeased Trump–and Angered Their Clients (wsj.com)

1 points by JumpCrisscross 45s ago 0 comments

Show HN: MCPglue (Open Source) – Let your agent build its own tools (superglue.cloud)

1 points by sfaist 1m ago 0 comments

Show HN: InvoiceMCP – Let AI create and manage invoices directly (invoicemcp.com)

1 points by jdalton 1m ago 0 comments

Making Rope with Ozzie's Homemade Rope Making Machine (youtube.com)

1 points by bookofjoe 5m ago 0 comments

Ask HN: What are the system requirements of autonomous military UAV?

1 points by eimrine 6m ago 0 comments

Chef and the Aesthetics of Multicoding (esoteric.codes)

1 points by yubblegum 9m ago 0 comments

Show HN: VentureLens, Data-backed business ideas and plans, delivered (apps.apple.com)

1 points by nikos_nikol 10m ago 0 comments

Browser.dating – Dating website matching people based on their browser history (browser.dating)

1 points by bschne 10m ago 1 comments

US community bank says thieves drained customer data through third party hole (theregister.com)

1 points by rntn 12m ago 1 comments

American science put on starvation diet (theregister.com)

2 points by pseudolus 14m ago 0 comments

Apple's ChatGPT Rival Moves Forward, but Siri's Future Still Uncertain (macrumors.com)

1 points by layer8 14m ago 0 comments

Curtis Yarvin's Plot Against America (newyorker.com)

2 points by pseudolus 15m ago 1 comments

Taskmaster AI: The PM for your AI agent (task-master.dev)

1 points by cloudking 16m ago 0 comments

Tabletop particle blaster: Tiny nozzles, lasers could replace giant accelerators (phys.org)

1 points by pseudolus 16m ago 0 comments

Researchers recreate ancient Egyptian blues (news.wsu.edu)

1 points by geox 17m ago 0 comments

Taking Things Apart (in three parts) (dansinker.com)

1 points by mooreds 17m ago 0 comments

Tracy profiler new release 0.12.0 (github.com)

1 points by frozeus 17m ago 0 comments

Jemalloc (github.com)

2 points by rhd1729 18m ago 0 comments

The Catholic Church and female leadership: A 'woman problem' or a history one? (americamagazine.org)

1 points by mooreds 19m ago 0 comments

How Hard Do You Have to Push Yourself to Get Stronger? (nytimes.com)

2 points by mooreds 19m ago 0 comments

Show HN: I am building the best spot cryptocurrency screener (cryptoquant.dev)

1 points by QuantFantom 20m ago 0 comments

Built a Quickest Plug & Play Webhook Event Notification Gateway for Your SaaS

1 points by hookflo 21m ago 0 comments

What They Definitely Don't Teach You in Business School (ianreppel.org)

2 points by fittingopposite 21m ago 1 comments

Zochi: First end-to-end AI research agent to be published in ACL (intology.ai)

1 points by overbytecode 22m ago 0 comments

ChatGPT: H1 2025 Strategy (justice.gov)

1 points by chuckhend 24m ago 0 comments

Technology is revolutionizing the search for prime numbers (theconversation.com)

3 points by tambourine_man 25m ago 0 comments

How do I learn robotics in 2025?

2 points by srijansriv 25m ago 0 comments

Write more reliable JavaScript with optional chaining (allthingssmitty.com)

2 points by AllThingsSmitty 26m ago 0 comments

The Most Misunderstood Feature of the Sound (substack.com)

1 points by che_shr_cat 26m ago 0 comments

Streaming HTML out of order without JavaScript (lamplightdev.com)

1 points by ducaale 27m ago 0 comments

One Roundtrip per Navigation (overreacted.io)

2 points by tentacleuno 28m ago 0 comments

Amazon and the New York Times Announce an A.I. Licensing Deal (nytimes.com)

1 points by tosh 29m ago 0 comments

Non-Developers Can Help with Technical Troubleshooting (spin.atomicobject.com)

2 points by philk10 29m ago 1 comments

TiRex: Zero-Shot Forecasting Across Long and Short Horizons (arxiv.org)

1 points by tosh 31m ago 0 comments

The Lifesaving Power of Doppler Weather Radar (scientificamerican.com)

1 points by m-hodges 32m ago 0 comments

Health as a Dev (mtende.blog)

2 points by sonderotis 36m ago 0 comments

Flesh-eating screwworms in cattle could raise US beef prices (reuters.com)

3 points by davedx 37m ago 0 comments

Remote MCP Servers and Implementation (medium.com)

1 points by paperplaneflyr 37m ago 0 comments

Ask HN: What do you spend your money on?

2 points by blahaj 38m ago 0 comments

The way of code (thewayofcode.com)

1 points by Nars088 43m ago 0 comments

Google DMARC Policy Changes?

2 points by flajr 44m ago 0 comments

GNOME's New Director Tackles Funding, Pride and Prejudice (fossforce.com)

1 points by nogajun 44m ago 0 comments

Show HN: I made a simple extension to help Chrome extension developers (extinsight.org)

2 points by kadeus 49m ago 0 comments

Show HN: GitHub search MCP – add code from any remote origin as context (github.com)

1 points by bigEnotation 50m ago 0 comments

Alexa, Shame on You (kg.dev)

1 points by kashnote 51m ago 0 comments

Moats in the Age of AI (cloudedjudgement.substack.com)

2 points by redm 52m ago 1 comments

Colt's Revolutions (taylor.town)

1 points by surprisetalk 54m ago 0 comments

Japan Wet Bulb Globe Temperature Index (wbgt.env.go.jp)

2 points by simonpure 54m ago 0 comments

Are you a big AI vendor making terrible AI business decisions? We can help (theregister.com)

1 points by rntn 54m ago 0 comments

Built an open-source web scraper for AI agents – seeking feedback

2 ntbperst 3 6/1/2025, 8:26:10 PM github.com ↗

Comments (3)

ntbperst · 16h ago

Anyone else here building AI agents that need web data?

So I built *AnyCrawl* specifically for AI use cases:

Handles JS-heavy sites (React, Vue, etc.) 20x performance boost through multi-processing Support proxies (no more blocks!) Returns LLM-friendly structured data Open source (MIT) + optional SaaS

mtmail · 16h ago

It doesn't seem to respect robots.txt.

ntbperst · 10h ago

the coming version will support.