Fight Chat Control (fightchatcontrol.eu)

The challenge: many websites' Terms of Service explicitly prohibit scraping, crawling, or automation. At the same time, the information needed (repos, dependencies, metadata) is often available only through those sites.

For those who've built tools around open source ecosystems:

* How do you navigate ToS restrictions while still delivering value to users?

* Do you focus on official APIs only, even if they're limited?

* Are there established legal/technical best practices for this situation?

* How to balance compliance with ToS and the mission of supporting FOSS?

Curious to hear what others have done (or seen work) in this space.

Comments (6)

like_any_other · 4h ago

The law around scraping is unfortunately complex, but it's plausible your use of it (legal compliance) could be legal regardless of ToS ("you're not allowed to use automated tools to check if we're breaking your license" is quite fishy):

https://legalclarity.org/is-web-scraping-legal-a-look-at-the...

https://en.wikipedia.org/wiki/HiQ_Labs_v._LinkedIn

Or you could base your business in Denmark: https://en.wikipedia.org/wiki/Web_scraping#European_Union

ATechGuy · 4h ago

Thanks for sharing the links! You're right, the legality around scraping is nuanced :( Use cases like license compliance might fall on the defensible side.

toomuchtodo · 3h ago

I’m unsure what your jurisdiction is, but if you’re in the US, speak with an attorney and get an attorney opinion letter. You’ll at least be able to demonstrate that you were acting in good faith.

ATechGuy · 3h ago

Thanks!

bigyabai · 4h ago

You're making a business, right? Pay for official API access.

ATechGuy · 4h ago

Right now the cost is a blocker (I'm bootstrapped, no funding yet). On top of that, sometimes official APIs either don't exist or don't expose the full dataset needed for license checks, which makes things tricky.

GPT-5 (openai.com)

Fight Chat Control (fightchatcontrol.eu)

GitHub is no longer independent at Microsoft after CEO resignation (theverge.com)

I tried every todo app and ended up with a .txt file (al3rez.com)

Claude Sonnet 4 now supports 1M tokens of context (anthropic.com)

I want everything local – Building my offline AI workspace (instavm.io)

Ultrathin business card runs a fluid simulation (github.com)

Streaming services are driving viewers back to piracy (theguardian.com)

Wikipedia loses challenge against Online Safety Act (bbc.com)

Anna's Archive: An Update from the Team (annas-archive.org)

FFmpeg 8.0 adds Whisper support (code.ffmpeg.org)

Emailing a one-time code is worse than passwords (blog.danielh.cc)

Debian 13 “Trixie” (debian.org)

Steve Wozniak: Life to me was never about accomplishment, but about happiness (yro.slashdot.org)

Good system design (seangoedecke.com)

Vibechart (vibechart.net)

Why LLMs can't really build software (zed.dev)

VC-backed company just killed my EU trademark for a small OSS project

Claude Code is all you need (dwyer.co.za)

Gemma 3 270M: Compact model for hyper-efficient AI (developers.googleblog.com)

Nginx introduces native support for ACME protocol (blog.nginx.org)

Show HN: The current sky at your approximate location, as a CSS gradient (sky.dlazaro.ca)

AGENTS.md – Open format for guiding coding agents (agents.md)

Claude says “You're absolutely right!” about everything (github.com)

Copilot broke audit logs, but Microsoft won't tell customers (pistachioapp.com)

PYX: The next step in Python packaging (astral.sh)

Open hardware desktop 3D printing is dead? (josefprusa.com)

How I code with AI on a budget/free (wuu73.org)

Show HN: Building a web search engine from scratch with 3B neural embeddings (blog.wilsonl.in)

Obsidian Bases (help.obsidian.md)

Show HN: I built an app to block Shorts and Reels (scrollguard.app)

How we exploited CodeRabbit: From simple PR to RCE and write access on 1M repos (research.kudelskisecurity.com)

Try and (ygdp.yale.edu)

This website is for humans (localghost.dev)

I accidentally became PureGym’s unofficial Apple Wallet developer (drobinin.com)

GPT-5: Key characteristics, pricing and system card (simonwillison.net)

Wikimedia Foundation Challenges UK Online Safety Act Regulations (wikimediafoundation.org)

Web apps in a single, portable, self-updating, vanilla HTML file (hyperclay.com)

Show HN: I was curious about spherical helix, ended up making this visualization (visualrambling.space)

OpenFreeMap survived 100k requests per second (blog.hyperknot.com)

Jim Lovell, Apollo 13 commander, has died (nasa.gov)

OpenMower – An open source lawn mower (github.com)

Search all text in New York City (alltext.nyc)

Lazy-brush – smooth drawing with mouse or finger (lazybrush.dulnan.net)

Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?

What's the strongest AI model you can train on a laptop in five minutes? (seangoedecke.com)

Show HN: Whispering – Open-source, local-first dictation you can trust (github.com)

The future of large files in Git is Git (tylercipriani.com)

Historical Tech Tree (historicaltechtree.com)

Why are there so many rationalist cults? (asteriskmag.com)

Ask HN: How to build services for FOSS projects when ToS forbids scraping?

Comments (6)