Show HN: ETL System to Extract Product Data from Websites and Upload to Shopify

1 gustavofortti 0 6/14/2025, 11:19:18 PM github.com ↗

About a year ago, I built an ETL system to extract and process product data from e-commerce websites, mainly supplements. It maps product structures, automates data collection, cleans and classifies the information, and uploads it directly to Shopify through API integration.

The system uses Python and Selenium for extraction, with transformation steps focused on cleaning, enrichment, and product classification. It was designed to be modular and easy to extend to new websites.

I paused development but I'm considering reviving it. Feedback or suggestions are welcome.

Repo: https://github.com/GustavoFortti/products-crawler

Infinite Grid of Resistors (mathpages.com)

I have reimplemented Stable Diffusion 3.5 from scratch in pure PyTorch (github.com)

Inside the Apollo "8-Ball" FDAI (Flight Director / Attitude Indicator) (righto.com)

Fixing the mechanics of my bullet chess (jacobbrazeal.wordpress.com)

Solar Orbiter gets world-first views of the Sun's poles (esa.int)

Seven replies to the viral Apple reasoning paper and why they fall short (garymarcus.substack.com)

Clinical knowledge in LLMs does not translate to human interactions (arxiv.org)

Chicken Eyeglasses (en.wikipedia.org)

We investigated Amsterdam's attempt to build a 'fair' fraud detection model (lighthousereports.com)

Unsupervised Elicitation of Language Models (arxiv.org)

Debunking HDR [video] (yedlin.net)

Waymo rides cost more than Uber or Lyft and people are paying anyway (techcrunch.com)

Last fifty years of integer linear programming: Recent practical advances (inria.hal.science)

Have a damaged painting? Restore it in just hours with an AI-generated "mask" (news.mit.edu)

How the Final Cartridge III Freezer Works (pagetable.com)

The Many Sides of Erik Satie (thereader.mitpress.mit.edu)

SIMD-friendly algorithms for substring searching (2018) (0x80.pl)

Peano arithmetic is enough, because Peano arithmetic encodes computation (math.stackexchange.com)

Endometriosis is an interesting disease (owlposting.com)

TimeGuessr (timeguessr.com)

SSHTron: A multiplayer lightcycle game that runs through SSH (github.com)

Slowing the flow of core-dump-related CVEs (lwn.net)

Peeling the Covers Off Germany's Exascale "Jupiter" Supercomputer (nextplatform.com)

Using `make` to compile C programs (jvns.ca)

Self-Adapting Language Models (arxiv.org)

Filedb: Disk-based key-value store inspired by Bitcask (github.com)

Student discovers fungus predicted by Albert Hoffman (wvutoday.wvu.edu)

Implementing Logic Programming (btmc.substack.com)

Solidroad (YC W25) Is Hiring (solidroad.com)

“Language and Image Minus Cognition”: An Interview with Leif Weatherby (jhiblog.org)

The international standard for identifying postal items (akpain.net)

The Army’s Newest Recruits: Tech Execs From Meta, OpenAI and More (wsj.com)

What is systems programming, really? (2018) (willcrichton.net)

If the moon were only 1 pixel: A tediously accurate solar system model (2014) (joshworth.com)

Frequent reauth doesn't make you more secure (tailscale.com)

Whatever Happened to Sandboxfs? (blogsystem5.substack.com)

Writing a Truth Oracle in Lisp (lambda-cove.net)

I convinced HP's board to buy Palm and watched them kill it (philmckinney.substack.com)

Me an' Algernon – grappling with (temporary) cognitive decline (tidyfirst.substack.com)

Jemalloc Postmortem (jasone.github.io)

100 years of Zermelo's axiom of choice: What was the problem with it? (2006) (research.mietek.io)

Apple's Liquid Glass is prep work for AR interfaces, not just a design refresh (omc345.substack.com)

When random people give money to random other people (2017) (quomodocumque.wordpress.com)

How I program with agents (crawshaw.io)

GPU-accelerated Llama3.java inference in pure Java using TornadoVM (github.com)

Using computers more freely and safely (2023) (akkartik.name)

OxCaml - a set of extensions to the OCaml programming language. (oxcaml.org)

Cray versus Raspberry Pi (aardvark.co.nz)

High-speed fluorescence light field tomography of whole freely moving organisms (opg.optica.org)

Strace Tips for Better Debugging (rrampage.github.io)

Show HN: ETL System to Extract Product Data from Websites and Upload to Shopify

Comments (0)