The Fastest Way to Insert Data to Postgres

Comments (1)

dancrystalbeach · 1h ago

I was recently working on a PySpark pipeline in which I was using the JDBC option to write about 22 million records from a Spark DataFrame into a Postgres RDS database. Hey, why not use the built in method provided by Spark, how bad could it be? I mean it’s not like the creators and maintainers of Spark aren’t probably our version of rocket engineers.

Quirks of Common Lisp Types (fosskers.ca)

Snapcast – Synchronous multi-room audio player (github.com)

Ask HN: Should single presidential signature control global trade policy?

Music to Break Models By (matthodges.com)

Cash Transfers Work (theatlantic.com)

Show HN: I made a game called "Freyren's Funeral Procession." (github.com)

Hurricane category 6 could be introduced under new storm severity scale (livescience.com)

Online Governance Surfaces and Attention Economies (osf.io)

BirdNET-Pi (birdweather.com)

Show HN: StegMark – Hide bookmarks inside images (local-first web app) (stegmark.dev)

HongMeng (HarmonyOS) Kernel (en.wikipedia.org)

Are tennis players the fittest athletes in the world? (cnn.com)

Trump is giving Russian cyber ops a free pass and putting democracy on the line (thebureauinvestigates.com)

Lisp interpreter with GC in <750 lines of Odin (and <500 lines of C) (github.com)

The Reason American Socialists Don't Win (theatlantic.com)

Microsoft Software Engineer Dies on Silicon Valley Campus at 35 (bloomberg.com)

Detection of an Anti-Solar Tail for 3I/Atlas (avi-loeb.medium.com)

Starship's heat shield appears to have performed quite well in test (arstechnica.com)

Gokop – Cooperative Ride-Hailing Platform (gokop.org)

Reform or Revolution? [video] (youtube.com)

Deleuzoguattarianism (philosophyball.miraheze.org)

An LLM Traded a Toe for a Foot (cto.berlin)

Intel amends CHIPS Act deal with US Commerce Department, gets $5.7B early (reuters.com)

AI Agents and Painted Facades (fulcrumresearch.ai)

Medicare Will Start Using AI to Help Make Coverage Decisions Next Year (newsweek.com)

Enrollment at trade schools is expected to grow 6.6% a year (finance.yahoo.com)

Why technical writers should learn to code and build things (sarahsanders.dev)

How Turkmenistan Censors Internet to Sell VPNs (blog.torproject.org)

New Huawei 96GB GPU (e.huawei.com)

Show HN: Search private note by AI semantic search (conniepad.com)

AI music takes on a life of its own [video] (youtube.com)

The Fastest Way to Insert Data to Postgres (confessionsofadataguy.com)

Inside the World of "The Great British Bake Off" (newyorker.com)

Affiliates Flock to 'Soulless' Scam Gambling Machine (krebsonsecurity.com)

Bootstrapping a Forth for Art (tia.mat.br)

PatchCore: Build modular synthesizers and audio processing apps with Kotlin MP (github.com)

Show HN: New personal website, have a look and tell more improvements (mandar.cloud)

The Art of Transformer Programming (2023) (yanivle.github.io)

Man declares country in unclaimed pocket of land between Serbia and Croatia (nbcnews.com)

Humble beginning,daily litter picked up during walkd (100daysoflitter.blogspot.com)

Verizon users hit with nationwide outage, including in Bay Area (sfchronicle.com)

NetSurf on ReMarkable 2 (akselmo.dev)

Ask HN: As parents, what is your "AI policy" for your children?

Foreigners and Goals in English Football (blog.engora.com)

Enterprise Migrations, Microfront Ends and AI Adoption with DOM from Vercel [video] (youtube.com)

Screening methods reveal high-risk diabetes patterns across family units (medicalxpress.com)

Thawing permafrost raised carbon dioxide levels after the last Ice Age (phys.org)

Reasoning in LLMs: A Taxonomy (lesswrong.com)

Magic Lantern Is Back (magiclantern.fm)

In my second year of Organizing AI Summit. So far 400 Sign ups (vanaisummit.com)

The Fastest Way to Insert Data to Postgres

Comments (1)