The Fastest Way to Insert Data to Postgres

Comments (1)

dancrystalbeach · 2d ago

I was recently working on a PySpark pipeline in which I was using the JDBC option to write about 22 million records from a Spark DataFrame into a Postgres RDS database. Hey, why not use the built in method provided by Spark, how bad could it be? I mean it’s not like the creators and maintainers of Spark aren’t probably our version of rocket engineers.

Ask HN: Who is hiring? (September 2025)

Ask HN: Who wants to be hired? (September 2025)

Understanding Android's Boot Process

Ask HN: Best foundation model for CLM fine-tuning?

From $4B to Forgotten: The Rise and Fall of Clubhouse (2024)

Ask HN: Tools for Crossword Puzzle Generation?

Ask HN: The government of my country blocked VPN access. What should I use?

Change Tracker: Monitor+revert file edits from Claude/AI agents(in-memory VCS)

Ask HN: Do custom ROMs exist for electric cars, for example Teslas?

Ask HN: How do you fight YouTube addiction and procrastination? I'm struggling

Tell HN: Use "-f**k" to kill Google AI Overview

Ask HN: What to learn for math for modeling?

Ask HN: Why hasn't x86 caught up with Apple M series?

Tell HN: My advice after I applied to 450 positions before getting hired

Ask HN: Did Developers Undermine Their Own Profession?

Ask HN: Which Open Source License to Choose for a Python Language Server

Hacker News Alternativies

Ask HN: How much are you guys paying for AI coding tools monthly?

JDeploy 5.0: Deploy Java Desktop Apps to ARM64 Windows and Linux with One Click

FUGC: Understand the GC in Fil-C

Ask HN: How can I recover and run my old mobile game from the 2010s?

Looking for Info on Aerosol Pathogen Detection

Ask HN: Anyone using their own custom text editor?

Ask HN: Any Android Engineers Here?

Ask HN: Best self-hosted wiki solution in 2025? Mediawiki or something else?

Ask HN: What do you think about GFW?

Ask HN: Best codebases to study to learn software design?

Ask HN: Should we stop worrying that AI will replace developer jobs?

Ask HN: What to Do with Old iPads?

Ask HN: What options do I have for self-hosted end to end encrypted group chat?

Ask HN: What to do when you suspect your interview is with a state operative?

Ask HN: If burnout tells you that you are in the wrong job/career, why avoid it?

The Fastest Way to Insert Data to Postgres

Comments (1)