20 years of data engineering experience compiled into a toolkit

Comments (1)

articsputnik · 8h ago

I created the Data Engineering Toolkit as a resource I wish I had when I started as a data engineer. Based on my two decades in the field, it basically compiles the most essential (opinionated) tools and technologies.

The Data Engineering Toolkit contains 70+ Technologies & Tools, 10 Core Knowledge Areas (from Linux basics to Kubernetes mastery), and multiple programming languages + their ecosystems. It is open-source focused.

It's perfect for new data engineers, career switchers, or anyone building their Toolkit. I hope it is helpful. Let me know the one toolkit you'd add to replace an existing one.

Ask HN: X account hacked again – no email when attacker changed the email? How?

Ask HN: What do you think about app native vs. portable look-and-feel?

Stripe alternative for India for payment processing

Ask HN: What is the equivalent to Win32 on Linux

Free Virtual CS Classes and Tutoring

Ask HN: What newspaper are you paying for these days?

Ask HN: How can we keep (part of) the web human?

Ask HN: Advice about transitioning to remote role?

Ask HN: Tips for hiring? It has been difficult

Ask HN: AI agents and the future of UI/UX design. Opinions?

Ask HN: Is AI 'context switching' exhausting?

Ask HN: Data engineers, What suck when working on exploratory data-related task?

BMW ConnectedDrive lets me control my returned rental car (Sixt)

Ask HN: Is cloud infra making us forget the local file system and memory?

Is there a way to run an LLM as a better local search engine?

I would enjoy an HN chat. Is there one?

Ask HN: Tech people who are self employed. How do you do it?

Ask HN: What cool skill or project interests you, but feels out of reach?

Ask HN: For a team experienced with LLMs – Any concrete reason to use LangGraph?

Khalifa University and Knowledge E to Organise AI Futures Summit in Abu Dhabi

Ask HN: What happens post ESOPs vesting period is over at a startup?

Tell HN: Help restore the tax deduction for software dev in the US (Section 174)

Ask HN: How do I give back to people helped me when I was young and had nothing?

Is GitHub Down?

Ask HN: What is your fallback job if AI takes away your career?

Ask HN: How to learn CUDA to professional level

Ask HN: In a guide to inner work for founders and engs, what topics to cover?

"A Crowd-Driven Platform That Lets People Vote

Ask HN: How to Deal with a Bad Manager?

Ask HN: How should I spend 10 weeks delving into AI?

Ask HN: Is there an AI bot that works like a literate programming build step

20 years of data engineering experience compiled into a toolkit

Comments (1)