Repo with backdated junk, filled with my system, right after I filed patent

It appears that some benchmarking tools provide average or percentile values but no information about statistical validity of the result. What did you observe or do in your career?

Comments (3)

Magma7404 · 5d ago

I haven't got a clue since I have never used any benchmark tool in my whole life. Could you tell us in which professional context you would use that kind of tool?

DenisM · 5d ago

Run a benchmark to compare performance of my product before and after making a change in code.

gus_massa · 5d ago

I run it 5 times and drop the two extremes. If the middle tree don't overlap, I'm probably fine. Not super precise, but good enough and easy.

Also, add a loop so the benchmark is like 1 second long, I'm old enough to be worried about anything smaller than 1/18 seconds.

Repo with backdated junk, filled with my system, right after I filed patent

Ask HN: What are you working on? (April 2025)

A affordable retrocomputer compatible with the C64

Ask HN: 3rd Week at FAANG and feeling imposter syndrome

Ask HN: Email Client

Ask HN: Parents of young kids: how do you teach that hitting is not acceptable?

Ask HN: I don't want to work in software anymore. Where do I go?

Ask HS: Career Advice for Someone Struggling

Payment processors shouldn't be able to charge through an expired card

Ask HN: Share your AI prompt that stumps every model

Ask HN: Memory-safe low level languages?

Ask HN: Are there any apps to track grocery prices in local stores?

Ask HN: What benchmarks are you using to judge AI models?

Ask HN: What Makes a Good Datasheet?

Ask HN: Valuable habit you've stuck with? What was key to making it stick?

Ask HN: CS degrees, do they matter again?

New Way to Fund Solo-Founders?

Ask HN: What are your favourite daily puzzle games?

Ask HN: When will Wayland eclipse X?

Ask HN: Do you have a blog you own or follow?

Ask HN: Alternatives to Deploys per Million Metric?

I want to help clear EU skies from US clouds

Ask HN: What Is the Hacker News for Medicine?

Ask HN: Sold my company, parents passed away – feeling lost. What now?

Kronotop: Horizontally scalable, distributed, transactional document database

Ask HN: Do you know niche job board for jobs that are NOT remote?

Ask HN: Resources for LeetCode Grinding?

Ask HN: What do you think about companies requiring AI use for code interviews?

Ask HN: Can vibe coding competitions be challenging and fair?

Ask HN: How to fix issue and find the origin of bug in codebase?

Last month 10k apps were built on our platform – here's what we learned

Has anyone else found Google's AI overview to be oddly error prone?

Ask HN: How do you get into systems programming

Ask HN: Is there a list of projects that will *not* adopt AI?

Ask HN: Did someone dig into the JFK files?

Ask HN: Is anyone else finding it impossible to use SMS in new apps?

Ask HN: My CEO wants to go hard on AI. What do I do?

Ask HN: Known ways app telemetry is abused?

Ask HN: How does ChatGPT Shopping work?

Ask HN: Are your code benchmarks statistically valid?

Comments (3)

Ask HN: Is there a list of projects that will not adopt AI?