BaxBench: Can LLMs Generate Secure and Correct Back Ends?

Comments (1)

lucasluitjes · 17h ago

I've seen LLMs generate plenty of wildly insecure code, but the percentage of insecure solutions out of the solutions that are functional, is even higher than I expected.

Also, I'm curious how the average coder would fare on this benchmark.

Ask HN: Ideas to acquire "good taste" in programming?

Super Simple "Hallucination Traps" to detect interview cheaters

Ask HN: Freelancer? Seeking freelancer? (July 2025)

Ask HN: Who is hiring? (July 2025)

Ask HN: Who wants to be hired? (July 2025)

Ask HN: What Are You Working On? (June 2025)

Ask HN: What's the 2025 stack for a self-hosted photo library with local AI?

Ask HN: Why there is no demand for my SaaS when competition is killing it?

1KB JavaScript Demoscene Challenge Just Launched

Why Are SaaS Boilerplates Still This Expensive? So I Built My Own

Ask HN: Are AI Copilots Eroding Our Programming Skills?

Ask HN: Why privacy consent is NOT part of Browser setting?

Ask HN: How to Block Spam Mails?

Ask HN: Would limiting game size to 5–10 MB spur the creation of novel games?

Ask HN: How do I open up my side project to the world?

Ask HN: 80s electronics book club; anyone remember this illustrator?

Ask HN: How have you shared computers with your young child (~3 to 5)

Ask HN: Anyone is an "AI Engineer"? What does your job tasks include?

Ask HN: How did low contrast text become so pervasive?

Ask HN: Startup shutting down, should we open source?

Ask HN: Stock Android tablet free of bloatware?

LinkedIn Locked Me Out Until I Submit to Biometric ID Verification via Persona

It is not possible to install your own addon in Firefox without Moz's approval

Ask HN: Which Free Software or Open Source Project Needs Help?

Ask HN: Which AI Dev Assistant Are You Using and Why?

Ask HN: Is noprocrast still working for you?

Ask HN: Who's using AI to build non-AI products?

Harsh Working Environment in Japan

Border search safe TOTP authenticator app?

Tell HN: (dictionary|thesaurus).reference.com is now a spam site

Ask HN: How to find developers interested in open-source concepts?

Ask HN: Any updates on what is happening to io domains?

Ask HN: Better-auth or Nextauth or something else

Ask HN: Is the header CSS broken for you?

A reverse-delta backup strategy – obvious idea or bad idea?

Ask HN: Where do you host your Go apps

Ask HN: Why aren't AIs being used as app beta testers yet?

Ask HN: Why does my Node.js multiplayer game lag at 500 players with low CPU?

How did Soham Parekh get so many jobs?

Ask HN: Alternatives to Cloudflare for DNS?

BaxBench: Can LLMs Generate Secure and Correct Back Ends?

Comments (1)