Llmnop, a tiny Rust rewrite of LLMPerf

Comments (1)

jpreagan · 5h ago

I've been using LLMPerf for a while to evaluate the performance of our inference servers (vLLM, SGLang, etc.).

It works great, but I was running into memory constraints while testing large number of concurrent users on some servers, and didn't always find the specific Python version requirements convenient.

So, I rewrote the benchmark aspect of this tool in Rust to get an easy single-line install.

I hope its useful to others as well, and would love to hear feedback if you have any suggestions for improvement.

Ask HN: What is a physiically disabled person to do in this job market?

Is Firebase Console Down

Cloudflare's 1.1.1.1 DNS server seems to be down

Tell HN: 1.1.1.1 Appears to Be Down

Cloudflare DNS Down in UK/EU

The German Works Council has blocked Amazon's performance reviews

Telnyx launches automatic noise suppression for AI Voice Agents

Ask HN: How much of OpenAI code is written by AI?

Ask HN: How did Soham Parekh get so many jobs?

Ask HN: How to find mentors while working remote?

Dyan – A Visual REST API Builder You Can Self-Host

Tell HN: Lobste.rs blocking the Brave browser

Ask HN: How are you productively using Claude code?

Ask HN: Battery life for graphical Linux VMs (or Asahi) on Apple Silicon laptops

Is making the rust compiler slow a billion dollar mistake?

Ask HN: How do you get first 10 customers?

Open-source STM32 autopilot for long-range fixed-wing UAVs (SmartNavX)

Ask HN: Could the C64 startup screen have encouraged more users to learn BASIC?

Ramanujan-Computing: Distributed Computing with Idle Smart Devices: Open-Source

Ask HN: Are there any tools for tracking GPU prices over time?

Tell HN: I Lost Joy of Programming

Attended Windsurf's Build Night 18 hours before founders joined Google DeepMind

Ask HN: Looking for a directory of PS1 command prompts. Like awesome lists

Ask HN: Has anybody gotten a Node.js MCP server to work with HTTP?

Co-founder exiting after pivot – what's a fair exit package?

Ask HN: Worth leaving position over push to adopt vibe coding?

Llmnop, a tiny Rust rewrite of LLMPerf

Comments (1)