Ask HN: Is anybody using llama.cpp for production?

11 HardikVala 1 7/24/2025, 4:18:13 AM
Considering the server version of llama.cpp for a commercial use case over bulkier options like vllm. But wondering if it's been battle-tested in production environments.

Comments (1)

thanhdongnguyen ยท 23h ago
No, i think llama.cpp only using testing model