Show HN: Paddler – open-source LLMOps platform for hosting AI in your own infra

1 mzagaj 0 8/15/2025, 12:43:50 PM github.com ↗
We recently did a major rework of Paddler (pretty much rewrote the llama-server from llama.cpp to make it distributed and scalable). It also supports live model swapping, custom chat templates, and other useful stuff.

Comments (0)

No comments yet