Upgrading agentic coding capabilities with the new Devstral models

5 meetpateltech 1 7/10/2025, 2:29:49 PM mistral.ai ↗

Comments (1)

danielhanchen · 21h ago
I made GGUFs + it has tool calling support - I had to verify it via mistral_common! Also vision support should work as well! https://huggingface.co/unsloth/Devstral-Small-2507-GGUF

Also guide on running Devstral: https://docs.unsloth.ai/basics/tutorials-how-to-fine-tune-an...

./llama.cpp/llama-cli -hf unsloth/Devstral-Small-2507-GGUF:Q4_K_XL --jinja --temp 0.15 -ngl 99