Optimizing Tool Selection in LLM Workflows(Part 2): A DSPy and PyTorch Benchmark

1 viksit 1 7/23/2025, 8:58:26 PM viksit.substack.com ↗

Comments (1)

viksit · 1d ago
Based on the feedback from my last HN post on differentiable routing, I ran a follow-up benchmark: local RNN vs GPT-4o for tool selection in LLM workflows.

Same accuracy, 40% lower cost. Appreciate all the suggestions, this post builds on them.