Ask HN: Can we use tools in batch prediction with GenAI SDK?
1 roughrider67 0 5/30/2025, 3:39:14 PM
I'm exploring the use of Google's Generative AI SDK (genai) and wondering about its compatibility with the tools parameter when running batch predictions.
So far, I can use tools (like Google Search) in single prompt calls, but when running batch prediction, I’m not sure where and how the tools config should be passed.
I couldn’t find clear documentation for this. Has anyone been able to successfully use tools with batch prediction jobs via the GenAI SDK?
Any references, example payloads, or code snippets would be appreciated!
No comments yet