Show HN: We beat Google DeepMind but got killed by Zhipu AI
So we built an agentic framework that taps, swipes, types… and somehow it’s outperforming giant labs like Google DeepMind and Microsoft Research on the AndroidWorld benchmark.
We were thrilled about our results until a massive lab (Zhipu AI) released its results last week to take the top spot.
They’re slightly ahead, but they have an army of 50+ phds and I don't see how a team like us can compete with them, that does not seem realistic... except that they're closed source.
And we decided to open-source everything. That way, even as a small team, we can make our work count.
We’re currently building our own custom mobile RL gyms, training environments made to push this agent further and get closer to 100% on the benchmark.
What do you think can make a small team like us compete against such giants?
Repo’s here if you want to check it out or contribute: https://github.com/minitap-ai/mobile-use
Our discord: https://discord.gg/6nSqmQ9pQs
No comments yet