Ask HN: Why aren't AIs being used as app beta testers yet?
2amichail16/27/2025, 2:09:02 PM
For example, why don't beta testing services such as TestFlight have ChatGPT as a possible beta tester along with the human testers?
Comments (1)
duxup ยท 4m ago
I'm going to throw out my own ignorant theory.
AIs that I find useful are still just LLMs and LLMs power comes from having a massive amount of text to work with to string together word math and come up with something ok. That's a lot of data that comes together to get things ... kinda right... sometimes.
I don't think there's that data set for "use an app" yet.
We've seen from "AI plays games" efforts that there have been some pretty spectacular failures. It seems like "use app" is a different problem.
AIs that I find useful are still just LLMs and LLMs power comes from having a massive amount of text to work with to string together word math and come up with something ok. That's a lot of data that comes together to get things ... kinda right... sometimes.
I don't think there's that data set for "use an app" yet.
We've seen from "AI plays games" efforts that there have been some pretty spectacular failures. It seems like "use app" is a different problem.