I built a voice-controlled map where an AI can see exactly where you're looking and describe those locations with the OpenAI Realtime API.
Its a very simple setup where, as you pan and zoom around the map, the AI receives your current coordinates, zoom level, and visible area. Now I can add tools like get the internet speed or weather for that area and I will have a Voice Controlled Map.
Its a very simple setup where, as you pan and zoom around the map, the AI receives your current coordinates, zoom level, and visible area. Now I can add tools like get the internet speed or weather for that area and I will have a Voice Controlled Map.