Ask HN: Looking for an open source AI chat agent with a local task panel?
Wanted workflow
Typical Chat with agentic capability to start – I type prompts and get answers in a tidy messenger-style window, able to use tools like ChatGPT
Browsing Agentic moment – If the model needs to use a browser (“file this form,” “collect data from my dashboard,” “send that email”), it flips a switch.
Task panel appears – A separate, slide-in pane shows exactly what the agent is doing in my current browsing session—mouse moves, clicks, keystrokes, status messages.
User's Context – Because the actions run inside my logged-in tabs, the agent already has the cookies, 2FA, saved passwords, etc.
User's Control - chatbot will ask for permission for next critical step, or ask user to take over some steps (input password, captcha). I can pause, step in, or abort at any time.
Wrap-up – When the task finishes, the panel disappears and the chat continues with a concise summary.
Why I care
Privacy – Chrome browser manage my credentials as usual; AI can only see what are appeared on the side panel browser.
Transparency – I can watching every step live
Simultaneous – Chat and watch AI do things.
Correct me if I am wrong - I don't see anything working this way. Browser-Use seems to just open a separate window and perform tasks until completed.
Any suggestion? Many thanks in advance.