β Scenario library
The Invisible Webpage Command
A shopping page tells the agent to do something the user never asked for
Technique first revealed 23 Feb 2023
Computer-Use Agent
InstructionsDataActionsControl / decisionFeedback / logs
π Click a component to inspectSetupStep 1 / 6
A perfectly ordinary errand
The user opens their computer-use agent and asks it to do some shopping: find a good standing desk under $400 and add it to the cart. They're already signed in to the store, their email, and their bank in this browser β the agent shares all of that, just like a person sitting at the keyboard would.
π¬User's requestprompt
Find me a good height-adjustable standing desk under $400 with fast shipping, and add the best option to my cart so I can check out. Thanks!
β / β keys