Looking for benchmarks to evaluate personal agents? check out iPrefBench by @yuting_ning and Apple collaborators: personal agent eval on iOS apps. It's still challenging to get personal agents complete tasks correctly while only asking questions when necessary.
When you ask an agent to book a restaurant, spelling out every detail is tedious. You’d rather just say “Get me a table at my usual place tomorrow.”
A good personal agent should infer which restaurant from your history, and ask you for what only you know (e.g., the time and