ScreenAI: A Vision-Language Model for UI and Infographics Understanding
Paper
• 2402.04615 • Published
• 44
Screen Agents
Papers related to web agents, screen agents, autonomous agents that can mimic human users in computer and/or web use
-
-
WebArena: A Realistic Web Environment for Building Autonomous Agents
Paper • 2307.13854 • Published • 27 -
Mind2Web: Towards a Generalist Agent for the Web
Paper • 2306.06070 • Published • 21 -
Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation
Paper • 2410.13232 • Published • 44 -
Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale
Paper • 2409.08264 • Published • 48 -
Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs
Paper • 2404.05719 • Published • 83 -
Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents
Paper • 2408.07199 • Published • 22 -
OmniParser for Pure Vision Based GUI Agent
Paper • 2408.00203 • Published • 24 -
OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
Paper • 2404.07972 • Published • 51 -
A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis
Paper • 2307.12856 • Published • 37 -
Agent Workflow Memory
Paper • 2409.07429 • Published • 32 -
Agent S: An Open Agentic Framework that Uses Computers Like a Human
Paper • 2410.08164 • Published • 26 -
SAM 2: Segment Anything in Images and Videos
Paper • 2408.00714 • Published • 120