arxivcs.AI2026-07-16
Tactile: Giving Computer-Using Agents Hands and Feet
Yong Liu, Zhenyi Zhong, Zhanpeng Shi
Computer-use agents are becoming capable software operators, but their interface to desktop applications is still often a brittle motor layer: they look at screenshots, predict coordinates, click, and hope that the visible state changed as intended. This collapses target groundin…