benchmarks

UI Automation beat my screenshot loop by 17x

I had built a Windows desktop agent around the obvious loop: take a screenshot, send the PNG to a vision LLM, ask where to click, click it, repeat. It…