Copilot Computer Use

Computer use is a new public preview feature in GitHub Copilot CLI and the GitHub Copilot app for macOS and Windows, built by GitHub. It lets Copilot read on-screen content and click, type, scroll, and drag across desktop applications, including legacy GUI-only software with no API or CLI. Users approve access before Copilot controls an app, and macOS walks through the needed Accessibility and Screen Recording permissions.