[tomek@vz]

Microsoft is reshaping Windows around AI, introducing capabilities that let users control their computers through voice and allow Copilot to take autonomous actions on their behalf. The company is now rolling out a "Hey, Copilot!" wake word on Windows 11 machines, positioning voice as a "third input mechanism" to supplement the keyboard and mouse.

Copilot Vision, which streams what a user sees on their screen, is rolling out globally, enabling the system to troubleshoot PC problems, help with app usage, and provide task guidance. Microsoft is simultaneously testing Copilot Actions through a limited preview, allowing the AI to take autonomous actions on local machines like editing folders of photos. The company is also integrating Copilot into the Windows taskbar and launching advertisements promoting these features, coinciding with Windows 10's end-of-support earlier this week.

Yusuf Mehdi, Microsoft's consumer chief marketing officer, said the company wants users upgrading to Windows 11 to "experience what it means to have a PC that's not just a tool, but a true partner." Microsoft attempted to popularize Cortana, a voice assistant, on Windows 10 a decade ago. Last year, the company released Recall, a feature that automatically captured screenshots, drawing criticism over privacy.

Microsoft’s Copilot Actions is what happens when Microsoft begins rethinking the future of Windows and how AI is integrated into the operating system. Imagine agentic AI being turned loose inside your PC and performing tasks without your supervision. It’s a big swing that’s conceptually almost as unsettling as Windows Recall.
What happens when you ask AI to start mining and collating and adjusting your files, giving AI agents essentially the same user accounts you might give to members of your family? Microsoft is giving you tools to monitor this voluntary service, but… whew. It’s a monumental shift.

> pcworld