{"id":308322,"date":"2025-10-16T15:06:19","date_gmt":"2025-10-16T15:06:19","guid":{"rendered":"https:\/\/www.europesays.com\/us\/308322\/"},"modified":"2025-10-16T15:06:19","modified_gmt":"2025-10-16T15:06:19","slug":"microsoft-wants-you-to-talk-to-your-pc-and-let-ai-control-it","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/us\/308322\/","title":{"rendered":"Microsoft wants you to talk to your PC and let AI control it"},"content":{"rendered":"

As Microsoft bids farewell to Windows 10<\/a> and gets ready to mark the 40-year milestone of its operating system, it\u2019s looking forward to what\u2019s next for Windows. Microsoft might not be ready to announce Windows 12 just yet, but it clearly wants to turn every Windows 11 PC into an AI PC that Copilot controls and users talk to.<\/p>\n

\u201cWe think we\u2019re on the cusp of the next evolution, where AI happens not just in that chatbot and gets naturally integrated into the hundreds of millions of experiences that people use every day,\u201d says Yusuf Mehdi, executive vice president and consumer chief marketing officer at Microsoft, in a briefing with The Verge. \u201cThe vision that we have is: let\u2019s rewrite the entire operating system around AI, and build essentially what becomes truly the AI PC.\u201d<\/p>\n

Microsoft is launching a set of capabilities in Windows today that will start to weave AI features into regular Windows 11 PCs, instead of consumers having to buy a special Copilot Plus PC. The biggest change is that Microsoft thinks people will want to talk to their computers and have Copilot take actions on their behalf.<\/p>\n

\u201cYou should be able to talk to your PC, have it understand you, and then be able to have magic happen from that,\u201d says Mehdi. \u201cWith your permission, we want people to be able to share with their AI on Windows what they\u2019re doing and what they\u2019re seeing. The PC should be able to act on your behalf.\u201d<\/p>\n

Microsoft is leaning on Copilot\u2019s Voice and Vision capabilities to try and make this reality, thanks to a new \u201cHey, Copilot!\u201d wake word that is now rolling out on Windows 11 PCs. \u201cIn our minds, voice will now become the third input mechanism to use with your PC,\u201d says Mehdi. \u201cIt doesn\u2019t replace the keyboard and mouse necessarily, but it\u2019s an added thing and it will be pretty profound and a new way to do it.\u201d<\/p>\n

We\u2019ve been here many times before. Microsoft tried to convince people to use Cortana on Windows 10 PCs a decade ago, and has added various voice features to Windows for accessibility over the past 40 years. Microsoft is now convinced that AI will somehow spark a change in behavior and convince people that talking to a PC isn\u2019t weird.<\/p>\n

\u201cAll the data that we see is when people use voice, they love it,\u201d says Mehdi. Some of that data is the billions of minutes that people spend talking in Microsoft Teams meetings. \u201cThey\u2019re talking through their computers today, and I think this change to \u2018talk with and talk to\u2019 will come to reality and we\u2019ll see this thing really take off,\u201d says Mehdi.<\/p>\n

\"Copilot<\/a><\/p>\n

Copilot is coming to the Windows 11 taskbar. Image: Microsoft<\/p>\n

I\u2019m not convinced that most people want to talk to their computer, even if it\u2019s great for accessibility and scenarios like getting help with apps. \u201cDoctors are taking transcriptions while they\u2019re performing examinations, people use it for searching, and our work with the accessibility community has taught us a lot about how to make voice access and voice typing really valuable,\u201d says Mehdi.<\/p>\n

For AI to control a PC and take actions on behalf of the user, it must first be granted access to see what\u2019s on the screen. Microsoft has been testing Copilot Vision in recent months, a feature that can scan everything on your screen<\/a> and coach you through using apps or answer questions about photos and documents.<\/p>\n

Copilot Vision is now rolling out worldwide in all markets where Copilot is available, and it will let you get help using apps, troubleshoot PC problems, learn new tasks, and even get step-by-step guidance in games. Unlike the Recall feature that automatically takes a snapshot of your PC, Copilot Vision is an opt-in feature where you essentially stream what you\u2019re seeing on your screen much like you would in a Teams call.<\/p>\n

The next step beyond Copilot Vision is Copilot Actions, allowing Microsoft\u2019s AI assistant to take actions on a local PC, like making edits to a folder full of photos. Microsoft is starting to test these actions on Windows PCs through a preview program, limited to a narrow set of use cases while Microsoft optimizes the AI model.<\/p>\n

\u201cIn the beginning you might see the agent make some mistakes, or encounter some challenges when trying to use some really complex applications,\u201d explains Navjot Virk, corporate vice president of Windows Experiences. An AI agent making mistakes using a computer doesn\u2019t fill me with confidence, which is probably why Microsoft is limiting this to Copilot Labs for now. \u201cWe\u2019re absolutely committed to learning from how people use it, and we want to continue to improve the experience to make it more capable and streamlined over time,\u201d says Virk.<\/p>\n

Copilot Actions launches in a separate Windows desktop \u201csecure and contained environment,\u201d and uses an AI agent to complete the job you\u2019ve asked it to do. You can have it running in the background while you go ahead and do something else, and it will list all the steps it\u2019s taking and you can sit and watch it complete them.<\/p>\n

Microsoft is also integrating Copilot into the Windows taskbar<\/a>, with one-click access to these new Copilot Vision and Voice features. It also has a new integrated search experience to make it faster to find local files, apps, and settings.<\/p>\n

After the Recall fiasco last year, I think Microsoft will have a hard time convincing people to trust its Copilot Vision and Copilot Actions features, and an equally challenging time getting people to talk to their PCs. That\u2019s not stopping Microsoft from trying, though. The company is planning to run television ads that highlight these new AI features in Windows 11, with the tagline \u201cmeet the computer you can talk to.\u201d<\/p>\n

The ads coincide with the end-of-support phase for Windows 10 earlier this week, and Microsoft is once again promoting Windows 11 PCs that consumers can upgrade to. \u201cWe want every person making the move to experience what it means to have a PC that\u2019s not just a tool, but a true partner,\u201d says Mehdi.<\/p>\n

Follow topics and authors<\/strong> from this story to see more like this in your personalized homepage feed and to receive email updates.<\/p>\n