Microsoft Copilot in Windows 11 Gains Voice, Vision, and the Power to Act
Microsoft has announced a significant update to Windows 11, introducing advanced AI capabilities through its Copilot feature. This update brings voice and visual interactions, allowing the AI assistant to perform tasks on behalf of users, even on non-Copilot Plus PCs. These enhancements mark a step toward integrating AI more deeply into the operating system.
🗣️ Copilot Voice: Hands-Free Interaction
Windows 11 users can now activate Copilot using the wake phrase “Hey, Copilot,” a feature previously limited to Copilot Plus PCs. This voice interaction enables users to:
-
Dictate text and take notes
-
Transcribe audio
-
Conduct searches
-
Utilize accessibility features like Voice Access and Voice Typing
Commands can be initiated with “Hey, Copilot” and ended with “Goodbye,” the ‘X’ button, or automatically after inactivity. A chime confirms both the start and end of a session.
👁️ Copilot Vision: Visual Assistance Across Apps
Copilot Vision is now available to all Windows 11 users, enabling the assistant to analyze what's displayed on the screen. Key features include:
-
Full desktop and app sharing: Copilot can analyze content, provide insights, answer questions, and coach users through tasks aloud.
-
Highlights: Users can ask Copilot “show me how” for a specific task, and it will highlight exactly where to click within the app.
-
Full app context in Microsoft Office: Copilot can review entire documents or presentations, providing a comprehensive overview.
-
Text-in, Text-out (coming soon for Windows Insiders): Vision will support text-based interaction, allowing users to converse via chat instead of voice.
🤖 Agentic AI: Copilot Takes Action
Microsoft is previewing agentic capabilities through Copilot Labs for Windows Insiders. These allow Copilot to take actions on local files and applications, such as organizing documents, extracting information from PDFs, or performing repetitive tasks. Users can monitor the process, intervene at any time, or let the assistant handle tasks in the background.
🔗 Expanded Integration
Copilot's integration is expanding to include services like OneDrive, Outlook, Google Drive, Gmail, and Calendar. Users can query connected content using natural language, streamlining workflows across platforms.
Source: For more details, visit Business Standard's article on Microsoft Copilot.
Disclaimer: The information provided is for informational purposes only and should not be construed as financial advice. Always conduct your own research or consult a financial advisor before making investment decisions.
Copyright Notice: This content is based on publicly available information and is intended for educational purposes. All trademarks and copyrights are the property of their respective owners.