Windows 11 users can anticipate a substantial upgrade to their operating system with the introduction of a new suite of AI features, primarily through the Copilot integration. The update’s centerpiece is Copilot Vision, designed to scan and interpret on-screen content, even extending to physical objects. Users will be able to query the AI for information on the scanned content, facilitating a more interactive computing experience.
The implementation of these features will be phased, ensuring a seamless experience for all users. Copilot Vision will be accessible within the Copilot app, which will enable analysis across multiple applications and websites. Users will also be able to use Copilot to perform tasks on their PCs, such as enhancing photos.
Recent Microsoft data reflects the growing adoption of generative AI for both work and personal projects. In response, the new features are designed to make existing PC actions easier and more intuitive.
Owners of Copilot Plus PCs, particularly those with Snapdragon processors, can access the AI agent directly via the Settings app. Furthermore, a ‘Click to Do’ preview function will enable users to perform actions like summarization, improve pronunciation, and much more. Other updates include an AI-based sticker creator in Paint, an object-selection tool to isolate and edit parts of images, an AI-powered lighting feature in Photos, and an AI-enhanced screenshot tool for capturing precise content.
The release of these features will coincide with the introduction of other updates in August, like a color picker in the Snipping Tool and a system designed to address unexpected restarts.