According to Windows Central, Microsoft might be bringing AI capabilities to a handful of Windows 11 apps, including Photos, Snipping Tool, and Paint. “Some of this functionality will require dedicated hardware, such as an NPU (neural processing unit) or VPU (vision processing unit,) while others may not,” notes the report. From the report: For the Photos app, Microsoft is working on an AI functionality that would allow the app to identify objects or people in photos and enable the ability to cut out and paste those elements elsewhere. This is a functionality that iOS and Android have had for some time, so it’s no surprise to hear that Microsoft is also working to bring it to Windows.
Regarding the Snipping Tool, my sources say the company wants to incorporate OCR (optical character recognition) technology to enable Windows to identify text in screenshots for faster clipboard copying. Microsoft is also working on bringing OCR to the Camera app, allowing users to select text in a photo taken on the device.
Lastly, my sources say Microsoft has also been experimenting with bringing generative AI to the Windows 11 Paint app. Users could ask Paint to create a canvas based on criteria set out by the user, similar to how Bing Image Creator currently works. Sources say the Paint AI integration will be based on that same Bing technology.
