Aug 24, 2023 13:13:00

Microsoft may add AI features to Windows 11 paint and photos

Microsoft is planning to strengthen Windows, its own OS, with artificial intelligence (AI), and

Windows Central reported that it is conducting experiments to add AI functions to Windows genuine applications Paint and Photos .

Microsoft might bring AI to apps like Paint and Photos | Windows Central
https://www.windowscentral.com/software-apps/windows-11/microsoft-may-bring-ai-capabilities-to-apps-like-paint-and-photos-on-windows-11

Report: Microsoft is “experimenting” with ways to work AI into bedrock Windows | Ars Technica
https://arstechnica.com/gadgets/2023/08/windows-utilities-like-paint-and-snipping-tool-could-get-an-ai-infusion-soon/

As information obtained from its own sources, Windows Central reported that Microsoft is developing to add AI functions to Microsoft genuine apps that are pre-installed in Windows 11, such as Photos, Paint, and Snipping Tool . . Some of the AI functions Microsoft is developing require dedicated hardware such as NPUs and VPUs , while others do not.

◆ AI function for photos
Microsoft seems to be working on an AI feature that will allow the app to identify objects and people in photos, cut out those elements and paste them elsewhere. ``It wouldn't be surprising to hear that Microsoft would add this kind of functionality to Windows,'' Windows Central reported, as features similar to this have been on iOS and Android for some time.

◆Snipping Tool with OCR
The Snipping Tool seems to be aiming to speed up the ability of Windows to identify text in screenshots and output text to the clipboard by incorporating OCR (optical character recognition) technology. Microsoft is also working to bring OCR functionality to the Camera app as well, allowing users to select text in photos taken with the device, according to Windows Central sources.

The screenshot below is from an internal build of the camera app with OCR capabilities.

◆ AI function for painting
In addition, Microsoft is also experimenting with introducing generation AI into the Windows 11 paint application. The Generate AI feature for Paint will generate output based on user-defined criteria, similar to how Microsoft's

Bing Image Creator works. According to sources, the AI function introduced in Paint will be based on the technology of Bing Image Creator.

Screenshot of an internal mockup of AI functions for paint

It's unclear when Microsoft will offer these AI features, but the source said, ``These ideas are still in the experimental stage, and Microsoft is still figuring out how to bring other AI features to Windows. It is under consideration,' he said. In addition, Microsoft plans to hold an event on September 21, 2023, and is expected to announce new Surface devices and AI functions.