Microsoft announces a large number of AI features, including 'a function to talk to Copilot with voice,' 'a function to upscale images by 8 times,' and 'a function to automatically recognize the content being operated on the PC and suggest the next operation'
On Tuesday, October 1, 2024, Microsoft announced a large number of AI features for 'Copilot+ PC', 'Copilot', and 'Bing'. The announced features include 'the ability to upscale images by 8 times' and 'the ability to have a voice conversation with Copilot'.
An AI companion for everyone - The Official Microsoft Blog
New experiences coming to Copilot+ PCs and Windows 11 | Windows Experience Blog
https://blogs.windows.com/windowsexperience/2024/10/01/new-experiences-coming-to-copilot-pcs-and-windows-11/
The next step in Bing generative search | Bing Search Blog
https://blogs.bing.com/search/October-2024/The-next-step-in-Bing-generative-search
◆ New features for Copilot+ PC
Copilot+ PC is a PC equipped with a high-performance AI processing chip (NPU) that can perform AI processing such as ' generating illustrations from doodles ' locally. Microsoft has recently announced several new features for Copilot+ PC. Each feature is scheduled to be rolled out in stages from November 2024.
・Recall (Preview)
Recall is a feature that takes a 'screen snapshot' every 5 seconds and analyzes the text and images contained on the screen to make them searchable later. The release of Recall had been delayed due to security and privacy concerns, but a preview version will be released in November 2024 after various measures have been implemented.
Details of the security and privacy measures taken for Recall are summarized in the following article.
・Click to Do (Preview)
Click to Do is a feature that recognizes text and images displayed on the screen and suggests the next action to be taken. The suggested actions range from 'Image search with Bing,' 'Blur background in photo,' 'Remove object in photo,' 'Summarize text,' 'Open target in text editor,' 'Detect email address and send email,' 'Detect URL and open in browser,' and more. For example, in the following example, it recognizes an image and suggests actions such as 'Image search with Bing,' 'Blur background in photo,' 'Remove object in photo,' and 'Remove background with Paint.'
- Improved search function
AI has been incorporated into the local search function of Windows, allowing you to search by content instead of file name. For example, if you search for the phrase 'barbecue party', you can get search results such as 'barbecue party photos'. The AI search function will first be installed in Explorer, and will be available in the search function of the taskbar and start menu within a few months.
・Super resolution of photos
The Photos app will be adding a feature that uses AI to upscale photos up to 8x the resolution while maintaining quality.
- Added generation fill and generation delete to Paint
Paint now has the new generation fill and generation delete functions, allowing you to replace parts of an image with something else, or delete parts of an image seamlessly. In addition, improvements to Paint's AI generation model have improved the generation speed and quality.
◆Copilot
Microsoft's AI assistant, Copilot, will also have several new features.
・Copilot Voice
Copilot Voice is a feature that allows you to talk to Copilot by voice. Copilot has four different voices available, and can be used for Q&A, brainstreaming, and more.
Copilot Voice is currently available in Australia, Canada, New Zealand, the UK and the US in English only, with more regions and languages coming soon.
・Copilot Daily
Copilot Daily is a feature that reads out news summaries, weather forecasts, reminders, and more. The news that can be read out by Copilot Daily is limited to news organizations that have partnered with Microsoft. Microsoft has already signed contracts with Reuters, Axel Springer, Hearst Magazines, USA TODAY Network, and the Financial Times, and plans to add more partners in the future.
Copilot Daily will be available in the US and UK from October 1, 2024, with plans to expand to other regions soon.
・Discover
Discover is a feature that displays conversation prompts and feature guides for Copilot, and if allowed by the user, can tailor the content shown in Discover to the user's conversation history.
-Easy access to Copilot on Edge
To access Copilot, simply type '@copilot' into the Edge address bar.
・Copilot Labs
Copilot Labs is a feature that allows users to try out experimental features of Copilot. The first Copilot Labs projects are planned to test 'Copilot Vision' and 'Think Deeper'.
・Copilot Vision
Copilot Vision is a voice assistant that can talk to you along with the text and images displayed in your browser, recognizing the content of the webpage and answering your questions. Copilot Vision only recognizes content when you explicitly initiate it, and discards the data once the conversation is over. Copilot Vision will soon be available for testing on Copilot Labs with a select number of Copilot Pro subscribers in the U.S.
・Think Deeper
Think Deeper is a feature that allows the robot to answer complex questions at the cost of a slower response time. For example, it can answer practical and everyday questions such as 'Should I move to city A or city B?' and 'What car should I buy?'
Think Deeper will begin testing in Copilot Labs later this week with a select number of Copilot Pro subscribers in Australia, Canada, New Zealand, the UK and the US.
◆Bing generative search
Bing's AI search function 'Bing generative search' has been enhanced to handle complex search terms such as 'How to conduct 1on1 efficiently' and 'How to remove noise from podcast recording data.' Testing of the enhanced Bing generative search has already begun in the United States.
Related Posts:
in Software, Web Application, Posted by log1o_hf