5 Exciting New AI Features in Windows 11 24H2: Will You Be Getting Them?
The recent rollout of Windows 11 24H2 introduces a host of AI advancements, originally featured on Copilot+ PCs. With this latest update, Microsoft has prepared several exciting AI functionalities for users.
Previously launched innovations included Cocreator within Paint, Restyle in Photos, Live Captions, and Windows Studio Effects. These features were exclusive to Copilot+ devices, which are equipped with a Neural Processing Unit (NPU) to handle AI tasks. Although Microsoft originally included the much-anticipated Recall feature, it was withdrawn due to inadequate privacy and security measures.
Aside from the standard components, these PCs come with a dedicated NPU for executing AI operations. Initially, only machines powered by Qualcomm processors supported this, but fresh options from Intel and AMD are now available.
Microsoft will start rolling out these new AI features on November 1, 2024. However, not all features will be immediately accessible, as the rollout will occur progressively across selected regions. Let’s explore the forthcoming AI functionalities.
1. Click to Do
As illustrated in the screenshot below, the Click to Do feature introduces a handy overlay that appears at the top of your screen when activated. It acts like a digital assistant, providing support right when you need it.
Powered by AI, Click to Do processes data locally and assesses the content displayed on your screen.
For instance, when viewing an image with this feature enabled, an overlay will appear at the top. By right-clicking on a selected area, you can access various options such as Bing image search, save, share, and functionality to blur backgrounds with Photos, and remove or raise objects with Paint.
Choosing an option will launch the relevant application with the captured content.
Additionally, Microsoft is testing features like “Summarization”and “Reword,”which will complement Click to Do when text is selected.
Expect Click to Do to launch in November.
2. Super-resolution in Photos
Interestingly, Microsoft had omitted the image upscaling capability in its offerings, despite earlier additions of image generation and editing tools in Paint and Photos. This oversight will be rectified with the introduction of a Super-resolution feature in the Photos application, complementing existing functionalities like background blur and Restyle.
This feature allows you to enhance the resolution of an image up to eight times its original size through an easy-to-use slider that controls the upscale effect. Super-resolution employs local AI algorithms for image enhancement.
3. Generative Erase and Fill in Paint
The Erase function already available in Photos can eliminate unwanted elements from images, and although Microsoft previously had a Retouch option for spot removal, it has since been discontinued. The good news is that Paint is set to receive a generative erase and fill capability.
Users can select an area to erase, seamlessly blending the composition as if the area never existed. The fill feature allows for the addition of new elements to the image.
These operations occur swiftly; there’s no lengthy waiting period involved. Copilot+ PCs can perform these tasks locally while only utilizing web requests for content moderation.
4. Enhanced Windows Search
Microsoft aims to streamline your file searches in File Explorer and Windows Search, even if you can’t recall the exact file name or extension.
This feature enables interaction using natural language. For example, if you traveled last year and want to find pictures from your train journey, simply typing keywords like “railway” or “train” will result in relevant images appearing in File Explorer, regardless of the original file name, such as 2023-x1345.jpg.
This advanced search capability will first roll out in File Explorer before being incorporated into Windows Search and the Settings app. We’ve already seen early versions of the Copilot suggestions feature in the Settings app during the May 2024 Build conference.
5. Recall
Windows Recall is set to make a return for Windows Insiders prior to being fully available for all Copilot+ PC users.
Microsoft has spent time addressing security vulnerabilities, resulting in an enhanced version of Recall coming soon. This has been confirmed by Microsoft to Windows Latest last month, making the announcement official.
This updated Recall feature is designed to be less intrusive to privacy, no longer capturing sensitive data within snapshots. Users now have the capability to exclude specific apps, with all collected data stored locally on the device.
Previously automatically enabled, Recall will now be an opt-in feature. During setup, users can choose to bypass this feature, ensuring that Microsoft maintains clarity around the new security protocols designed to encrypt and safeguard user information.
If deemed unnecessary, you can easily disable or remove Recall from your Windows device.
Will you access all the new AI features mentioned above?
In the update for Windows 11 24H2, Microsoft differentiates between Copilot+ PC users and standard users. All AI functionalities are reserved for Copilot+ PC owners, while general OS enhancements remain accessible to all.
It is important to note that these AI features will not function optimally on standard PCs due to the absence of an NPU. Consequently, if these advanced features pique your interest, acquiring a Copilot+ PC will be necessary.
Leave a Reply