At its Worldwide Developers Conference, Apple revealed its latest innovation in AI technology, dubbed Siri AI. This marks the introduction of numerous features across iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27.
The Photos app is being enhanced with advanced image models, allowing for more intuitive photo editing while preserving the original captured moment. With the new Spatial Reframing feature, users can touch and drag a photo to view and alter its perspective in real time, showcasing Apple’s expertise in spatial modeling through the Vision Pro headset.
This feature enables you to ‘edit’ photos as if repositioning the camera within the original scene, generating new content only where needed. Additionally, the Extend tool allows users to straighten horizons and adjust aspect ratios without losing critical elements of the image.
Apple has significantly upgraded the Clean Up tool, enhancing its capability to remove distractions from photos while maintaining realistic fill, even in complex scenarios.
Safari is also receiving AI enhancements, including the automatic organization of tabs into relevant topics. As users browse, new tabs are categorized accordingly or new ones are created as needed. The new Notify Me feature enables Safari to track changes on web pages and notify users when modifications occur, aiding in tracking restocks and price drops.
A new AI feature, Describe an Extension, allows users to describe a desired Safari extension, which Safari will then create and add directly to the toolbar.
User convenience is further enhanced as passwords can now be automatically updated with stronger alternatives through a single tap, utilizing Apple Intelligence and Safari to navigate websites and manage password changes securely.
Image Playground is now available, allowing users to create “high-quality images in virtually any style,” including photorealistic options. This feature leverages a generative model running on Apple’s Private Cloud Compute, ensuring that private data remains secure. Users can edit images easily by highlighting objects or generating tailored Lock Screen wallpapers and Contact Posters with custom aspect ratios.
The Messages app now offers one-tap suggestions based on conversation context, like creating reminders or locating specific photos by recognizing keywords and people in your library. The enhancements extend to the Mail app, which supports actions through third-party applications, while Smart Reply adapts to individual writing styles.
When dialing a business, the Call Context feature provides useful information, such as confirmation codes or reservation numbers directly in the Phone app. This feature operates based on the calling contact, maintaining user privacy as it is processed entirely on the device.
With the Describe a Shortcut feature, users can talk to the Shortcuts automation app to have it assemble the desired steps for any task. Any modifications can similarly be described for instant adjustments.
The Home app introduces generated video descriptions that allow users to quickly grasp events across video clips from smart home devices without needing to watch all the footage. It also enables searching through clips to locate specific occurrences, like package deliveries, while intriguing “noteworthy clips” are highlighted at the top of the search page.
Voice Control is made more intuitive, allowing users to navigate devices entirely by voice, simply describing on-screen buttons rather than recalling specific labels. The Accessibility Reader provides on-demand summaries and translations. Moreover, intelligent suggestions for file and folder names can be generated based on their content, and the quality of Genmoji has been enhanced, enabling users to describe adjustments they wish to make.
Apple Intelligence features will be available on the iPhone 16 and later models, including iPhone 15 Pro, iPhone 15 Pro Max, iPad mini (A17 Pro), iPads with M1 or later, MacBook Neo, Macs with M1 or later, Vision Pro, Apple Watch Series 10 or later, Apple Watch Ultra 2 or later, and Apple Watch SE 3 when used with an Apple Intelligence-enabled iPhone.
Some features, particularly image generation capabilities, come with daily usage limits, which can be extended through iCloud+ subscription plans. Subscribers also gain access to Apple Intelligence features for cameras compatible with the Home app.
Source
