At its Worldwide Developers Conference, Apple unveiled significant advancements in artificial intelligence, prominently featuring Siri AI. These innovations are set to enhance iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27.
The Photos app will now utilize advanced image models, allowing users to make edits while preserving the original captured moment. The Spatial Reframing feature enables users to drag and touch a photo to preview a change in perspective in real-time through the Vision Pro headset, simulating the effect of repositioning the camera in the original scene. This feature ensures editing generates new content only where necessary, maintaining the photo's integrity. Additionally, users can expand images with the Extend tool, which straightens horizons without losing important elements or altering aspect ratios.
The Clean Up tool has also been upgraded, promising to effectively remove distractions from photos with improved quality and more realistic fill-ins, even in complex scenes.
Safari is receiving several AI enhancements as well. It can now automatically categorize tabs into relevant topics, putting new tabs into existing ones or creating new categories as needed. The new Notify Me feature allows users to track web page changes; Safari will alert users when changes occur, assisting with monitoring restocks and price drops.
A new feature, Describe an Extension, enables users to request a specific Safari extension, which Safari will generate directly in the toolbar.
Password management has been enhanced, allowing Safari to automatically strengthen weak and compromised passwords with a single tap. This feature autonomously navigates websites to update passwords, ensuring stronger security without user intervention.
Image Playground is now available, enabling users to create high-quality images in various styles, including photorealistic. This feature leverages a new generative model running on Apple's Private Cloud Compute, ensuring privacy and security of user data. Users can easily edit images using prompts or by interactively selecting objects to move or resize. Image Playground can also generate Lock Screen wallpapers and Contact Posters, allowing users to specify aspect ratios for different uses.
The Messages app now includes one-tap suggestions based on conversation context, assisting users in creating notes or reminders. It can also help locate photos that match keywords, locations, or contacts. Additionally, Mail's suggestions are more efficient, capable of integrating actions with third-party apps, while Smart Reply features now align with a user's personalized writing style.
For business calls, Call Context provides relevant information like confirmation codes or reservation numbers within the Phone app. Operating entirely on-device, this feature prioritizes user confidentiality, ensuring that personal data remains private.
Describe a Shortcut enhances the Shortcuts app, allowing users to create automations by simply stating their needs. It automatically assembles the required steps, enabling users to make further adjustments through voice descriptions.
The Home app now features generated video descriptions, offering quick insights into sequences recorded by smart home devices without requiring users to watch each clip. The app will also allow searches through camera footage to locate specific events, such as package deliveries. Noteworthy clips will be highlighted at the top of the search page.
Voice Control has become more user-friendly, enabling navigation of iPhones and iPads purely by voice commands; users can describe on-screen buttons rather than memorizing specific labels. Accessibility Reader offers on-demand summaries and translations.
Intelligent suggestions for naming files and folders based on their contents have been improved, along with a significant enhancement in Genmoji quality, allowing users to articulate desired changes.
Apple Intelligence will be available on the iPhone 16 and later models, iPhone 15 Pro and Pro Max, iPad mini (A17 Pro), iPads with M1 or newer chipsets, MacBook Neo, Macs with M1 or later, Vision Pro, as well as Apple Watch Series 10 or newer, Apple Watch Ultra 2, and Apple Watch SE 3 when paired with a compatible iPhone.
Some features, such as image generation, will have daily usage limits, which can be increased through iCloud+ subscription plans. These plans also include Apple Intelligence features designed for Home app-compatible cameras.
Source
