Apple's Worldwide Developers Conference next week is sure to be a key moment in the iPhone maker's history, and while the Vision Pro debuted at last year's event, don't expect the hardware to be a highlight at WWDC 2024, which starts at 10 a.m. PST on Monday.
WWDC is for developers, and much of the focus will be on iOS 18. The Cupertino tech giant will be showcasing its selection of integrating AI technologies into its devices and software, including its historic partnership with OpenAI. As the big event draws closer, various leaks have surfaced about what's in store for iOS 18 and its rumored AI-powered apps and features.
Among the changes, Apple is said to be using Ajax LLM for some of its new AI features, such as suggested email replies. Other reports say that Apple plans to process data from its AI in a way that even employees won't have access to, allowing the company to continue to fulfill its data privacy promises to users.
Below, we look at how Apple is said to be adding AI to its apps and services in the next big update for iPhone, as well as other improvements and changes planned for iOS 18.
Siri's AI-powered future
Apple's digital assistant is poised to receive an AI makeover. The digital assistant will leverage Apple's own large language model and allow Siri to control individual functions within apps. This will work without any developer or user setup, which is currently required with App Intents and Siri Shortcuts. Instead, users can ask Siri to do things like delete emails or edit photos. Some of Siri's upgraded AI features won't be ready until next year. For example, Siri's ability to handle tasks that involve multiple steps may be delayed. A more advanced Siri will also come to the Apple Watch for on-the-go use. According to one report, you can use Siri on your Watch to play music on another device. Siri will receive a more natural voice. Siri will be able to summarize notifications with people, companies, calendar events, places, dates, and more. Could it be hinting at Siri's new look in the animation below?
A new design for Apple Photos
A new interface has been teased. Users will be able to retouch photos using AI, which could put it up against Google Photos in this area. For example, the “Clean Up” feature will allow users to remove objects from photos using generative AI techniques similar to Google's Magic Eraser. One report said that Apple has created an internal-only application called Generative Playground that uses GenAI to create and edit images. It is unclear how this functionality will be delivered to end users, but iMessage integration has been spotted in the form of an app extension.
Safari now even more AI-enabled
AI summaries of web pages and news articles will be available in Safari through the new Intelligent Search feature (take note, Arc?).
AI-infused notebook
Users can request AI summarization of their notes. GenAI will also help transcribe audio for notes. In-app voice recording will be supported alongside voice transcription and AI summarization. Math Notes will recognize the text of math equations and help graph and solve equations through AI. Notes users will also have the option to auto-complete math equations as they type. Project Greymatter is the code name for a set of AI tools that will be integrated into the core of Safari, Photos, Notes, etc., reports Bloomberg.
Voice memo transcription
There's also a real-time transcription feature for voice memos.
iMessages gets a makeover with AI
Generative AI emojis will be supported, allowing users to create their own emojis using the technology. AI summaries for missed texts will also be available. Overall, deeper integration with Siri is expected. Tapbacks will have new icons. Message effects for individual words will be supported in addition to effects on the message itself. Messages will offer reply suggestions generated by Apple's on-device Ajax LLM, making text replies easier. RCS support is also expected to come later this year, bringing read recipes, typing indicators, and high-quality videos and images when texting with Android users via iMessage.
Calendar updates
Apple's LLM will now be able to communicate with the Calendar app to see events when composing a reply to a message.
AI-Enabled Email
Mail will also show Ajax-generated email reply suggestions. Project BlackPearl is the code name for an AI upgrade that will power Apple Mail. Searches within Apple Mail will include information from contacts, locations, and locally stored documents. Users may be able to ask Siri to make their emails “sound more professional.”
New Settings Interface
The revamped interface and updates including improved organization and search will hopefully make the settings easier to understand.
Control Center Update
A new music widget will be available; Potentially featuring larger artwork; HomeKit improvements for smart home integration.
notification
An AI summary of missed notifications will be available, and Apple is working on what it calls “enhanced” notifications.
Spotlight
Spotlight promises to deliver faster and more reliable searches.
Home screen updates
In iOS 18, users will be able to place app icons anywhere they like, rather than aligning them to a grid and leaving no space between them. Users will also be able to change the color of app icons, which is perhaps Apple's answer to Google's Material You.
Maps with route creation
Music with AI-powered playlists
Further improvements
Other apps scheduled for updates include Freeform, Xcode, and Apple's productivity apps such as Keynote and Pages, which may add GenAI capabilities.
We're launching our AI newsletter: Sign up here to start receiving it in your inbox starting June 5th.