Apple's Worldwide Developers Conference next week will be a pivotal moment in history for the iPhone maker, as the Cupertino-based tech giant will showcase its selection of integrating AI technologies into its devices and software, including its historic partnership with OpenAI. As the big event draws closer, various leaks have surfaced about what's in store for iOS 18 and its rumored AI-powered apps and features.
Among the changes are reports that Apple is using Ajax LLM to power some of its new AI features, and other reports suggest that Apple plans to process data from its AI in a way that even employees won't have access to, allowing the company to continue to fulfill its data privacy promises to users.
Below, we look at how Apple is said to be adding AI to its apps and services in the next big iPhone update, as well as other improvements and changes planned for iOS 18.
Siri's AI-powered future
Apple's digital assistant is poised to receive an AI makeover. The digital assistant will leverage Apple's own large language model and enable Siri to control individual functions within apps. This will work without any developer or user setup, which is currently required with App Intents and Siri Shortcuts. Instead, users can ask Siri to do things like delete an email or edit a photo, for example. However, some of Siri's upgraded AI features won't be ready until next year. For example, Siri's ability to handle tasks that involve multiple steps will likely be delayed. A more advanced Siri will also come to the Apple Watch for on-the-go use. According to one report, you can use Siri on the Watch to play music on another device. Siri will receive a more natural voice. Siri will be able to summarize notifications with people, companies, calendar events, places, dates, and more. Can you hint at Siri's new look in the animation below?
A new design for Apple Photos
A new interface has been teased, along with the ability to retouch photos using AI, which could put it up against Google Photos in this area. For example, the “Clean Up” feature can remove objects from photos using generative AI techniques similar to Google's Magic Eraser. One report said that Apple has created an internal-only application called Generative Playground that uses genAI to create and edit images. It is unclear how this functionality will be delivered to end users, but iMessage integration has been spotted in the form of an app extension.
Safari now even more AI-enabled
AI-infused notebook
Users can request AI summarization of their notes. GenAI will also help transcribe audio for notes. In-app voice recording will be supported alongside voice transcription and AI summarization. Math Notes will recognize the text of math equations and help graph and solve equations through AI. Notes users will also have the option to auto-complete math equations as they type. Project Greymatter is the code name for a set of AI tools that will be integrated into the core of Safari, Photos, Notes, etc., reports Bloomberg.
Voice memo transcription
iMessages gets a makeover with AI
Generative AI emojis will be supported, allowing users to create their own emojis using the technology. AI summaries for missed texts will also be available. Overall, deeper integration with Siri is expected. Tapbacks will have new icons. Message effects for individual words will also be supported, in addition to effects on the message itself. Messages will offer reply suggestions generated by Apple's on-device Ajax LLM, making text replies easier. RCS support is also coming later this year, bringing read recipes, typing indicators, and high-quality videos and images when texting with Android users via iMessage.
Calendar updates
Apple's LLM will now be able to communicate with the Calendar app to see events when composing a reply to a message.
AI-Enabled Email
New Settings Interface
The revamped interface and updates including improved organization and search will hopefully make the settings easier to understand.
Control Center Update
A new music widget will be available; Potentially featuring larger artwork; HomeKit improvements for smart home integration.
notification
Spotlight
Home screen updates
In iOS 18, users will be able to place app icons anywhere they like, rather than aligning them to a grid and leaving no space between them. Users will also be able to change the color of app icons, which is perhaps Apple's answer to Google's Material You.
Maps with route creation
Music with AI-powered playlists
Further improvements
Other apps with planned updates include Freeform, Xcode, and Apple's productivity apps such as Keynote and Pages, which may add genAI capabilities.