Apple’s WWDC keynote is over, and the company has a lot to share. We’re getting our first look at the artificial intelligence capabilities of Apple devices as well as some major updates to the company’s operating systems.
If you missed watching the keynote live, we’ve rounded up all the most important announcements, which you can check out below.
Apple’s first artificial intelligence system is coming to iPhone, iPad and Mac
With nearly every major tech company joining the AI craze, it’s no surprise that Apple is launching its own AI system. Apple Intelligence is the company’s new personal intelligence system that “puts powerful generative models at the heart of iPhone, iPad and Mac.” This enables native Apple apps to implement a host of new features, such as the ability to generate images or summarize text.
Apple Intelligence takes security very seriously as the system automatically determines whether it needs to use on-device processing or contact Apple’s private cloud computing servers to fulfill your request. The system will be available for free on iPhone 15 Pro, as well as iPads and Macs equipped with M1 chips and above.
Apple’s major push into the field of artificial intelligence also includes Siri. The upgraded voice assistant will now be more deeply integrated into iPhone, appearing as a pulsating light on the edge of the device. It will give you more control over your apps, allow you to ask the voice assistant to find information in a specific email, or even display a photo of one of your friends. Apple relies on LL.M. to help Siri better understand what you say and track follow-up requests and questions.
Apple is building ChatGPT into Siri
Photo credit: Alison Johnson/The Verge
Siri’s big artificial intelligence upgrade also includes integration with OpenAI’s ChatGPT 4o chatbot. With the new integration, Siri will automatically determine whether a query is better suited for ChatGPT. It will then ask for your permission before sending the request to ChatGPT. You will be able to use ChatGPT through Siri for free, no account required.
New AI features in Mail, Messages, Photos, and more
Apple is launching a slew of new artificial intelligence features in apps in iOS 18, including ways to summarize emails and generate responses. The company showed off a new Genmoji feature that lets you create custom emojis based on text prompts, as well as a new AI image generator called Image Playground.
Apple is also bringing artificial intelligence to the Photos app, allowing you to search for photos using natural language. You can also clean up objects in the background of your images, similar to Google’s Magic Eraser. In addition, Apple has added artificial intelligence-driven transcription and summarization to the Notes and Phone apps.
iPhone becomes more customizable in iOS 18
In addition to all the artificial intelligence, Apple is also introducing a new, more customizable Control Center in iOS 18. The company will also let you lock certain apps in an upcoming update to prevent them from being used if you hand your phone over to someone else.
Other big changes include a redesign of the Photos app and a new Game Mode for iPhone that minimizes background activity to optimize gameplay.
iPhone finally gets RCS support
After announcing support for RCS last year, Apple confirmed it would be released with iOS 18.
iMessage is also getting some other upgrades, including the ability to schedule text messages and support for sending them via satellite. Apple also introduced a variety of Tapback options that allow you to bold, underline, and italicize text.
Apple TV Plus adds ‘inSights’ feature that tells you which actors are on screen
Apple TV Plus has introduced a new feature that lets you swipe down on the remote to reveal actors and their characters from the movie or TV show you’re watching. You can also find out what songs are currently playing and add them to your Apple Music playlist. Apple TV Plus automatically displays subtitles when you mute a program and supports 21:9 projectors.
Password app to track your logins
As rumored last week, Apple has released a new Passwords app that lets you track login details across different devices. The app lets you generate and store passwords, similar to other password managers like LastPass and 1Password. Passwords will be available on iOS, iPadOS, macOS, visionOS and even Windows.
iPadOS 18 adds calculator app that supports Pencil
Photo credit: Alison Johnson/The Verge
More than a decade after its release, the iPad finally has a calculator app. It comes with a new feature called Math Notes, which lets you use Apple Pencil to write equations on iPad and let the app answer them for you.
Apple also launched Smart Script, a feature that uses machine learning to improve the appearance of handwriting and spell-check notes.
macOS 15 will let you mirror your iPhone
Apple’s next macOS update will let you mirror your iPhone on your Mac. You’ll be able to interact with your iPhone directly from your Mac, view notifications and hear audio playing on your mobile device.
Safari also introduces a new “Highlights” feature, which uses machine learning to pick out interesting parts of a page.
Apple will automatically display gadgets in watchOS 11
Photo credit: Alison Johnson/The Verge
watchOS 11 also introduces a ton of new features, including the ability to automatically add gadgets when you need them. Apple is launching a new Vitals app that lets you “explore the most important health metrics at a glance,” along with new cycle tracking features, real-time activity, and support for check-ins so your loved ones can track you during your rides your workout.
VisionOS 2 adds spatial photos and ultrawide Mac displays
Apple has released visionOS 2, the first major update to the operating system. One of Vision Pro’s new features uses machine learning to bring depth to existing photos. The update will also introduce support for ultra-wide virtual Mac displays, more intuitive gestures, and support for train travel mode.
Apple also plans to bring Vision Pro to more countries, including China, Singapore, Australia, Canada, France and the United Kingdom.
The next update to AirPods Pro will let you respond to Siri quietly
Apple will introduce Siri interaction in its next AirPods Pro software update, letting you shake your head to say “yes” or “no” in response to Siri’s announcements. AirPods Pro are also equipped with voice isolation to improve voice quality and reduce background noise.
