Apple gets ready for AI: all the news on iOS 18, macOS Sequoia, and more

The iPhone 16, despite its marketing so far, still doesn’t have Apple Intelligence. That’s set to change on October 28th with the release of iOS 18.1, according to Bloomberg’s Mark Gurman in today’s Power On newsletter.

The update will bring with it AI-powered notification summaries, Gurman writes. Though he only lists that example, the iOS 18.1 beta has also included some Siri improvements (like understanding you better when you stumble over your words), along with writing tools and a new rainbow-colored glowing edge graphic when you summon Siri on a phone or iPad.

A few weeks ago, while cursing NJ Transit under my breath, I decided to screw it and call an Uber. I’m the sort of anxious where, once hailed, I stare at the Uber app on my phone until my driver arrives. Except this time, I didn’t have to. I pinchy pinched, and I could see a live Uber widget in the Smart Stack on my Apple Watch. It was a small moment — the kind where you quirk your head and go, “Well, would you look at that?”

I’ve had a few of those moments while testing watchOS 11 these past few months, both in the beta and while reviewing the new Series 10. This year’s software update adds Live Activities to the wrist as well as suggested widgets to the Smart Stack. The latter pop up based on time, date, location — context clues, essentially. When it’s about to rain and you happen to look at your wrist, you might notice the weather widget pops up first. On a plane, I look down and can see how much time is left until landing from the United app. Other times, usually in bustling cafes, I see the Shazam widget. It’s never when I actually don’t know the song, but I see it enough times to take note. If you travel abroad, the new Translate app will automatically pop up in the stack. 

Apple has just released public betas of iOS 18.1, iPadOS 18.1, and macOS Sequoia 15.1, and they include upcoming Apple Intelligence features like text rewriting tools, the glowy new Siri design, a “Clean Up” tool to remove objects from your photos, and more.

To be able to access the betas, you’ll need to register on Apple’s beta software program site. Once you’ve done that, you should be able to see the beta update available in settings for you to download and install. Note that a only few iPhones can access the Apple Intelligence features: last year’s iPhone 15 Pro phones as well as the nearly-here iPhone 16 and iPhone 16 Pro. iPads and Macs with M1 chips or newer can try Apple Intelligence as well.

Apple rolled out updates to all of its major operating systems this week, and the Vision Pro was no exception. With visionOS 2, the company has a chance to show the relative few who bought its spendy headset — and those who might yet — that it’s still committed to the new platform.

After a few months of using it in beta, visionOS 2 isn’t a dramatic change — it’s more like a smoothed-out version of the software the headset launched with. The addition of things like new gestures, better device support, and a couple of splashy features has removed a lot of the friction of using the Vision Pro and should give people who own it a reason to dust it off and take it for another spin.

With this week’s release of iOS 18, adding smart home devices to Apple Home just got a lot easier. The update brings direct local control of Matter devices to newer iPhones, meaning all you need to set up and control them is an iPhone that can run iOS 18 — no hub or border router required. This is good news for anyone interested in dabbling in smart home gadgets who isn’t ready to go all in.

Matter is a new standard designed to simplify the smart home. Compatible devices work over Wi-Fi or Thread, a protocol specifically designed for IoT gadgets. With iOS 18, you can now add any Wi-Fi device to Apple Home with just an iPhone. For Thread devices, you’ll need an iPhone with a Thread radio (iPhone 15 Pro or newer).

iOS 18 has a new feature that lets you wirelessly restore an iPhone 16 using another iPhone or an iPad, 9to5Mac reports.

9to5Mac says it was able to simulate the new recovery method. “Essentially, when the iPhone 16 enters Recovery Mode for some reason, users can simply place it next to another iPhone or iPad to start the firmware recovery,” according to 9to5Mac. “The other device will download a new iOS firmware and transfer it to the bricked device.”

Apple’s announcement last week that the Action Button is now on all of its iPhone 16 models, rather than just the Pro model that the button debuted on last year, was a little overshadowed by the introduction of the Camera Control button — a capacitive, tactile button for launching and controlling the iPhone 16’s camera. But don’t let that fool you: the Action Button is still one of the most powerful features Apple has added to its phones in years.

One very obvious use of the button is to connect it to the iPhone’s camera app, letting you press and hold to open the app, then press once more to take a picture. But does that mean the Camera Control button has made it obsolete? I don’t think so.

Green bubbles, rejoice: your iPhone-using friends are finally going to have a much better time texting you. As part of iOS 18, which was released for everyone on Monday, Apple added support for RCS, the Rich Communication Services protocol for messaging. This means that chats between iPhone and Android users will finally have a bunch of sorely needed features that should have been in place a long time ago.

A big reason I’ve stayed on iOS (and haven’t even considered switching to Android) is because iMessage conversations work especially well for my family group chats, and I don’t want to nerf those chats. This new RCS support is a great step toward making iPhone-to-Android texts work a lot better (though there are still enough drawbacks that I’m planning to stick with iOS).

Halide users who’ve upgraded their iPhones to iOS 18 are now able to quickly access the advanced camera app directly from their phone’s lockscreen without having to unlock it first. Previously, only the native iOS camera app could be conveniently accessed that way.

Although Halide offers advanced features like manual shutter speed adjustments and a “Process Zero” option that delivers images without any AI processing, accessing Apple’s camera app was always faster thanks to its lockscreen shortcut. Halide could be made accessible through a lockscreen widget, but actually getting into the third-party camera app required an iPhone to be unlocked using Face ID, Touch ID, or by entering a passcode.

It’s a weird year for iOS.

Usually, the new software version arrives all at once. Not so with iOS 18. The foundational stuff has arrived, and in a normal year, things like RCS support and a redesigned control center would be more than enough. But iOS 18’s headline feature, Apple Intelligence, isn’t even part of this initial release, and we may not see some of its most interesting features until well into 2025. The iOS 18 rollout starts now, and it’s just going to keep on rolling for the foreseeable future.

Apple has just released watchOS 11, the latest version of its smartwatch operating system, alongside iOS 18 and iPadOS 18. The update, available for the Apple Watch Series 6 and later models, will finally allow users to take rest days without breaking their activity streak and introduces FDA-cleared sleep apnea detection.

Sleep apnea is a condition that can cause a person to stop breathing during sleep and can lead to an increased risk of hypertension and Type 2 diabetes if left untreated. Apple’s sleep apnea detection feature, which uses the accelerometer to monitor for small wrist movements associated with sleep interruptions, was announced alongside the new Apple Watch Series 10 and is now available for both the Apple Watch Series 9 and the Apple Watch Ultra 2. If sleep apnea is detected, the Apple Watch will alert the user and provide additional information that can be shared with a doctor, who can make a formal diagnosis.

Apple officially released macOS Sequoia on Monday, bringing features like the ability to wirelessly mirror your iPhone on your Mac, window tiling tools, and more. There are Apple Intelligence features on the way, too, but they aren’t available yet.

iPhone mirroring is arguably the coolest new feature in macOS Sequoia, and in his testing, my colleague David Pierce said it might change how you use your phone. When you open the phone mirroring app, your iPhone pops up, and you can navigate around it using your mouse and type things with your keyboard. Your iPhone’s notifications can also show up on your Mac. And later this year, you’ll be able to drag and drop things between your iPhone and your Mac.

Apple is rolling out iOS 18 and iPadOS 18, which will introduce a bunch of new features to the iPhone and iPad. One of the biggest changes with today’s launch is the addition of RCS messaging, which should help improve communication with Android users.

First announced in June, RCS messaging will finally allow iPhone and Android users to share high-res photos and videos, see typing indicators, and use read receipts. (Messages from Android users will still appear in green bubbles, though.)

The iPhone 16 lineup has 8GB of RAM, from the base model to the 16 Pro Max, and it’s all thanks to Apple Intelligence. Apple VP of hardware tech Johny Srouji confirmed as much in an interview with Geekerwan, published yesterday, that 9to5Mac spotted.

Srouji explained in the interview that “DRAM is one aspect” when it comes to deciding hardware characteristics needed for Apple Intelligence, saying that the feature “led us to believe we need to get to 8GB.” He added that the extra RAM would also “help immensely” for tasks like high-end gaming on devices.

Between flashy shots of a sleek new Apple Watch and a colorful array of iPhones, Apple made a major announcement for a two-year-old product: the AirPods Pro 2. The earbuds will soon gain a hearing aid function that anyone can access, a move that will provide a cheaper alternative to traditional hearing aids and an all-in-one solution that could change the way people get help for hearing loss.

The Food and Drug Administration signed off on over-the-counter hearing aids in 2022, giving people access to cheaper alternatives that don’t require them to see a doctor. Provided Apple receives approval from the FDA, Apple’s new “clinical-grade” over-the-counter hearing aid capability will roll out as a free software update this fall. Some people with hearing loss have already used the AirPods Pro as a way to amplify sound, but this update will have the FDA’s stamp of approval and will come with a few other benefits.

Apple heavily sprinkled mentions of AI throughout its iPhone 16 event on Monday. However, generative Apple Intelligence features won’t be ready for the public launch of iOS 18 on September 16th or the new iPhones when they’re released on September 20th.

The first set of Apple’s AI features is scheduled for public availability next month in most regions — except the EU — as part of a beta test for iPhone 15 Pro and all iPhone 16s, plus Macs and iPads with M1 or higher Apple Silicon chips. At launch, they’ll be available in US English only.

Apple has added a new Camera app feature in the latest iOS 18 beta that gives iPhone users a dedicated option to pause video recordings. The feature, spotted by 9to5Mac, is coming to all iOS 18-supported iPhone models when the OS update is released on September 16th, unlike the wider “Camera Control” tools that are exclusive to the iPhone 16.

The feature will finally enable iPhones to film multiple shots in a single video instead of the current process that requires users to take separate recordings that must be edited together. When updated to iOS 18, a pause button is added to the Camera app which changes to a Record button when users have actively paused their video recording. Users can also switch between camera lenses while a recording is paused if they want to adjust the zoom or focal length.