Add Category
In Photos, a new clean-up tool can remove distracting background elements with a tap, while users can also surface specific images by describing them.
Bringing all of the Apple Intelligence tools together is a redesigned Siri, which can be interacted with using voice or text. Apple said Siri would be able to look at a user’s screen for context or dig through their data, to accomplish complex tasks such as “Play that podcast that Jamie recommended” or “Send the photos from the barbecue on Saturday to Malia.”
Siri and Apple Intelligence can use Chat-GPT for some requests, such as generating or refining text.
Apple stressed that it was taking a privacy-first approach to AI, with as much data processed on-device as possible. Any cloud processing is done in Apple’s custom secure servers, which limit personal data collected. However, the system can also use external AI services, the first of which is OpenAI’s ChatGPT.
When a user asks for something that’s best handled by ChatGPT, the device will ask permission to share the request, and OpenAI will not log the user’s IP address or store their data unless they’re a paying OpenAI customer who has linked their account. The ChatGPT integration is free to use on Apple devices.
Vision Pro and other updates
Also at the conference, Apple announced that its Vision Pro headset would arrive in Australia on July 12, and would start at $6000. The so-called spatial computer is also getting its first annual software update with VisionOS 2, including the ability to turn regular photos into 3D spatial photos, and a new extremely wide-screen virtual display for use with Mac computers.
Apple’s Vision Pro headset is coming to Australia in July.
Aside from Apple Intelligence, iOS 18 was shown with a redesigned Home Screen that allows more customisable app layouts and the ability to tint app icons with any colour. An AI system will now also identify notifications, messages and emails it thinks are high priority to emphasise them above others.
The iPhone will also get the much-requested ability to send and receive RCS messages, which should mean better multimedia support between Apple and Android devices. A new Passwords app offers an Apple-focused option for a password manager, while users of recent AirPods models will be able to shake or nod their head to interact with Siri.
Loading
iPadOS is getting many of the same features, but a special mention was given to a new calculator app. Not only can it function like a regular calculator, but it will also work out and respond to sums you write by hand, any time you create an equals sign.
Apple TV is taking a cue from Amazon with a new feature called InSight, which shows you which actors are in a scene when you pause a show or movie. It will also display what song is playing, and let you add it to your Apple Music library.
Finally, a new continuity feature in MacOS lets you control your iPhone from your computer. While the phone stays locked, users are able to navigate the device and even use apps by interacting with a virtual version of their phone on their computer screen.
Get news and reviews on technology, gadgets and gaming in our Technology newsletter every Friday. Sign up here.