On Monday, Apple published the Apple Vision Pro’s visionOS 2.4 upgrade. Introducing the first set of Apple Intelligence capabilities for the mixed reality (MR) headset, it is regarded as a significant update. The Cupertino-based tech behemoth claims that users can now utilize Image Playground to reimagine photographs, Writing Tools to summarize and edit text, and Natural Language Search in photographs to swiftly locate the greatest memories. Additionally, the update includes a brand-new feature called Spatial Gallery that features Apple Curations.
Features of the Apple Vision Pro’s visionOS 2.4 update
In a press article, Apple described the new functions included in the visionOS 2.4 upgrade. The features are accessible on the headset when the device and Siri language are set to English (US). According to the iPhone manufacturer, the Apple Vision Pro now has Writing Tools. It is an AI-powered tool that offers spelling and grammatical checks along with features for creating, editing, and proofreading texts. Additionally, it may highlight the text’s main ideas, make lists and tables, and summarize the content.
Image Playground, a stand-alone application that uses generative AI to produce images in response to detailed questions, is included in the update. Users can choose from a variety of painting genres and choose a reference person from their Photos app for inspiration. Genmoji, which functions similarly but for emojis, is also included in the same software. According to Apple, these can be delivered as a Tapback, shared as a sticker, or placed inline to conversations.
Users may now utilize natural language searches to look for specific photographs stored in the Photos app thanks to Apple Intelligence. Furthermore, depending on the prompt the user enters, the Create a Memory Movie feature allows AI to create a plot with chapters based on themes found in the photographs and arrange them into a movie with a narrative arc. In the meantime, rapid responses are possible with Mail and Messages’ Smart Reply feature.
Priority Messages in Mail, Mail Summaries, Image Wand in Notes, Priority Notifications in Notification Center, and Notification Summaries are also supported by visionOS 2.4, according to Apple.
The business emphasizes that images and videos used to make films and other activities are kept confidential and aren’t shared with other businesses. In order to preserve user privacy, Apple Intelligence also employs on-device processing whenever feasible. Apple uses Private Cloud Compute for workloads that call for larger AI models, and customer data is never saved or shared with the business.
