In summary, at WWDC 2024, Apple unveils new generative AI features for Apple Intelligence.
AI authoring tools and Mail’s priority messages are among the important features.
Apple promises privacy-preserving on-device processing, releasing a beta version for a few devices this autumn.
Apple has entered the AI competition at last. While you refer to it as artificial intelligence, Apple refers to its own technology as Apple intelligence. At WWDC 2024, Apple unveiled its own personal intelligence system for the iPhone, iPad, and Mac, kicking off this year’s annual developer’s conference. Apple is set to incorporate its latest artificial intelligence model, known as New Gen AI, into its upcoming software releases for iOS 18, iPadOS 18, and macOS Sequoia. Apple claims that their AI model makes use of Apple Silicon’s ability to comprehend and produce words and graphics, act across apps, and take advantage of user context to expedite and simplify daily operations.
Concerns about privacy arise with AI, and Apple reassures consumers that it understands these issues and has built the system to employ on-device processing whenever feasible. This implies that user data is not continuously uploaded to Apple’s servers but rather remains on the device. “And it can help people do the tasks that are most important to them by accessing that data in a totally private and secure manner. Tim Cook, the CEO of Apple, adds, “We are excited for users to see what AI is capable of. Only Apple can provide this.”
Let’s take a detailed look at the new generative AI features Apple is bringing for its users:
New Apple Intelligence – AI features in Apple devices
- Apple Devices Getting Their AI Writing Tools: Although Android users have been enjoying a plethora of amazing AI features, Apple users have felt a little left out. However, Apple has now made significant progress in integrating suit AI capabilities into all of its programs. Writing tools will be made available by Apple Intelligence to assist users with editing, proofreading, and summarizing material in Mail, Notes, Pages, and other apps. When using the Rewrite feature, various text variants with tone adjustments are provided. Additionally, a Proofread function is available to assist with grammatical and structure checks and change suggestions. Long texts can be distilled into concise formats, such as tables or bulleted lists, by using the Summarize option.
- Priority Messages in Mail: This feature allows users to mark important emails as urgent and puts them at the top of their inbox. Handling lengthy threads is made easier for users by allowing them to preview summaries rather than just the first few lines. Smart Reply ensures thorough responses by providing prompt response suggestions.
- Better Notifications: You may put critical alerts at the top of the stack with the aid of this feature. Key information will be displayed in summaries on the lock screen. In order to help users focus, the Reduce Interruptions Focus filter limits messages, allowing only urgent alerts.
- Recording, transcribing, and summarizing audio in Notes and Phone apps will be made easier for users with the aid of this technology. Participants receive notifications when a recording begins, and calls are followed by summaries that help with memory recall.
- Image Playground: To assist users in creating images in the Animation, Illustration, or Sketch styles, Apple is also launching a new AI capability. It may be found both as a standalone app and integrated into other apps like Messages. Tailored recommendations facilitate the rapid and pertinent generation of images.
- Genmoji Creation: Apple has also unveiled a tool called Genmoji, which lets users type descriptions to create personalized emojis. These can be used as stickers or comments in messages to represent friends and relatives based on images, which improves communication.
- Advanced Photo Search and Cleanup: Apple has introduced natural language queries for easy photo and video searches, akin to Google’s Magic Eraser. Users are able to identify particular video moments. By removing distracting items from photographs, the Clean Up tool enhances image quality without changing the subject. With the Memories function, users may make movies with a narrative arc and suggested songs that go along with the tale they generate from their data.
- Improvements to Siri: The most significant development in AI is the latest iteration of Siri. With the ability to retain context throughout exchanges, the sophisticated Siri can now assist users with better language understanding. Siri can be used for advanced app functions and device assistance. Users can talk or type to it interchangeably. Siri may now search specific articles from a Reading List or add addresses from Messages to contacts.
- Private Cloud Compute: This feature will assist customers by protecting their privacy when processing data on-device or through Private Cloud Compute for sophisticated requests. This technology offers openness and confidence by scaling computing capability and enabling independent experts to examine the code on Apple’s servers.
- Integration of ChatGPT: Notably, Apple has included ChatGPT into iOS 18, iPadOS 18, and macOS Sequoia. With permission from the user for each conversation, Siri can access ChatGPT to provide in-depth answers. With the use of Apple’s Writing Tools, ChatGPT facilitates the creation of text and images, boosting efficiency and creativity.
Apple plans to deliver these Apple Intelligence – AI features when?
Even while all of these capabilities seem appealing, Apple is now only making them available to a select few users. Apple Intelligence, which supports iPad and Mac with M1 or later, iPhone 15 Pro, iPhone 15 Pro Max, will be available in beta form this fall, according to the firm. It will launch in US English, with more features and languages to follow over the course of the following year.