Apple Intelligence

Suite of artificial intelligence tools developed by Apple Inc.

Apple Intelligence
Apple Intelligence Logo
Developer(s)Apple Inc.
Initial releaseJune 10 2024
Operating systemiOS 18, iPadOS 18, macOS Sequoia
PlatformARM
TypeArtificial intelligence
LicenseProprietary
Websitehttps://www.apple.com/apple-intelligence/
Part of a series on
Artificial intelligence
Major goals
Glossary
  • v
  • t
  • e

Apple Intelligence is an artificial intelligence platform developed by Apple Inc.[1] Relying on a combination of on-device and server processing, it was announced on June 10, 2024 at WWDC 2024 as a feature of Apple's iOS 18, iPadOS 18, and macOS Sequoia operating systems, which were announced alongside Apple Intelligence. Apple Intelligence will be free for all users with supported devices. It is scheduled to enter into a developer beta in the United States in late 2024 and will fully launch in 2025.[2][3]

Models

Apple Intelligence consists of an on-device model as well as a cloud model running on servers using Apple silicon. Both models consist of a generic foundation model, as well as multiple adapter models that are more specialized to particular tasks like text summarization and tone adjustment.[4]

According to a human evaluation done by Apple's machine learning division, the on-device foundation model beat or tied equivalent small models by Mistral AI, Microsoft, and Google, while the server foundation models beat the performance of OpenAI's GPT-3, while roughly matching the performance of GPT-4.[5]

Apple's cloud models are built on a Private Cloud Compute platform, designed heavily with user privacy and end-to-end encryption in mind.[6]

Functionality and features

Writing tools

Apple Intelligence features writing tools that are powered by AI, including Rewrite and Proofread. These features help enhance users' writing to make it more friendly, concise or professional, similar to Grammarly's AI writing features. It can also be used to generate summaries, key points, tables, and lists from an article or piece of writing.[7][8] ChatGPT will be available as part of Writing Tools.[9]

Image Playground

Apple Intelligence can also be used to generate images on-device with the Image Playground app. Similarly to OpenAI's DALL-E, it can be used to generate images using AI, using phrases and descriptions to create an image with customizable styles such as Animation and Sketch. In Notes, users can access Image Playground on iPad through the Image Wand tool in the Apple Pencil palette without having to open the Image Playground app. Rough sketches can be transformed into images.

Genmoji

Using Apple Intelligence text-to-image models, users can create original Genmoji images by typing descriptions.[10] Users can pick people in photos and create Genmoji images that resemble them.[11] Similarly to emoji, Genmoji can be added inline to text messages and can be shared in Messages and in supported third-party apps as stickers or Tapback reactions.[12][13]

Siri overhaul

Siri, Apple's virtual assistant, has been updated with enhanced capabilities made possible by Apple Intelligence. The latest iteration features an updated user interface, improved natural language processing, and the option to interact via text by double tapping the home bar without enabling the feature in the Accessibility menu. In addition, Apple Intelligence adds the ability for Siri to use personal context from device activities to make conversations feel more natural and fluid.[9]

Mail

Apple Intelligence adds a feature called Priority Messages to the Mail app.[9]

Photos

Apple's Photos app includes a feature to create custom memory movies and enhanced search capabilities. Users can describe a story , and using Apple Intelligence, selects matching photos and videos. It organizes these into a movie with a narrative arc based on identified themes. Additionally, users can search for specific photos or videos by description and/or keyword, and Apple Intelligence can pinpoint particular moments within video clips.[14]

Code completion

Apple Intelligence is integrated into Apple's Xcode IDE, starting with version 16. This includes a predictive code completion feature, similar to GitHub Copilot, that runs on-device, using a model specifically trained on the Swift language and APIs. A new Swift Assist chat feature, using cloud models, generates and edits Swift code based on a user's prompt.[15] The on-device code completion feature requires a Mac with at least 16GB of memory to run.[16]

ChatGPT integration

As a result of the company's partnership with OpenAI, Apple Intelligence also includes a system-wide integration with ChatGPT, allowing Siri to determine when to send certain complex user requests to ChatGPT. This system-wide integration is powered by GPT-4o.[9] ChatGPT integration is opt-in by default, with users being prompted before any data or photos are sent to ChatGPT servers and IP addresses being obscured when requests are sent to OpenAI's servers.[17] Using ChatGPT features are free for all users without needing to sign in, however paid subscribers can sign in to gain access to paid features systemwide. Apple plans to integrate other models such as Google's Gemini into the system in the future.[18]

Development

Background

In October 2015, Apple Inc. acquired Perceptio, an on-device artificial intelligence modeling company.[19] Following the acquisition, Apple engaged in efforts to ensure its artificial intelligence operations remained covert; according to University of California, Berkeley professor Trevor Darrell, the company's secrecy deterred graduate students.[20]

Supported devices

All Macs and iPads with an M-series Apple silicon processor will support Apple Intelligence with the release of macOS Sequoia and iPadOS 18. iPhones with at least an A17 Pro or later will also be supported with the release of iOS 18.[21] Analyst Ming-Chi Kuo speculates that the RAM requirements of the on-device model prohibits Apple Intelligence from running on earlier iPhones.[22]

Macs

  • MacBook Air (M1, 2020) or later
  • MacBook Pro (M1, 2020) or later
  • Mac mini (M1, 2020) or later
  • Mac Pro (M2 Ultra, 2023)
  • Mac Studio (M1 Max/Ultra, 2022) or later
  • iMac (M1, 2021) or later

iPads

  • iPad Air (5th generation) or later
  • iPad Pro (5th generation) or later

iPhones

See also

References

  1. ^ "Apple's AI plans, iOS 18, and more at WWDC 2024". The Verge. June 10, 2024. Archived from the original on June 11, 2024. Retrieved June 10, 2024.
  2. ^ "Apple Intelligence Preview". Apple. Retrieved June 14, 2024.
  3. ^ Davis, Wes (June 16, 2024). "Apple won't wait until next year for some Siri improvements". The Verge. Retrieved June 17, 2024.
  4. ^ "Introducing Apple's On-Device and Server Foundation Models". Apple Machine Learning Research. Retrieved June 15, 2024.
  5. ^ Lambert, Nathan (June 12, 2024). "AI for the rest of us". Interconnects. Retrieved June 15, 2024.
  6. ^ "Private Cloud Compute: A new frontier for AI privacy in the cloud". Apple Security Research. June 10, 2024. Archived from the original on June 11, 2024. Retrieved June 11, 2024.
  7. ^ Chedraoui, Katelyn (June 11, 2024). "Did Apple Intelligence's 'Rewrite' Tool Just Kill Grammarly?". CNET. Retrieved June 12, 2024.
  8. ^ Lovejoy, Ben (June 11, 2024). "Apple Intelligence: The features I can't wait to try". 9to5Mac. Retrieved June 12, 2024.
  9. ^ a b c d "Introducing Apple Intelligence for iPhone, iPad, and Mac". Apple Newsroom. June 10, 2024. Retrieved June 14, 2024.
  10. ^ Rutherford, Sam (June 10, 2024). "In case there weren't enough emoji already, Apple's Genmoji uses AI to generate even more". Engadget. Archived from the original on June 24, 2024. Retrieved June 24, 2024.
  11. ^ Jones, D. Griffin (June 10, 2024). "Image Playground and Genmoji bring AI images to iMessage and more". Cult of Mac. Archived from the original on June 11, 2024. Retrieved June 24, 2024.
  12. ^ Murphy, Darragh (June 10, 2024). "WWDC 2024: Genmoji lets you create your own emojis with 'Apple Intelligence'". Mashable. Archived from the original on June 12, 2024. Retrieved June 24, 2024.
  13. ^ Joseph, Melwyn (June 11, 2024). "How to Use Genmoji - Steps Explained". Stealth Optional. Archived from the original on June 24, 2024. Retrieved June 24, 2024.
  14. ^ Perez, Sarah (June 10, 2024). "Apple revamps its Photos app for iOS 18". TechCrunch. Retrieved June 12, 2024.
  15. ^ "Apple empowers developers and fuels innovation with new tools and resources". Apple Newsroom. June 10, 2024. Retrieved June 15, 2024.
  16. ^ "Xcode 16 Beta Release Notes". Apple Developer Documentation. Retrieved June 15, 2024.
  17. ^ Edu, Jide (June 14, 2024). "Apple insists its ChatGPT tie-up will protect users' privacy: here are the questions it must answer first". The Conversation. Retrieved June 26, 2024.
  18. ^ Perry, Alex (June 11, 2024). "Apple plans to work with Google's Gemini, other AI models". Mashable. Retrieved June 15, 2024.
  19. ^ Clark, Jack; Satariano, Adam (October 5, 2015). "Apple Acquires Startup Developing Advanced AI for Phones". Bloomberg News. Archived from the original on December 23, 2023. Retrieved June 10, 2024.
  20. ^ Clark, Jack (October 29, 2015). "Apple's Deep Learning Curve". Bloomberg News. Archived from the original on May 26, 2023. Retrieved June 10, 2024.
  21. ^ Nield, David (June 11, 2024). "Apple Intelligence: here's a full list of the iPhones, iPads and Macs that'll get Apple's new AI powers". TechRadar. Retrieved June 15, 2024.
  22. ^ Kuo, Ming-Chi (June 11, 2024). "How Apple defines on-device AI and future trends — from the perspective of analyzing supported models of Apple Intelligence". Medium. Retrieved June 15, 2024.

External links

  • Official website
  • Apple Developer page
  • v
  • t
  • e
Software by Apple
Operating systems
Consumer
Professional
Education
  • Classroom
Bundled
Server
Developer
Internet
on Windows