In a rapidly evolving AI landscape, Google and OpenAI have announced major updates, ramping up the competition for Apple just before the Worldwide Developers' Conference (WWDC). These advancements highlight the urgency for Apple to enhance its AI offerings.
OpenAI’s Latest Updates
On Monday, OpenAI introduced its cutting-edge GPT-4o model and a new Mac app. GPT-4o is a multi-modal AI model that can process various input types—audio, images, and text—using a single neural network. This update promises enhanced speed and language processing, making AI interactions more seamless.
A notable feature of GPT-4o is its ability to understand and convey emotions. For instance, it can analyze facial expressions to determine specific emotions, offering a more nuanced user experience. Additionally, the improved Voice Mode feature allows the AI to adjust its voice tone, catering to user preferences for a more robotic or natural sound.
OpenAI has also launched a desktop application for ChatGPT on macOS and introduced a new API for developers. GPT-4o will be gradually rolled out to users, enhancing the AI experience across various platforms.
Google’s Gemini Enhancements
On Tuesday, Google unveiled significant updates to its Gemini AI model during its I/O developer conference. The enhanced Gemini can comprehend complex user inputs and images while considering their context. Its new context-aware capabilities enable it to interact with PDFs, videos, and text messages, providing more accurate responses.
One standout feature is the Circle to Search option, which allows users to select objects within an image and receive Google Search results about them. Another feature, exclusive to Android, enables users to analyze YouTube videos and PDFs using Gemini Advanced. This paid service offers detailed answers drawn from video or PDF content.
Google’s updated Gemini also excels in summarizing lengthy conversations and extracting key information from documents, images, and videos. These capabilities are set to benefit users significantly, with Apple aiming to offer similar features through its products.
Apple’s AI Strategy
Despite lagging behind in AI, Apple is poised to unveil significant advancements with the announcement of iOS 18 in early June. Apple’s in-house large language model, Ajax, aims to introduce generative AI features akin to those from Google and OpenAI.
Apple plans to embed AI technology into core system applications like Notes, Safari, Messages, Mail, Siri, and Spotlight Search. Expected features include document and webpage analysis, text summarization, image captioning, and response generation.
However, Apple’s on-device AI model currently supports only basic text analysis and response generation. For more advanced features, Apple might rely on cloud-based processing, potentially through a partnership with OpenAI. Such a collaboration would enable Apple to offer sophisticated AI enhancements that its on-device models cannot support.
There’s also speculation that Apple could create an "AI App Store" for users to purchase AI-themed applications from other companies, including advanced features like those in Gemini Advanced.