Pixel 10 Series: Google's Focus on AI Phones Intensifies

Google Accelerates AI Smartphone Development, Surpassing Apple

Following the unveiling of the new Pixel 10 series, Google is proactively advancing its position in the smartphone market, delivering AI-powered devices to consumers at a faster pace than Apple. The devices, revealed during Wednesday’s Made by Google event, precede Apple’s anticipated iPhone 17 announcement by several weeks.

Enhanced AI Integration in the Pixel 10 Series

Google has been consistently integrating its AI platform into its devices. Last year’s Pixel 9 series introduced several AI features, including Gemini Live, image-generation capabilities, call notes, and searchable screenshots. Data indicates that Gemini Live conversations are now five times longer than their text-based counterparts.

This year’s launch of the Pixel 10 introduces even more AI-powered upgrades. These include a Visual Overlays feature for the camera, a proactive “Magic Cue” function, Camera Coach, Voice Translate for calls, an assistant-like “Take a Message” feature, Pixel Journal, and additional enhancements.

Powering AI with the Tensor G5 Processor

These combined updates demonstrate the capabilities of Google’s latest AI technology, which is further enhanced by the Tensor G5 processor. This represents an upgrade to the company’s custom silicon, specifically designed for AI experiences and the first to utilize the newest Gemini Nano model.

Google also announced that Gemini Live will incorporate a new audio model capable of detecting the user’s emotional tone – such as excitement or concern – and adjusting its responses accordingly.

New Features: Visual Overlays and Magic Cue

The addition of Visual Overlays allows Gemini Live to analyze what the user sees through the camera lens, providing guidance by highlighting elements on the screen. For example, while traveling abroad, the feature could identify information about parking regulations on street signs.

Magic Cue, another new feature, proactively offers contextual suggestions in real-time across various applications like Gmail, Calendar, Messages, and Screenshots.

A Return to Proactive Assistance

The concept of proactive interaction between users and Google technology dates back to the early 2010s with the introduction of Google Now. This Android feature displayed cards with real-time information relevant to the user’s schedule or time of day.

Magic Cue represents an AI-powered revival of this feature, seamlessly integrating into everyday apps and interactions.

Google showcased Magic Cue suggesting a restaurant for a meeting, offering quick access to reservations, proposing reply options, and linking to calendar availability.

Magic Cue: Integration and Reminders

Suggestions from Magic Cue appear within the app being used, distinguished by a rainbow-colored outline, and are also accessible within Daily Hub, a personalized digest in the Discover feed. Users can tap on suggestions to initiate actions.

Similar to Google Now, Magic Cue will also provide reminders, but with improved intuitiveness. It may prompt users about pending tasks, suggest research topics, or recommend new music playlists.

Initially, Magic Cue’s suggestions will be limited to specific activities, such as settling bills, adding calendar events, and displaying weather forecasts. Google plans to expand these options and allow users to customize data access.

Comparison with Apple’s Siri

Apple is pursuing a similar approach by enabling voice interaction with Siri to control and interact with apps. However, the launch of its AI-powered Siri has been delayed until 2026.

Camera Enhancements: Camera Coach and Auto Best Take

The Pixel 10 series introduces Camera Coach, an AI-powered assistant designed to improve photographic skills. Launching in preview, it utilizes Gemini models to offer suggestions on framing and composition, even providing inspirational scene ideas.

The camera now recognizes group photos, activating the “Auto Best Take” feature. This analyzes up to 150 images to select the optimal shot, potentially blending multiple images using AI.

AI-Powered Photo Editing and Zoom Capabilities

The AI-powered “Ask Photos” tool allows users to edit photos by fixing lighting, adjusting framing, or removing objects through voice or text commands.

On Pro devices, the Pro Res Zoom option leverages AI to enhance zoom capabilities for architecture, landscapes, animals, and wildlife, reaching 30x-60x magnification.

C2PA and Content Authenticity

Pixel 10 phones will be the first to implement C2PA, a standard that verifies the origin and edits of digital content, helping to identify AI-modified photos.

Voice Translate and Take a Message

The new Voice Translate feature uses on-device AI to provide real-time translation during phone calls, mimicking each speaker’s voice. This could be particularly valuable for business professionals and travelers.

The feature supports translation between English and Spanish, German, Japanese, French, Hindi, Italian, Portuguese, Swedish, Russian, and Indonesian.

The Pixel Phone app introduces “Take a Message,” which transcribes missed and declined calls and uses AI to identify necessary follow-up actions. This update will also be available in Call Notes.

Pixel Journal and Additional AI Upgrades

Pixel Journal, Google’s counterpart to Apple’s Journal app, utilizes AI to encourage reflection, track progress, and provide insights over time.

Other minor AI upgrades include writing tools for Gboard, updates to Pixel screenshots in Pixel Studio, and Notebook LM integrations with Recorder and screenshots.

We’re always looking to evolve, and by providing some insight into your perspective and feedback into TechCrunch and our coverage and events, you can help us! Fill out this survey to let us know how we’re doing and get the chance to win a prize in return!