The Company Continues to Emphasize AI as it Incorporates the New Tech Into Its Smartphone Lineup
Google has officially unveiled its Pixel 9 lineup with today’s Made by Google event, further emphasizing artificial intelligence as the company’s top priority as it works to integrate these new technologies within its hardware and software offerings.
On the hardware side, Google has increased the RAM across its new phones to better support on-device AI applications. The Pixel 9 comes equipped with 12GB of RAM, while the other models in the lineup boast 16GB. However, the software enhancements are the real highlight, with several new Pixel-exclusive AI features. Additionally, the Pro models include a year of Google One AI Premium, providing access to Gemini Advanced, Google’s most advanced AI system.
Here is a summary of the major AI features announced for the Pixel 9:
Pixel Screenshots
Google introduces Pixel Screenshots, a feature similar to Microsoft’s Recall. This feature allows users to take screenshots to track events or information, which can be retrieved later using a conversational search. Google describes this as exclusive to Pixel devices.
Gemini’s Screen Understanding
Google has integrated the ability for Gemini to respond based on the content on your phone screen. Users can ask Gemini questions about what they are viewing by tapping “Ask about this screen” or “Ask about this video.” This enables functionalities like adding restaurants from a YouTube video to Google Maps.
Enhanced Gemini Assistant
The Gemini assistant is getting faster and more reliable with the new Gemini 1.5 Flash model, which provides improved response quality. Google is expanding Gemini’s capabilities with additional extensions for apps like Keep, Tasks, Utilities, and Google Calendar.
Gemini Live
Google introduces Gemini Live, a voice chat feature similar to ChatGPT’s voice chat. It allows for natural conversation, letting users interrupt or pause as needed, even with a locked screen. Gemini Live is exclusive to Gemini Advanced subscribers. Users of the new Pixel Buds Pro 2 can also interact with Gemini through their headphones.
Photo Reimagination
The new Magic Editor feature allows users to modify photos by describing desired changes. Users can alter backgrounds or other elements by selecting parts of the image and providing prompts. This tool offers a creative way to enhance photos.
Add Me Feature
The Pixel 9 camera introduces the “Add Me” feature for group photos, which uses an AR overlay to help users take a picture with friends without needing assistance from others. This feature will be available on all Pixel 9 phones from launch.
Pixel Studio App
A new Pixel Studio app enables users to create illustrations using text prompts. This is powered by an on-device diffusion model and Google’s Imagen 3 cloud-based model. An internet connection is required to use this feature.
Circle to Search
Google is adding a new AI-powered sharing feature called Circle to Search, allowing users to share parts of an image or screen easily. After circling the desired portion, users can quickly share it via text.
AI Weather Summaries
The new Pixel Weather app uses Gemini Nano to generate AI-powered weather reports, allowing users to customize the layout and prioritize specific information like the UV index.
Call Notes
Google will use AI to create summaries of phone calls, helping users capture important details such as phone numbers. The company assures users that calls and summaries are not sent to the cloud and that all call participants are notified before transcription. Call Notes works for calls lasting at least 30 seconds.
