The Exciting Gemini and Google AI Features We’re Waiting For

In recent years, Google has unveiled numerous Gemini-branded and AI-powered features across its consumer apps. Here’s a detailed look at what’s been announced and when these innovations might become available.

Pixel: The Future of Zoom Enhancement

At the Made by Google 2023 event, Google teased a new Zoom Enhance feature for the Pixel 8 Pro. This tool intelligently fills gaps between pixels, predicting fine details using a custom generative AI image model. It’s a groundbreaking application of AI, transforming how we frame and edit photos. Despite three Pixel Feature Drops since its announcement, the feature has yet to arrive. It may debut with the Pixel 9 Pro, potentially as its headline photo feature.

Google Home: Streamlined Event Summaries

The Google Home app will soon leverage generative AI to summarize events into a streamlined view of recent activities. Users will benefit from quick and easy summaries with bullet points and the ability to ask conversational questions about their home. These experimental features are expected to be available to Nest Aware subscribers in 2024.

Fitbit: Personalized AI Coaching

Fitbit Labs is introducing experimental AI capabilities for Fitbit Premium users, including a chatbot for personalised coaching. This AI-powered feature offers actionable messages and guidance based on fitness goals, providing responses with custom charts. Powered by a new Personal Health LLM from Fitbit and Google Research, this feature will be available later this year for a limited number of Android users in the Fitbit Labs program.

Google Photos: Intelligent Image Queries

Google Photos will soon feature Ask Photos, allowing users to ask questions about their images and videos. Powered by Gemini, this tool can find pictures, provide text answers, suggest top photos, and create captions. This experimental feature will be rolled out soon, with additional capabilities to follow.

Also Read: New Generative AI in Google Search : Let AI Do the Work for You

Gmail and Google Workspace: Enhanced Communication Tools

Gmail for Android and iOS will feature a Gemini button for entering prompts, along with Contextual Smart Replies offering detailed suggestions. In April 2024, Google previewed a voice prompting capability for mobile Gmail’s Help me write feature. On desktop, Gemini will enhance Gmail, Google Drive, Docs, Sheets, and Slides, with future integration into Google Chat for summarizing conversations and answering questions.

Google Maps: Enhanced Location Queries

In February, Google announced that Maps would use LLMs to power an “Ask about” chatbot. This feature helps users find places matching their prompts, supported by details from 250 million locations and user-generated content. This generative AI tool is a significant step forward for Google Maps.

Chrome: Writing Assistance

Gemini Nano will soon be available on desktop Chrome, enhancing features like Help me write. This tool will support most modern laptops and desktops, streamlining the writing process with AI assistance.

Google Search: Advanced Query Capabilities

Google is set to launch several AI features in Search Labs, including AI Overviews that can be simplified or expanded upon. Users will be able to perform complex, multi-step reasoning queries, plan meals and trips, and search videos. These enhancements will significantly improve the search experience.

Android: Multimodal Gemini Nano

Later this year, Gemini Nano with Multimodality will launch on Pixel devices, powering features like on-device TalkBack descriptions and real-time scam alerts. Google will also introduce Dynamic Suggestions, which use Gemini Nano to understand screen content and offer relevant actions. Additionally, Gemini Extensions will integrate with Google Calendar, Tasks, and Keep, turning photos of upcoming dates into Calendar events.

Gemini Live: Real-Time AI Interaction

Gemini Live will enable two-way conversations with Gemini, providing concise, interruptible responses. This feature, available to Gemini Advanced members, will support various applications, from interview prep to speech rehearsals. Later this year, a live camera mode will allow users to ask questions about real-world objects, powered by Project Astra.

Customised Gemini Gems

Gems are specialized versions of Gemini designed for specific tasks like being a gym buddy, sous chef, or coding partner. Users can create custom Gems, while pre-made Gems like Learning Coach will be accessible to all. Gemini Advanced users will also benefit from an immersive planner that integrates travel details, recommendations, and personal interests into detailed itineraries.

Stay tuned for these exciting developments as Google continues to push the boundaries of AI technology.

Source