AI Studio Annotation Mode: Easily Edit Your Apps with Gemini

Introducing Annotation Mode in AI Studio

• 💡 Annotation Mode in AI Studio Build allows users to highlight specific parts of their app and instruct Gemini on desired modifications.
• 🚀 This feature aims to simplify the iteration process and accelerate the realization of app development ideas.

How Annotation Mode Works

• 🎯 Users can activate annotation mode within the chat window of an open app in AI Studio.
• ✍️ Available tools include drawing rectangles, adding comments, and using arrows to point to specific elements.
• 🎨 Free-form sketching and drawing are also supported, allowing for direct visual modifications.

Applying Edits with Gemini

• 🖼️ When a user applies annotations, AI Studio captures a screenshot with the markings and generates a prompt for Gemini, such as "apply the edits shown in the screenshots."
• 🧠 Gemini's vision understanding capabilities enable it to interpret these visual instructions and the accompanying text prompts.
• ✅ The system then processes the request, refreshing the app to reflect the applied changes, like converting text to a one-liner, changing button colors, or removing elements.

Benefits of Annotation Mode

• 💬 This method provides a more natural and intuitive way to iterate on app designs and communicate modification ideas.
• ✨ The goal is to make app refinement as straightforward as directly indicating desired changes.