Googlebooks’ Magic Pointer is also coming to Chrome on Gemini

Google just gave us our first look at Magic Pointer, the new AI-powered cursor experience coming to its newly announced Googlebook laptops. The company has now confirmed that Magic Pointer won’t be limited to Googlebooks, and that the experience is also heading to Gemini in Chrome.

in a new blog postResearchers at Google DeepMind detailed the ideas and interaction principles behind the magic pointer.

DeepMind says the mouse pointer “has barely evolved in more than half a century” and Google now wants to change that with Gemini-powered contextual understanding.

The goal is to create “intuitive AI that meets users across all the devices they use without disrupting their flow.”

This means that instead of copying text into Gemini or typing long prompts, Chrome users can simply point to something on the screen and ask for help. Google says the system can understand what you’re pointing at and what you’re trying to do with it.

“Starting today, instead of typing a complex prompt, you can now use your pointer to ask Gemini in Chrome about the part of a webpage you care about. For example, you can select some products on a page and ask to compare, or point to where you’d like to imagine a new sofa in your living room,” DeepMind wrote in its blog.

Google describes the Magic Pointer experience as one where users can “just point, and the AI ​​knows exactly what word, paragraph, part of an image, or block of code the user needs help with.”

The company also says it wants AI interactions to feel more human and conversational. Instead of typing detailed prompts, users can type “fix this,” “move that here,” or “what does this mean?” Can make simple requests like. Relying on physical gestures and shared context to communicate intent.

One of the more interesting ideas highlighted by Google is “turning pixels into actionable entities.” Essentially, Gemini can recognize objects, dates, places, and other content directly from what’s on the screen. Google says this lets users instantly interact with things like restaurant listings, handwritten notes or travel destinations in videos.

It seems that the Magic Pointer’s more complex capabilities will be present in the upcoming Googlebooks, while its Chrome experience may offer some basic features like comparisons and visualizations.

Google hasn’t shared which regions or users are first getting access to the Magic Pointer experience in Chrome through Gemini. We tested Gemini in Chrome ourselves and couldn’t access any magic pointer capabilities yet, so the rollout may be limited or gradual.