SPB Git

Repository Public

interactions.md 12.8 KB 192 lines markdown

1# Interactions API23> [!IMPORTANT]4> The Interactions API is currently in Beta. Features and schemas are subject to [breaking changes](https://ai.google.dev/gemini-api/docs/interactions-breaking-changes-may-2026).5>6> If you are migrating from the `generateContent` API, see the [Migration Guide](https://ai.google.dev/gemini-api/docs/migrate-to-interactions).78The Interactions API is the new standard for building with Gemini, recommended for all new projects. It is optimized for agentic workflows, server-side state management, and complex multi-modal, multi-turn conversations. The original [`generateContent`](https://ai.google.dev/gemini-api/docs/interactions/text-generation) API remains fully supported.910## Why use the Interactions API?1112- **Server-side history management** : Simplified multi-turn flows via `previous_interaction_id`. The server enables state by default (`store=true`), but you can opt into stateless behavior by setting `store=false`.13- **Observable execution steps**: Typed steps make it easy to debug complex flows and render UI for intermediate events (like thoughts or search widgets).14- **Built for agentic workflows**: Native support for multi-step tool use, orchestration, and complex reasoning flows through typed execution steps.15- **Long-running and background tasks** : Supports offloading time-intensive operations like [Deep Think](https://ai.google.dev/gemini-api/docs/interactions/thinking) and [Deep Research](https://ai.google.dev/gemini-api/docs/interactions/deep-research) to background processes using `background=true`.16- **Access to new models and capabilities**: Going forward, new models beyond the core mainline family, along with new agentic capabilities and tools, will launch exclusively on the Interactions API.1718**Use the Interactions API** if you're starting a new project, building agentic applications, or need server-side conversation management. **Use [`generateContent`](https://ai.google.dev/gemini-api/docs/interactions/text-generation)** if you have an existing integration that works for your needs, or if you require a feature that is [not yet available](https://ai.google.dev/gemini-api/docs/interactions#limitations) in the Interactions API, such as the Batch API or explicit caching.1920## Get started2122- **Set up your coding agent** : Connect to the **Gemini Docs MCP** and install the `gemini-interactions-api` skill to give your assistant direct access to the latest developer docs and best practices. [Set up your coding agent →](https://ai.google.dev/gemini-api/docs/coding-agents)23- **Migrate from `generateContent`** : If you have an existing integration, follow the [Migration Guide](https://ai.google.dev/gemini-api/docs/migrate-to-interactions) to transition to the Interactions API.24- **Try the quickstart** : Get started with a minimal working example in the [Interactions API quickstart](https://ai.google.dev/gemini-api/docs/interactions/quickstart).2526### Feature Guides2728Explore the specific capabilities of the Interactions API through these guides. You can use the toggle on these pages to switch between generateContent and Interactions API:2930- [Text generation](https://ai.google.dev/gemini-api/docs/interactions/text-generation)31- [Image generation](https://ai.google.dev/gemini-api/docs/interactions/image-generation)32- [Image understanding](https://ai.google.dev/gemini-api/docs/interactions/image-understanding)33- [Audio understanding](https://ai.google.dev/gemini-api/docs/interactions/audio)34- [Video understanding](https://ai.google.dev/gemini-api/docs/interactions/video-understanding)35- [Document processing](https://ai.google.dev/gemini-api/docs/interactions/document-processing)36- [Function calling](https://ai.google.dev/gemini-api/docs/interactions/function-calling)37- [Structured output](https://ai.google.dev/gemini-api/docs/interactions/structured-output)38- [Deep Research Agent](https://ai.google.dev/gemini-api/docs/interactions/deep-research)39- [Flex inference](https://ai.google.dev/gemini-api/docs/interactions/flex-inference)40- [Priority inference](https://ai.google.dev/gemini-api/docs/interactions/priority-inference)41- [Streaming](https://ai.google.dev/gemini-api/docs/interactions/streaming)4243## How the Interactions API works4445The Interactions API centers around a core resource: the [**`Interaction`**](https://ai.google.dev/api/interactions-api#Resource:Interaction). An `Interaction` represents a complete turn in a conversation or task. It acts as a session record, containing the entire history of an interaction as a chronological sequence of **execution steps** . These steps include model thoughts, server-side or client-side tool calls and results (like `function_call` and `function_result`), and the final `model_output`. The stored resource (retrieved via `interactions.get`) also includes `user_input` steps for full context, though the `interactions.create` response only returns model-generated steps.4647When you make a call to48[`interactions.create`](https://ai.google.dev/api/interactions-api#CreateInteraction), you are49creating a new `Interaction` resource.5051### Access outputs with SDK convenience properties5253While the Interactions API returns a structured timeline of execution steps54(such as thoughts, search queries, and function calls), you don't need to55manually traverse the steps to get the final model response.5657The Google GenAI SDKs provide convenience properties directly58on the returned `Interaction` object to access the outputs for different59modalities:6061| SDK convenience property | Return Type | Description |62|---|---|---|63| **`interaction.output_text`** | String | Returns the last text blocks in the model's response. If the response is split across multiple consecutive `TextContent` blocks, it automatically joins them. It does not include earlier text blocks separated by non-text content (such as thoughts, images, audio, or tool calls). For complex or interleaved multimodal responses, you must manually iterate over `steps` instead. |64| **`interaction.output_image`** | ImageContent or `None` | Returns the last image block generated by the model in the current request. |65| **`interaction.output_audio`** | AudioContent or `None` | Returns the last audio block generated by the model in the current request. |6667For advanced use cases---such as rendering intermediate thinking processes,68inspecting step-by-step tool calls, or debugging---you can still inspect and69traverse the raw `interaction.steps` timeline manually.7071### Server-side state management7273You can use the `id` of a completed interaction in a subsequent call using the74`previous_interaction_id` parameter to continue the conversation. The server75uses this ID to retrieve the conversation history, saving you from having to76resend the entire chat history.7778The `previous_interaction_id` parameter preserves only the conversation history (inputs and outputs)79using `previous_interaction_id`. The other parameters are **interaction-scoped**80and apply only to the specific interaction you are currently generating:8182- `tools`83- `system_instruction`84- `generation_config` (including `thinking_level`, `temperature`, etc.)8586This means you must re-specify these parameters in each new interaction if you87want them to apply. This server-side state management is optional; you can also88operate in stateless mode by sending the full conversation history in each89request.9091### Data storage and retention9293By default, the API stores all Interaction objects (`store=true`) in order to94simplify use of server-side state management features (with95`previous_interaction_id`), background execution (using `background=true`) and96observability purposes.9798- **Paid Tier** : The system retains interactions for **55 days**.99- **Free Tier** : The system retains interactions for **1 day**.100101If you don't want this, you can102set `store=false` in your request. This control is separate from state103management; you can opt out of storage for any interaction. However, note that104`store=false` is incompatible with `background=true` and prevents using105`previous_interaction_id` for subsequent turns.106107You can delete stored interactions at any time using the delete method found in108the [API Reference](https://ai.google.dev/api/interactions-api). You can only delete interactions if109you know the interaction ID.110111After the retention period expires, your data will be112deleted automatically.113114The system processes Interaction objects according to the [terms](https://ai.google.dev/gemini-api/terms).115116## Best practices117118- **Cache hit rate** : Using `previous_interaction_id` to continue conversations allows the system to more easily utilize implicit caching for the conversation history, which improves performance and reduces costs.119- **Mixing interactions** : You have the flexibility to mix and match Agent and Model interactions within a conversation. For example, you can use a specialized agent, like the Deep Research agent, for initial data collection, and then use a standard Gemini model for follow-up tasks such as summarizing or reformatting, linking these steps with the `previous_interaction_id`.120121## Supported models \& agents122123| Model Name | Type | Model ID |124|---|---|---|125| Gemini 3.5 Flash | Model | `gemini-3.5-flash` |126| Gemini 3.1 Flash-Lite | Model | `gemini-3.1-flash-lite` |127| Gemini 3.1 Flash-Lite Preview | Model | `gemini-3.1-flash-lite-preview` |128| Gemini 3.1 Pro Preview | Model | `gemini-3.1-pro-preview` |129| Gemini 3 Flash Preview | Model | `gemini-3-flash-preview` |130| Gemini 2.5 Pro | Model | `gemini-2.5-pro` |131| Gemini 2.5 Flash | Model | `gemini-2.5-flash` |132| Gemini 2.5 Flash-lite | Model | `gemini-2.5-flash-lite` |133| Lyria 3 Clip Preview | Model | `lyria-3-clip-preview` |134| Lyria 3 Pro Preview | Model | `lyria-3-pro-preview` |135| Deep Research Preview | Agent | `deep-research-pro-preview-12-2025` |136| Deep Research Preview | Agent | `deep-research-preview-04-2026` |137| Deep Research Preview | Agent | `deep-research-max-preview-04-2026` |138139## SDKs140141You can use latest version of the Google GenAI SDKs in order to access142Interactions API.143144- On Python, this is `google-genai` package from `1.55.0` version onwards.145- On JavaScript, this is `@google/genai` package from `1.33.0` version onwards.146147You can learn more about how to install the SDKs on148[Libraries](https://ai.google.dev/gemini-api/docs/libraries) page.149150## Limitations151152- **Beta status**: The Interactions API is in beta/preview. Features and schemas may change.153- **Remote MCP**: Gemini 3 does not support remote MCP, this is coming soon.154155The following features are supported by the156[`generateContent`](https://ai.google.dev/gemini-api/docs/interactions/text-generation) API but are **not yet157available** in the Interactions API:158159- **[Video metadata](https://ai.google.dev/gemini-api/docs/interactions/video-understanding)** : The `video_metadata` field, used to set clipping intervals and custom frame rates for video understanding.160- **[Batch API](https://ai.google.dev/gemini-api/docs/batch-api)**161- **[Automatic function calling (Python)](https://ai.google.dev/gemini-api/docs/function-calling?example=meeting#automatic_function_calling_python_only)**162- **[Explicit caching](https://ai.google.dev/gemini-api/docs/interactions/caching)** : Note that server-side implicit caching is available in the Interactions API via `previous_interaction_id`.163164## Breaking changes165166The Interactions API is currently in an early beta stage. We are actively167developing and refining the API capabilities, resource schemas, and SDK168interfaces based on real-world usage and developer feedback. As a result, **breaking changes may occur**.169170Existing breaking changes:171172- **Steps schema**: A new steps array replaces the outputs array, providing a structured timeline of each interaction turn.173174To learn about the most recent breaking change and understand how to migrate, see [Breaking changes migration guide (May 2026)](https://ai.google.dev/gemini-api/docs/interactions-breaking-changes-may-2026).175176Other potential updates may include changes to schemas for input and output, SDK method signatures and object structures, specific feature behaviors.177178For production workloads, you should continue to use the standard179[`generateContent`](https://ai.google.dev/gemini-api/docs/interactions/text-generation) API. It remains the180recommended path for stable deployments, and we will continue to actively develop and maintain it.181182## Feedback183184Your feedback is critical to the development of the Interactions API.185Share your thoughts, report bugs, or request features on our186[Google AI Developer Community Forum](https://discuss.ai.google.dev/c/gemini-api/4).187188## What's next189190- Try the [Interactions API quickstart notebook](https://colab.sandbox.google.com/github/google-gemini/cookbook/blob/main/quickstarts/Get_started_interactions_api.ipynb).191- Learn about [Streaming interactions](https://ai.google.dev/gemini-api/docs/interactions/streaming) for real-time response handling.192- Learn more about the [Gemini Deep Research Agent](https://ai.google.dev/gemini-api/docs/interactions/deep-research).
Files main
Menu

Theme