FirebaseAILogic Framework Reference Stay organized with collections Save and categorize content based on your preferences.
Structures
The following structures are available globally.
The model’s response to a generate content request.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructGenerateContentResponse:SendableextensionGenerateContentResponse:DecodableA struct representing a possible reply to a content generation prompt. Each content generationprompt may produce multiple candidate responses.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructCandidate:SendableextensionCandidate:DecodableA collection of source attributions for a piece of content.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructCitationMetadata:SendableextensionCitationMetadata:DecodableA struct describing a source attribution.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructCitation:Sendable,EquatableextensionCitation:DecodableA value enumerating possible reasons for a model to terminate a content generation request.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructFinishReason:DecodableProtoEnum,Hashable,SendableA metadata struct containing any feedback the model had on the prompt it was provided.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructPromptFeedback:SendableextensionPromptFeedback:DecodableMetadata returned to the client when grounding is enabled.
Important
If using Grounding with Google Search, you are required to comply with the“Grounding with Google Search” usage requirements for your chosen API provider:Gemini Developer APIor Vertex AI Gemini API (seeService Termssection within the Service Specific Terms).
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructGroundingMetadata:Sendable,Equatable,HashableextensionGroundingMetadata:DecodableRepresents a specific segment within a
ModelContentstruct, often used to pinpoint theexact location of text or data that grounding information refers to.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructSegment:Sendable,Equatable,HashableextensionSegment:DecodableA struct defining model parameters to be used when sending generative AIrequests to the backend model.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructGenerationConfig:SendableextensionGenerationConfig:EncodableConfiguration parameters for sending requests to the backend.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructRequestOptions:SendableextensionRequestOptions:EquatableRepresents token counting info for a single modality.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructModalityTokenCount:SendableextensionModalityTokenCount:DecodableContent part modality.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructContentModality:DecodableProtoEnum,Hashable,SendableA type describing data in media formats interpretable by an AI model. Each generative AIrequest or response contains an
ArrayofModelContents, and eachModelContentvaluemay comprise multiple heterogeneousParts.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructModelContent:Equatable,SendableextensionModelContent:CodableA type defining potentially harmful media categories and their model-assigned ratings. A valueof this type may be assigned to a category for every model-generated response, not justresponses that exceed a certain threshold.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructSafetyRating:Equatable,Hashable,SendableextensionSafetyRating:DecodableA type used to specify a threshold for harmful content, beyond which the model will return afallback response instead of generated content.
Seesafety settings for Geminimodels formore details.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructSafetySetting:SendableextensionSafetySetting:EncodableCategories describing the potential harm a piece of content may pose.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructHarmCategory:CodableProtoEnum,Hashable,SendableStructured representation of a function declaration.
This
FunctionDeclarationis a representation of a block of code that can be used as aToolby the model and executed by the client.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructFunctionDeclaration:SendableextensionFunctionDeclaration:EncodableA tool that allows the generative model to connect to Google Search to access and incorporateup-to-date information from the web into its responses.
Important
When using this feature, you are required to comply with the“Grounding with Google Search” usage requirements for your chosen API provider:Gemini Developer APIor Vertex AI Gemini API (seeService Termssection within the Service Specific Terms).
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructGoogleSearch:SendableextensionGoogleSearch:EncodableA helper tool that the model may use when generating responses.
A
Toolis a piece of code that enables the system to interact with external systems to performan action, or set of actions, outside of knowledge and scope of the model.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructTool:SendableextensionTool:EncodableConfiguration for specifying function calling behavior.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructFunctionCallingConfig:SendableextensionFunctionCallingConfig:EncodableTool configuration for any
Toolspecified in the request.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructToolConfig:SendableextensionToolConfig:EncodableThe model’s response to a count tokens request.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructCountTokensResponse:SendableextensionCountTokensResponse:DecodableRepresents available backend APIs for the Firebase AI SDK.
Declaration
Swift
publicstructBackendAn aspect ratio for images generated by Imagen.
To specify an aspect ratio for generated images, set
aspectRatioinyourImagenGenerationConfig. See theClouddocumentationfor more details and examples of the supported aspect ratios.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructImagenAspectRatio:SendableConfiguration options for generating images with Imagen.
SeeParameters for Imagenmodels tolearn about parameters available for use with Imagen models, including how to configure them.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructImagenGenerationConfigA response from a request to generate images with Imagen.
The type placeholder
Tis an image type; this is currently always anImagenInlineImage.This type is returned from:
generateImages(prompt:)whereTisImagenInlineImage
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructImagenGenerationResponse<T>:SendablewhereT:SendableextensionImagenGenerationResponse:DecodablewhereT:DecodableAn image format for images generated by Imagen.
To specify an image format for generated images, set
imageFormatinyourImagenGenerationConfig. See theClouddocumentationfor more details.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructImagenImageFormatAn error that occurs when image generation fails due to all generated images being blocked.
The images may have been blocked due to the specified
ImagenSafetyFilterLevel, theImagenPersonFilterLevel, or filtering included in the model. These filter levels may beadjusted in yourImagenSafetySettings. See theResponsible AI and usage guidelines forImagenfor more details.Declaration
Swift
publicstructImagenImagesBlockedError:ErrorextensionImagenImagesBlockedError:CustomNSErrorAn image generated by Imagen, represented as inline data.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructImagenInlineImage:SendableextensionImagenInlineImage:EquatableextensionImagenInlineImage:DecodableA filter level controlling whether generation of images containing people or faces is allowed.
See the
personGenerationdocumentation for more details.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructImagenPersonFilterLevel:ProtoEnumA filter level controlling how aggressively to filter sensitive content.
Text prompts provided as inputs and images (generated or uploaded) through Imagen on Vertex AIare assessed against a list of safety filters, which include ‘harmful categories’ (for example,
violence,sexual,derogatory, andtoxic). This filter level controls how aggressively tofilter out potentially harmful content from responses. See thesafetySettingdocumentation and theResponsible AI and usageguidelinesfor more details.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructImagenSafetyFilterLevel:ProtoEnum,SendableSettings for controlling the aggressiveness of filtering out sensitive content.
See theResponsible AI and usageguidelinesfor more details.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructImagenSafetySettingsConfiguration options for audio transcriptions when communicating with a model that supports theGemini Live API.
While there are not currently any options, this will likely change in the future. For now, justproviding an instance of this struct will enable audio transcriptions for the correspondinginput or output fields.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructAudioTranscriptionConfig:SendableText transcription of some audio form during a live interaction with the model.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructLiveAudioTranscription:SendableConfiguration options for live content generation.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructLiveGenerationConfig:SendableIncremental server update generated by the model in response to clientmessages.
Content is generated as quickly as possible, and not in realtime. Clientsmay choose to buffer and play it out in realtime.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructLiveServerContent:SendableServer will not be able to service client soon.
To learn more about session limits, see the docs onMaximum session duration.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructLiveServerGoingAwayNotice:SendableUpdate from the server, generated from the model in response to client messages.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructLiveServerMessage:SendableRequest for the client to execute the provided
functionCalls.The client should return matching
FunctionResponsePart, where thefunctionIdfields correspond to individualFunctionCallParts.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)@available(watchOS,unavailable)publicstructLiveServerToolCall:SendableNotification for the client to cancel a previous function call from
LiveServerToolCall.The client does not need to send
FunctionResponseParts for the cancelledFunctionCallParts.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructLiveServerToolCallCancellation:SendableThe model sent a message that the SDK failed to parse.
This may indicate that the SDK version needs updating, a model is too old for the current SDKversion, or that the model is justnot supported.
Check the
NSUnderlyingErrorKeyentry inerrorUserInfofor the error that caused this.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructLiveSessionUnsupportedMessageError:Error,Sendable,CustomNSErrorThe live session was closed, because the network connection was lost.
Check the
NSUnderlyingErrorKeyentry inerrorUserInfoforthe error that caused this.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructLiveSessionLostConnectionError:Error,Sendable,CustomNSErrorThe live session was closed, but not for a reason the SDK expected.
Check the
NSUnderlyingErrorKeyentry inerrorUserInfofor the error that caused this.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructLiveSessionUnexpectedClosureError:Error,Sendable,CustomNSErrorThe model refused our request to setup a live session.
This can occur due to the model not supporting the requested response modalities, the projectnot having access to the model, the model being invalid, or some internal error.
Check the
NSUnderlyingErrorKeyentry inerrorUserInfofor the errorthat caused this.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructLiveSessionSetupError:Error,Sendable,CustomNSErrorConfiguration for controlling the voice of the model during conversation.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,*)@available(watchOS,unavailable)publicstructSpeechConfig:SendableA text part containing a string value.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructTextPart:PartA data part that is provided inline in requests.
Data provided as an inline data part is encoded as base64 and included directly (inline) in therequest. For large files, see
FileDataPartwhich references content by URI instead ofincluding the data in the request.Important
Only small files can be sent as inline data because of limits on total requestsizes; seeinput files and requirements for more details and size limits.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructInlineDataPart:PartFile data stored in Cloud Storage for Firebase, referenced by URI.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructFileDataPart:PartA predicted function call returned from the model.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructFunctionCallPart:PartResult output from a function call.
Contains a string representing the
FunctionDeclaration.nameand a structured JSON objectcontaining any output from the function is used as context to the model. This should contain theresult of aFunctionCallPartmade based on model prediction.Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructFunctionResponsePart:PartA part containing code that was executed by the model.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructExecutableCodePart:PartThe result of executing code.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructCodeExecutionResultPart:PartRepresents the different types, or modalities, of data that a model can produce as output.
To configure the desired output modalities for model requests, set the
responseModalitiesparameter when initializing aGenerationConfig. See themultimodalresponsesdocumentation for more details.Important
Support for each response modality, or combination of modalities, depends on themodel.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructResponseModality:EncodableProtoEnum,SendableConfiguration for controlling the “thinking” behavior of compatible Gemini models.
Certain models, like Gemini 2.5 Flash and Pro, utilize a thinking process before generating aresponse. This allows them to reason through complex problems and plan a more coherent andaccurate answer.
Declaration
Swift
publicstructThinkingConfig:SendableextensionThinkingConfig:EncodableA tool that allows the model to execute code.
This tool can be used to solve complex problems, for example, by generating and executing Pythoncode to solve a math problem.
Declaration
Swift
publicstructCodeExecution:Sendable,EncodableMetadata related to the
urlContext()tool.Warning
URL context is aPublic Preview feature, which means that it is not subject toany SLA or deprecation policy and could change in backwards-incompatible ways.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructURLContextMetadata:Sendable,HashableextensionURLContextMetadata:DecodableMetadata for a single URL retrieved by the
urlContext()tool.Warning
URL context is aPublic Preview feature, which means that it is not subject toany SLA or deprecation policy and could change in backwards-incompatible ways.
Declaration
Swift
@available(iOS15.0,macOS12.0,tvOS15.0,watchOS8.0,*)publicstructURLMetadata:Sendable,HashableextensionURLMetadata:Decodable
Except as otherwise noted, the content of this page is licensed under theCreative Commons Attribution 4.0 License, and code samples are licensed under theApache 2.0 License. For details, see theGoogle Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2025-10-28 UTC.