Class ChromeBuiltInLlm

constructor

• new ChromeBuiltInLlm(params?: ChromeBuiltInLlmParams): ChromeBuiltInLlm

  Parameters

  • params: ChromeBuiltInLlmParams = {}

  Returns ChromeBuiltInLlm

Static ReadonlysupportedModels

availability

• availability(): Promise<ChromeModelAvailability>

  Reports whether this browser can actually run the model.

  Returns Promise<ChromeModelAvailability>

connect

• connect(_llmRequest: LlmRequest): Promise<BaseLlmConnection>

  Creates a live connection to the LLM.

  Parameters

  • _llmRequest: LlmRequest

  Returns Promise<BaseLlmConnection>

  A live connection to the LLM.

destroy

• destroy(): void

  Releases the warm base session.

  Returns void

generateContentAsync

• generateContentAsync(
      llmRequest: LlmRequest,
      stream?: boolean,
      abortSignal?: AbortSignal,
  ): AsyncGenerator<LlmResponse, void>

  Generates one content from the given contents and tools.

  Parameters

  • llmRequest: LlmRequest

    LlmRequest, the request to send to the LLM.

  • stream: boolean = false

    whether to do streaming call. For non-streaming call, it will only yield one Content.

  • OptionalabortSignal: AbortSignal

  Returns AsyncGenerator<LlmResponse, void>

  A generator of LlmResponse.