VinF Hybrid Inference #2: Introduce ChromeAdapter class

[erikeldridge]

This change minimally introduces a ChromeAdapter class to abstract interactions with Chrome's Prompt API.

To constrain the scope of the change, this only injects the adapter into the generateContent path. If we agree on this approach, a subsequent PR can inject the adapter into the generateContentStream and countTokens paths.

This builds on the API change added by #8874. The diff is against the erikeldridge-vertex-api branch used for that PR. Once we merge that change, we can re-diff this against the integration branch.

[changeset-bot]

⚠️ No Changeset found

Latest commit: 08d341f

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[google-oss-bot]

Size Report ¹

Affected Products

• @firebase/vertexai

  Type	Base (78fed95)	Merge (b38556b)	Diff
  browser	35.0 kB	35.8 kB	+838 B (+2.4%)
  main	36.0 kB	36.8 kB	+838 B (+2.3%)
  module	35.0 kB	35.8 kB	+838 B (+2.4%)

• firebase

  Type	Base (78fed95)	Merge (b38556b)	Diff
  firebase-vertexai.js	28.4 kB	28.9 kB	+493 B (+1.7%)

Test Logs

• Base (78fed95): https://github.com/firebase/firebase-js-sdk/actions/runs/14252654313
• Merge (b38556b): https://github.com/firebase/firebase-js-sdk/actions/runs/14252674594

1. https://storage.googleapis.com/firebase-sdk-metric-reports/IOVAtqeyo4.html

[google-oss-bot]

Size Analysis Report ¹

Affected Products

• @firebase/vertexai

  • ChatSession

    Size

    Type	Base (78fed95)	Merge (b38556b)	Diff
    size	15.8 kB	16.0 kB	+175 B (+1.1%)
    size-with-ext-deps	34.7 kB	34.9 kB	+175 B (+0.5%)

    Dependency

    Type	Base (78fed95)	Merge (b38556b)	Diff
    functions	21 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest createEnhancedContentResponse formatBlockErrorMessage formatNewContent generateContent generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	22 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest createEnhancedContentResponse formatBlockErrorMessage formatNewContent generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	+ generateContentOnCloud

  • GenerativeModel

    Size

    Type	Base (78fed95)	Merge (b38556b)	Diff
    size	19.0 kB	19.2 kB	+236 B (+1.2%)
    size-with-ext-deps	37.9 kB	38.2 kB	+236 B (+0.6%)

    Dependency

    Type	Base (78fed95)	Merge (b38556b)	Diff
    functions	24 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	25 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	+ generateContentOnCloud

  • ImagenModel

    Size

    Type	Base (78fed95)	Merge (b38556b)	Diff
    size	20.7 kB	21.0 kB	+236 B (+1.1%)
    size-with-ext-deps	39.7 kB	39.9 kB	+236 B (+0.6%)

    Dependency

    Type	Base (78fed95)	Merge (b38556b)	Diff
    functions	26 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse createPredictRequestBody formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason handlePredictResponse makeRequest processStream registerVertex validateChatHistory	27 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse createPredictRequestBody formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason handlePredictResponse makeRequest processStream registerVertex validateChatHistory	+ generateContentOnCloud

  • VertexAIModel

    Size

    Type	Base (78fed95)	Merge (b38556b)	Diff
    size	19.0 kB	19.2 kB	+236 B (+1.2%)
    size-with-ext-deps	37.9 kB	38.2 kB	+236 B (+0.6%)

    Dependency

    Type	Base (78fed95)	Merge (b38556b)	Diff
    functions	24 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	25 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	+ generateContentOnCloud

  • getGenerativeModel

    Size

    Type	Base (78fed95)	Merge (b38556b)	Diff
    size	19.2 kB	19.7 kB	+474 B (+2.5%)
    size-with-ext-deps	38.2 kB	38.7 kB	+474 B (+1.2%)

    Dependency

    Type	Base (78fed95)	Merge (b38556b)	Diff
    functions	25 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getGenerativeModel getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	26 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getGenerativeModel getHeaders getResponsePromise getResponseStream getText hadBadFinishReason makeRequest processStream registerVertex validateChatHistory	+ generateContentOnCloud
    classes	ChatSession GenerativeModel RequestUrl VertexAIError VertexAIModel VertexAIService	ChatSession ChromeAdapter GenerativeModel RequestUrl VertexAIError VertexAIModel VertexAIService	+ ChromeAdapter

  • getImagenModel

    Size

    Type	Base (78fed95)	Merge (b38556b)	Diff
    size	20.9 kB	21.1 kB	+236 B (+1.1%)
    size-with-ext-deps	39.9 kB	40.1 kB	+236 B (+0.6%)

    Dependency

    Type	Base (78fed95)	Merge (b38556b)	Diff
    functions	27 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse createPredictRequestBody formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getImagenModel getResponsePromise getResponseStream getText hadBadFinishReason handlePredictResponse makeRequest processStream registerVertex validateChatHistory	28 dependencies addHelpers aggregateResponses assignRoleToPartsAndValidateSendMessageRequest constructRequest countTokens createEnhancedContentResponse createPredictRequestBody formatBlockErrorMessage formatGenerateContentInput formatNewContent formatSystemInstruction generateContent generateContentOnCloud generateContentStream generateResponseSequence getClientHeaders getFunctionCalls getHeaders getImagenModel getResponsePromise getResponseStream getText hadBadFinishReason handlePredictResponse makeRequest processStream registerVertex validateChatHistory	+ generateContentOnCloud

Test Logs

• Base (78fed95): https://github.com/firebase/firebase-js-sdk/actions/runs/14252654313
• Merge (b38556b): https://github.com/firebase/firebase-js-sdk/actions/runs/14252674594

1. https://storage.googleapis.com/firebase-sdk-metric-reports/EL93dL8zqY.html

[github-actions]

Vertex AI Mock Responses Check ⚠️

A newer major version of the mock responses for Vertex AI unit tests is available. update_vertexai_responses.sh should be updated to clone the latest version of the responses: v8.0