Titan embeddings breaking for LibreChat clients with v1.80.5-stable for anyone?

[gmerritt]

Is anyone proxying Titan embeddings for LibreChat? It worked fine for us for months, but possibly with the update to LiteLLM v1.80.5-stable it broke. (Well, it is broken for us today for sure, but there is a likely time correlation with us going to this version of LiteLLM.)

LibreChat embedding requests to LiteLLM now generate this error from Bedrock back to LiteLLM for us:

Malformed input request: expected type: String, found: JSONArray, please reformat your input and try again.

This is our LiteLLM configuration for this embedding model:

- model_name: amazon.titan-embed-text-v2:0
    litellm_params:
      model: bedrock/amazon.titan-embed-text-v2:0
      drop_params: true

Note that simple curl tests to the proxy work fine:

curl -X POST https://our.litellm.hostname/v1/embeddings \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer YOUR_LITELLM_API_KEY" \
  -d '{
    "model": "amazon.titan-embed-text-v2:0",
    "input": "The quick brown fox jumps over the lazy dog"
  }'

For completeness, here are relevant settings from our LibreChat (v0.7.9) which formally worked:

EMBEDDINGS_PROVIDER=openai
EMBEDDINGS_MODEL=amazon.titan-embed-text-v2:0
RAG_OPENAI_API_KEY=[redacted]
RAG_OPENAI_BASEURL=https://litellm.river.berkeley.edu/v1

I poked around the LiteLLM issues on GitHub, as we seem to be associating the breaking change with an update to LiteLLM, but I didn't find any likely candidate.

There are kind of a number of pieces in the chain, and I am working on digging deeper, but if anyone is experiencing this, please do share!