feat: google vertex llm #599
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
|
@jrj5423 is attempting to deploy a commit to the pingcap Team on Vercel. A member of the Team first needs to authorize it. |
There was a problem hiding this comment.
Keep the ANTHROPIC_VERTEX for compatibility, we will delete it in the feature.
Please also support dsp.GoogleVertexAI on dspy LM
autoflow/backend/app/utils/dspy.py
Line 76 in 61597f7
backend/app/rag/llms/resolver.py
Outdated
| @@ -75,6 +75,22 @@ def get_llm( | |||
| credentials=google_creds, | |||
| **config, | |||
| ) | |||
| case LLMProvider.VERTEX: | |||
There was a problem hiding this comment.
| case LLMProvider.VERTEX: | |
| case LLMProvider.ANTHROPIC_VERTEX: | |
| case LLMProvider.VERTEX: |
There was a problem hiding this comment.
Does this suggestion mean to delete the processing operation of ANTHROPIC_VERTEX?
| @@ -132,6 +133,22 @@ class LLMProviderOption(BaseModel): | |||
| "private_key_id": "****", | |||
| }, | |||
| ), | |||
| LLMProviderOption( | |||
There was a problem hiding this comment.
rename the provider name of ANTHROPIC_VERTEX option to Anthropic Vertex AI (Deprecated)
| @@ -8,6 +8,7 @@ class LLMProvider(str, enum.Enum): | |||
| OPENAI = "openai" | |||
| GEMINI = "gemini" | |||
| ANTHROPIC_VERTEX = "anthropic_vertex" | |||
There was a problem hiding this comment.
Keep the LLMProvider.ANTHROPIC_VERTEX enumeration to avoid errors for users who are already using it.
Close #523.
Considering that our current
llama_indexcan already supportVertex, should we mergeANTHROPIC_VERTEXinto the same type asVERTEXin this commit?