From 9aa21aec7f242494f41e9a1e53ee775ccc9498d5 Mon Sep 17 00:00:00 2001 From: Spike Lu Date: Mon, 1 Jan 2024 15:25:52 -0800 Subject: [PATCH] update doc --- cookbook/openai_with_azure_openai_failover.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/cookbook/openai_with_azure_openai_failover.md b/cookbook/openai_with_azure_openai_failover.md index d38cbb0..cd8aa1e 100644 --- a/cookbook/openai_with_azure_openai_failover.md +++ b/cookbook/openai_with_azure_openai_failover.md @@ -43,7 +43,7 @@ curl -X PUT http://localhost:8001/api/key-management/keys \ ``` ### Step 4 - Create a route that calls OpenAI chat completion with Azure OpenAI chat completion as fallback -Use `id` from the step 3 as part of `keyIds` to create a route with a caching TTL of 5 seconds. +Use `id` from the step 3 as part of `keyIds` to create a route with a caching TTL of 5 seconds, 2 retries for the initial OpenAI requests with a timeout of 10 seconds and 2 retries for the azure openai failover with a timeout of 10 seconds. ```bash curl -X POST http://localhost:8001/api/routes \