Skip to content
This repository has been archived by the owner on Jan 5, 2025. It is now read-only.

Commit

Permalink
Adding prebuilt images guide
Browse files Browse the repository at this point in the history
  • Loading branch information
codebanesr committed Aug 23, 2023
1 parent f73d11b commit 052db41
Show file tree
Hide file tree
Showing 2 changed files with 25 additions and 1 deletion.
14 changes: 14 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -115,6 +115,20 @@ If you want to switch from Pinecone to Qdrant, you can set the following environ
- `retrieval_qa` -> [Learn more](https://python.langchain.com/docs/use_cases/question_answering/how_to/vector_db_qa)
- `conversation_retrieval` -> [Learn more](https://python.langchain.com/docs/use_cases/question_answering/how_to/chat_vector_db)

#### Using Prebuilt Images

If you're experiencing slow internet speeds or if Docker builds are taking a long time, consider using the prebuilt images for your respective architecture. Simply comment out the unnecessary image line in the `docker-compose.yml` file and uncomment the appropriate prebuilt image line.

Example:

```yaml
# Mac environment
image: codebanesr/openchat_llm_server:edge_amd64

# Or, for Linux environment
image: codebanesr/openchat_llm_server:edge
```
> Note: for pincone db, make sure that the dimension is equal to 1536
Expand Down
12 changes: 11 additions & 1 deletion docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,17 @@ services:

llm-server:
restart: unless-stopped
image: codebanesr/openchat_llm_server:edge
# prebuilt image for linux
# image: codebanesr/openchat_llm_server:edge

# prebuilt image for mac
# image: codebanesr/openchat_llm_server:edge_amd64

# or build from source
build:
context: ./llm-server
dockerfile: Dockerfile

volumes:
- shared_data:/app/shared_data
env_file:
Expand Down

0 comments on commit 052db41

Please sign in to comment.