Skip to content

new flock-llm release #22

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
ray-ruisun wants to merge 6 commits into
base: main
Choose a base branch
from
Open

new flock-llm release #22

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
1cce3da
new flock-llm release
ray-ruisun Apr 3, 2024
121d25c
add efficient file compression and uploading progress bar
ray-ruisun Apr 4, 2024
0b9cf80
add download pretrained weights from flock S3 or hugging face
ray-ruisun Apr 5, 2024
144329d
optimize
ray-ruisun Apr 8, 2024
ee833b1
add env vars
ray-ruisun Apr 9, 2024
c0eb804
fix file extraction
ray-ruisun Apr 9, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -161,3 +161,5 @@ cython_debug/

.DS_Store
wandb/
model/
.idea/
18 changes: 16 additions & 2 deletions examples/flock_llm/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,17 @@
FROM nvidia/cuda:11.8.0-base-ubuntu22.04
FROM nvidia/cuda:12.2.0-base-ubuntu22.04
#FROM nvidia/cuda:11.8.0-base-ubuntu22.04

# ================ Setup system environment =================
ARG WANDB_API_KEY=your_wandb_api_key_here

ENV WANDB_API_KEY=$WANDB_API_KEY

# AWS S3 condential info
ARG AWS_ACCESS_KEY_ID
ARG AWS_SECRET_ACCESS_KEY

ENV AWS_ACCESS_KEY_ID=$AWS_ACCESS_KEY_ID
ENV AWS_SECRET_ACCESS_KEY=$AWS_SECRET_ACCESS_KEY

# ================ Install Python from source code =================

Expand Down Expand Up @@ -42,4 +55,5 @@ RUN pip install --no-cache-dir -r requirements.txt
COPY . .

EXPOSE 5000/tcp
CMD [ "python3.11", "./flock_llm_example.py" ]
CMD [ "python3.11", "main.py", "--conf", "config.yaml" ]

Loading