Skip to content

feat: add Apple Silicon Qwen3-TTS MLX backends #8

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
groxaxo wants to merge 1 commit into
base: main
Choose a base branch
from
Open

feat: add Apple Silicon Qwen3-TTS MLX backends #8

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 7 additions & 26 deletions Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,6 @@ WORKDIR /app
ENV DEBIAN_FRONTEND=noninteractive
ENV PYTHONUNBUFFERED=1
ENV ENABLE_FLASHSR=true

ENV TORCH_CUDA_ARCH_LIST="8.0;8.6;8.9;9.0"
ENV MAX_JOBS=4

Expand All @@ -14,52 +13,34 @@ RUN apt-get update && apt-get install -y --no-install-recommends \
&& add-apt-repository ppa:deadsnakes/ppa \
&& apt-get update \
&& apt-get install -y --no-install-recommends \
python3.11 \
python3.11-dev \
python3.11-venv \
python3.11-distutils \
git \
curl \
ca-certificates \
build-essential \
ninja-build \
libsndfile1 \
ffmpeg \
python3.11 python3.11-dev python3.11-venv python3.11-distutils \
git curl ca-certificates build-essential ninja-build libsndfile1 ffmpeg \
&& rm -rf /var/lib/apt/lists/* \
&& ln -sf /usr/bin/python3.11 /usr/bin/python3 \
&& ln -sf /usr/bin/python3 /usr/bin/python

RUN curl -sS https://bootstrap.pypa.io/get-pip.py | python3.11

RUN curl -LsSf https://astral.sh/uv/install.sh | sh
ENV PATH="/root/.local/bin:$PATH"

COPY pyproject.toml ./
COPY .python-version ./
COPY README.md ./
COPY main.py ./

COPY runner ./runner
COPY third_party/VibeVoice ./third_party/VibeVoice
COPY overrides ./overrides
COPY scripts ./scripts

RUN mkdir -p models

RUN uv venv --python /usr/bin/python3.11

RUN . .venv/bin/activate && uv sync

RUN . .venv/bin/activate && uv sync --extra vibevoice
RUN . .venv/bin/activate && uv pip install -e third_party/VibeVoice
RUN . .venv/bin/activate && uv pip install --no-build-isolation flash-attn

RUN if [ -f "overrides/app.py" ]; then \
cp overrides/app.py third_party/VibeVoice/demo/web/app.py; \
fi
RUN if [ -f "overrides/index.html" ]; then \
cp overrides/index.html third_party/VibeVoice/demo/web/index.html; \
fi
RUN if [ -f overrides/app.py ]; then cp overrides/app.py third_party/VibeVoice/demo/web/app.py; fi
RUN if [ -f overrides/index.html ]; then cp overrides/index.html third_party/VibeVoice/demo/web/index.html; fi

EXPOSE 8000

ENV HF_HOME=/app/models

CMD [".venv/bin/python", "scripts/run_realtime_demo.py", "--port", "8000", "--host", "0.0.0.0"]
Loading