Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion .wordlist.txt
Original file line number Diff line number Diff line change
Expand Up @@ -70,7 +70,6 @@ SMCi
SRIOV
SVM
SuperMicro
Taichi
tbody
td
thead
Expand Down
1 change: 0 additions & 1 deletion docs/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,6 @@ This section describes the ROCm for Linux installation options.
* :doc:`Stanford Megatron-LM <install/3rd-party/stanford-megatron-lm-install>`
* :doc:`DGL <install/3rd-party/dgl-install>`
* :doc:`Megablocks <install/3rd-party/megablocks-install>`
* :doc:`Taichi <install/3rd-party/taichi-install>`
* :doc:`Ray <install/3rd-party/ray-install>`
* :doc:`llama.cpp <install/3rd-party/llama-cpp-install>`
* :doc:`FlashInfer <install/3rd-party/flashinfer-install>`
Expand Down
8 changes: 6 additions & 2 deletions docs/install/3rd-party/jax-install.rst
Original file line number Diff line number Diff line change
Expand Up @@ -112,11 +112,11 @@ If you prefer to use the ROCm Ubuntu image or already have a ROCm Ubuntu contain
:sync: python-3.10
:selected:


.. code-block:: bash

pip install https://github.com/ROCm/rocm-jax/releases/download/rocm-jax-v0.6.0/jaxlib-0.6.0-cp310-cp310-manylinux2014_x86_64.whl


4. Install JAX, ``jax-rocm7-pjrt``, and ``jax-rocm7-plugin`` from PyPI.

.. code-block:: bash
Expand Down Expand Up @@ -236,28 +236,32 @@ Follow these steps if you prefer to install ROCm manually on your host system or

pip install https://github.com/ROCm/rocm-jax/releases/download/rocm-jax-v0.6.0/jaxlib-0.6.0-cp313-cp313-manylinux2014_x86_64.whl


.. tab-item:: Python 3.12
:sync: python-3.12

.. code-block:: bash

pip install https://github.com/ROCm/rocm-jax/releases/download/rocm-jax-v0.6.0/jaxlib-0.6.0-cp312-cp312-manylinux2014_x86_64.whl


.. tab-item:: Python 3.11
:sync: python-3.11

.. code-block:: bash

pip install https://github.com/ROCm/rocm-jax/releases/download/rocm-jax-v0.6.0/jaxlib-0.6.0-cp311-cp311-manylinux2014_x86_64.whl


.. tab-item:: Python 3.10
:sync: python-3.10
:selected
:selected:

.. code-block:: bash

pip install https://github.com/ROCm/rocm-jax/releases/download/rocm-jax-v0.6.0/jaxlib-0.6.0-cp310-cp310-manylinux2014_x86_64.whl


4. Install JAX, ``jax-rocm7-pjrt``, and ``jax-rocm7-plugin`` from PyPI.

.. code-block:: bash
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -28,10 +28,10 @@ Install llama.cpp

To install llama.cpp for ROCm, you have the following options:

* :ref:`using-docker-with-llama-cpp-pre-installed` **(recommended)**
* :ref:`build-llama-cpp-docker-image`
* :ref:`using-docker-with-llama-cpp-pre-installed-v25-8` **(recommended)**
* :ref:`build-llama-cpp-docker-image-v25-8`

.. _using-docker-with-llama-cpp-pre-installed:
.. _using-docker-with-llama-cpp-pre-installed-v25-8:

Use a prebuilt Docker image with llama.cpp pre-installed
--------------------------------------------------------------------------------------
Expand All @@ -51,7 +51,7 @@ and other dependencies.
- Light: This image only includes the main executable file.

You can download Docker images with specific ROCm, llama.cpp, and operating system versions.
See the available tags on `Docker Hub <https://hub.docker.com/r/rocm/llama.cpp/tags>`_ and see :ref:`docker image support <llama-cpp-docker-support>` below.
See the available tags on `Docker Hub <https://hub.docker.com/r/rocm/llama.cpp/tags>`_ and see :ref:`docker image support <llama-cpp-docker-support-v25-8>` below.

1. Download your required public `llama.cpp Docker image <https://hub.docker.com/r/rocm/llama.cpp/tags>`__:

Expand Down Expand Up @@ -117,7 +117,7 @@ and other dependencies.
This will automatically download the image if it does not exist on the host. You can
also pass the ``-v`` argument to mount any data directories from the host onto the container.

.. _llama-cpp-docker-support:
.. _llama-cpp-docker-support-v25-8:

Docker image support
--------------------------------------------------------------------------------------
Expand Down Expand Up @@ -165,7 +165,7 @@ validated for `ROCm 6.4.0 <https://repo.radeon.com/rocm/apt/6.4/>`_.
* `ROCm 6.4.0 <https://repo.radeon.com/rocm/apt/6.4/>`_


.. _build-llama-cpp-docker-image:
.. _build-llama-cpp-docker-image-v25-8:

Build your own Docker image
--------------------------------------------------------------------------------------
Expand Down Expand Up @@ -246,7 +246,7 @@ prebuilt Docker image from AMD ROCm Docker Hub.

To run unit tests manually and validate your installation fully, follow these steps:

1. To verify that llama.cpp has been successfully installed, run the Docker container as described in :ref:`build-llama-cpp-docker-image`.
1. To verify that llama.cpp has been successfully installed, run the Docker container as described in :ref:`build-llama-cpp-docker-image-v25-8`.

2. Once inside the container, ensure you have access to the Bash shell.

Expand Down
202 changes: 0 additions & 202 deletions docs/install/3rd-party/taichi-install.rst

This file was deleted.

2 changes: 0 additions & 2 deletions docs/sphinx/_toc.yml.in
Original file line number Diff line number Diff line change
Expand Up @@ -74,8 +74,6 @@ subtrees:
title: DGL
- file: install/3rd-party/megablocks-install
title: Megablocks
- file: install/3rd-party/taichi-install
title: Taichi
- file: install/3rd-party/ray-install
title: Ray
- file: install/3rd-party/llama-cpp-install
Expand Down