Skip to content

Commit

Permalink
adding README instructions
Browse files Browse the repository at this point in the history
  • Loading branch information
apbose committed Feb 18, 2025
1 parent fb0ba7f commit 58a4bb3
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions examples/distributed_inference/README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,10 @@ Option 1: Install TensorRT-LLM
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Follow the instructions to `install TensorRT-LLM <https://nvidia.github.io/TensorRT-LLM/installation/linux.html>`_.
Please note that before installing TensorRT-LLM, you need to

1. apt install libmpich-dev
2. apt install libopenmpi-dev

If the default installation fails due to issues like library version mismatches or Python compatibility, consider using Option 2.
After a successful installation, test by running:
Expand Down

0 comments on commit 58a4bb3

Please sign in to comment.