|
|
@@ -43,13 +43,8 @@ nvidia-docker run --name paddlex -v $PWD:/paddle --shm-size=8G --network=host -
|
|
|
|
|
|
* Note: For more official PaddlePaddle Docker images, please refer to the [PaddlePaddle official website](https://www.paddlepaddle.org.cn/install/quick?docurl=/documentation/docs/en/install/docker/linux-docker.html)
|
|
|
|
|
|
-To use [Paddle Inference TensorRT Subgraph Engine](https://www.paddlepaddle.org.cn/documentation/docs/en/install/pip/linux-pip_en.html#gpu), install TensorRT by executing the following instructions in the 'paddlex' container that has just been started
|
|
|
-
|
|
|
-```bash
|
|
|
-python -m pip install /usr/local/TensorRT-*/python/tensorrt-*-cp310-none-linux_x86_64.whl
|
|
|
-```
|
|
|
-
|
|
|
## Installing PaddlePaddle via pip
|
|
|
+
|
|
|
<b>If you choose to install via pip</b>, please refer to the following commands to install PaddlePaddle in your current environment using pip:
|
|
|
|
|
|
```bash
|
|
|
@@ -100,21 +95,29 @@ python -m pip install https://paddle-qa.bj.bcebos.com/paddle-pipeline/Develop-Ta
|
|
|
|
|
|
## Install the TensorRT Subgraph Engine
|
|
|
|
|
|
-If you want to use the [Paddle Inference TensorRT Subgraph Engine](https://www.paddlepaddle.org.cn/documentation/docs/en/guides/paddle_v3_features/paddle_trt_en.html), after installing Paddle, you need to refer to the [TensorRT Documentation](https://docs.nvidia.com/deeplearning/tensorrt/archives/index.html) to install the corresponding version of TensorRT:
|
|
|
+If you want to use the [Paddle Inference TensorRT Subgraph Engine](https://www.paddlepaddle.org.cn/documentation/docs/en/guides/paddle_v3_features/paddle_trt_en.html):
|
|
|
|
|
|
-- For PaddlePaddle with CUDA 11.8, the compatible TensorRT version is 8.x (where x >= 6). PaddleX has completed compatibility tests of Paddle-TensorRT on TensorRT 8.6.1.6, so it is **strongly recommended to install TensorRT 8.6.1.6**.
|
|
|
+1. If you are using the official PaddlePaddle 3.0 Docker image, you need to run the following command in the started container to install TensorRT.
|
|
|
|
|
|
-Below is an example of installing TensorRT 8.6.1.6 using the "Tar File Installation" method in a CUDA 11.8 environment:
|
|
|
+ ```bash
|
|
|
+ python -m pip install /usr/local/TensorRT-*/python/tensorrt-*-cp310-none-linux_x86_64.whl
|
|
|
+ ```
|
|
|
|
|
|
-```bash
|
|
|
-# Download TensorRT tar file
|
|
|
-wget https://developer.nvidia.com/downloads/compute/machine-learning/tensorrt/secure/8.6.1/tars/TensorRT-8.6.1.6.Linux.x86_64-gnu.cuda-11.8.tar.gz
|
|
|
-# Extract TensorRT tar file
|
|
|
-tar xvf TensorRT-8.6.1.6.Linux.x86_64-gnu.cuda-11.8.tar.gz
|
|
|
-# Install TensorRT wheel package
|
|
|
-python -m pip install TensorRT-8.6.1.6/python/tensorrt-8.6.1-cp310-none-linux_x86_64.whl
|
|
|
-# Add the absolute path of TensorRT's `lib` directory to LD_LIBRARY_PATH
|
|
|
-export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:TensorRT-8.6.1.6/lib"
|
|
|
-```
|
|
|
+2. If you are using the official PaddlePaddle 3.1 Docker image or higher, or if you installed PaddlePaddle with pip, you need to refer to the [TensorRT Documentation](https://docs.nvidia.com/deeplearning/tensorrt/archives/index.html) to install the corresponding version of TensorRT:
|
|
|
+
|
|
|
+ - For PaddlePaddle with CUDA 11.8, the compatible TensorRT version is 8.x (where x >= 6). PaddleX has completed compatibility tests of Paddle-TensorRT on TensorRT 8.6.1.6, so it is **strongly recommended to install TensorRT 8.6.1.6**.
|
|
|
+
|
|
|
+ Below is an example of installing TensorRT 8.6.1.6 using the "Tar File Installation" method in a CUDA 11.8 environment:
|
|
|
+
|
|
|
+ ```bash
|
|
|
+ # Download TensorRT tar file
|
|
|
+ wget https://developer.nvidia.com/downloads/compute/machine-learning/tensorrt/secure/8.6.1/tars/TensorRT-8.6.1.6.Linux.x86_64-gnu.cuda-11.8.tar.gz
|
|
|
+ # Extract TensorRT tar file
|
|
|
+ tar xvf TensorRT-8.6.1.6.Linux.x86_64-gnu.cuda-11.8.tar.gz
|
|
|
+ # Install TensorRT wheel package
|
|
|
+ python -m pip install TensorRT-8.6.1.6/python/tensorrt-8.6.1-cp310-none-linux_x86_64.whl
|
|
|
+ # Add the absolute path of TensorRT's `lib` directory to LD_LIBRARY_PATH
|
|
|
+ export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:TensorRT-8.6.1.6/lib"
|
|
|
+ ```
|
|
|
|
|
|
> ❗ <b>Note</b>: If you encounter any issues during the installation process, feel free to [submit an issue](https://github.com/PaddlePaddle/Paddle/issues) in the Paddle repository.
|