Kaynağa Gözat

Merge pull request #2752 from myhloli/dev

docs: add GPU requirements and multi-GPU usage tips to README files
Xiaomeng Zhao 5 ay önce
ebeveyn
işleme
4156a2b89d
2 değiştirilmiş dosya ile 14 ekleme ve 2 silme
  1. 6 0
      README.md
  2. 8 2
      README_zh-CN.md

+ 6 - 0
README.md

@@ -665,6 +665,12 @@ mineru -p <input_path> -o <output_path> -b vlm-sglang-engine
 mineru-sglang-server --port 30000
 mineru-sglang-server --port 30000
 ```
 ```
 
 
+> [!TIP]
+> sglang acceleration requires a GPU with Ampere architecture or newer, and at least 24GB VRAM. If you have two 12GB or 16GB GPUs, you can use Tensor Parallelism (TP) mode:  
+> `mineru-sglang-server --port 30000 --tp 2`  
+> 
+> If you still encounter out-of-memory errors with two GPUs, or if you need to improve throughput or inference speed using multi-GPU parallelism, please refer to the [sglang official documentation](https://docs.sglang.ai/backend/server_arguments.html#common-launch-commands).
+
 2. Use Client in another terminal:
 2. Use Client in another terminal:
 
 
 ```bash
 ```bash

+ 8 - 2
README_zh-CN.md

@@ -493,8 +493,8 @@ uv pip install -e .[core] -i https://mirrors.aliyun.com/pypi/simple
 ```
 ```
 
 
 > [!TIP]
 > [!TIP]
-> Linux和macOS系统安装后自动支持cuda/mps加速,Windows用户如需使用cuda加速,请前往 [Pytorch官网](https://pytorch.org/get-started/locally/)
-> 选择合适的cuda版本安装pytorch。
+> Linux和macOS系统安装后自动支持cuda/mps加速,Windows用户如需使用cuda加速,
+> 请前往 [Pytorch官网](https://pytorch.org/get-started/locally/) 选择合适的cuda版本安装pytorch。
 
 
 #### 1.3 安装完整版(支持 sglang 加速)(需确保设备有Ampere及以后架构,24G显存及以上显卡)
 #### 1.3 安装完整版(支持 sglang 加速)(需确保设备有Ampere及以后架构,24G显存及以上显卡)
 
 
@@ -654,6 +654,12 @@ mineru -p <input_path> -o <output_path> -b vlm-sglang-engine
 mineru-sglang-server --port 30000
 mineru-sglang-server --port 30000
 ```
 ```
 
 
+> [!TIP]
+> sglang加速需设备有Ampere及以后架构,24G显存及以上显卡,如您有两张12G或16G显卡,可以通过张量并行(TP)模式使用。
+>  `mineru-sglang-server --port 30000 --tp 2`
+> 
+> 如使用两张卡仍出现显存不足错误或需要使用多卡并行增加吞吐量或推理速度,请参考 [sglang官方文档](https://docs.sglang.ai/backend/server_arguments.html#common-launch-commands)
+
 2. 在另一个终端中使用 Client 调用:
 2. 在另一个终端中使用 Client 调用:
 
 
 ```bash
 ```bash