瀏覽代碼

Merge pull request #2679 from myhloli/dev

fix: support NPU device in UnimernetModel initialization
Xiaomeng Zhao 5 月之前
父節點
當前提交
1bec25b1e1
共有 3 個文件被更改,包括 22 次插入1 次删除
  1. 11 0
      README.md
  2. 10 0
      README_zh-CN.md
  3. 1 1
      mineru/model/mfr/unimernet/Unimernet.py

+ 11 - 0
README.md

@@ -51,6 +51,9 @@ Easier to use: Just grab MinerU Desktop. No coding, no login, just a simple inte
 </div>
 
 # Changelog
+- 2025/06/17 2.0.4 Released 
+  - Fixed the issue where models were still required to be downloaded in the `sglang-client` mode  
+  - Fixed the issue where only the first instance would take effect when attempting to launch multiple `sglang-client` instances via multiple URLs within the same process
 - 2025/06/15 2.0.3 released
   - Fixed a configuration file key-value update error that occurred when downloading model type was set to `all`
   - Fixed the issue where the formula and table feature toggle switches were not working in `command line mode`, causing the features to remain enabled.
@@ -533,6 +536,14 @@ If you need to use **sglang to accelerate VLM model inference**, you can choose
 > [!TIP]
 > The Dockerfile uses `lmsysorg/sglang:v0.4.7-cu124` as the default base image. If necessary, you can modify it to another platform version.
 
+
+#### 1.4 Install client  (for connecting to sglang-server on edge devices that require only CPU and network connectivity)
+
+```bash
+uv pip install -U mineru
+mineru -p <input_path> -o <output_path> -b vlm-sglang-client -u http://<host_ip>:<port>
+```
+
 ---
 
 ### 2. Using MinerU

+ 10 - 0
README_zh-CN.md

@@ -50,6 +50,9 @@
 </div>
 
 # 更新记录
+- 2025/06/17 2.0.4发布
+  - 修复了`sglang-client`模式下依然需要下载模型的问题
+  - 修复了同一进程内尝试通过多个url启动多个`sglang-client`实例时,只有第一个生效的问题
 - 2025/06/15 2.0.3发布
   - 修复了当下载模型类型设置为`all`时,配置文件出现键值更新错误的问题
   - 修复了命令行模式下公式和表格功能开关不生效导致功能无法关闭的问题
@@ -522,6 +525,13 @@ uv pip install -e .[core] -i https://mirrors.aliyun.com/pypi/simple
   
 > [!TIP]
 > Dockerfile默认使用`lmsysorg/sglang:v0.4.7-cu124`作为基础镜像,如有需要,您可以自行修改为其他平台版本。
+  
+#### 1.4 安装client(用于在仅需 CPU 和网络连接的边缘设备上连接 sglang-server)
+
+```bash
+uv pip install -U mineru -i https://mirrors.aliyun.com/pypi/simple
+mineru -p <input_path> -o <output_path> -b vlm-sglang-client -u http://<host_ip>:<port>
+```
 
 ---
 

+ 1 - 1
mineru/model/mfr/unimernet/Unimernet.py

@@ -21,7 +21,7 @@ class MathDataset(Dataset):
 class UnimernetModel(object):
     def __init__(self, weight_dir, _device_="cpu"):
         from .unimernet_hf import UnimernetModel
-        if _device_.startswith("mps"):
+        if _device_.startswith("mps") or _device_.startswith("npu"):
             self.model = UnimernetModel.from_pretrained(weight_dir, attn_implementation="eager")
         else:
             self.model = UnimernetModel.from_pretrained(weight_dir)