 myhloli
|
7c77db7135
fix: import enable_custom_logits_processors in server.py
|
il y a 3 semaines |
|
myhloli
|
0d0ebfd7bc
fix: improve GPU memory utilization handling and ensure OMP_NUM_THREADS is set only if not defined
|
il y a 3 semaines |
|
myhloli
|
0758de6d24
Update vllm version and increase default GPU memory utilization
|
il y a 4 semaines |
|
myhloli
|
ea4271ab37
Set OMP_NUM_THREADS environment variable to 1 for vllm backend initialization
|
il y a 1 mois |
|
myhloli
|
f1659eb7a7
Refactor logits processor handling in server.py and vlm_analyze.py for improved clarity and consistency
|
il y a 1 mois |
|
myhloli
|
7c481796f8
Refactor custom logits processors to include vllm version checks and improve logging
|
il y a 1 mois |
|
myhloli
|
f5e0e67545
Add custom logits processors functionality with compute capability check
|
il y a 1 mois |
|
myhloli
|
a4cac624df
Add compute capability check for custom logits processors in server.py and vlm_analyze.py
|
il y a 1 mois |
|
myhloli
|
bce9bb6d1d
Add support for --logits-processors argument in server.py
|
il y a 1 mois |
|
myhloli
|
8fd544273e
Update mineru-vl-utils version and add logits processors support
|
il y a 1 mois |
|
myhloli
|
72f1f5f935
Update mineru-vl-utils version and add logits processors support
|
il y a 1 mois |
|
myhloli
|
ba36a94aa0
fix: streamline model argument handling in server.py
|
il y a 2 mois |
|
myhloli
|
96a0a45c9a
fix: update sys.argv to include 'serve' for vllm server startup
|
il y a 2 mois |
|
myhloli
|
f2553dd89a
fix: add default arguments for port and GPU memory utilization in server.py
|
il y a 2 mois |
|
myhloli
|
b35c3345c0
fix: add default arguments for port and GPU memory utilization in server.py
|
il y a 2 mois |
|
myhloli
|
af3ee06aa3
fix: update import path for vllm entrypoint in server.py
|
il y a 2 mois |
|
myhloli
|
4f6ac22ce6
fix: update import path for vllm entrypoint in server.py
|
il y a 2 mois |
|
myhloli
|
2ca6ee1708
refactor: rename server files and update model path handling for vllm integration
|
il y a 2 mois |
