Dockerfile 108 B

1234
  1. from vllm/vllm-openai:v0.9.1
  2. RUN pip3 install flash_attn==2.8.0.post2
  3. RUN pip3 install transformers==4.51.3