support for vllm 0.10.0
Thanks for contribute, I use your codes in docker image: vllm/vllm-openai:v0.10.0, but still get bug:
support for vllm 0.10.0 Thanks for contribute, I use your codes in docker image: vllm/vllm-openai:v0.10.0, but still get bug:
Could you tell me the startup command?
fix it, can you try again?
nice job
· Sign up or log in to comment