vLLM发布v0.28.0版本
原文：vLLM v0.28.0
vLLM v0.28.0 【HN 热评 · 0分 · @kouteiheika】I love vLLM, but damn if it isn't frustratingly buggy. I was recently running DeepSeek-V4-Flash on a B300. On v0.26 it was totally broken, and I had to add three out-of-tree patches to fix it. I updated to v0.27 -- no patches necessary now, but the output is now broken as it randomly starts responding with garbage (repeated token loops). On my workstation where I run Gemma-4 on an RTX 6000 the whole process tends to get stuck and stops responding, and needs to be killed and restarted to start working again. On my friend's 4x RTX 6000 box where he runs DeepSeek-V4-Flash high concurrency also tr 【HN 热评 · 0分 · @joshheitzman】I was hoping to see the reasoning_content mess get robustly fixed, but all we got was this doc change: https://github.com/vllm-project/vllm/pull/50624 【HN 热评 · 0分 · @SillyUsername】I just wish they'd support Pascal :( Nvidia might have given up support but it doesn't mean vllm have to (llama.cpp didn't). 【HN 热评 · 0分 · @Der_Einzige】Still way behind on LLM sampler support compared to llama-cpp. Where's support for top-n-sigma? for DRY? for XTC? C'mon guys! 【HN 热评 · 0分 · @zoobab】Did some loadtests on vllm, managed to crash it :-)