{"name":"HyperQwen","repo":"syv-ai/HyperQwen","url":"https://midorreal.com/project/syv-ai-hyperqwen","repository":"https://github.com/syv-ai/HyperQwen","description":"Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.","facts":{"license":{"value":"Apache-2.0","source":"https://github.com/syv-ai/HyperQwen","checked":"22 Nov 2026"},"language":{"value":"Python","source":"https://github.com/syv-ai/HyperQwen","checked":"22 Nov 2026"},"releases":{"value":"0","source":"https://github.com/syv-ai/HyperQwen/releases","checked":"21 Nov 2026"},"contributors":{"value":"39","source":"https://github.com/syv-ai/HyperQwen/graphs/contributors","checked":"21 Nov 2026"},"archived":{"value":"no","source":"https://github.com/syv-ai/HyperQwen","checked":"22 Nov 2026"}},"stars":2784.0,"writeup":{"what_it_is":"HyperQwen is a repository for serving large Qwen models with vLLM on consumer GPUs. It provides a patch series against a pinned vLLM version, a model preparation pipeline, and Docker setups for single-user and batch serving modes. The README reports benchmarks for Qwen3.8-27B on a single 24 GB RTX 3090.","audience":"Users running large Qwen models locally on their own GPUs","claims":[{"kind":"specific","claim":"Provides an OpenAI-compatible API with key auth in two ready-made modes","excerpt":"an OpenAI-compatible API with key auth, in two ready-made modes","status":"not_checked"}],"alternatives":[],"written_by":"AI, from the project's README","date":"2026-11-08"},"why_now":null,"owner_supplied":null,"score":{"verdict":"real","hype":70,"reality":74,"gap":-4,"momentum":null,"confidence":60,"version":"score-2.0","rule":"verdict-2.0","calculated_at":"2026-11-22T08:00:00+00:00","verdict_source":"rule"},"early_read":null,"changes":[{"date":"2026-08-15T09:10:56+00:00","text":"Repository created","source":"https://github.com/syv-ai/HyperQwen"}],"cite":"HyperQwen is a GitHub project at https://github.com/syv-ai/HyperQwen written mainly in Python, described there as \"Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks\".","attribution":"Data from Mid or Real, https://midorreal.com/project/syv-ai-hyperqwen, checked 22 November 2026. Attribution with a link is required.","still_real":null}