Search results

TimeoutError during startup with Pipeline Parallelism (PP) on Qwen3-8B

Status: Open.

#245 In ovg-project/kvcached;

· iMmAseu opened on Feb 21, 2026

How can we reproduce the fact that using kvcached is 2-28 times faster than not using kvcached in TTFT?

Status: Open.

#233 In ovg-project/kvcached;

· yugenlgy opened on Jan 12, 2026

Inquiry regarding MuxServe++ implementation and model support for reproduction

questionFurther information is requestedFurther information is requested

Status: Open.

#231 In ovg-project/kvcached;

· Rabenda opened on Jan 8, 2026

Add support for Arm64

Status: Open.

#225 In ovg-project/kvcached;

· kenmoini opened on Dec 24, 2025

Performance comparison: vLLM with and without kvcached

Status: Open.

#223 In ovg-project/kvcached;

· Blueblack319 opened on Dec 17, 2025

undefined symbol: _ZNK2at10TensorBase4nameEv when using torch2.8.0

Status: Open.

#222 In ovg-project/kvcached;

· Weili17 opened on Dec 12, 2025

Dynamic Memory Management incurs error when running 4 instances on 2 * A100 GPUs

Status: Open.

#221 In ovg-project/kvcached;

· Ltryxcy opened on Dec 2, 2025

Hybrid models with more than one KV cache type are not supported yet

Status: Open.

#215 In ovg-project/kvcached;

· alecngo opened on Nov 13, 2025

Using nvfp4 + kvcached + sglang results in a type mismatch error

Status: Open.

#214 In ovg-project/kvcached;

· jiahe7ay opened on Nov 10, 2025

Running Llama3.1 + Llama3.3 70bs on 8 x A100s

Status: Open.

#210 In ovg-project/kvcached;

· Nujjy opened on Nov 5, 2025

Using kvcached + sglang + qwen-fp8 directly causes an out-of-bounds error. [bug]

bugSomething isn't workingSomething isn't working

Status: Open.

#203 In ovg-project/kvcached;

· jiahe7ay opened on Oct 30, 2025

[RFC] Support multiple attention types

enhancementNew feature or requestNew feature or request

Status: Open.

#202 In ovg-project/kvcached;

· ivanium opened on Oct 29, 2025