forked from ggml-org/llama.cpp
-
-
Notifications
You must be signed in to change notification settings - Fork 367
Pull requests: TheTom/llama-cpp-turboquant
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Feature/turboquant kv cache rebase
AMD ZenDNN
Apple Metal
build
conversion
CUDA
devops
documentation
Improvements or additions to documentation
ggml
Hexagon
jinja parser
model
mtmd
OpenCL
OpenVINO
server/ui
server
SYCL
testing
vendor
Vulkan
WebGPU
feat: OSCAR2 quantized KV-cache (draft)
Apple Metal
conversion
CUDA
documentation
Improvements or additions to documentation
examples
ggml
model
testing
Port poolside Laguna-S-2.1 architecture (draft, WIP)
conversion
CUDA
documentation
Improvements or additions to documentation
ggml
model
testing
Merge tag 'b10164' of https://github.com/ggml-org/llama.cpp into feature/turboquant-kv-cache
Apple Metal
build
conversion
CUDA
devops
documentation
Improvements or additions to documentation
ggml
Hexagon
jinja parser
model
mtmd
OpenCL
OpenVINO
server/ui
server
SYCL
testing
vendor
Vulkan
WebGPU
#208
opened Jul 6, 2026 by
sxlmnwb
Loading…
hip: VEC flash-attn for D=512 (Gemma 4) on ROCm with quantized KV
ggml
Nvidia GPU
#156
opened May 24, 2026 by
cclecle
Loading…
vulkan: add TurboQuant KV cache support and optimized turbo mat-vec paths
ggml
Vulkan
#140
opened May 10, 2026 by
Fenix46
Loading…
fix(qwen35): support Qwen3.5:9B loading from Ollama GGUF
model
#135
opened May 8, 2026 by
Jordan-HS
Loading…
vendor: bump cpp-httplib to 0.43.2 (openssl 4.0.0 fix)
python
script
#121
opened May 4, 2026 by
TheTom
Owner
Loading…
1 of 3 tasks
HIP mixed TurboQuant vec FA on gfx900/gfx906
build
ggml
Nvidia GPU
#99
opened Apr 21, 2026 by
2bigO
Loading…
perf: turbo VEC flash attention — +9% decode on CUDA via autoresearch
ggml
Nvidia GPU
script
#53
opened Apr 4, 2026 by
signalnine
Loading…
7 tasks done
fix: HIP/ROCm compatibility — check cudaMemcpyToSymbol errors, guard …
ggml
Nvidia GPU
#41
opened Apr 1, 2026 by
terrysimons
•
Draft
ProTip!
Updated in the last three days: updated:>2026-07-29.