Public/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-08-29 00:21:21 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
ae86645c28024aafd3ebb9102467bb79f101da64
llama.cpp/tools
T
History
Oliver Simons ae86645c28 Consistify polling frequency of llama-bench with args 
llama-bench differs from llama-server in 2 ways:
1. It attaches a persistent threadpool across cgraph invocations
2. It has a polling scheme of 50 (as opposed to 0 of args)

Together, this causes a significant perf regression in the CUDA backend
on Windows when the CPU backend is built with OpenMP disabled.
Why is the CPU backend affecting the CUDA backend?
Typically, we have a LUT on the CPU backend where we map Token_ID
-> Embedding to save on VRAM budget.
2026-08-07 20:59:38 +02:00
..
batched-bench
cmake : add install() for impl libraries + fix apple builds (#23511)
2026-05-22 11:46:26 +03:00
cli
sampler : remove "full-context windows" from history-based samplers (#26524)
2026-08-04 21:28:55 +03:00
completion
sampler : remove "full-context windows" from history-based samplers (#26524)
2026-08-04 21:28:55 +03:00
cvector-generator
libs : rename libcommon -> libllama-common (#21936)
2026-04-17 11:11:46 +03:00
export-lora
docs: fix export-lora --lora-scaled syntax [no release] (#24703)
2026-06-18 16:46:17 +02:00
fit-params
cmake : add install() for impl libraries + fix apple builds (#23511)
2026-05-22 11:46:26 +03:00
gguf-split
gguf-split: Add option to delete split parts during merge (#26538)
2026-08-04 21:27:47 +03:00
imatrix
Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)
2026-06-04 17:45:40 +02:00
llama-bench
Consistify polling frequency of llama-bench with args
2026-08-07 20:59:38 +02:00
mtmd
mtmd: fix longest_edge ignoring min/max pixels (#26638)
2026-08-07 18:05:15 +02:00
parser
chat : enable tool call in thinking for DS4 (#26269)
2026-08-01 00:13:07 -05:00
perplexity
perplexity : fix format specifier in LOG_ERR (#23788)
2026-05-28 10:34:58 +03:00
quantize
Add Q2_0 quantization: type definition and CPU backend (#24448)
2026-07-07 12:05:47 -07:00
results
libs : rename libcommon -> libllama-common (#21936)
2026-04-17 11:11:46 +03:00
rpc
binaries : Improve rpc-server and export-graph-ops names. (#25045)
2026-06-27 10:31:29 +03:00
server
tests : speed-up server test suite 3x (#26734)
2026-08-07 21:38:32 +03:00
tokenize
tokenize : drop --stdin mutual-exclusion check (#25672)
2026-07-15 18:41:51 +02:00
tts
mtmd: support Qwen3-TTS (note: breaking change to llama-tts binary) (#26254)
2026-08-04 17:26:15 +02:00
ui
allozaur/feat/chat form contenteditable (#26717)
2026-08-07 20:40:10 +02:00
CMakeLists.txt
cmake: skip cvector-generator and export-lora when CPU backend is disabled (#24053)
2026-06-04 13:13:19 +03:00