Oleksandr Kuvshynov e5155e6986 server : export max observed n_past value (#15361) ...

Add tracking for high watermark cache usage and make it available in /metrics endpoint.

Use-case: Tracking largest needed cache usage under realistic workload
to better understand memory requirements and be able to adjust
cache size/quantization for model/cache accordingly.

2025-08-18 00:28:58 +02:00

..

batched-bench

llama : add high-throughput mode (#14363)

2025-07-16 16:35:42 +03:00

cvector-generator

llama : deprecate llama_kv_self_ API (#14030)

2025-06-06 14:11:15 +03:00

export-lora

mtmd : fix 32-bit narrowing issue in export-lora and mtmd clip (#14503)

2025-07-25 13:08:04 +02:00

gguf-split

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

imatrix

imatrix : warn when GGUF imatrix is saved without .gguf suffix (#15076)

2025-08-04 23:26:52 +02:00

llama-bench

Fixed name -override-tensors to -override-tensor (#15129)

2025-08-06 17:28:48 +01:00

main

chat : include kwargs in template example (#15309)

2025-08-14 10:28:29 -07:00

mtmd

model : support vision LiquidAI LFM2-VL family (#15347)

2025-08-16 23:33:54 +02:00

perplexity

perplexity: give more information about constraints on failure (#15303)

2025-08-14 09:16:32 +03:00

quantize

llama : add gpt-oss (#15091)

2025-08-05 22:10:36 +03:00

rpc

rpc : Fix build on OpenBSD (#13541)

2025-05-25 15:35:53 +03:00

run

cmake : do not search for curl libraries by ourselves (#14613)

2025-07-10 15:29:05 +03:00

server

server : export max observed n_past value (#15361)

2025-08-18 00:28:58 +02:00

tokenize

llama : move end-user examples to tools directory (#13249)

2025-05-02 20:27:13 +02:00

tts

sync : vendor (#13901)

2025-05-30 16:25:45 +03:00

CMakeLists.txt

mtmd : rename llava directory to mtmd (#13311)

2025-05-05 16:02:55 +02:00