llama.cpp/tools at osimons/ocp_fp8_kv - llama.cpp - Gitea: Git with a cup of coffee

Public/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-19 17:24:57 +02:00

Files

T

History

Oliver Simons b6ccff9b0e Add FP8 KV-cache support

2026-09-04 20:51:13 +02:00

..

cmake : add install() for impl libraries + fix apple builds (#23511 )

2026-05-22 11:46:26 +03:00

common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969 )

2026-08-30 09:18:10 +03:00

common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969 )

2026-08-30 09:18:10 +03:00

cvector-generator

cmake : introduce semantic versioning (#26839 )

2026-08-12 14:15:03 +02:00

docs: fix export-lora --lora-scaled syntax [no release] (#24703 )

2026-06-18 16:46:17 +02:00

fit: also take into account n_streams (#27496 )

2026-08-22 16:16:06 +02:00

cmake : introduce semantic versioning (#26839 )

2026-08-12 14:15:03 +02:00

imatrix.cpp: Move finite check and only check touched experts (#26861 )

2026-08-11 11:18:19 -04:00

Add FP8 KV-cache support

2026-09-04 20:51:13 +02:00

model, mtmd: fix gemma4 vision handling (#28335 )

2026-09-04 12:23:27 +02:00

quant : Optimise memory usage by evicting weights after processing each layer (#22877 )

2026-08-18 16:22:32 +02:00

quantize: cap working memory size to avoid loading big tensors onto RAM (#27795 )

2026-08-27 18:31:13 +02:00

libs : rename libcommon -> libllama-common (#21936 )

2026-04-17 11:11:46 +03:00

rpc: avoid serializing buffers from other servers (#26500 )

2026-08-30 20:26:16 +03:00

server : use pytest-xdist for server tests (#28298 )

2026-09-03 15:04:30 +02:00

tokenize : drop --stdin mutual-exclusion check (#25672 )

2026-07-15 18:41:51 +02:00

args: add --video-* CLI arguments (#24318 )

2026-08-27 12:11:12 +02:00

metal : per-device tuned (Q, NE) for flash-attn vec (#26570 )

2026-08-24 19:22:27 +03:00

ui: export conversations from database instead of cached store (#27432 )

2026-09-04 15:13:10 +02:00

CMakeLists.txt

metal : per-device tuned (Q, NE) for flash-attn vec (#26570 )

2026-08-24 19:22:27 +03:00