Public/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-08-31 17:41:26 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
8e53fcefd2c01ff70434ab41866bfc2eca31fe90
llama.cpp/tools
T
History
hmirin a7cc83bbae rpc: avoid serializing buffers from other servers (#26500) 
* rpc: avoid serializing buffers from other servers

Only include remote buffer pointers when the buffer belongs to the RPC dispatcher receiving the graph. Add a two-server regression test for cross-server tensor serialization.

Assisted-by: Codex

* cont : add ref

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2026-08-30 20:26:16 +03:00
..
batched-bench
cmake : add install() for impl libraries + fix apple builds (#23511)
2026-05-22 11:46:26 +03:00
cli
common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)
2026-08-30 09:18:10 +03:00
completion
common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)
2026-08-30 09:18:10 +03:00
cvector-generator
cmake : introduce semantic versioning (#26839)
2026-08-12 14:15:03 +02:00
export-lora
docs: fix export-lora --lora-scaled syntax [no release] (#24703)
2026-06-18 16:46:17 +02:00
fit-params
fit: also take into account n_streams (#27496)
2026-08-22 16:16:06 +02:00
gguf-split
cmake : introduce semantic versioning (#26839)
2026-08-12 14:15:03 +02:00
imatrix
imatrix.cpp: Move finite check and only check touched experts (#26861)
2026-08-11 11:18:19 -04:00
llama-bench
common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)
2026-08-30 09:18:10 +03:00
mtmd
args: add --video-* CLI arguments (#24318)
2026-08-27 12:11:12 +02:00
perplexity
quant : Optimise memory usage by evicting weights after processing each layer (#22877)
2026-08-18 16:22:32 +02:00
quantize
quantize: cap working memory size to avoid loading big tensors onto RAM (#27795)
2026-08-27 18:31:13 +02:00
results
libs : rename libcommon -> libllama-common (#21936)
2026-04-17 11:11:46 +03:00
rpc
rpc: avoid serializing buffers from other servers (#26500)
2026-08-30 20:26:16 +03:00
server
common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)
2026-08-30 09:18:10 +03:00
tokenize
tokenize : drop --stdin mutual-exclusion check (#25672)
2026-07-15 18:41:51 +02:00
tts
args: add --video-* CLI arguments (#24318)
2026-08-27 12:11:12 +02:00
tuning
metal : per-device tuned (Q, NE) for flash-attn vec (#26570)
2026-08-24 19:22:27 +03:00
ui
ui: Improve Chat Form Actions UI/UX (models selector, add panel) (#27746)
2026-08-27 14:47:36 +02:00
CMakeLists.txt
metal : per-device tuned (Q, NE) for flash-attn vec (#26570)
2026-08-24 19:22:27 +03:00