Radoslav Gerganov 41386cf365 rpc : report actual free memory (#16616) ...

* rpc : report actual free memory

Start reporting the free memory on every device instead of using
fixed values. Now llama-cli users can get a nice memory breakdown
when using RPC devices.

* drop --mem in rpc-server

2025-10-17 18:02:52 +03:00

..

batched-bench

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

cvector-generator

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

export-lora

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

gguf-split

ci : use smaller model (#16168)

2025-09-22 09:11:39 +03:00

imatrix

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

llama-bench

llama : add --no-host to disable host buffers (#16310)

2025-10-06 19:55:53 +02:00

main

llama-cli: prevent spurious assistant token (#16202)

2025-09-29 10:03:12 +03:00

mtmd

mtmd : support home-cooked Mistral Small Omni (#14928)

2025-10-16 19:00:31 +02:00

perplexity

perplexity : show more kl-divergence data (#16321)

2025-09-29 09:30:45 +03:00

quantize

ci : use smaller model (#16168)

2025-09-22 09:11:39 +03:00

rpc

rpc : report actual free memory (#16616)

2025-10-17 18:02:52 +03:00

run

common: introduce http.h for httplib-based client (#16373)

2025-10-01 20:22:18 +03:00

server

webui: reorganize settings layout (#16607)

2025-10-17 10:35:03 +02:00

tokenize

cmake : Do not install tools on iOS targets (#15903)

2025-09-16 09:54:44 +07:00

tts

model : Apertus model implementation (#15852)

2025-10-02 20:43:22 +03:00

CMakeLists.txt

mtmd : rename llava directory to mtmd (#13311)

2025-05-05 16:02:55 +02:00