mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-27 07:30:49 +02:00

Files

T

Georgi Gerganov c41bde6fbd metal : add residency sets keep-alive heartbeat (#17766 )

* examples : add idle

* metal : attach residency sets to queue

* idle : add link

* idle : adjust intervals

* metal : add residency sets keep-alive heartbeat

* cont : adjust default keep-alive time

2025-12-05 19:38:54 +02:00

CMakeLists.txt

metal : add residency sets keep-alive heartbeat (#17766 )

2025-12-05 19:38:54 +02:00

idle.cpp

metal : add residency sets keep-alive heartbeat (#17766 )

2025-12-05 19:38:54 +02:00

README.md

metal : add residency sets keep-alive heartbeat (#17766 )

2025-12-05 19:38:54 +02:00

README.md

llama.cpp/example/idle

https://github.com/ggml-org/llama.cpp/pull/17766