Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-29 00:20:49 +02:00
Code Issues Packages Projects Releases Wiki Activity
10,923 Commits 3 Branches 252 Tags
44ce1a80b319df6fd42e1bdce8f8319ea4e6bf8e
Commit Graph

3 Commits

Author SHA1 Message Date
Xuan-Son Nguyen 951520ddb0 server: delegate result_state creation to server_task (#17835) 
* server: delegate result_state creation to server_task

* remove unued states

* add more docs
 2025-12-08 17:04:38 +01:00
Xuan-Son Nguyen f896d2c34f server: improve speed of speculative decoding (#17808) 
* server: improve speed of speculative decoding

* fix small draft case

* add link to the PR

* server : fix generation time measurement

* server : fix draft acceptance logs (add SRV_CNT, SLT_CNT macros)

* server : add comment

* add PR to docs

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2025-12-08 14:35:28 +01:00
Xuan-Son Nguyen 37a4f63244 server : add development documentation (#17760) 
* first draft

* rewrite

* update & remove duplicated sections
 2025-12-08 13:54:58 +01:00