Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-15 03:08:49 +02:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • f71af352a5 convert : fix Gemma4 with no audio encoder (#24242) Sigbjørn Skjæret 2026-06-07 08:43:05 +02:00
  • 3f7c79d7b5 docker : bump cuda13 to 13.3.0 (#24228) Sigbjørn Skjæret 2026-06-07 08:31:58 +02:00
  • b1dc6110f0 sd: fix utf-8 prompt handling (#2254) Wagner Bruna 2026-06-07 02:37:20 -03:00
  • 98d5e8ba8a common/chat : fix LFM2/LFM2.5 reasoning round-trip and <think> leak (#24234) Tarek Dakhran 2026-06-06 22:39:21 +02:00
  • 31e82494c0 mtmd: support "frame merge" for qwen-vl-based models (#21858) Xuan-Son Nguyen 2026-06-06 21:17:25 +02:00
  • 6b80c74f28 completion : remove useless statics (#24226) Adrien Gallouët 2026-06-06 12:16:16 +02:00
  • 588f0dc2ce completion : fix format specifier in LOG_INF (#24213) Adrien Gallouët 2026-06-06 11:24:27 +02:00
  • f5c6ae1827 mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913) Xuan-Son Nguyen 2026-06-06 11:06:51 +02:00
  • 5a69c97439 vulkan: check coopmat2 features before reporting support (#24186) Ruben Ortlam 2026-06-06 09:11:35 +02:00
  • d7bc1c7296 update sdui ref picker Concedo 2026-06-06 13:08:37 +08:00
  • 5343f4502a model : rename local n_layer_all variable (#24209) Sigbjørn Skjæret 2026-06-06 06:07:20 +02:00
  • 603300b008 context : fix off-by-one comparisons to n_gpu_layers (#24208) Sigbjørn Skjæret 2026-06-06 06:06:47 +02:00
  • 9042af9a2e increase prompt length limit Concedo 2026-06-06 09:55:39 +08:00
  • 308f61c31f opencl: improve get_rows, cpy, concat and q6_k flat gemv (#24160) lhez 2026-06-05 13:45:25 -07:00
  • da87e9b612 common/chat : unify and fix LFM2/LFM2.5 tool parser (#24178) Tarek Dakhran 2026-06-05 21:31:56 +02:00
  • e82beaa60d vulkan: add fwht support for Intel with shmem reduction (#23964) Ruben Ortlam 2026-06-05 19:44:40 +02:00
  • c4a278d68e model: fix build failed (#24193) Xuan-Son Nguyen 2026-06-05 18:12:27 +02:00
  • 64086f2b2f model, mtmd: Granite4 Vision (#23545) Gabe Goodhart 2026-06-05 09:44:59 -06:00
  • 6effcecd0b TP: round up granularity to 128 (#24180) Johannes Gäßler 2026-06-05 17:35:13 +02:00
  • 86591c7536 cli: fix model params not propagated (#23893) therealkenc 2026-06-05 08:29:41 -07:00
  • 96fbe00393 model : fix llama_model::n_gpu_layers() (#24188) Georgi Gerganov 2026-06-05 17:11:42 +03:00
  • 2016bf2b3b ui: run npm install when package-lock.json is newer than node_modules (#24171) Pascal 2026-06-05 14:57:32 +02:00
  • 9c955c48b0 Fix link to available UI settings (#24169) Mario 2026-06-05 13:39:32 +01:00
  • cc7bef34e2 ui: add ignore-scripts=true to npmrc (#24149) Xuan-Son Nguyen 2026-06-05 14:31:03 +02:00
  • ad1b88ca0d docs: Update quantization readme (#24133) Pedro Cuenca 2026-06-05 12:21:26 +02:00
  • a9d743634c reordered some args Concedo 2026-06-05 17:27:17 +08:00
  • 59917d3922 minor : fix lint issues (#24165) Georgi Gerganov 2026-06-05 11:17:54 +03:00
  • 7acb4e8cd2 hparams : refactor hparams.n_layer (#24060) Georgi Gerganov 2026-06-05 11:09:36 +03:00
  • 3ecfb150a4 kleidiai : dynamic chunck-based scheduling for hybrid execution (#23819) Charles Xu 2026-06-05 09:11:47 +02:00
  • 2154a0fdcf CUDA: enroll mul_mat_vec_q_moe into pdl (#24087) Oliver Simons 2026-06-05 08:37:34 +02:00
  • 46fa662b1f ci : build-msys job slimming [no ci] (#24157) Daniel Bevenius 2026-06-05 07:57:36 +02:00
  • 7fe2ae45ab sycl : port multi-column MMVQ from CUDA backend (#21845) Mason Milburn 2026-06-05 01:10:31 -04:00
  • 9755b05556 g4ua audio fix Concedo 2026-06-05 10:59:24 +08:00
  • b8acf16e73 hacky fix that worked for gemma4 uv Concedo 2026-06-05 01:40:08 +08:00
  • 2cfcd40fd4 gemma4uv vision still a little buggy Concedo 2026-06-05 00:53:23 +08:00
  • 7c158fbb4a server : disable on-device spec checkpoints (#24108) Georgi Gerganov 2026-06-04 19:30:59 +03:00
  • 260862b8ca arg: fix double mtp downloads (#24128) Xuan-Son Nguyen 2026-06-04 18:23:48 +02:00
  • f997d23660 gemma4uv alloc fix Concedo 2026-06-05 00:15:59 +08:00
  • 42b2d60e57 webui: [a11y] fix keyboard navigation issues in chat interface and sidebar (#23132) viggy 2026-06-04 08:59:00 -07:00
  • e7bcf1c3a8 Move duplicated imatrix code into single common imatrix-loader.cpp (#22445) Bartowski 2026-06-04 11:45:40 -04:00
  • af3bcde675 Merge branch 'upstream' into concedo_experimental Concedo 2026-06-04 23:44:05 +08:00
  • 2750cc492b Merge branch 'upstream' into concedo_experimental Concedo 2026-06-04 23:42:40 +08:00
  • 21444c822e ui: Fixed packages (#24119) Aleksander Grygier 2026-06-04 16:23:08 +02:00
  • 526977068f ui: added single line reasoning preview (#23601) MagicExists 2026-06-04 21:09:43 +07:00
  • 0dbfa66a1f return filter to save memory (#24125) forforever73 2026-06-04 21:56:33 +08:00
  • e8023568d0 convert: Fix Gemma 4 Unified conversion (#24118) Pedro Cuenca 2026-06-04 15:21:38 +02:00
  • 4c51309617 ggml: vectorize ggml_vec_dot_q4_1_q8_1 with WASM SIMD128 (#22209) Kartik Sirohi 2026-06-04 18:42:38 +05:30
  • 6f3a9f3dee server: avoid unnecessary checkpoint restore when new tokens are present (#24110) Yongyue Sun 2026-06-04 21:09:01 +08:00
  • a121232fdc agents: refactor, include more guidelines (#24111) Xuan-Son Nguyen 2026-06-04 13:40:23 +02:00
  • 4586479852 webui: fix tool selector toggle/counter, key tools by stable identity (#24065) Pascal 2026-06-04 13:09:49 +02:00
  • 4d742877b2 build : use umbrella Headers directory for XCFramework module map (#23974) Gerard Martinez 2026-06-04 03:58:25 -07:00
  • 94375fb145 Revert "e4b fix https://github.com/ggml-org/llama.cpp/pull/24077" Concedo 2026-06-04 18:39:50 +08:00
  • 0066404085 server : add header to tools/server/server-http.h (#24089) A B 2026-06-04 05:14:46 -05:00
  • 7ac5a4225e cmake: skip cvector-generator and export-lora when CPU backend is disabled (#24053) Andrea Richiardi 2026-06-04 04:13:19 -06:00
  • e3ba22d6cc fix(mtmd): handle Gemma 4 audio projector embedding size (#24091) Andrei 2026-06-04 02:51:23 -07:00
  • 6ddc9430b1 readme : add status badges (#24104) Georgi Gerganov 2026-06-04 10:58:13 +03:00
  • 65ef50a0a4 tests : refactor test-save-load-state to accept token input (#24073) Georgi Gerganov 2026-06-04 08:06:36 +03:00
  • 3d1998634e metal : reduce rset heartbeat from 500ms -> 5ms (#24074) Georgi Gerganov 2026-06-04 08:05:32 +03:00
  • e8c54893f2 ggml-webgpu: FlashAttention refactor + standardize quantization support (#23834) Reese Levine 2026-06-03 22:05:04 -07:00
  • 3c7450cee1 ggml-cpu: extend RVV quantization vec dot to higher VLENs (#22754) rehan-10xengineer 2026-06-04 10:03:40 +05:00
  • f478f1b6d7 sycl : Improve SYCL doc (#23025) Todd Malsbary 2026-06-03 22:02:54 -07:00
  • da0bb976b3 e4b fix https://github.com/ggml-org/llama.cpp/pull/24077 Concedo 2026-06-04 10:49:35 +08:00
  • 7fb55b1e32 does not work for e4b Concedo 2026-06-04 10:44:40 +08:00
  • 1f14c98d36 sd: fix gemma3 vocab and merge filenames and add functions for gemma2 (#2249) Wagner Bruna 2026-06-03 23:31:06 -03:00
  • 94a220cd67 mtmd: fix Gemma 4 unified FPE (#24088) Andrei 2026-06-03 12:51:18 -07:00
  • 166fe29492 qwen35: use post-norm hidden state for MTP (#24025) Aman Gupta 2026-06-04 01:29:09 +08:00
  • c8d6a00636 mtmd: enable non-causal vision for gemma 4 unified (#24082) Xuan-Son Nguyen 2026-06-03 19:05:17 +02:00
  • a731805ced mtmd, model: allow skip build_vit() (#24077) Xuan-Son Nguyen 2026-06-03 17:10:35 +02:00
  • ee4cf705bb ui: Mermaid Diagrams in chat + interactive preview (#24032) Aleksander Grygier 2026-06-03 16:55:36 +02:00
  • 9e58d4d692 Avoid PDL race conditions by disabling __restrict__ when PDL is used (#24030) Andreas Kieslinger 2026-06-03 13:56:42 +02:00
  • 3571fa5435 ggml-cpu: use runtime SVE width in FWHT (#24059) Charles Xu 2026-06-03 12:45:10 +02:00
  • f8f0a47a55 cuda: reserve space for quantize kv-cache at startup (#23907) Aman Gupta 2026-06-03 18:39:59 +08:00
  • 06938ac129 tests : add support for qwen3 SSM archs (#24031) Georgi Gerganov 2026-06-03 10:15:27 +03:00
  • d545a2a993 update BoringSSL to 0.20260526.0 (#23794) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-06-03 02:42:58 -03:00
  • 4da6370d43 ci : disable ccache for msvc windows release jobs (#23911) Georgi Gerganov 2026-06-03 08:05:21 +03:00
  • e3666269f9 arg : removed unecesary mmproj download when users pass --no-mmproj (#23425) Ryan Mangeno 2026-06-02 22:04:46 -07:00
  • 63e66fdd23 opencl: use flat variants of q4_K and q6_K gemv for very large M (#24006) lhez 2026-06-02 14:16:17 -07:00
  • 5c394fdc8b hexagon: profiler output fix and script updates (#24042) Max Krasnyansky 2026-06-02 14:08:29 -07:00
  • 4fb16eccce model: add Mellum architecture (#23966) Mikhail Podvitskii 2026-06-02 21:11:12 +02:00
  • bfb4308b05 model : support granite multilingual embeddings R2 (ibm-granite/granite-embedding-{97,311}m-multilingual-r2) (#22716) Hans Florian 2026-06-02 11:55:11 -04:00
  • 2187e00337 StepFun 3.5 MTP (#23274) Piotr Wilkin (ilintar) 2026-06-02 17:44:35 +02:00
  • 0b7154066e common : fix state save in common_prompt_batch_decode (#23468) Daniel Bevenius 2026-06-02 15:44:15 +02:00
  • 60130d18f9 server: add SSE ping interval (#24013) Xuan-Son Nguyen 2026-06-02 14:14:55 +02:00
  • 598b594aa2 Revert "disable temporal tiling" Concedo 2026-06-02 19:45:15 +08:00
  • 13eaa04269 Merge branch 'upstream' into concedo_experimental Concedo 2026-06-02 19:28:39 +08:00
  • 153214c66a Merge commit '5aba5364d959756c43eccc45596731e7b4eb3aa4' into concedo_experimental Concedo 2026-06-02 18:30:40 +08:00
  • a468b89018 ci : reduce self-hosted server workflow jobs (#24012) Georgi Gerganov 2026-06-02 13:17:59 +03:00
  • d5ab0834ab docs : update HOWTO-add-model.md (#23883) Mikhail Podvitskii 2026-06-02 11:40:22 +02:00
  • 69cea5b669 ui: simplify network error handling (#23431) Marcos Del Sol Vives 2026-06-02 10:45:25 +02:00
  • f8e67fc583 ui: Add Thinking mode toggle with reasoning effort levels + improvements for Chat Form Add Action UI (#23434) Aleksander Grygier 2026-06-02 10:23:19 +02:00
  • 2365315955 kv-cache : SWA checkpoints store only non-masked cells (#23981) Georgi Gerganov 2026-06-02 11:06:29 +03:00
  • f7a0777a5c convert : support Step3.7-Flash (#23845) forforever73 2026-06-02 15:54:49 +08:00
  • 4f3a4beb8d llama : deprecate llama_set_warmup (#24009) Georgi Gerganov 2026-06-02 10:30:38 +03:00
  • 8f7f3bf141 hexagon: MUL_MAT, MUL_MAT_ID, FLASH_ATTN and GDN cleanup and optimizations for latest models (#23989) Max Krasnyansky 2026-06-01 23:40:08 -07:00
  • d178a11818 hexagon: add gelu_quick (#24007) Todor Boinovski 2026-06-01 23:19:07 -07:00
  • 354ebac8cb server: real-time reasoning interruption via control endpoint (#23971) Pascal 2026-06-02 07:26:20 +02:00
  • 1fd5f48037 clean up unused variables warnings (#23975) Anav Prasad 2026-06-01 19:38:37 -07:00
  • 210a6570ce opencl: fix compiler warnings for non-adreno path (#23922) lhez 2026-06-01 19:15:09 -07:00
  • b8275a8acc revert to using global_invocation_id for cpy shader (#23955) Masashi Yoshimura 2026-06-02 08:59:06 +09:00
  • 5dcb711666 speculative : fix n_outputs_max and remove draft-simple auto-enable (#23988) Georgi Gerganov 2026-06-01 22:26:58 +03:00