Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-12 08:08:44 +02:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 5839ba3524 CUDA: dedup MoE gate/up activation quantization (#25441) Pranesh Gonegandla 2026-07-16 07:02:25 +00:00
  • a320cbfcb7 ci : add official website link to release notes (#25728) Georgi Gerganov 2026-07-16 08:30:42 +03:00
  • 56d6e9dde2 quant : allow using manual tensor types with --pure (#25716) Georgi Gerganov 2026-07-16 08:30:20 +03:00
  • 3dafb585f8 opencl: disable FA and MoE weights repack to work around compiler issues for Adreno 850 GPU (#25745) Hongqiang Wang 2026-07-15 20:53:14 -07:00
  • 602f828b4d cuda: extract Q1_0 elements via __byte_perm (#25628) David Friehs 2026-07-16 05:39:17 +02:00
  • 505b1ed15c opencl: exclude some moe kernels on Adreno a7x (#25698) Hongqiang Wang 2026-07-15 12:02:19 -07:00
  • 32beb244f5 ui: Agentic Content UX improvements (#25450) Aleksander Grygier 2026-07-15 20:31:45 +02:00
  • 3b53219361 cuda : CUDA GGML_OP_LIGHTNING_INDEXER implementation (generic vector kernel + wmma kernel) (#25545) fairydreaming 2026-07-15 19:57:52 +02:00
  • aff6eb6e75 tokenize : drop --stdin mutual-exclusion check (#25672) Adrien Gallouët 2026-07-15 18:41:51 +02:00
  • c3d47e696b opencl: fix two issues on flash attention for Adreno a7x (#25697) Hongqiang Wang 2026-07-15 09:08:40 -07:00
  • f6f12e43fa CUDA: tighter MMQ src1 buffer size for native fp4 (#25613) leonardHONG 2026-07-15 23:21:22 +08:00
  • 60f7cfc7b7 fix server build Concedo 2026-07-15 22:31:18 +08:00
  • 956973c764 Fix crash with draft-simple (#25720) Gaurav Garg 2026-07-15 19:51:34 +05:30
  • a582222290 server: fix read_file append_loc space breaking edit_file match (#25705) Pascal 2026-07-15 13:46:46 +02:00
  • a05df0a81a ui: fix thinking menu never appearing in single-model mode (#25637) Pascal 2026-07-15 13:39:21 +02:00
  • a3e5b96ac5 cuda : relax tensor contiguity requirements for quantized concat (#25678) fairydreaming 2026-07-15 13:36:32 +02:00
  • c81029373d ci : add HF_TOKEN to self-hosted workflows (#25706) Georgi Gerganov 2026-07-15 14:34:53 +03:00
  • b3c9d1b846 metal: fuse snake activation (mul, sin, sqr, mul, add) (#25459) Pascal 2026-07-15 12:53:31 +02:00
  • f955e394bf ggml: add f16 out_prod support for CPU and out_prod op for Vulkan (#23997) Michael Lamothe 2026-07-15 18:46:56 +10:00
  • da39cc21b4 Merge branch 'upstream' into concedo_experimental Concedo 2026-07-15 15:55:27 +08:00
  • 33a75f41c3 DeepseekV4: reduce graph splits (#25702) Aman Gupta 2026-07-15 15:47:18 +08:00
  • 9001369da0 Merge branch 'upstream' into concedo_experimental Concedo 2026-07-15 15:39:31 +08:00
  • d3fba0c79d sycl : fix get_rows Q2_K, Q4_K, Q5_K (#25656) Neo Zhang 2026-07-15 15:32:28 +08:00
  • ae9291e16b sycl : support kernel type fp16 for conv2d_dw (#25653) Neo Zhang 2026-07-15 15:31:10 +08:00
  • 22b208b1ca sycl : implement xielu op (#25550) Andrew Smith 2026-07-15 00:29:12 -07:00
  • 0e148a573f sycl: Increase minimum buffer size for USM system allocations (#25525) Francois Dugast 2026-07-15 09:28:24 +02:00
  • 32b741c336 [SYCL] Flash Attention with XMX engine via oneDNN (#25222) hmscider 2026-07-15 03:26:53 -04:00
  • 23ba6932b5 Merge commit 'e920c523e3b8a0163fe498af5bf90df35ff51d25' into concedo_experimental Concedo 2026-07-15 15:25:48 +08:00
  • 12127defda opencl: do not use clCreateBufferWithProperties when targeting CL 2.x (#25673) Hongqiang Wang 2026-07-14 19:53:56 -07:00
  • 00fa7cb284 opencl: handle OOB write in noshuffle GEMV kernels (odd ne01) (#25640) Hongqiang Wang 2026-07-14 13:46:54 -07:00
  • a4ce2595c5 opencl: avoid the vec path in GEMV for unaligned row stride (#25671) Hongqiang Wang 2026-07-14 12:27:56 -07:00
  • c71854292f hexagon: fix hmx-queue signal enum-narrowing problem (#25677) Chyan 2026-07-15 03:27:09 +08:00
  • 04111eeadb jinjathink enables jinja Concedo 2026-07-15 00:22:51 +08:00
  • bf2c86ddc0 server : refactor prompt cache state ownership (#25649) Georgi Gerganov 2026-07-14 18:25:52 +03:00
  • 6e52db5b72 server: add --cors-* options (#25655) Xuan-Son Nguyen 2026-07-14 17:23:44 +02:00
  • 236ab574e0 ui: Fix spacing in tool-call request (#25634) Bill Sideris 2026-07-14 18:23:11 +03:00
  • dfba90db63 webui: parse effective-parameter sizes (E2B, E4B) as params (#25529) Emanuil Rusev 2026-07-14 18:12:22 +03:00
  • 00e79f6fb1 opencl: fix a dp4a bug for devices where cl_khr_integer_dot_product is unavailable (#25639) Hongqiang Wang 2026-07-14 08:08:13 -07:00
  • 17a05e451f ui: fix mcp panel for toggle + timeout + proxy + ON/OFF state (#25631) Pascal 2026-07-14 16:50:44 +02:00
  • 7f575c39d6 DeepseekV4: fix seq_rm (#25588) Aman Gupta 2026-07-14 21:45:36 +08:00
  • 7cbd61002d vulkan/cpu: Support f16 as SET_ROWS src. (#25432) Jeff Bolz 2026-07-14 08:26:55 -05:00
  • 8ff8c4299d tokenize : align usage by using common args (#25516) Adrien Gallouët 2026-07-14 15:20:53 +02:00
  • a7312ae94f ggml : add a set of functions for checking contiguity of inner tensor dimensions (#25650) fairydreaming 2026-07-14 14:37:52 +02:00
  • 657e01125a tests: export-graph-ops: exit gracefully when called w/o arguments (#25619) Christian Kastner 2026-07-14 12:15:41 +02:00
  • 47a39665e7 ggml: uniformize im2col dst_type for all conv ops (#23660) JusteLeo 2026-07-14 12:13:13 +02:00
  • 47c786924a kleidiai : add SME2 f32 kernel (#24414) Charles Xu 2026-07-14 12:12:18 +02:00
  • c9330ed0cf ui: add reasoning effort control to mobile add sheet (#25539) Pascal 2026-07-14 12:05:40 +02:00
  • cb489bc0fb convert_hf_to_gguf: support split MTP export for HY V3 (#25641) Thiago Padilha 2026-07-14 06:43:15 -03:00
  • ec0dbef816 arg: Flush log before exiting after usage() (#25504) Christian Kastner 2026-07-14 11:03:22 +02:00
  • c1063ac9d7 sycl: set fattn_vec_nthreads to 256 for Battlemage (#25205) Titaniumtown 2026-07-14 05:00:00 -04:00
  • 14d3ba45f3 metal : add Q2_0 support (#25419) Pasha Khosravi 2026-07-13 21:52:00 -07:00
  • 2969d6d15d model: add Hy3 (hy_v3) support with MTP speculative decoding (#25395) Satinder Grewal 2026-07-14 10:31:04 +12:00
  • 6eddde06a4 CUDA: refactor MMQ kernel configuration (#24127) Johannes Gäßler 2026-07-13 18:37:57 +02:00
  • e920c523e3 vulkan: Use native e2m1 and e4m3 conversions for mxfp4/nvfp4 (#25338) Jeff Bolz 2026-07-13 08:44:17 -05:00
  • 259ae1df8b spec: add Minimax2 eagle3 support Adrian 2026-07-13 06:22:37 -07:00
  • 4193ea697f readme : add link to maintainer PRs (#25621) Georgi Gerganov 2026-07-13 16:07:58 +03:00
  • fa21872f97 Merge branch 'upstream' into concedo_experimental Concedo 2026-07-13 20:53:37 +08:00
  • 1f9dd9c398 sd: sync with master-775-b5d8120 (#2321) Wagner Bruna 2026-07-13 09:42:22 -03:00
  • d067fc6d28 fixed kcpp sdcpp file location Concedo 2026-07-13 20:40:48 +08:00
  • f4253ef965 tests: Harmonize header use (#25616) Christian Kastner 2026-07-13 14:36:51 +02:00
  • 75ada7102f exclude z-image from reference image list Concedo 2026-07-13 20:32:58 +08:00
  • ad8d821991 gguf : add tensor shape accessor (#24405) QuintinShaw 2026-07-13 18:55:15 +08:00
  • b368c874e9 fixed int8 convrot loading Concedo 2026-07-13 18:39:32 +08:00
  • 91b1e1c89a fix speculative logging Concedo 2026-07-13 18:29:21 +08:00
  • 2f7d1bb5c4 fixed nonetype error Concedo 2026-07-13 18:04:37 +08:00
  • 91c631b21d chat : fix reasoning leak with force-opened bare <think> templates (#24674) Frosty40 2026-07-13 02:45:10 -05:00
  • efb3036c18 sycl: add fused top-k MoE (#25217) Frosty40 2026-07-13 01:56:41 -05:00
  • e474bba7af sycl: add Q2_K to DMMV reorder path (#25064) Todd Malsbary 2026-07-12 23:53:39 -07:00
  • 38fd5c9993 ui: Remove recommended MCP Servers + improve MCP Servers Settings UI/UX (#25535) Aleksander Grygier 2026-07-13 08:45:04 +02:00
  • 99f3dc3229 server: honour per-request reasoning_budget_tokens in chat completions (#23116) Bernard Ladenthin 2026-07-13 01:58:44 +02:00
  • 34558825a2 vendor : update cpp-httplib to 0.50.1 (#25576) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-07-12 20:10:03 -03:00
  • 8014d2cf97 server: Don't consider models with --no-mmproj-auto as multimodal (#25590) Sebastian Dröge 2026-07-13 01:48:13 +03:00
  • 4114ba18b2 mtmd: fix silent prompt truncation on embedded NUL (#25548) Pascal 2026-07-13 00:47:25 +02:00
  • 0c4fa7a989 server : evict checkpoints within min-step of each other (#25472) Aldehir Rojas 2026-07-12 15:59:14 -05:00
  • 6b4dc2116a server : fix image blocks in tool_result being dropped during Anthropic OpenAI conversion (#22536) quei 2026-07-12 23:43:51 +08:00
  • faabad2fab up speculative vocab drafting from 128 to 256 Concedo 2026-07-12 22:55:00 +08:00
  • f2f9d9d2b3 cont: abort bug for images Concedo 2026-07-12 22:37:12 +08:00
  • 60f0e18cb0 added int8 convrot support Concedo 2026-07-12 21:43:36 +08:00
  • 30def702a0 fixed abort bug for images Concedo 2026-07-12 21:01:15 +08:00
  • 70a9d58fff fixed sefi loading Concedo 2026-07-12 14:25:14 +08:00
  • 062a2d0bd3 added support for qwen3tts aliases, replaces https://github.com/LostRuins/koboldcpp/pull/2315 Concedo 2026-07-12 11:49:33 +08:00
  • 6fffdb5c62 rowsplit removed Concedo 2026-07-12 09:58:39 +08:00
  • e3546c7948 Fix conditional to display 'LLAMA_SPLIT_MODE_TENSOR not implemented for architecture' message (#24926) kdkd 2026-07-11 13:03:24 -05:00
  • d72bfa38f7 gguf : reject empty metadata keys (#24917) Rohit Mahesh 2026-07-11 13:02:44 -05:00
  • 3cec3bcd16 cuda: Don't crash when querying memory on device with no free memory. (#25157) cphlipot 2026-07-11 10:13:43 -07:00
  • 13f2b28b09 DeepseekV4: clear cache only for seq rather than full (#25521) Aman Gupta 2026-07-11 23:35:45 +08:00
  • c95d4e466e update sdui Concedo 2026-07-11 22:21:51 +08:00
  • ce3623ad8b sd: make aborting on client disconnect opt-out (#2322) Wagner Bruna 2026-07-11 11:21:22 -03:00
  • 0240b72895 add script working dir to convert script Concedo 2026-07-11 22:15:16 +08:00
  • c92e806d1c server: allow stream for exec_shell_command (#25526) Xuan-Son Nguyen 2026-07-11 12:42:55 +02:00
  • ea1f7bbb5d server: refactor server_stream (#25541) Xuan-Son Nguyen 2026-07-11 12:41:47 +02:00
  • 00f5442cc4 ggml : add GGML_OP_LIGHTNING_INDEXER that implements DeepSeek V3.2/V4 lightning indexer (#24231) fairydreaming 2026-07-11 11:39:07 +02:00
  • 76f2798059 Vulkan: route large matmuls to medium tile on Adreno (#24877) Raman Shinde 2026-07-11 13:58:29 +05:30
  • 1d1d9a9ed7 opencl: add int8 dp4 dense and MoE prefill optimization for Adreno GPUs (#25537) Hongqiang Wang 2026-07-10 23:05:58 -07:00
  • 622599d8b5 updated sdui Concedo 2026-07-11 12:28:53 +08:00
  • c43c27c838 sd: cancel image generation on client disconnect (#2318) Wagner Bruna 2026-07-11 01:28:04 -03:00
  • cf11aeb27e bump version Concedo 2026-07-11 11:37:54 +08:00
  • f57cd915a9 Merge branch 'upstream' into concedo_experimental Concedo 2026-07-11 11:36:59 +08:00
  • 9d8a50378a Merge commit '961e4b26a7dd0e01e20599b27d709a74788ecb55' into concedo_experimental Concedo 2026-07-11 11:13:27 +08:00
  • 0f0245161e Merge branch 'upstream' into concedo_experimental Concedo 2026-07-11 09:20:40 +08:00