Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-20 01:31:42 +02:00
Code Issues Packages Projects Releases Wiki Activity
11,443 Commits 3 Branches 254 Tags
66e1913da669bb3403d07f03fdaa191bf1c2a67e
Commit Graph

11443 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Concedo 329c0e7e32 mini qol to prevent fake tool calls 2025-12-29 17:54:27 +08:00
o7si daa242dfc8 common: fix return value check for setpriority (#18412) 
* common: fix return value check for setpriority

* tools: add logging for process priority setting
 2025-12-29 11:07:49 +02:00
Johannes Gäßler e70e640db3 CUDA: Blackwell features for non-native builds (#18436) 2025-12-29 09:35:42 +01:00
Aman Gupta 5fa66c6e67 cuda: fix race condition in cumsum (#18448) 
* ggml-cuda: fix race condition in cumsum

* remove unneccesary sync_threads
 2025-12-29 14:07:17 +08:00
Tim Neumann 382808c14b ci : re-enable rocm build on amd64 (#18439) 
This was disabled in #9340 due to compiler crash, but seems to build now as confirmed by the latest comments in #11913.

I've also managed to build the image with `docker build -f .devops/rocm.Dockerfile .` (for all three stages, `full`, `server` and `light`).

A quick attempt at trying to build an arm64 image failed. Since none of the other images are build for arm, I only enabled the amd64 one.

The `runs_on` option was added to match the other entries.
 2025-12-29 00:29:23 +01:00
uvos 4ffc47cb20 HIP: Use mmq on MFMA devices for MUL_MAT_ID in cases where a lot of splits would be generated (#18202) 2025-12-28 20:12:55 +01:00
momonga 9c675c7140 model : Plamo3 support (#17304) 
* plamo3

* fix plamo3

* clean code

* clean up the code

* fix diff

* clean up the code

* clean up the code

* clean up the code

* clean up the code

* clean up the code

* clean up the code

* add chat_template if exist

* clean up the code

* fix cpu-backend

* chore: whitespace trim fix + typo fix

* Fix: address review feedback

* restore `FREQ_BASE_SWA` constant

* Fix: address review feedback2

* Fix:typecheck

* Fix: address review feedback3

* final cleanup

---------

Co-authored-by: mmngays <146910567+mmngays@users.noreply.github.com>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
 2025-12-28 17:28:31 +01:00
Concedo 0e26e4d354 Merge branch 'upstream' into concedo_experimental 
# Conflicts:
#	.github/ISSUE_TEMPLATE/010-bug-compilation.yml
#	.github/ISSUE_TEMPLATE/011-bug-results.yml
#	.github/ISSUE_TEMPLATE/019-bug-misc.yml
#	ggml/CMakeLists.txt
#	ggml/src/CMakeLists.txt
#	ggml/src/ggml-cuda/CMakeLists.txt
#	ggml/src/ggml-opencl/ggml-opencl.cpp
#	ggml/src/ggml-rpc/ggml-rpc.cpp
 2025-12-28 23:47:55 +08:00
Concedo 58d8635827 fixed autofit 2025-12-28 23:15:06 +08:00
Concedo 82d562ad7b unstable merge 2025-12-28 23:03:03 +08:00
Concedo 9082403a43 disable vk events until directio pr or jeff's fix is added. (+1 squashed commits) 
Squashed commits:

[4796db21a] disable vk events until directio pr or jeff's fix is added.
 2025-12-28 21:54:25 +08:00
Concedo a94d5ffbec Revert "Triage: revert https://github.com/ggml-org/llama.cpp/pull/18047 and https://github.com/ggml-org/llama.cpp/pull/18302" 
This reverts commit dfa1b72d2f.
 2025-12-28 21:48:55 +08:00
Concedo 4c1daf886a updated lite 2025-12-28 21:43:18 +08:00
Concedo 07fb18a04b handle case differences 2025-12-28 21:41:56 +08:00
Aman Gupta 07a0c4ba92 Revert "ggml-cuda: use CMAKE_CUDA_ARCHITECTURES if set when GGML_NATIVE=ON (#18413)" (#18426) 2025-12-28 20:53:36 +08:00
o7si 60f17f56da rpc: fix segfault on invalid endpoint format (#18387) 
* rpc: fix segfault on invalid endpoint format

* rpc: add error log for failed endpoint connection
 2025-12-28 12:34:41 +02:00
Concedo 46891b3c0a updated lite 2025-12-28 18:07:13 +08:00
Johannes Gäßler f8d561eb87 llama-fit-params: fix step size for last device (#18415) 2025-12-28 10:52:09 +01:00
Johannes Gäßler e59efe6a78 github: update issue templates [no ci] (#18410) 
* github: update issue templates [no ci]

* Apply suggestions from code review

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

---------

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
 2025-12-28 10:50:56 +01:00
Xuan-Son Nguyen cffa5c46ea mtmd: clarify that we no longer accept AI-generated PRs (#18406) 2025-12-28 09:57:04 +01:00
Boian Berberov 94de74e7b1 cmake: Added more x86_64 CPU backends when building with GGML_CPU_ALL_VARIANTS=On (#18186) 
* minor: Consolidated `#include <immintrin.h>` under `ggml-cpu-impl.h`

* cmake: Added more x86-64 CPU backends when building with `GGML_CPU_ALL_VARIANTS=On`

- `ivybridge`
- `piledriver`
- `cannonlake`
- `cascadelake`
- `cooperlake`
- `zen4`

Resolves: #17966
 2025-12-28 09:33:29 +02:00
Concedo 21d801f6d5 init total weight for adaptive p 2025-12-28 15:33:06 +08:00
Concedo ec95655f3c fixed default handling for special keys 2025-12-28 13:56:05 +08:00
Concedo 27261bfc26 adaptive decay as an overridable param (+1 squashed commits) 
Squashed commits:

[d94df7843] adaptive decay as an overridable param
 2025-12-28 13:34:20 +08:00
QDelta 4fd59e8427 ggml-cuda: use CMAKE_CUDA_ARCHITECTURES if set when GGML_NATIVE=ON (#18413) 2025-12-28 09:33:14 +08:00
lhez 08566977a7 opencl: allow resizing transpose buffers (#18384) 
* opencl: allow resizing transpose buffers instead of using fixed sizes

* opencl: remove commented code
 2025-12-27 15:51:14 -08:00
Johannes Gäßler a4bf35889e llama-fit-params: fix overflow check (#18354) 2025-12-27 20:20:45 +01:00
Johannes Gäßler 026d2ad472 llama: fix magic number of 999 for GPU layers (#18266) 
* llama: fix magic number of 999 for GPU layers

* use strings for -ngl, -ngld

* enacapsulate n_gpu_layers, split_mode
 2025-12-27 20:18:35 +01:00
Concedo 1051313cb2 added deprecated item sdgendefaults (+1 squashed commits) 
Squashed commits:

[efc14a5d9] fixed sd error
 2025-12-27 22:47:43 +08:00
Aman Gupta 06705fdcb3 ggml-cuda: Use same regex for GGML_NATIVE=OFF (#18407) 2025-12-27 19:56:27 +08:00
Concedo f5282e114d allow ANY api field to have specified defaults, and to be overwritten by value specified at load time 2025-12-27 18:57:04 +08:00
Concedo 6548645aaa rename power law sampler to adaptive p 2025-12-27 17:50:58 +08:00
Johannes Gäßler a52dc60ba3 llama_fit_params: return enum for fail vs. error (#18374) 2025-12-27 09:59:19 +01:00
Johannes Gäßler 9045c9afe5 llama-fit-params: fix Gemma 3 calculation (#18372) 2025-12-27 09:56:04 +01:00
Concedo 445aad5e00 remove sdcpp qwen image lora hack 2025-12-27 16:31:29 +08:00
Wagner Bruna 84765f5967 sd: sync to master-447-ccb6b0a (#1898) 
* sd: sync to master-438-298b110

* sd: sync to master-440-3e81246

* sd: sync to master-444-a0adcfb

* sd: sync to master-447-ccb6b0a
 2025-12-27 16:30:52 +08:00
Concedo 9bb362cce9 revised power law sampling 2025-12-27 10:59:46 +08:00
Concedo 91d8863f18 power law sampler added 2025-12-27 09:46:06 +08:00
Jeff Bolz c9ced4910b vulkan: preprocess mul_mat_id experts and discard workgroups more quickly (#18352) 
Run a preprocess to count how many times each expert is used, and use this to
quickly discard workgroups that aren't needed.
 2025-12-26 16:12:58 -06:00
Jeff Bolz 7ac8902133 vulkan: optimize decodeFuncB in coopmat2 mul_mat_id shader (#18349) 
* vulkan: Use BK=32 for coopmat2 mul_mat_id

* vulkan: optimize decodeFuncB in coopmat2 mul_mat_id shader

Disable robustness, remove the OOB check in decodeFuncB, and initialize the
row_ids to zero to avoid OOB access.

Don't slice/offset the B matrix to ic * BN, only to adjust the coord back down
to the range [0, BN) in decodeFuncB. Instead just slice with a row offset of
zero and remove the '& (BN - 1)'. This allows the compiler to common some of
the shared memory loads.
 2025-12-26 18:15:50 +01:00
Jeff Bolz 9bf20d8ac3 vulkan: Use BK=32 for coopmat2 mul_mat_id (#18332) 2025-12-26 18:15:02 +01:00
Eve cb999704fb vulkan: small dequantization improvements (#18380) 
* iq4_xs

* quants
 2025-12-26 18:12:11 +01:00
Jeff Bolz b96b82fc85 vulkan: Support UPSCALE w/antialias (#18327) 2025-12-26 17:00:57 +01:00
Jeff Bolz 10dc500bdb vulkan: handle rope with large number of rows (#18306) 2025-12-26 16:53:46 +01:00
o7si 4893cc07bb server : fix crash when seq_rm fails for hybrid/recurrent models (#18391) 
* server : fix crash when seq_rm fails for hybrid/recurrent models

* server : add allow_processing param to clear_slot
 2025-12-26 16:35:29 +01:00
Francisco Herrera af3be131c0 docs: added note for pre SYCL Intel hardware (#18016) 
Specify that it's for pre sycl hardware
 2025-12-26 10:34:30 +08:00
0Marble b07cda687c CANN: implement the SSM_CONV operator (#17737) 
* CANN: implement SSM_CONV operator

Co-authored-by: Aleksei Lobanov, <zeromarblectm@gmail.com>
Co-authored-by: Sujin Kang, <waterjin326@gmail.com>

* CANN: remove custom error limit for SSM_CONV

* CANN: merge SSM_CONV tensor shape/strides into one line

---------

Co-authored-by: Sujin Kang, <waterjin326@gmail.com>
 2025-12-26 09:12:04 +08:00
Aman Gupta 85c40c9b02 ggml-cuda: fix regex for arch list (#18371) 
* ggml-cuda: fix regex for arch list

* make regex exact
 2025-12-26 01:35:14 +08:00
Concedo dfa1b72d2f Triage: revert https://github.com/ggml-org/llama.cpp/pull/18047 and https://github.com/ggml-org/llama.cpp/pull/18302 
Revert "vulkan: Implement set_tensor_async and the event interfaces (#18047)"

This reverts commit e1f15b454f. (+1 squashed commits)

Squashed commits:

[3cfbc7b1a] Revert "vulkan: fix command buffer corruption in ggml_backend_vk_event_wait (#18302)"

This reverts commit 2a9ea2020c.
 2025-12-26 01:20:31 +08:00
Concedo 399fc9c57e rename tokens tab to context, move fa to hardware 2025-12-26 00:06:07 +08:00