d5876024ec
Merge commit 'f4586ee5986d6f965becb37876d6f3666478a961' into concedo_experimental
...
# Conflicts:
# README.md
# docs/multimodal/minicpmo2.6.md
# docs/multimodal/minicpmv2.6.md
# ggml/src/ggml-cann/aclnn_ops.cpp
# ggml/src/ggml-cann/ggml-cann.cpp
# ggml/src/ggml-cpu/kleidiai/kleidiai.cpp
# ggml/src/ggml-cuda/CMakeLists.txt
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-opencl/kernels/add.cl
# ggml/src/ggml-sycl/ggml-sycl.cpp
# tools/perplexity/perplexity.cpp
# tools/server/README.md
2025-08-14 21:29:52 +08:00
302bb8cd39
fixed sdmain compile issues
2025-08-13 22:32:02 +08:00
4b2ca1169c
more consistency fixes
2025-08-13 19:28:53 +08:00
955cf66bbc
load embedding at current maxctx instead of max trained ctx by default
2025-08-13 18:42:14 +08:00
06a3ee4c3b
populate better server identifier headers.
2025-08-13 16:10:30 +08:00
5de7ed3d56
WIP: update stable-diffusion.cpp to 5900ef6605c6 (new API) ( #1669 )
...
* Update stable-diffusion.cpp to 5900ef6605c6 (new API)
* Clean up pending LoRA code and simplify LoRA changes to upstream
* Move VAE tiling disabling for TAESD to sdtype_adapter.cpp
* Move auxiliary ctx functions to sdtype_adapter.cpp
* Use ref_images parameter for Kontext images
* Drop clip skip workaround (fixed upstream)
* Workaround for flash attention with img2img
leejet/stable-diffusion.cpp#756
* Workaround for Chroma with flash attention, debug prints
* Disable forcing CLIP weights to F32 for reduced memory usage
2025-08-12 23:25:02 +08:00
7b5cf7143f
handle gguf already containing renamed diffusion tensors prefix
2025-08-12 22:42:29 +08:00
f4586ee598
sycl: Fix and disable more configurations of mul_mat ( #15151 )
...
* sycl: Fix and disable more configurations of mul_mat
* Disable more configurations
2025-08-12 13:58:22 +02:00
0d06e95548
updated lite (+1 squashed commits)
...
Squashed commits:
[d6b832033] updated lite
2025-08-12 18:32:40 +08:00
60a7658810
opencl: allow mixed f16/f32 add ( #15140 )
2025-08-12 02:42:41 -07:00
efe3a90996
CUDA cmake: add -lineinfo for easier debug ( #15260 )
2025-08-12 17:21:45 +08:00
bbd57b7eaf
CANN: GGML_OP_CPY optimization ( #15070 )
...
Signed-off-by: noemotiovon <757486878@qq.com >
2025-08-12 16:12:13 +08:00
25ff6f7659
musa: fix failures in test-backend-ops for mul_mat_id op ( #15236 )
...
* musa: fix failures in test-backend-ops for mul_mat_id op
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* Address review comments
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
---------
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2025-08-12 10:02:51 +08:00
be48528b06
CANN: Add broadcast for softmax and FA ( #15208 )
...
* refactor softmax
* fix fa
* fix mask shape
* format
* add comments
* Remove whitespace
2025-08-11 22:50:31 +08:00
cf9e5648a7
mtmd : Fix MinicpmV model converter and clip to avoid using hardcode. ( #14750 )
...
* Fix MinicpmV model converter and clip to avoid using hardcode.
* Code update for pr/14750
* Remove unused field, update script path in docs.
* Add version 5 for fallback code.
---------
Co-authored-by: lzhang <zhanglei@modelbest.cn >
2025-08-11 16:12:12 +02:00
258f53a938
autoguess: fix Kimi search strings ( #1681 )
...
* updated lite
* autoguess: fix Kimi search strings
* Update klite.embd
---------
Co-authored-by: Concedo <39025047+LostRuins@users.noreply.github.com >
2025-08-11 21:55:42 +08:00
962daa1fdc
updated lite (+1 squashed commits)
...
Squashed commits:
[8da24c85b
2025-08-11 21:41:28 +08:00
fba5c0d680
chat : hotfix gpt-oss jinja raising an exception ( #15243 )
...
* chat : hotfix gpt-oss jinja raising an exception
* fix
2025-08-11 15:31:35 +02:00
53d0a12658
server : allow specifying reasoning_format in HTTP request ( #15238 )
2025-08-11 14:48:41 +02:00
27093afe78
readme : update infra list ( #15234 )
2025-08-11 15:27:54 +03:00
228f724d9c
kv-cache : fix seq_rm with seq_id == -1 ( #15226 )
...
Check Pre-Tokenizer Hashes / pre-tokenizer-hashes (push) Successful in 30s
Python check requirements.txt / check-requirements (push) Failing after 7s
Python Type-Check / pyright type-check (push) Successful in 25s
* kv-cache : fix seq_rm with seq_id == -1
ggml-ci
* cont : iterate over streams
ggml-ci
2025-08-11 13:58:24 +03:00
cd3069dfcb
kv-cache : log (debug) all streams in find_slot ( #15176 )
...
This commit updates `llama_kv_cache_unified::find_slot` to log
information for all streams when debug is enabled.
The motivation for this change is that currently if a non-unified
kv-cache is used, then only one stream will be logged because the
code was currently uses `seq_to_stream[1]`.
2025-08-11 11:21:19 +02:00
50e81bdf5d
convert : fix merge conflicts ( #15229 )
2025-08-11 11:15:44 +02:00
1ebbaddff2
perplexity : update comments/error msg to use decode [no ci] ( #15227 )
...
This commit updates comments and error messages to use "decode" instead
of "eval" in perplexity.cpp.
The motivation for this is that `llama_eval` was renamed to
`llama_decode` a while ago, but the comments and error messages
still referred to "eval". This change ensures consistency and clarity.
2025-08-11 11:21:24 +03:00
a3a7874272
convert : improve Mistral models integration ( #14737 )
...
* Improve Mistral models integration with llama.cpp
* Revert changes and fix gguf
* Revert change
* refactor convert_mistral_to_gguf.py in convert_hf_to_gguf.py
* Revert collateral
* Rename model name
* refactor
* revert
* remove duplicate
* Remove duplication code
* Fixes
* Fix flake issues
* Apply comments
* Apply comments
* Apply comments
* Fix remote
* add default chat template
* Revert
* nit
2025-08-11 10:07:49 +02:00
002cb1bb33
kleidiai: fix unsigned overflow bug ( #15150 )
...
* kleidiai: fix unsigned overflow bug
* address review comments
2025-08-11 09:59:26 +02:00
30e2f25c05
alias tensorsplit , fixed python error
2025-08-10 22:38:14 +08:00
300e20be6c
allow termux to launch existing downloaded models
2025-08-10 21:29:51 +08:00
8e6d27f629
handle if assistant_message_gen and assistant_message_gen!=assistant_message_start, replace final output tag with unspaced (gen) version if exists
2025-08-10 16:51:34 +08:00
204739e7f1
Adapter fixes ( #1659 )
...
* test adapters
* add assistant_gen adapter key
* add support for chat templates stored as .jinja files
* removed mistakenly commited gated-tokenizers link
* autoguess: Harmony: add missing newline prefixes to system_end
2025-08-10 16:19:50 +08:00
57db0ce9cd
allow uploading tagged pinned versions for rocm
2025-08-10 11:04:49 +08:00
1515d67c2c
oldpc build is now fixed (+2 squashed commit)
...
Squashed commit:
[d11ac6cef] temp test
[cfbc008b1] test no f16 as well
2025-08-10 10:52:45 +08:00
79c1160b07
cuda: refactored ssm_scan and use CUB ( #13291 )
...
* cuda: refactored ssm_scan to use CUB
* fixed compilation error when when not using CUB
* assign L to constant and use size_t instead of int
* deduplicated functions
* change min blocks per mp to 1
* Use cub load and store warp transpose
* suppress clang warning
2025-08-09 20:29:43 +02:00
89266ac6b8
autoguess adapter make case insensitive
2025-08-10 00:58:47 +08:00
487d509b44
try fix oldpc cuda broken without flash attn since upstream pr14361 between 1.94 and 1.95 (+1 squashed commits)
...
Squashed commits:
[940f0c639] try fix oldpc cuda broken without flash attn since upstream pr14361 between 1.94 and 1.95
2025-08-10 00:10:37 +08:00
4c1faf61b2
increment version (+1 squashed commits)
...
Squashed commits:
[6e5080ad2] increment version
2025-08-09 20:53:26 +08:00
0fb25bb165
Merge branch 'upstream' into concedo_experimental
2025-08-09 20:31:36 +08:00
5f95fc1122
update lite
2025-08-09 20:31:15 +08:00
34c9d765bf
CUDA: add attention sinks for tile and wmma ( #15178 )
...
* CUDA: add attention sinks for tile and wmma
* Review: formatting changes + remove syncthreads from tile + remove warp_reduce_max from wmma
2025-08-09 20:00:24 +08:00
ced98823a1
kai api tool calling
2025-08-09 10:51:10 +08:00
4c7b82e982
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# scripts/server-bench.py
2025-08-09 10:34:24 +08:00
fc551470d4
updated lite
2025-08-09 10:33:59 +08:00
e54d41befc
gguf-py : add Numpy MXFP4 de/quantization support ( #15111 )
...
Python Type-Check / pyright type-check (push) Successful in 58s
* gguf-py : add MXFP4 de/quantization support
* ggml-quants : handle zero amax for MXFP4
2025-08-08 17:48:26 -04:00
4850b52aed
server-bench: external OAI servers, sqlite ( #15179 )
...
* server-bench: external OAI servers, sqlite
* Update scripts/server-bench.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Update scripts/server-bench.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Update scripts/server-bench.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* raise_for_status
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
2025-08-08 23:04:36 +02:00
9e7a940ce4
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# ggml/src/ggml-opencl/ggml-opencl.cpp
# ggml/src/ggml-opencl/kernels/softmax_4_f16.cl
# ggml/src/ggml-opencl/kernels/softmax_4_f32.cl
# ggml/src/ggml-opencl/kernels/softmax_f16.cl
# ggml/src/ggml-opencl/kernels/softmax_f32.cl
# ggml/src/ggml-rpc/ggml-rpc.cpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
2025-08-09 01:24:52 +08:00
7087aeb4bc
anti bsod only for nvidia
2025-08-09 01:23:38 +08:00
67e0072245
fixed clblast repacking
2025-08-09 01:08:02 +08:00
3468c2834d
fixed adv mode
2025-08-08 22:26:36 +08:00
866cc346ab
tweak OpenAI Harmony autoguess developer prefix and assistant end token ( #1673 )
...
* tweak OpenAI Harmony autoguess developer prefix
* use <|end|> for adapter end
2025-08-08 21:15:11 +08:00
cd6983d56d
ggml : fix field name when new ggml_backend ( #14944 )
2025-08-08 14:37:22 +02:00
Concedo
Wagner Bruna
Romain Biessy
rmatif
Aman Gupta
Chenguang Li
R0CKSTAR
hipudding
rainred
kallewoof
Xuan-Son Nguyen
Zagaj
Georgi Gerganov
Daniel Bevenius
Sigbjørn Skjæret
Julien Denize
Charles Xu
David Zhao
compilade
Johannes Gäßler
AN Long