7061cd1cc9
Merge commit 'e4a71599e5846110159955dec0008eb4aa24222b' into concedo_experimental
...
# Conflicts:
# CODEOWNERS
# tools/mtmd/clip.cpp
2025-11-08 10:28:49 +08:00
7e787c2083
Revert "Kcpp triage for rowsplit: revert https://github.com/ggml-org/llama.cpp/pull/16715 until https://github.com/ggml-org/llama.cpp/issues/16799 is resolved"
...
This reverts commit 3aec5ed0fd
2025-11-08 10:16:54 +08:00
af94884971
update props
2025-11-08 10:15:13 +08:00
92b5afc019
flag to show if jinja is enabled
2025-11-08 00:49:50 +08:00
b02fc29030
jinja2 as dependency
2025-11-07 23:47:39 +08:00
462a34ed5b
jinja is now working
2025-11-07 23:46:22 +08:00
cfb22b5c9d
rename a missed BLAS -> batch
2025-11-06 16:11:26 +08:00
978d755ddc
escape clause for tool calling
2025-11-05 22:02:24 +08:00
3e4a33499f
updated lite
2025-11-05 20:52:47 +08:00
6ddacb62a0
serve gzipped versions of files. added a modded lcpp gui with modified path handling and proper stream termination, see https://github.com/ggml-org/llama.cpp/pull/14839#issuecomment-3490987929
2025-11-05 20:40:30 +08:00
fc80cdccc2
Merge commit 'bea04522ff1a0d8559ccfd353aa018dcfbb608cc' into concedo_experimental
...
# Conflicts:
# scripts/sync-ggml.last
# src/CMakeLists.txt
# tests/test-backend-ops.cpp
2025-11-05 12:41:01 +08:00
9720aa6224
change an assert to optional testing https://github.com/LostRuins/koboldcpp/issues/1821
2025-11-02 10:30:04 +08:00
7946203d5b
add test build target for linux olderpc
2025-11-02 10:25:00 +08:00
3aec5ed0fd
Kcpp triage for rowsplit: revert https://github.com/ggml-org/llama.cpp/pull/16715 until https://github.com/ggml-org/llama.cpp/issues/16799 is resolved
...
revert https://github.com/ggml-org/llama.cpp/pull/16715 (+2 squashed commit)
Squashed commit:
[289af2ee2] Revert "Hide latency of bias and gate-loading (#16847 )"
This reverts commit 8b11deea46#16807 )"
This reverts commit 463bbf20bf
2025-11-02 09:58:41 +08:00
2649618042
ROCm 7.1 CI ( #1823 )
2025-11-02 08:03:27 +08:00
af327857ec
handle loading very old mmproj that broke after https://github.com/ggml-org/llama.cpp/pull/14928
2025-11-02 02:11:17 +08:00
333e2bb30b
fix for qwen image crashing due to ref images being too big, trial and error shows it happens after 512x512
2025-11-02 01:31:01 +08:00
e4a71599e5
webui: add HTML/JS preview support to MarkdownContent with sandboxed iframe ( #16757 )
...
* webui: add HTML/JS preview support to MarkdownContent with sandboxed iframe dialog
Extended MarkdownContent to flag previewable code languages,
add a preview button alongside copy controls, manage preview
dialog state, and share styling for the new button group
Introduced CodePreviewDialog.svelte, a sandboxed iframe modal
for rendering HTML/JS previews with consistent dialog controls
* webui: fullscreen HTML preview dialog using bits-ui
* Update tools/server/webui/src/lib/components/app/misc/CodePreviewDialog.svelte
Co-authored-by: Aleksander Grygier <aleksander.grygier@gmail.com >
* Update tools/server/webui/src/lib/components/app/misc/MarkdownContent.svelte
Co-authored-by: Aleksander Grygier <aleksander.grygier@gmail.com >
* webui: pedantic style tweak for CodePreviewDialog close button
* webui: remove overengineered preview language logic
* chore: update webui static build
---------
Co-authored-by: Aleksander Grygier <aleksander.grygier@gmail.com >
2025-11-01 17:14:54 +01:00
dd5e8cab51
vendor : update cpp-httplib to 0.27.0 ( #16846 )
...
Signed-off-by: Adrien Gallouët <angt@huggingface.co >
2025-11-01 16:52:17 +01:00
7179e49aef
fix from https://github.com/leejet/stable-diffusion.cpp/pull/926
2025-11-01 23:38:37 +08:00
cf659bbb8e
mtmd: refactor preprocessing + support max/min pixels ( #16878 )
...
* mtmd: refactor preprocessing + support max/min pixels
* fix mlp type
* implement mix/max pixels
* improve hparams
* better image preproc for qwen
* fix
* fix out of bound composite
* fix (2)
* fix token calculation
* get_merge_kernel_size()
* fix llama4 and lfm2
* gonna fix them all
* use simple resize for qwen
* qwen: increase min tokens
* no resize if dst size == src size
* restore to initial min/max tokens value for qwen
2025-11-01 15:51:36 +01:00
d8b860a219
Add a setting to display message generation statistics ( #16901 )
...
* feat: Add setting to display message generation statistics
* chore: build static webui output
2025-11-01 15:35:57 +01:00
1ae74882f8
webui: recognize AsciiDoc files as valid text files ( #16850 )
...
* webui: recognize AsciiDoc files as valid text files
* webui: add an updated static webui build
* webui: add the updated dependency list
* webui: re-add an updated static webui build
This also reverts commit 742dbb837939c176a813868c268d28ebd3fafb7c.
2025-11-01 15:02:57 +01:00
961660b8c3
common : allow --system-prompt-file for diffusion-cli ( #16903 )
2025-11-01 11:01:42 +01:00
74fef4129f
codeowners : update after refactor ( #16905 )
2025-11-01 09:55:25 +02:00
5d8bb900bc
vulkan: Fix multi_add invalid descriptor usage ( #16899 )
2025-11-01 06:52:14 +01:00
2e76e01360
vulkan: fuse mul_mat+add and mul_mat_id+add_id ( #16868 )
...
* vulkan: fuse mul_mat+add and mul_mat_id+add_id
The fusion is only applied for the mat-vec mul paths.
* Apply suggestions from code review
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* fix 32b build
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
2025-11-01 06:45:28 +01:00
d3dc9dd898
CUDA: Remove unneded bias/gate dims in fused mmvq ( #16858 )
...
* CUDA: Remove unneded bias/gate dims in fused mmvq
Pointed out
[here](https://github.com/ggml-org/llama.cpp/pull/16847#discussion_r2476798989 )
that only a single value is needed per target col per thread
* Apply suggestions from code review
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
* Fix "Error 991-D: extra braces are nonstandard" during compilation
---------
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
2025-11-01 13:13:26 +08:00
60d3cc713c
updated lite
2025-11-01 12:21:35 +08:00
988baa544e
add JobRate and JobCost to worker log ( #1820 )
...
- adds average jobs per hour
- adds average kudos earned per job
- change EarnRate to show 2 decimal places
2025-11-01 10:01:13 +08:00
bea04522ff
refactor : llama-model.cpp ( #16252 )
...
* Sqashed: llama-model.cpp refactoring
* Fix formatting of attn / ffn / ffn_moe calls
* Fix import regression / unify spacing in models.h
* totally DID NOT miss those!
* Add missing qwen3vl(moe) models
* Add missing new .cpp files to build
* Remove extra semicolons
* Editor checker
* Update src/models/models.h
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
2025-10-31 23:40:23 +01:00
0de0a01576
model : Minimax M2 ( #16831 )
...
* Model: Minimax M2
* Cleanup
* Cleanup pt. 2
* Cleanup pt. 3
* Update convert_hf_to_gguf_update.py - merge catch blocks
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Remove vocab models and test
* Remove all redundant hparam settings covered by TextModel
* Move super to start, don't set block_count
* Update src/llama-model.cpp
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
* Update gguf-py/gguf/constants.py
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com >
2025-10-31 21:20:47 +01:00
e58d585604
model : add Granite Hybrid nano types ( #16896 )
...
Signed-off-by: Giuseppe Scrivano <gscrivan@redhat.com >
2025-10-31 21:20:07 +01:00
31c511a968
CUDA: Volta tensor core support for MMF ( #16843 )
...
* CUDA: Volta tensor core support for MMF
* more generic checks for hardware support
* Update ggml/src/ggml-cuda/mmf.cuh
Co-authored-by: Aman Gupta <amangupta052@gmail.com >
---------
Co-authored-by: Aman Gupta <amangupta052@gmail.com >
2025-10-31 15:57:19 +01:00
6d39015a74
sync : ggml
2025-10-31 16:26:28 +02:00
75375157fd
Merge commit '8da3c0e200a586f768ada6f38745acb01380174c' into concedo_experimental
...
# Conflicts:
# tests/test-backend-ops.cpp
2025-10-31 21:35:58 +08:00
800b5c3dfa
updated lite
2025-10-31 21:34:21 +08:00
4146d6a1a6
CUDA: add expert reduce kernel ( #16857 )
...
* CUDA: add expert reduce kernel
* contigous checks, better formatting, use std::vector instead of array
* use vector empty instead of size
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
---------
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
2025-10-31 20:05:07 +08:00
8da3c0e200
batch : fix consistency checks for the input positions ( #16890 )
2025-10-31 13:50:33 +02:00
0891b0752d
qwen3vl fixed (+2 squashed commit)
...
Squashed commit:
[89f65ed0c] wip fixing q3vl
[6fa34cff2] wip fixing q3vl
2025-10-31 17:52:33 +08:00
c22473b580
server : don't print user inputs to console ( #16871 )
2025-10-31 10:54:19 +02:00
0f715b4e75
server : fix typos in server.cpp comments [no ci] ( #16883 )
2025-10-31 09:51:26 +01:00
d2d931f173
vulkan: disable spirv-opt for rope shaders ( #16872 )
2025-10-31 08:34:47 +01:00
2976b0374d
vulkan: Fix crash when FP16 mul_mat accumulation is not supported ( #16796 )
...
* Experimenting crash fix
* added assert for aborting and fixed comment
* changed to check if a pipeline is empty or not
* Moved function in class definition
* replaced with is_empty
* Modified is_empty to check only unaligned pipelines
2025-10-31 08:18:59 +01:00
d2a2673dd1
vulkan: fix shmem overrun in mmq id shader ( #16873 )
...
* vulkan: fix shmem overrun in mmq id shader
* metal : fix mul_mm_id
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2025-10-31 08:14:49 +01:00
13002a0896
ggml-hexagon: respect input size when getting/setting tensor data ( #16836 )
...
* respect input size when getting/setting tensor data
allows partial repacking/copying when get tensor size is smaller than the actual tensor
* Removed duplicate repack_mxfp4_mxfp4x4x2 function
2025-10-30 21:46:31 -07:00
adec6eb5d5
occam patch for vulkan: fix shmem overrun in mmq id shader https://github.com/ggml-org/llama.cpp/pull/16873
2025-10-31 10:58:29 +08:00
2b00e55356
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# .github/workflows/docker.yml
# ggml/src/ggml-opencl/kernels/mul_mm_f16_f32_l4_lm.cl
# ggml/src/ggml-opencl/kernels/mul_mm_f32_f32_l4_lm.cl
# ggml/src/ggml-sycl/rope.cpp
# ggml/src/ggml-webgpu/wgsl-shaders/rope.tmpl.wgsl
# requirements/requirements-convert_legacy_llama.txt
# tests/test-backend-ops.cpp
# tests/test-rope.cpp
# tools/server/README.md
2025-10-31 10:52:57 +08:00
6eb208d17e
ci : enable free-disk-space on cuda docker build ( #16877 )
Check Pre-Tokenizer Hashes / pre-tokenizer-hashes (push) Has been cancelled
Python check requirements.txt / check-requirements (push) Has been cancelled
Python Type-Check / pyright type-check (push) Has been cancelled
2025-10-31 00:34:27 +01:00
9984cbb61d
opencl: fix boundary handling for mul_mm ( #16875 )
2025-10-30 16:00:20 -07:00
LostRuins Concedo
henk717
Pascal
Adrien Gallouët
Xuan-Son Nguyen
Aleksander Grygier
Jaromír Hradílek
Sigbjørn Skjæret
Jeff Bolz
Oliver Simons
xzuyn
Piotr Wilkin (ilintar)
Giuseppe Scrivano
Johannes Gäßler
Georgi Gerganov
Aman Gupta
Daniel Bevenius
Masato Nakasaka
Ruben Ortlam
l3utterfly
lhez