84b8856295
Merge commit '32eddaf2ea8dd5d499dee9655592a89b91bfde9d' into concedo_experimental
...
# Conflicts:
# docs/multimodal.md
# docs/preset.md
# ggml/src/ggml-hexagon/ggml-hexagon.cpp
# ggml/src/ggml-hexagon/htp/CMakeLists.txt
# ggml/src/ggml-hexagon/htp/flash-attn-ops.c
# ggml/src/ggml-hexagon/htp/hex-dma.h
# ggml/src/ggml-hexagon/htp/hex-utils.h
# ggml/src/ggml-hexagon/htp/hmx-flash-attn-ops.c
# ggml/src/ggml-hexagon/htp/hmx-matmul-ops.c
# ggml/src/ggml-hexagon/htp/hmx-queue.c
# ggml/src/ggml-hexagon/htp/hmx-queue.h
# ggml/src/ggml-hexagon/htp/htp-ctx.h
# ggml/src/ggml-hexagon/htp/htp-ops.h
# ggml/src/ggml-hexagon/htp/main.c
# ggml/src/ggml-hexagon/htp/matmul-ops.c
# scripts/snapdragon/ggml-hexagon-profile.py
# scripts/ui-assets.cmake
# tools/export-lora/README.md
# tools/server/CMakeLists.txt
2026-06-20 11:18:24 +08:00
2fb3406be7
added ideogram 4 support
2026-06-20 00:29:48 +08:00
9b1e2fa8b8
advanced onready bypass
2026-06-19 21:44:37 +08:00
df08e951d0
response format returns actual mp3 filename if requested
2026-06-19 15:18:53 +08:00
98236505e5
fix build
2026-06-19 15:10:34 +08:00
7780cf7288
suppress some warnings
2026-06-19 10:30:55 +08:00
6f4325ac87
support mp3 from api
2026-06-19 10:26:34 +08:00
32eddaf2ea
cmake : fix ui build with read-only source ( #24752 )
2026-06-18 18:59:18 +02:00
060ce1bf72
mtmd: refactor llava-uhd overview image handling (always use ov_img_first) ( #24769 )
...
* add dedicated "overview" for mtmd_image_preproc_out
* corrections
* correct (again)
* nits
* nits (2)
2026-06-18 18:53:49 +02:00
2bc18617ba
move jinja to the quick tab
2026-06-18 23:52:17 +08:00
d2c67959b3
hexagon: support for op-trace (fine-grain tracing of HVX/HMX/DMA events) ( #24592 )
...
* hex-optrace: add support for optrace and instrument matmul and flash-atten code
* hex-trace: improve trace event and prefetto generator
* hex-trace: add new script dedicated to handling traces, specifically perfetto traces
* hex-trace: add --head/--tail options to profile and trace tools
* hex-trace: fix whitespaces
* hex-trace: fix flake8 warnings
* hex-trace: fix flake8 warnings
* hmx-fa: restore q_tiles clearing
* hex-profile: remove circular dep in includes
* hex-trace: simplify trace sizing check
* hex-profile: sort events in the summary by name
2026-06-18 08:35:02 -07:00
7b6c5a2aed
docs: fix export-lora --lora-scaled syntax [no release] ( #24703 )
...
Assisted-by: Codex
2026-06-18 16:46:17 +02:00
45f49f9bd9
fixed tts mp3 saving
2026-06-18 22:33:30 +08:00
1b36e7f606
option to save tts as mp3, currently slightly bugged
2026-06-18 22:16:29 +08:00
2c64520ba6
failsafe target for macos
2026-06-18 21:46:54 +08:00
fe7c8b2414
server: (router) fix stopping_thread potentially hang ( #24728 )
...
* server: (router) fix stopping_thread potentially hang
* fix windows build
2026-06-18 15:41:09 +02:00
e1efd0991d
server: add "schema" and validation ( #24150 )
...
* wip
* working
* correct some limits
* add field name to error message
2026-06-18 15:40:58 +02:00
635c45e1a0
fix incorrect mtp layers setting (+1 squashed commits)
...
Squashed commits:
[8dad1a5c0] fix incorrect mtp layers setting
2026-06-18 21:10:28 +08:00
6591c33667
Merge branch 'upstream' into concedo_experimental
...
# Conflicts:
# .github/workflows/release.yml
# app/llama.cpp
# common/download.cpp
# docs/backend/SYCL.md
# docs/ops.md
# docs/ops/SYCL.csv
# ggml/CMakeLists.txt
# ggml/src/CMakeLists.txt
# ggml/src/ggml-cpu/CMakeLists.txt
# ggml/src/ggml-sycl/CMakeLists.txt
# ggml/src/ggml-sycl/backend.hpp
# ggml/src/ggml-sycl/common.cpp
# ggml/src/ggml-sycl/common.hpp
# ggml/src/ggml-sycl/convert.cpp
# ggml/src/ggml-sycl/dequantize.hpp
# ggml/src/ggml-sycl/dmmv.cpp
# ggml/src/ggml-sycl/dpct/helper.hpp
# ggml/src/ggml-sycl/ggml-sycl.cpp
# ggml/src/ggml-sycl/mmvq.cpp
# ggml/src/ggml-sycl/outprod.cpp
# ggml/src/ggml-sycl/vecdotq.hpp
# tools/server/README.md
2026-06-18 21:00:52 +08:00
08023072ef
server : add last-5-seconds generation speed display ( #24291 )
...
* server : add last-5-seconds generation speed display
* cont : clean-up
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com >
2026-06-18 14:02:20 +02:00
20832179e2
ui: provide touch accessible model selection UI ( #24604 )
...
* ui : add model selector storybook stories
Covers list, favorites, single-model, all status states
(loading/loaded/sleeping/failed/idle), and selection states.
* ui : improve model selector mobile UX with hover media queries
Use @media (hover:none) to show action buttons directly on touch
devices and color-code them by model status (amber=sleeping,
green=loaded, muted=idle). Status dots hidden on touch. Desktop
hover behavior unchanged.
2026-06-18 13:14:20 +02:00
10786217e9
server : return HTTP 400 on invalid grammar ( #24144 ) ( #24154 )
...
Throw on grammar parse failure so the server returns HTTP 400
instead of silently dropping the constraint.
Add a regression test for the invalid-grammar response.
Fixes #24144
2026-06-18 12:49:14 +02:00
552258c535
server: (router) rework -hf preset repo ( #24739 )
...
* server: temporary remove HF remote preset
* rework remove preset.ini support
* rm unused get_remote_preset_whitelist()
* print warning
* add docs
* rm stray file
2026-06-18 12:45:23 +02:00
968c43891a
server: fix router args not being forwarded to child instances ( #24760 )
2026-06-18 12:15:46 +02:00
24bba7b98e
mtmd: refactor preprocessor, add mtmd_image_preproc_out ( #24736 )
...
* add mtmd_image_preproc_out
* add dev docs
* remove unused clip API
* rm unused clip_image_f32_batch::grid
* change preprocess() call signature
2026-06-18 12:04:39 +02:00
9724f664e8
[SYCL] rename GGML_SYCL_SUPPORT_LEVEL_ZERO ( #24719 )
...
* rename GGML_SYCL_SUPPORT_LEVEL_ZERO to GGML_SYCL_SUPPORT_LEVEL_ZERO_API, and GGML_SYCL_ENABLE_LEVEL_ZERO to GGML_SYCL_USE_LEVEL_ZERO_API
* fix code format
* fix error when rebase
2026-06-18 11:18:26 +03:00
dd69db2924
sycl : support MUL_MAT and OUT_PROD with Q1_0 ( #24721 )
2026-06-18 11:17:37 +03:00
6ec59ddaea
app : enable self-update only when built with llama-install.sh ( #24754 )
...
Signed-off-by: Adrien Gallouët <angt@huggingface.co >
2026-06-18 09:57:59 +02:00
32e806b9c1
ci : fix check-release message parsing ( #24751 )
2026-06-18 09:32:56 +02:00
6f1034b32a
[SYCL] support OPs: conv_2d, conv_2d_dw, conv2d_transpose ( #24600 )
...
* fix conflict
* fix format issue, rename
* rm debug code
* correct the file name
2026-06-18 09:40:03 +03:00
0b73fc79fe
ui: Update code formatting command in pre-commit hook ( #24685 )
2026-06-18 08:33:50 +02:00
4a79037b8b
ci : fix Windows x64 (OpenVINO) release link ( #24731 )
2026-06-18 08:30:08 +02:00
cae0a3b0b0
metal : check for BF16 support in concat kernel ( #24747 )
2026-06-18 09:16:06 +03:00
f3e1828164
mtmd: llava_uhd should no longer use batch dim ( #24732 )
2026-06-17 22:40:50 +02:00
2e88c49c90
ggml-cpu: Conditionally enable power11 backend based on compiler support ( #24687 )
...
* ggml: Conditionally enable power11 backend based on compiler support
Guard POWER11 backend creation behind a compiler flag check for -mcpu=power11. This avoids build failures on current GCC/Clang toolchains while preserving forward compatibility once POWER11 support becomes available.
* Update CMakeLists.txt
ggml-cpu: Use -mcpu=power10 for P10 and P11
2026-06-18 02:45:19 +08:00
0843245cb1
metal : implement rope_back operator ( #24725 )
...
Reuse existing rope kernels with a function constant to toggle forward/backward
rotation, avoiding duplicate kernel code.
Assisted-by: pi:llama.cpp/Qwen3.6-27B
2026-06-17 20:36:05 +03:00
8d2e580632
metal : add f16 and bf16 support for concat operator ( #24724 )
...
* metal : add f16 and bf16 support for concat operator
Extend the Metal backend concat operator to support f16 and bf16 tensor
types in addition to the existing f32 and i32 support.
- Template kernel_concat on type T with specializations for float, half,
bfloat, and int
- Add type-specific pipeline getter ggml_metal_library_get_pipeline_concat()
- Update device support check to allow f16 unconditionally and bf16 when
device supports bfloat16
- Update dispatch to select the correct kernel specialization by type
Assisted-by: pi:llama.cpp/Qwen3.6-27B
* metal : extend concat operator to support f16, bf16, i8, i16 and i64
Assisted-by: pi:llama.cpp/Qwen3.6-27B
2026-06-17 19:38:55 +03:00
e3c9601d37
updated sdui
2026-06-18 00:15:39 +08:00
4b4d13ae72
server: (router) add model management API ( #23976 )
...
* wip
* server: (router) add SSE realtime updates API
* nits
* wip
* add download API
* add download api
* update docs
* add delete endpoint
* fix std::terminate
* fix crash
* fix 2
* add tests
* nits
2026-06-17 18:04:58 +02:00
11cd91658b
minor linting
2026-06-17 23:53:06 +08:00
eb05dd5fab
support audio to video for ltx 2.3
2026-06-17 23:50:08 +08:00
b4024af6c2
llama : skip main_gpu validation when no devices are available ( #23405 )
2026-06-17 17:30:26 +03:00
1a2dea29b9
spec: fix segfault error on long prompts for eagle3 ( #24707 )
2026-06-17 17:29:49 +03:00
74a80dd9c0
[SYCL] add dev2dev memcpy by SYCL API ( #24476 )
...
* add dev2dev memcpy by SYCL API
* mv GGML_SYCL_DEV2DEV_MEMCPY to runntime table
* update the detect method for p2p comm
* fix the erro created during fix confilct
---------
Co-authored-by: Neo Zhang <NA>
2026-06-17 17:21:34 +03:00
d1759e4156
[SYCL] Add conv_3d ( #24691 )
...
* add conv_3d
* optimize
* update ops.md
* restore test script
* rm unused code
* rm copyright notes
2026-06-17 17:20:01 +03:00
8086439a4c
webui: export conversations as jsonl ( #24688 )
...
* webui: export conversations as jsonl
each session is one jsonl file, a session header line followed by one line per message
exporting multiple conversations bundles them into a zip, one jsonl file each
* webui: import jsonl and zip conversation exports
parse the new jsonl session format and zip archives on import
keep supporting the legacy json format
2026-06-17 13:25:47 +02:00
558e221b70
vulkan: record actual memory properties during buffer creation ( #24326 )
2026-06-17 11:14:48 +02:00
ea21e03955
Revert "cuda: reset cuda context after reading memory size ( #23935 )" ( #24715 )
...
This reverts commit 0f7fada56b
2026-06-17 10:59:35 +02:00
1e81db2426
updated cmake
2026-06-17 16:35:58 +08:00
097cc91424
sd: sync with master-707-5a34bc7 ( #2274 )
...
* sd: sync with master-692-9b0fceb
* sd: sync with master-694-276025e
* sd: sync with master-697-5db680c
* sd: sync to master-700-c2df4e1
* sd: sync with master-704-6e66a1a
* sd: sync with master-707-5a34bc7
2026-06-17 16:31:16 +08:00
Concedo
o7si
Xuan-Son Nguyen
Max Krasnyansky
Kangjia Gao
Aarni Koskela
Amos Wong
Anuj Attri
Neo Zhang
Adrien Gallouët
Sigbjørn Skjæret
Aleksander Grygier
Ravi Panchumarthy
Georgi Gerganov
shalinib-ibm
Dev-iL
Ruixiang Wang
Julien Chaumond
Winston Ma
Ruben Ortlam
Wagner Bruna