Piotr Wilkin (ilintar) d4abd573f6 CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (#28552) ...

Recreated from #24546

---------

Co-authored-by: Carl Philipp Klemm <carl@uvos.xyz>

* CUDA: pick MMQ tile size against ncols_opt set on the host side

Assisted-by: Claude Fable 5.1
Claude-Session: https://claude.ai/code/session_011SYPfRhKoUpU3gMsGxq6go

---------

Co-authored-by: ravel7524 <58877666+ravel7524@users.noreply.github.com>
Co-authored-by: Carl Philipp Klemm <carl@uvos.xyz>

2026-09-09 13:25:54 +02:00

..

ggml-blas

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

2026-08-11 09:20:46 +03:00

ggml-cann

ggml: add SWIGLU_CLAMP (#27930)

2026-08-30 23:00:02 +08:00

ggml-cpu

ggml : fix msvc+clang ggml_vld1q_u32 (#28284)

2026-09-08 17:40:26 +03:00

ggml-cuda

CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (#28552)

2026-09-09 13:25:54 +02:00

ggml-et

ggml: add SWIGLU_CLAMP (#27930)

2026-08-30 23:00:02 +08:00

ggml-hexagon

hexagon: add RELU and LEAKY_RELU ops (#28585)

2026-09-07 17:04:25 -07:00

ggml-hip

CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (#28079)

2026-09-09 12:50:08 +02:00

ggml-metal

metal : fix idle threads in mul_mv_iq3_xxs for ne00 < 1024 (#28086)

2026-09-08 15:54:42 +03:00

ggml-musa

CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (#28079)

2026-09-09 12:50:08 +02:00

ggml-opencl

opencl: properly handle non-contiguous inputs to conv2d (#28503)

2026-09-08 09:26:34 +03:00

ggml-openvino

vulkan: support type-aligned GET_ROWS (#28253)

2026-09-07 12:22:10 +02:00

ggml-rpc

sync : ggml (#28379)

2026-09-04 14:39:19 +03:00

ggml-sycl

Add IQ type handling for MoE (#28476)

2026-09-09 09:25:41 +08:00

ggml-virtgpu

ggml: allow passing alloc dependencies in graph_optimize (#27301)

2026-08-30 11:34:20 +08:00

ggml-vulkan

vulkan: add dedicated iq4_xs mat-vec shader (#28426)

2026-09-09 09:26:36 +03:00

ggml-webgpu

webgpu: format the GET_ROWS case block (#28542)

2026-09-07 15:55:14 +02:00

ggml-zdnn

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

2026-08-11 09:20:46 +03:00

ggml-zendnn

CI: Use LLVM's OpenMP over MSVC_DEBUG_non_redist on Windows (#26678)

2026-08-20 15:42:26 +02:00

CMakeLists.txt

ggml : replace compile definitions with version.h.in (#28364)

2026-09-04 10:28:23 +02:00

ggml-alloc.c

ggml : fix ggml_clamp (#27644)

2026-08-24 10:43:04 +03:00

ggml-backend-dl.cpp

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)

2026-01-29 12:33:21 -08:00

ggml-backend-dl.h

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)

2026-01-29 12:33:21 -08:00

ggml-backend-impl.h

sync : ggml (#28379)

2026-09-04 14:39:19 +03:00

ggml-backend-meta.cpp

ggml-meta: propagate buffer usage and call init on the new tensors (#27586)

2026-08-26 08:27:51 +03:00

ggml-backend-reg.cpp

ggml : don't crash when backend search path can't be read (#28271)

2026-09-04 10:24:06 +03:00

ggml-backend.cpp

ggml: allow backend inputs to not create another split (#28387)

2026-09-07 09:10:40 +03:00

ggml-common.h

AVX2: Speed up large batch size prompt processing of IQ models (#27402)

2026-08-31 14:33:50 -04:00

ggml-feats.h

ggml : fix arm builds, unused var (#26991)

2026-08-13 07:57:24 +03:00

ggml-impl.h

ggml : update ggml_prec specification (#26675)

2026-09-08 09:06:24 +03:00

ggml-opt.cpp

fix: free ctx_copy in ggml_opt_free to plug per-training-session leak (#21592)

2026-04-08 17:40:15 +02:00

ggml-quants.c

Add Q2_0 quantization: type definition and CPU backend (#24448)

2026-07-07 12:05:47 -07:00

ggml-quants.h

Add Q2_0 quantization: type definition and CPU backend (#24448)

2026-07-07 12:05:47 -07:00

ggml-threading.cpp

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

2024-12-12 19:02:49 +01:00

ggml-version.h.in

ggml : replace compile definitions with version.h.in (#28364)

2026-09-04 10:28:23 +02:00

ggml.c

ggml : update ggml_prec specification (#26675)

2026-09-08 09:06:24 +03:00

ggml.cpp

ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)

2025-06-01 13:43:57 +03:00

gguf.cpp

llama : add missing headers (#28566)

2026-09-08 12:59:53 +02:00