Public/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-20 01:31:31 +02:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • ee3d1b54c1 server: abstract llama_memory calls to common_memory (#26221) b10167 Xuan-Son Nguyen 2026-07-28 16:35:20 +02:00
  • da5b448622 ggml : set output of view src (#25729) b10166 Aman Gupta 2026-07-28 21:23:24 +08:00
  • 8161641005 vulkan: add iq4_nl support back to FA (#24585) b10165 Jeff Bolz 2026-07-28 13:06:03 +01:00
  • b62b350981 ggml-cuda: add chunked SSD matmul for Mamba-2 prefill acceleration (#22675) b10164 Bhavik Sharda 2026-07-28 17:33:42 +05:30
  • 84075273c8 spec: add DSpark speculative decoding (#25173) 王金旭 2026-07-28 19:43:27 +08:00
  • f45ca59f0f server: abstract llama_memory calls to common_memory xsn/common_memory Xuan Son Nguyen 2026-07-28 11:36:16 +02:00
  • 6ba5ef2470 common/chat: add specialized minimax m3 parser (#26210) Aldehir Rojas 2026-07-28 04:27:20 -05:00
  • d6b61ac0d3 sycl: fix use-after-return of the SDPA scale in the oneDNN flash-attention path (#25880) meatposes 2026-07-28 03:37:25 -05:00
  • 9a3bf2b849 server : add extra trace log for prompt similarity (#26218) Georgi Gerganov 2026-07-28 11:05:16 +03:00
  • f95de9776b ggml-metal: FWHT kernel for metal backend (#25924) b10159 Nick Lafleur 2026-07-28 03:44:06 -04:00
  • f87067841b spec: add eagle3-v3 support for gpt-oss model (#25794) b10158 Ruixiang Wang 2026-07-28 08:58:16 +02:00
  • c6292cfb8e contrib : add guideline about the "merge ready" label (#26178) Georgi Gerganov 2026-07-28 08:41:04 +03:00
  • 91f8c9c5fb Disable -ffast-math on HIP (#25495) b10156 Beinsezii 2026-07-27 16:13:48 -07:00
  • 1cbfd19883 mtmd: support MiMo-V2.5 audio input (RVQ-based model) (#26190) b10155 Xuan-Son Nguyen 2026-07-27 23:17:09 +02:00
  • be4c137590 nits 2 xsn/mimo_audio Xuan Son Nguyen 2026-07-27 21:35:03 +02:00
  • 3a70b88994 nits Xuan Son Nguyen 2026-07-27 21:28:10 +02:00
  • feafe185c8 cpp impl Xuan Son Nguyen 2026-07-27 21:10:09 +02:00
  • c962345f0f fix conv Xuan Son Nguyen 2026-07-27 21:09:13 +02:00
  • b668302604 gguf converter for mimo audio Xuan Son Nguyen 2026-07-27 20:04:55 +02:00
  • 0e4a036223 common : add common_print_available_devices() (#26170) b10154 Adrien Gallouët 2026-07-27 18:19:59 +02:00
  • b77d646751 model: Add support for Nanbeige4.2 (#25994) b10153 zql 2026-07-27 23:04:18 +08:00
  • 0324696b8e fit : count nextn (MTP) blocks in n_gpu_layers so front layers stay on GPU (#26177) b10152 Jonas Jankaitis 2026-07-27 16:21:37 +03:00
  • 8e8681e0e2 sycl(build): parallelize ocloc invocations (#25903) b10151 Titaniumtown 2026-07-27 05:33:11 -07:00
  • dee2a846b8 ggml : adjust logic for offloading ops to weight's backend (#25832) b10150 Georgi Gerganov 2026-07-27 14:54:46 +03:00
  • 7ef790f90a tests : remove unnecessary sync in test-save-load-state (#26166) b10149 Georgi Gerganov 2026-07-27 13:11:20 +03:00
  • ddfc2288e4 common: fix explicit -md precedence over draft sidecar resolution (#26165) b10148 Pascal 2026-07-27 12:10:59 +02:00
  • 419b881c02 docs: add exception about weight folding (#26168) Xuan-Son Nguyen 2026-07-27 12:00:56 +02:00
  • 7ecdaafc35 add example xsn/docs_weight_fold Xuan Son Nguyen 2026-07-27 11:45:54 +02:00
  • 02819342c4 docs: add exception about weight folding Xuan Son Nguyen 2026-07-27 11:40:05 +02:00
  • b910200897 ggml-cpu: Enable BF16 tiled gemm optimization on PowerPC (#26068) b10146 shalinib-ibm 2026-07-27 14:22:03 +05:30
  • ad256ded30 args: add -lm mlock where it mlocks but doesnt mmap (#26135) b10145 Aaron Teo 2026-07-27 16:44:08 +08:00
  • d73c1d6b22 server + ui: fix stream routes for model names containing a slash (#26137) b10144 Pascal 2026-07-27 07:34:47 +02:00
  • 88b47a755c ui: Fix symbolic math tool JS sandbox prompt (#26131) b10143 rankaiyx 2026-07-27 08:30:22 +08:00
  • 3d1c3a8975 mtmd: Add Vision Support for Minimax-M3 (#25113) b10142 timkhronos 2026-07-27 01:44:41 +02:00
  • 6b0b1ea112 mtmd: support multi-row batching for deepseek-ocr Xuan Son Nguyen 2026-07-27 01:34:10 +02:00
  • 987e91cae2 fix lint xsn/skill_ggml_test Xuan Son Nguyen 2026-07-27 01:06:31 +02:00
  • d29e61d45a skills: add ggml-test skill Xuan Son Nguyen 2026-07-27 00:58:39 +02:00
  • 0d47ea7427 mtmd: fix android build (#26150) b10141 Xuan-Son Nguyen 2026-07-27 00:22:02 +02:00
  • 3c5a50cc50 mtmd: fix android build xsn/fix_android_build Xuan Son Nguyen 2026-07-27 00:18:15 +02:00
  • d4d057b6dd ui: fix system message edit box not expanding to fit content (#26006) Piero Evangelista 2026-07-26 18:03:06 -04:00
  • 7657a6c26a Keep Minimax's indexer tensors at F32 for speed and accuracy (#26144) Bartowski 2026-07-26 18:02:56 -04:00
  • 55b7d6c4c7 ui: detect the conversation import format from file contents (#26121) Pascal 2026-07-26 23:32:58 +02:00
  • d2a818231e common: add subproc.h wrapper, disabled on android/ios (#26102) Xuan-Son Nguyen 2026-07-26 20:54:25 +02:00
  • af285020e9 mtmd: add GLM-5.2-Vision (#26126) Eric Hartford 2026-07-26 14:43:51 -04:00
  • b1d4c65524 model: Add MiniMax-M3 (MSA: MiniMax Sparse Attention) support (#24908) timkhronos 2026-07-26 19:43:45 +02:00
  • 42fc243060 opencl: fix fused RMS norm mul view offset (#26085) yzyyzyhhh 2026-07-26 23:01:08 +08:00
  • ff067f76dd ui: fix context gauge card regressions and land at the conversation end (#26099) b10133 Pascal 2026-07-26 06:51:10 +02:00
  • 7cdd557f76 ggml-webgpu: Fix WASM compilation with OpenMP (#25943) Reese Levine 2026-07-25 17:37:18 -07:00
  • 474aef9770 migrate server-mcp xsn/common_subproc Xuan Son Nguyen 2026-07-26 01:11:28 +02:00
  • 8bb909374d common : use-after-free when loading LoRA adapter fails (#25611) Nicky Mouha 2026-07-25 19:10:32 -04:00
  • a3d10e33f9 Merge branch 'master' into xsn/common_subproc Xuan Son Nguyen 2026-07-26 01:09:25 +02:00
  • 20455a4ad3 server: support MCP stdio (#26062) Xuan-Son Nguyen 2026-07-26 01:08:49 +02:00
  • 355303edab hexagon: partial im2col support (#26007) Todor Boinovski 2026-07-25 15:47:29 -07:00
  • c812c543f8 common : skip empty implicit default preset (#25643) hogeheer499-commits 2026-07-25 21:15:27 +02:00
  • abc348790e server: add format arg to datetime tool (#26117) Xuan-Son Nguyen 2026-07-25 21:15:15 +02:00
  • 2cfc7670ed server : add missing task parameters(adaptive_target, adaptive_decay) in generation_settings (#25830) Tekin Ertekin 2026-07-25 21:53:08 +03:00
  • d8efdcbdb8 server: add format arg to datetime tool xsn/tool_datetime_format Xuan Son Nguyen 2026-07-25 18:23:28 +02:00
  • 720d7fa409 vendor : update cpp-httplib to 0.51.0 (#26067) Adrien Gallouët 2026-07-25 18:16:29 +02:00
  • 33f3ec1b67 server: make MCP test fixtures JSON-RPC 2.0 compliant xsn/server_mcp_stdio Pascal 2026-07-25 17:40:53 +02:00
  • 08a384bd77 server: fix MCP zombie leak and timeout-induced transport teardown Pascal 2026-07-25 17:28:59 +02:00
  • fb92d8f187 Update ggml/src/gguf.cpp : Defined virtual keyword for destructor of gguf_writer_base (#25867) Yongmin Yoo 유용민 2026-07-25 21:32:37 +09:00
  • 910196f6b3 common : add support for multiple end sequences in the reasoning budget sampler (#25544) Aldehir Rojas 2026-07-25 04:58:09 -05:00
  • a99b462daa fix response schema + docs Xuan Son Nguyen 2026-07-25 11:28:30 +02:00
  • 07d65d6227 fix last_error data race Xuan Son Nguyen 2026-07-25 11:25:49 +02:00
  • d67c0b4107 tests: synchronize save-load-state generation (#26056) helanfxz 2026-07-25 16:23:31 +08:00
  • 20cc96ff43 make is_created atomic Xuan Son Nguyen 2026-07-25 02:13:07 +02:00
  • a1de37181e disable subproc on wasm Xuan Son Nguyen 2026-07-25 02:05:18 +02:00
  • 600bb60808 mtmd: disable video if subproc is not set Xuan Son Nguyen 2026-07-25 02:05:12 +02:00
  • e6d477bcae test-jinja: use common subproc Xuan Son Nguyen 2026-07-25 02:04:56 +02:00
  • c063f10698 disabled by default on android and ios Xuan Son Nguyen 2026-07-25 01:35:56 +02:00
  • 062bd334a8 add compile flag LLAMA_SUBPROCESS Xuan Son Nguyen 2026-07-25 01:34:13 +02:00
  • 8e000ac754 add common/subproc.h|cpp Xuan Son Nguyen 2026-07-25 01:22:54 +02:00
  • 555881ebc8 ui: reduce per-token render cost when streaming (#26053) b10121 Zach Winter 2026-07-24 16:09:46 -04:00
  • 96013c5112 ui: remove render effects (#26083) Pascal 2026-07-24 21:43:23 +02:00
  • 6dfc0857fc fix some edge cases Xuan Son Nguyen 2026-07-24 21:30:23 +02:00
  • a669ac5a55 Merge branch 'master' into xsn/server_mcp_stdio Xuan Son Nguyen 2026-07-24 21:19:36 +02:00
  • 49d0ad7b98 internal/mcp-stdio: integration + tests + fixes (#26075) Piotr Wilkin (ilintar) 2026-07-24 21:19:09 +02:00
  • 88bfee1429 model: add GLM 5.2 Indexer support (#25407) Pedro Cuenca 2026-07-24 20:55:56 +02:00
  • 95a923a64c ui: fix MCP server display name conflicts in tools lists (#26011) Pascal 2026-07-24 19:28:14 +02:00
  • 27209a598d server: support "reasoning_effort": "none" in OAI API (#26045) Nigel Bosch 2026-07-24 12:19:10 -05:00
  • 298219f985 llama: various bug fixes (#26051) Xuan-Son Nguyen 2026-07-24 18:56:42 +02:00
  • fa72aeccb2 HIP: remove rocWMMA FlashAttention (#26046) Johannes Gäßler 2026-07-24 17:53:54 +02:00
  • ed7adbfefd opencl: cache compiled cl_program binaries on disk (#26050) Hongqiang Wang 2026-07-24 08:14:33 -07:00
  • 56a83860dd opencl: do not treat NULL-mask flash attention as causal (#25771) kumaal 2026-07-24 20:12:01 +05:00
  • 77095ee0cb skill: create add-new-model and code-review (#26042) Xuan-Son Nguyen 2026-07-24 17:04:17 +02:00
  • 54ce507b6f UI: Fix settings precedence, Factory < Admin (--ui-config-file) < Users (Settings panel) (#26002) Pascal 2026-07-24 15:09:55 +02:00
  • 8f5ab832ca cohere2 moe template parser: enforce JSON schema for text responses if a response schema is provided (#26018) Matt Thompson 2026-07-24 03:54:47 -07:00
  • 0cea36222f vendor: update subprocess.h (#26061) Xuan-Son Nguyen 2026-07-24 08:02:23 +02:00
  • fd88e926f6 server_mcp_stdio is now framing-only, no json Xuan Son Nguyen 2026-07-24 07:41:38 +02:00
  • fcf91702b2 server_mcp_transport Xuan Son Nguyen 2026-07-24 07:38:40 +02:00
  • 2beaeaa216 stderr drain Xuan Son Nguyen 2026-07-24 07:29:57 +02:00
  • 84f13f901c vendor: update subprocess.h xsn/bump_subproc Xuan Son Nguyen 2026-07-24 07:21:04 +02:00
  • bbf240a113 add server_mcp_stdio Xuan Son Nguyen 2026-07-24 07:21:54 +02:00
  • 7804b57f3e vendor: update subprocess.h Xuan Son Nguyen 2026-07-24 07:21:04 +02:00
  • 40908874f1 init impl Xuan Son Nguyen 2026-07-24 06:56:53 +02:00
  • f5addb42f6 move server_pipe to common Xuan Son Nguyen 2026-07-24 06:18:03 +02:00
  • 0a50d9909a hexagon: further improved pipeline of the core bits (L2, DMA, MM, FA) (#26049) b10108 Max Krasnyansky 2026-07-23 19:13:03 -07:00
  • c867e1c38c llama: various bug fixes xsn/ub_fix_2 Xuan Son Nguyen 2026-07-23 21:03:06 +02:00
  • b60794b60f nits xsn/skill_add_models Xuan Son Nguyen 2026-07-23 18:51:19 +02:00
  • b1f66cb3b8 conversion-time weight modification Xuan Son Nguyen 2026-07-23 18:50:53 +02:00