llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-08-28 16:11:21 +02:00

Files

T

Kyozzz 1729ed5371 server : reject prefilled assistant messages with tool calls (#27626 )

* server: fix tool calls getting silently stripped with --prefill-assistant

Last assistant carries tool_calls + --prefill-assistant is on → request
flips into continuation mode, add_generation_prompt forced off, tail
rebuilt from reasoning_content + content only. Tool calls just vanish.

- Auto-continuation now skips trailing assistant msgs that have tool calls
- continue_final_message on those throws a clear error instead of
  silently corrupting the prompt
- Regression tests included, red before / green after

Fixes #27588

Developed with AI assistance, disclosed per the contribution policy.

* server : address review: fail on prefill-assistant + trailing tool_calls

Move validation into oaicompat_chat_params_parse (next to the existing
two-or-more-assistant check) and remove it from common_chat_templates_apply,
which has no precedent for validation. Drop the regression tests.

Per review: --prefill-assistant with a trailing assistant message
containing tool calls is not supported and should fail loudly.

2026-08-25 09:35:22 -05:00

batched-bench

cmake : add install() for impl libraries + fix apple builds (#23511 )

2026-05-22 11:46:26 +03:00

cli

common: add json.h abstraction (#27511 )

2026-08-22 16:28:28 +02:00

completion

common: migrate the deprecated --mmap/--no-mmap to --load-mode (#26934 )

2026-08-15 16:35:53 +08:00

cvector-generator

cmake : introduce semantic versioning (#26839 )