Aman Gupta 3e12fbdea5 llama: avoid copying logits during prompt decode in MTP (#23198) ...

* llama: avoid copying logits during prompt decode in MTP

* review: update comment

* llama-graph: call set_output for t_h_pre_norm

2026-05-17 23:30:25 +08:00

..

batched-bench

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

cli

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

completion

llama + spec: MTP Support (#22673)

2026-05-16 20:06:23 +08:00

cvector-generator

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

export-lora

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

fit-params

fit-params : refactor + add option to output estimated memory per device (#22171)

2026-04-21 09:54:36 +03:00

gguf-split

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

imatrix

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

llama-bench

spec : refactor params (#22397)

2026-04-28 09:07:33 +03:00

mtmd

mtmd: add chunks and fix preproc for qwen3a (#23073)

2026-05-15 19:32:47 +02:00

parser

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

perplexity

fit-params : refactor + add option to output estimated memory per device (#22171)

2026-04-21 09:54:36 +03:00

quantize

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

results

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

rpc

fix: rpc-server cache may not work in Windows environments (#22394)

2026-04-27 17:25:09 +03:00

server

llama: avoid copying logits during prompt decode in MTP (#23198)

2026-05-17 23:30:25 +08:00

tokenize

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

tts

logs : reduce (#23021)

2026-05-14 13:05:52 +03:00

ui

webui: support video files as input (#22830)

2026-05-17 02:13:44 +02:00

CMakeLists.txt

ui: Restructure repo to use tools/ui folder and ui / UI / llama-ui / LLAMA_UI naming (#23064)

2026-05-16 02:02:40 +02:00