Xuan-Son Nguyen a04c2b06a3 server: improve slots scheduling for n_cmpl (#18789) ...

* server : make sure children tasks are scheduled to launch with parent

* fix

* add comment pointing to this PR

* fix

* clean up

* more debug messages

* add pop_deferred_task with specific ID version

* improve the logic

* simple approach

* no double move

* correct return type of launch_slots_with_parent_task

2026-01-15 17:10:28 +01:00

..

test_basic.py

server: add router multi-model tests (#17704) (#17722)

2025-12-03 15:10:37 +01:00

test_chat_completion.py

server: improve slots scheduling for n_cmpl (#18789)

2026-01-15 17:10:28 +01:00

test_compat_anthropic.py

server : add thinking content blocks to Anthropic Messages API (#18551)

2026-01-06 16:17:13 +01:00

test_completion.py

server : adjust unified KV cache tests (#18716)

2026-01-10 17:51:56 +02:00

test_ctx_shift.py

memory : remove KV cache size padding (#16812)

2025-10-28 20:19:44 +02:00

test_embedding.py

server : disable context shift by default (#15416)

2025-08-19 16:46:37 +03:00

test_infill.py

server : support unified cache across slots (#16736)

2025-11-02 18:14:04 +02:00

test_lora.py

server : disable context shift by default (#15416)

2025-08-19 16:46:37 +03:00

test_rerank.py

server / ranking : add sorting and management of top_n (#16403)

2025-10-11 16:39:04 +03:00

test_router.py

server: add router multi-model tests (#17704) (#17722)

2025-12-03 15:10:37 +01:00

test_security.py

server: add --media-path for local media files (#17697)

2025-12-02 22:49:20 +01:00

test_sleep.py

server: add auto-sleep after N seconds of idle (#18228)

2025-12-21 02:24:42 +01:00

test_slot_save.py

server : disable context shift by default (#15416)

2025-08-19 16:46:37 +03:00

test_speculative.py

kv-cache : pad the cache size to 256 for performance (#17046)

2025-11-07 20:03:25 +02:00

test_template.py

server : speed up tests (#15836)

2025-09-06 14:45:24 +02:00

test_tokenize.py

server : disable context shift by default (#15416)

2025-08-19 16:46:37 +03:00

test_tool_call.py

server : speed up tests (#15836)

2025-09-06 14:45:24 +02:00

test_vision_api.py

server : speed up tests (#15836)

2025-09-06 14:45:24 +02:00