Files
automatic/modules/api
CalamitousFelicitousness f431141d2f feat(api): add LLM generation parameters to VQA endpoint
Add optional LLM generation parameters to the VQA API request model,
allowing per-request override of settings:

- max_tokens, temperature, top_k, top_p, num_beams, do_sample
- thinking_mode, prefill, keep_thinking, keep_prefill

Changes:
- Add 10 new optional fields to ReqVQA model with descriptive docs
- Update get_kwargs() to support per-request overrides via singleton
- Add helper functions get_keep_thinking(), get_keep_prefill()
- Update post_vqa endpoint to pass generation kwargs
- Add _generation_overrides instance variable to VQA class
2026-02-11 02:47:40 +00:00
..
2025-10-07 08:21:05 -04:00
2025-10-26 18:55:54 -04:00
2025-08-12 08:49:38 -04:00
2025-11-14 15:47:13 -05:00
2025-12-22 09:17:15 +01:00
2025-08-10 09:19:49 -04:00
2025-07-03 09:18:38 -04:00
2026-01-13 02:08:11 -08:00
2025-10-27 02:14:41 +03:00