CalamitousFelicitousness b57b8c6a64 perf(attention): capture backend options once per chain ...

The sdnq backend read six settings on every call; it now captures them
when the chain is built. Each backend declares the settings its call
captures, and webui registers one onchange over those names plus the
override set and the torch kernel flags, so a change rebuilds the chain
between jobs. When a compiled model is resident the rebuild also resets
dynamo, since its graphs hold the previous router.

2026-08-23 08:21:28 +01:00

..

backends

perf(attention): capture backend options once per chain

2026-08-23 08:21:28 +01:00

__init__.py

perf(attention): capture backend options once per chain

2026-08-23 08:21:28 +01:00

context.py

feat(attention): generation context

2026-08-23 08:20:46 +01:00

debug.py

feat(attention): route tracing and chain telemetry

2026-08-23 08:20:46 +01:00

dispatcher.py

fix(processing): re-apply attention when the overrides change

2026-08-23 08:20:46 +01:00

registry.py

perf(attention): capture backend options once per chain

2026-08-23 08:21:28 +01:00

router.py

perf(attention): capture backend options once per chain

2026-08-23 08:21:28 +01:00