1946892b7f
improve memory reporting, explicit interpolation and minimax tracking
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2026-08-25 09:11:46 +02:00
d38f2c97b2
feat(monitor): report model placement in the memory monitor
...
Move the per-component placement walk from the api server into memstats
next to ram and gpu stats, and add it to the --monitor tick so offload
placement is visible in a log rather than only over the api.
- guard the walk internally: the supervisor loop logs its monitor line
unguarded, and the walk can race a reload or an offload rewrap
- monitor reports gb and merges into a fresh dict, since memory_stats
returns a module global that the per-generation log also prints
- endpoint keeps reporting raw bytes
2026-08-10 22:10:42 +01:00
023c829179
fix model/vae: wrong quant_config var, getattr guards, remote-vae latent_copy shadowing + response handling
...
Co-Authored-By: Claude <noreply@anthropic.com >
2026-06-12 13:00:39 -04:00
d1a40b3ba7
openvino device selecrtion
...
Signed-off-by: vladmandic <mandic00@live.com >
2026-04-12 19:07:20 +02:00
a54e9b3311
update readme and some debug functions
...
Signed-off-by: vladmandic <mandic00@live.com >
2026-03-21 09:08:53 +01:00
e5c494f999
cleanup logger
2026-02-19 11:09:13 +01:00
a3074baf8b
unified logger
2026-02-19 09:46:42 +01:00
bfe014f5da
modernize typing
2026-02-19 09:15:37 +01:00
d0ac508a59
lint
...
Signed-off-by: vladmandic <mandic00@live.com >
2025-11-17 20:12:47 -05:00
8c2b76a8da
add buffers and cache info
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-09-30 14:36:55 -04:00
201ca28300
improve ram monitor
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-09-30 14:27:43 -04:00
32906a20ee
update docker build
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-15 07:57:08 -04:00
2a85c05689
refactor pipeline loaders to generic methods and introduce te_shared_t5 option
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-11 16:05:39 -04:00
3e0fee01f9
cleanup
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-10 11:06:37 -04:00
41640773e5
fix global state tracking
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-08-10 09:19:49 -04:00
c07e5d74ab
control auto-determine save path
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-07-29 09:07:36 -04:00
a5b77b8ee2
remove dead code
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-07-05 16:47:25 -04:00
59bdec09dc
refactor ui server restart
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-04-28 09:44:51 -04:00
dc9a64d00b
memmon detect gpu swapping
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-04-07 08:59:54 -04:00
d3633be484
add job info to monitor stats
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-04-01 14:19:40 -04:00
17fbadb0e8
reset memory stats between runs
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-04-01 14:00:39 -04:00
6430f7006f
add monitor cli option and finish lora refactor
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-04-01 13:39:47 -04:00
c82d5a8a8a
Fix get_runpod_limit
2025-03-14 19:44:00 +03:00
75c1dcb892
Update changelog
2025-03-14 17:57:14 +03:00
851fb9d307
Fix runpod limit
2025-03-14 17:48:44 +03:00
dabd89a8b3
Fix memstats
2025-03-12 22:02:19 +03:00
79416af994
parse cgroups
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-01-27 10:00:06 -05:00
843011406f
obj trace
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2025-01-25 11:41:34 -05:00
f4847f1b8a
optimize balanced offload
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2024-12-10 15:49:20 -05:00
2a1fbd904f
handle os err
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2024-12-06 07:36:20 -05:00
023b13b6cb
balanced offload improvements
...
Signed-off-by: Vladimir Mandic <mandic00@live.com >
2024-12-01 15:34:25 -05:00
6c11002420
PyTorch 2.5 XPU support
2024-10-17 23:11:52 +03:00
753bfebe1c
fix img2img batch
2024-01-29 08:34:36 -05:00
70bfe4ced8
enable gc on ram threshold
2023-12-31 08:15:22 -05:00
2a9133bfec
IPEX rework
2023-07-14 17:33:24 +03:00
cb307399dd
jumbo merge
2023-06-13 11:59:56 -04:00
c0a824d8c6
add extra networks to xyz
2023-06-05 10:32:08 -04:00
562947c944
Use proper device names instead of "xpu"
2023-06-02 01:14:56 +03:00
cb4cff3929
redesign logging
2023-05-02 13:57:16 -04:00
Vladimir Mandic
CalamitousFelicitousness
QualiaRain
Disty0
Disty0