Public/automatic
1
0
Fork 0
mirror of https://github.com/vladmandic/automatic synced 2026-09-18 16:54:33 +02:00
Code Issues Packages Projects Releases Wiki Activity
11,690 Commits 4 Branches 34 Tags
a90d85ddfd8ebd85cb2c09fd44ab90e20f4eda04
Commit Graph

11690 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
CalamitousFelicitousness a90d85ddfd feat(ui): add dynamic task selection based on VLM model 
- Rename "Predefined question" to "Task"
- Task dropdown updates choices when model changes
- Prompt placeholder updates based on selected task
- Model-specific tasks: Florence-2 gets detection tasks, Moondream gets point/detect
 2025-12-05 00:00:25 +00:00
CalamitousFelicitousness 4df6aa7944 fix(ui): set prefill text to empty by default 2025-12-05 00:00:25 +00:00
CalamitousFelicitousness 0d88fcd396 feat(ui): add prefill and thinking controls to Caption tab 
Add minimal UI controls to expose new VQA functionality:
- Prefill Text input for guiding VLM responses
- Thinking Mode checkbox for reasoning models
- Keep Thinking Trace checkbox for output retention
- Keep Prefill checkbox for output retention
- Annotated Image output panel for detection visualization
- Updated button handlers to pass new parameters
 2025-12-05 00:00:24 +00:00
CalamitousFelicitousness c2810dfee2 fix(api): update VQA API endpoint for tuple return format 
Update interrogate API endpoint to handle the new (text, image)
tuple return format from VQA interrogate function.
 2025-12-05 00:00:24 +00:00
CalamitousFelicitousness 27fa48cc99 feat(vqa): major VQA handler refactor with prefill, thinking, and visualization 
Comprehensive overhaul of the VQA interrogation system including:
- Prefill text support for guiding VLM responses
- Thinking mode support with tag cleanup/retention
- Dynamic prompt/task selection based on model type
- Bounding box visualization for detection results
- Debug infrastructure (SD_VQA_DEBUG env var)
- New model support: MiMo-VL, Nidum Gemma, Allura Gemma
- Model-specific prompt lists (Florence, Moondream)
 2025-12-05 00:00:24 +00:00
CalamitousFelicitousness 0a322c0faf feat(vqa): add Moondream 3 Preview handler 
Add support for Moondream 3 Preview VLM with:
- Text query, caption, point, and detect capabilities
- Bounding box visualization for object detection
- Max pixels setting for resolution control
- Device offloading support
 2025-12-05 00:00:24 +00:00
CalamitousFelicitousness c024c0c9c6 feat(settings): add VLM prefill and thinking retention options 
Add new VLM configuration options:
- interrogate_vlm_keep_prefill: Keep prefill text in output
- interrogate_vlm_keep_thinking: Keep reasoning trace in output

Also adjust defaults:
- Change interrogate_clip_flavor_count: 16 -> 1024 with updated range
- Change interrogate_vlm_prompt default to first item ("Use Prompt")
 2025-12-05 00:00:24 +00:00
Vladimir Mandic 26dd77cb4b Merge pull request #4447 from awsr/authfetch-fix 
Allow for explicit null response
 2025-12-05 00:43:28 +01:00
awsr 6ef6c4c891 Allow for explicit null response 
Fixes constant spam to browser console from every fetch request
 2025-12-04 15:35:23 -08:00
Vladimir Mandic c1098cb7ab Merge pull request #4445 from awsr/gallery-folder-modification-to-look-better-when-the-path-is-extremely-long 
Gallery folder modification to look better when the path is extremely long
 2025-12-04 22:26:50 +01:00
awsr e1c05b0e91 Improve standard theme compatibility 2025-12-04 04:56:59 -08:00
awsr a322186650 Improve rendering on non-modern UI 2025-12-04 04:18:31 -08:00
awsr 6cff06eafe Improve layout of gallery status info 2025-12-04 03:58:50 -08:00
awsr 489db27210 Fix GalleryFolder rendering for long paths 2025-12-04 03:56:56 -08:00
awsr 78e8bff46f Reposition setting lastSortName 
Makes more sense to use the provided catch-all that's part of switch...case
 2025-12-04 03:24:11 -08:00
vladmandic 66ead091ee update diffusers 
Signed-off-by: vladmandic <mandic00@live.com>
 2025-12-04 11:34:57 +01:00
awsr 28144d83e4 Better rendering of long path names 2025-12-03 21:16:38 -08:00
vladmandic 32b5f8ee2a Merge branch 'dev' of https://github.com/vladmandic/sdnext into dev 2025-12-03 19:19:40 +01:00
vladmandic 31aaf57021 update changelog & todo 
Signed-off-by: vladmandic <mandic00@live.com>
 2025-12-03 19:19:36 +01:00
Vladimir Mandic 16cdef5a6c Merge pull request #4441 from CalamitousFelicitousness/fix/vqa-minor-improvements 
Fix/vqa minor improvements
 2025-12-03 19:18:16 +01:00
Vladimir Mandic 6c8a8ef6df Merge pull request #4442 from awsr/gallery-maintenance3 
Small gallery update
 2025-12-03 19:15:26 +01:00
awsr 955759a4cd Set minimum display time for message 2025-12-02 19:26:30 -08:00
awsr c771b82ad9 Improve look of cleanup overlay 2025-12-02 17:55:59 -08:00
awsr 2c288b651a Remove need for timeout failsafe 
All the failure routes should either:
- Get far enough along to not leave checked values unable to reach the finished state...
- or all be tied into the same AbortController so everything aborts together.

... I think...
 2025-12-02 16:29:20 -08:00
CalamitousFelicitousness 9505a674ea docs(i18n): add detailed VLM/CLiP tooltips and improve labels 
Add comprehensive tooltips explaining VLM and CLiP parameters:
- New labels for VLM: Prompt, Task, Prefill, Thinking mode
- New labels for CLiP: min/max length, chunk size, flavors
- Detailed hints for sampling parameters (temperature, top-k, top-p)
- Improved system prompt and sampling method descriptions
- Standardized label capitalization
 2025-12-02 23:06:46 +00:00
CalamitousFelicitousness 85cd222793 fix(vqa): sort CLiP analysis results and add text output 
Improvements to the OpenCLIP interrogation:
- Sort all ranking dicts by similarity score (descending)
- Add format_category() helper for text formatting
- Add formatted text output for CLIP labels textbox
- Return additional text update in analyze_image()
 2025-12-02 21:48:09 +00:00
CalamitousFelicitousness eb832a4850 fix(vqa): respect offload setting in JoyCaption, add max_pixels 
Two fixes for the JoyCaption handler:
- Only offload model if shared.opts.interrogate_offload is True
- Add max_pixels=1024*1024 to AutoProcessor for consistent image handling
 2025-12-02 21:46:09 +00:00
CalamitousFelicitousness 766cb49928 feat(ui): add vision and reasoning symbols, fix dropdown fonts 
Add new Font Awesome symbols for model capability indicators:
- vision symbol (eye icon) for vision-capable VLM models
- reasoning symbol (lightbulb icon) for thinking/reasoning models

Also fix dropdown font styling by adding NotoSans font-family.
 2025-12-02 21:43:13 +00:00
vladmandic d3a2f6c7ed fix loading local prequant models 
Signed-off-by: vladmandic <mandic00@live.com>
 2025-12-02 20:53:19 +01:00
vladmandic 0ad40d2b8b lint 
Signed-off-by: vladmandic <mandic00@live.com>
 2025-12-02 12:25:04 +01:00
vladmandic b97aae687c fix gemini-2.5 
Signed-off-by: vladmandic <mandic00@live.com>
 2025-12-02 11:59:52 +01:00
vladmandic 44b461cdf7 fix xhr object auth 
Signed-off-by: vladmandic <mandic00@live.com>
 2025-12-02 10:59:18 +01:00
vladmandic 39bced0987 Merge branch 'dev' of https://github.com/vladmandic/sdnext into dev 2025-12-02 10:40:31 +01:00
vladmandic 903d47f9e6 add zimage and f2 to lora overrides 
Signed-off-by: vladmandic <mandic00@live.com>
 2025-12-02 10:40:27 +01:00
vladmandic 175201a72f fix progress auth 
Signed-off-by: vladmandic <mandic00@live.com>
 2025-12-02 10:38:17 +01:00
Vladimir Mandic ea07a972f3 Merge pull request #4429 from awsr/gallery-maintenance2 
Gallery performance overhaul
 2025-12-02 04:08:00 -05:00
Vladimir Mandic 3b4f909862 Merge pull request #4436 from CalamitousFelicitousness/runai-update 
Update runai-model-streamer logging integration
 2025-12-02 03:59:38 -05:00
Vladimir Mandic 1673380b94 Merge pull request #4430 from awsr/fix_show_progress 
show_progress requires "full", "minimal", or "hidden"
 2025-12-02 03:50:34 -05:00
Vladimir Mandic de3ebf470d Merge pull request #4428 from awsr/revert-for-now 
Revert changes that require at least Python version 3.12
 2025-12-02 03:49:20 -05:00
awsr e986f5638e Update initGallery position to wait for opts 2025-12-01 20:19:06 -08:00
CalamitousFelicitousness 55c089ae48 Update runai-model-streamer logging integration 
- Remove stdout redirect monkeypatch (fixed in runai v0.15.1 via PR #97)
- Add RUNAI_STREAMER_LOG_LEVEL controlled by SD_LOAD_DEBUG
- Add one-time runai config log when hijack is activated
- Add `loader=runai|default` to model loading logs
- Remove per-file logging clutter from sd_hijack_safetensors.py
 2025-12-02 02:01:51 +00:00
awsr 75dc851d1c Fix incorrect syntax 2025-12-01 17:49:00 -08:00
awsr e1febfd92c Logging adjustment 2025-12-01 16:45:23 -08:00
awsr 9ae7c1a7c7 Generalize the SimpleFunctionQueue class 2025-12-01 16:20:23 -08:00
awsr 766aa6c728 Change from ternary to make things easier to read 2025-12-01 15:55:40 -08:00
Disty0 7aa1bfdc70 Add get_modules_to_not_convert from transformers v5 2025-12-02 01:01:51 +03:00
awsr 8fa791a22f Remove extra parentheses 
Looks like they snuck in when refactoring to inline declaration.
 2025-12-01 05:26:06 -08:00
awsr 6cab50e584 Overhaul custom element styling 
Large performance improvement due to only needing a single style source instead of creating and parsing thousands of style elements.
 2025-12-01 05:18:23 -08:00
awsr 35cd563c7d Minor rename and logic adjustment 
Only add to the hashes Set when guard is in place.
 2025-11-30 22:59:26 -08:00
awsr b25cf56181 Rename and remove redundant logic 2025-11-30 22:05:14 -08:00