Public/automatic
1
0
Fork 0
mirror of https://github.com/vladmandic/automatic synced 2026-09-20 01:31:13 +02:00
Code Issues Packages Projects Releases Wiki Activity

add cogflorence22, miaoshouai-promptgen to vqa

Browse Source
This commit is contained in:
Vladimir Mandic
2024-09-09 18:28:29 -04:00
parent daa206ed73
commit 05b237aefb
4 changed files with 12 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
CHANGELOG.md
+5
View File
@@ -119,6 +119,11 @@ Plus tons of minor items and fixes - see [changelog](https://github.com/vladmand
- use `diffusers` from main branch, no longer tied to release
- improve diffusers/transformers/huggingface_hub progress reporting
- use unique identifiers for all ui components
- **visual query** (a.ka vqa or vlm) added support for several models
- [MiaoshouAI PromptGen 1.5 Base](https://huggingface.co/MiaoshouAI/Florence-2-base-PromptGen-v1.5)
- [MiaoshouAI PromptGen 1.5 Large](https://huggingface.co/MiaoshouAI/Florence-2-large-PromptGen-v1.5)
- [CogFlorence 2.2 Large](https://huggingface.co/thwri/CogFlorence-2.2-Large)
- **modernui** update
- fix handling of model configs if offline config is not available
- fix vae decode in backend original
- fix model path typos
extensions-builtin/sdnext-modernui
+1 -1
Submodule extensions-builtin/sdnext-modernui updated: 62a01fd490...3220411fb8
modules/ui_loadsave.py
+2
View File
@@ -37,6 +37,8 @@ class UiLoadsave:
pass
elif condition and not condition(saved_value):
pass
# elif getattr(obj, 'type', '') == 'index':
# pass # may need special handling
else:
setattr(obj, field, saved_value)
if init_field is not None:
modules/vqa.py
+4 -1
View File
@@ -12,7 +12,10 @@ loaded: str = None
MODELS = {
"MS Florence 2 Base": "microsoft/Florence-2-base", # 0.5GB
"MS Florence 2 Large": "microsoft/Florence-2-large", # 1.5GB
"CogFlorence 2 Large": "thwri/CogFlorence-2-Large-Freeze", # 1.6GB
"MiaoshouAI PromptGen 1.5 Base": "MiaoshouAI/Florence-2-base-PromptGen-v1.5", # 1.1GB
"MiaoshouAI PromptGen 1.5 Large": "MiaoshouAI/Florence-2-large-PromptGen-v1.5", # 3.3GB
"CogFlorence 2.0 Large": "thwri/CogFlorence-2-Large-Freeze", # 1.6GB
"CogFlorence 2.2 Large": "thwri/CogFlorence-2.2-Large", # 1.6GB
"Moondream 2": "vikhyatk/moondream2", # 3.7GB
"GIT TextCaps Base": "microsoft/git-base-textcaps", # 0.7GB
"GIT VQA Base": "microsoft/git-base-vqav2", # 0.7GB