Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Added ImageReward, Clip and Blip scorers, fixed download of aesthetic scorers and gave the option to average scorers #110

Open
wants to merge 18 commits into
base: main
Choose a base branch
from
Open

feat: Added ImageReward, Clip and Blip scorers, fixed download of aesthetic scorers and gave the option to average scorers #110

wants to merge 18 commits into from

Conversation

WhiteWipe
Copy link

WIP

@WhiteWipe
Scorers
6760948 
Updated, added blip, clip, ir and fixed aesthetic
@WhiteWipe
Fixed config template
4455d51 
Fixed config template
@WhiteWipe
Fix missing config for BLIP and ImageReward
42ebe6c 
Fix missing config for BLIP and ImageReward
@WhiteWipe
Scorer device fixed
1882ba1
@WhiteWipe
Fixed blip config
2b5edd4 
Fixed blip config(med.json) not being downloaded right
@6DammK9 6DammK9 mentioned this pull request Dec 23, 2023
Open
@WhiteWipe
Refactor
99acbab 
Major refactor, added HPSv2 and Pick-a-Pic scorers, geometric and exponential averages for both payloads and scorers, and possibly different devices for different scorers, fixed manual scoring, etc
@WhiteWipe
Fixed log spam
6bb24da
@WhiteWipe
Fix
203cdfa
@WhiteWipe
Suggested config change
86a7c33
@WhiteWipe
Fixed manual
5e538df
@WhiteWipe
Major Change
7773b56 
Added laionv1, shadow aesthetic, cafe aesthetic and wd aesthetic
Laionv1 and chad appear to be broken
@WhiteWipe
FIX Chad
575ac97
@WhiteWipe
Deleted laionv1
ee67632 
Couldn't get it to work in any way, shape or form(wasn't worth it anyway probably)
@WhiteWipe
Slight Config Edit
6b1b393
@WhiteWipe WhiteWipe mentioned this pull request Dec 27, 2023
Open
@WhiteWipe
Copy link
Author

New Scorers Currently Added with Links:
ImageReward: https://github.com/THUDM/ImageReward
BlipScore: Implementation from IR repository
ClipScore: Implementation from IR repository
Pick-A-Pic: https://github.com/yuvalkirstain/PickScore
HPSv2: https://github.com/tgxs002/HPSv2
The classifier used to filter the dataset for waifu-diffusion: https://huggingface.co/hakurei/waifu-diffusion-v1-4/tree/main/models
Cafe_Aesthetic: https://huggingface.co/cafeai/cafe_aesthetic
Shadow_Aesthetic: https://huggingface.co/shadowlilac/aesthetic-shadow

@WhiteWipe
Feature additions(check config)
a0c9011 
Added default scorer weight and default score device, also replaced exponential average with quadratic
@WhiteWipe
Fix
3a9657f
@WhiteWipe
Added noai scorer
9760191
@WhiteWipe
Fix manual
6203fa3
@Koitenshin
Copy link

If you want to add a really good super strict image scorer, check out this HF repo. Just make sure you grab the pull request from the bot under the Community tab. It has the safetensors file you'll want. It has two options, 'good' is super strict while 'normal' rates everything pretty highly.

I've tested almost every single image scorer there is, and there's only a couple good ones. You really don't want an image scorer that's going to rate something highly if the image is actually bad.

#wkpark/sd-webui-model-mixer#148

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@WhiteWipe @Koitenshin