v5.3.0rc2

This release candidate includes a number of enhancements and fixes. Standouts include:

• Support for FLUX IP Adapters.
• Auto-masking in Canvas (via Segment Anything).
• Installer improvements, which should resolve all xformers-related issues.
• Improved FLUX support for MPS (Apple Silicon) devices.
• Reworked context menus, now with sub-menus.

Be sure to review the v5 release notes if you haven't already upgraded to v5.

FLUX IP Adapters

We now support XLabs FLUX IP Adapters. There's only the one model right now, which we've added to the starter models.

Workflow & Input Image	Output

Internally, IP Adapter requires CFG to work. For now, this is only exposed via workflows. Negative conditioning is also now available in workflows. We're exploring a sane way to expose this in the linear UI.

Negative conditioning requires a CFG value >1. Leave CFG at 1 to disable it and ignore negative conditioning.

Note: CFG doubles denoising time, and negative conditioning requires a good additional chunk of VRAM.

Canvas Auto-Masking

Use auto-mask to quickly select objects from a layer, then use the selection as a mask. Add Include and Exclude points to fine-tune the masking.

Screen.Recording.2024-10-25.at.8.00.48.am.mov

You can also save the selection as a Raster or Control Layer.

Internally, this uses Segment Anything v1. We'll upgrade to SAM v2 once support for it lands in transformers, which will improve both speed and quality.

All Changes

Enhancements

• Support for FLUX IP Adapters.
• Support for CFG and Negative Conditioning for FLUX in workflows only.
• Canvas auto-mask.
• Added RealVisXL5 to SDXL Starter Model Bundle.
• Model manager in-place checkbox remembers your choice. Thanks @rikublock!
• Better tooltips in the model manager, including a starter bundle contents.
• Support for sub-menus, which are now used in the Image context menu and various Canvas context menus.
• Support more conversions between Canvas layers. Both in-place and copy conversions are supported. For example, convert between Inpaint Masks and Regional Guidance, or copy a Raster Layer into a new Inpaint Mask.
• Updated translations. Thanks @rikublock, @Vasyanator, @Harvester62, @Ery4z!

Fixes

• Improved FLUX support for MPS devices. Thanks @Vargol!
• FLUX denoise node erroneously required controlnet_vae field.
• Uninstall xformers before installation, fixing issues w/ xformers version mismatch.
• Fixed installer text output. Thanks @max-maag!
• Fixed ROCm PyPI indices. Thanks @max-maag!
• Normalize solid infill alpha values from 0-1 to 0-255 when building canvas graphs. This issue didn't cause any problems, because VAE ignores the alpha channel, but it should be fixed regardless.
• View/Hide Boards button cut off with certain translations.

Internal

• Reworked logging implementation.
• Directory traversal issue when deleting images.

Installation and Updating

To install or update to v5.3.0rc2, download the latest installer and follow the installation instructions

To update, select the same installation location. Your user data (images, models, etc) will be retained.

What's Changed

• fix(app): directory traversal when deleting images by @psychedelicious in #7145
• Small improvements for the installer text output by @max-maag in #7150
• refactor(ui): logging config handling by @psychedelicious in #7143
• add starter model Architecture (RealVisXL5) by @maryhipp in #7151
• fix(nodes): FluxDenoiseInvocation.controlnet_vae missing default=None by @psychedelicious in #7156
• Remove xformers before installation by @ebr in #7161
• FLUX CFG support by @RyanJDick in #7152
• FLUX XLabs IP-Adapter Support by @RyanJDick in #7157
• Fix AMD GPUs not being detected by @max-maag in #7147
• Load non quantized t5encoder using same dtype the model is saved in/ by @Vargol in #7140
• Get flux working with MPS on torch 2.4.1, with GGUF support by @Vargol in #7113
• ui: translations update from weblate by @weblate in #7135
• feat(ui): canvas auto-mask by @psychedelicious in #7163
• chore: bump version to v5.3.0rc1 by @psychedelicious in #7164
• feat(ui): move model manager in-place install state to redux by @rikublock in #7167
• feat(ui): canvas auto mask followups 1 by @psychedelicious in #7168
• fix(ui): normalize infill alpha to 0-255 when building infill nodes by @psychedelicious in #7172
• tweak(ui): prevent show/hide boards button cutoff by @psychedelicious in #7184
• feat(ui,api): misc model QoL by @maryhipp in #7173
• feat(ui): canvas auto mask followups 2 by @psychedelicious in #7180
• feat(ui): canvas auto mask followups 3 by @psychedelicious in #7189
• chore: bump version to v5.3.0rc2 by @psychedelicious in #7190

Full Changelog: v5.2.0...v5.3.0rc2