![]() Please post any issues and feedback here regarding the above instructions or anything else related to web UI performance on Macs.Įdit: As of Feburary 11, the PyTorch nightly builds have broken the ability to use torch.nn.functional.layer_norm with half precision and web UI doesn't currently have a patch to fix it. If you are having problems but instead want to try reverting to an older PyTorch nightly, replace the line in webui-user.sh that starts with export TORCH_COMMAND= with export TORCH_COMMAND="pip install -pre torch=2.0.0.dev20230131 torchvision=0.15.0.dev20230131 -f ", replace the two 20230131 dates with whatever previous date you would like to use a PyTorch nightly build from, then delete the venv-torch-nightly folder and run. ![]() If you encounter problems, you can always revert back by running git checkout webui-user.sh and then you can delete the venv-torch-nightly folder. Keep in mind that the nightly PyTorch builds may have issues, especially since they are updated every day. webui.sh the web UI dependencies will be reinstalled, along with the latest nightly build of PyTorch. To use all of these new improvements, you don't need to do much just unzip this webui-user.sh file and replace the webui-user.sh file in stable-diffusion-webui. The latest nightly builds get roughly 25% better performance than 1.12.1 (the current default). It manages memory far better than any of the other cross attention optimizations available to Macs and is required for large image sizes. This is the recommended cross attention optimization to use with newer PyTorch versions. Add the command line argument -opt-sub-quad-attention to use this. ![]() Note that if you want to train embeddings or hypernetworks, you should start web UI with -no-half (e.g./webui.sh -no-half you don't have to fully override the default command lines arguments to remove -upcast-sampling as -no-half overrides it). In that case you'll need to remove -no-half and make sure -upcast-sampling is used instead. This has been the default for macOS since e0df864 so other than upgrading web UI, no action is needed - unless you've edited webui-user.sh to override the default command line arguments and included -no-half. This significantly lowers memory usage and improves performance.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |