[Bug]: "xFormers wasn't build with CUDA support" after running with --reinstall-xformers #11905

Sparkwave2 · 2023-07-20T22:01:18Z

Is there an existing issue for this?

I have searched the existing issues and checked the recent builds/commits

What happened?

I forced xformers to reinstall because it was outdated (using --reinstall-xformers) and it returned the following error:

NotImplementedError: No operator found for `memory_efficient_attention_forward` with inputs:
     query       : shape=(2, 4096, 8, 40) (torch.float32)
     key         : shape=(2, 4096, 8, 40) (torch.float32)
     value       : shape=(2, 4096, 8, 40) (torch.float32)
     attn_bias   : <class 'NoneType'>
     p           : 0.0
`flshattF` is not supported because:
    xFormers wasn't build with CUDA support
    dtype=torch.float32 (supported: {torch.float16, torch.bfloat16})
    Operator wasn't built - see `python -m xformers.info` for more info
`tritonflashattF` is not supported because:
    xFormers wasn't build with CUDA support
    dtype=torch.float32 (supported: {torch.float16, torch.bfloat16})
    Operator wasn't built - see `python -m xformers.info` for more info
    triton is not available
    requires A100 GPU
`cutlassF` is not supported because:
    xFormers wasn't build with CUDA support
    Operator wasn't built - see `python -m xformers.info` for more info
`smallkF` is not supported because:
    xFormers wasn't build with CUDA support
    max(query.shape[-1] != value.shape[-1]) > 32
    Operator wasn't built - see `python -m xformers.info` for more info
    unsupported embed per head: 40

Not sure how to fix it from here.

Steps to reproduce the problem

Launch the A1111 WebUI with --xformers --reinstall-xformers
Try generating an image
The error "xFormers wasn't build with CUDA support" appears

What should have happened?

The image should have generated correctly using xformers.

Version or Commit where the problem happens

f865d3e

What Python version are you running on ?

None

What platforms do you use to access the UI ?

No response

What device are you running WebUI on?

No response

Cross attention optimization

Automatic

What browsers do you use to access the UI ?

No response

Command Line Arguments

--xformers --api --disable-safe-unpickle --no-half-vae --no-half --reinstall-xformers

List of extensions

Extension URL Branch Version Date Update Cozy-Nest https://github.com/Nevysha/Cozy-Nest.git main [2f4964c2](https://github.com/Nevysha/Cozy-Nest/commit/2f4964c24506c84c78ef1f92dbe62b7081a7ffb7) Sun Jul 2 09:03:03 2023 unknown SD-CN-Animation https://github.com/volotat/SD-CN-Animation.git main [2e257bbf](https://github.com/volotat/SD-CN-Animation/commit/2e257bbfc3b76fb1323f7b22f820981c1b9f56b2) Tue May 30 16:49:03 2023 unknown SDAtom-WebUi-client-queue-ext https://github.com/Kryptortio/SDAtom-WebUi-client-queue-ext.git master [9cf161b2](https://github.com/Kryptortio/SDAtom-WebUi-client-queue-ext/commit/9cf161b22edb81f40b86fd1ee9cf929f02e032c2) Thu Jun 1 17:41:46 2023 unknown Stable-Diffusion-Webui-Civitai-Helper https://github.com/butaixianran/Stable-Diffusion-Webui-Civitai-Helper.git main [920ca326](https://github.com/butaixianran/Stable-Diffusion-Webui-Civitai-Helper/commit/920ca3267f789a72e3225c99f069bf0be0db795d) Tue May 23 11:53:22 2023 unknown a1111-sd-webui-lycoris https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris.git main [8e97bf54](https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris/commit/8e97bf54867c25d00fc480be1ab4dae5399b35ef) Sun Jul 9 07:44:58 2023 unknown aesthetic-gradients https://github.com/AUTOMATIC1111/stable-diffusion-webui-aesthetic-gradients master [2624e5dd](https://github.com/AUTOMATIC1111/stable-diffusion-webui-aesthetic-gradients/commit/2624e5dd4902cb731287b426ad483e741ece85bb) Fri Jan 6 10:59:30 2023 unknown aesthetic-image-scorer https://github.com/tsngo/stable-diffusion-webui-aesthetic-image-scorer main [1c3ab7a1](https://github.com/tsngo/stable-diffusion-webui-aesthetic-image-scorer/commit/1c3ab7a116ab5bc3b81d718e6383edd98903a01f) Sun Dec 11 05:52:39 2022 unknown artists-to-study https://github.com/camenduru/stable-diffusion-webui-artists-to-study master [5cd19f68](https://github.com/camenduru/stable-diffusion-webui-artists-to-study/commit/5cd19f68f65e994fc2ef2700bed4d9efe28e48b4) Mon Jun 26 08:38:08 2023 unknown booru2prompt https://github.com/Malisius/booru2prompt.git master [4bd88839](https://github.com/Malisius/booru2prompt/commit/4bd88839a6454428d098c7ad6672cc0989dd6a60) Wed Nov 23 14:41:10 2022 unknown ddetailer https://github.com/dustysys/ddetailer.git master [22a17414](https://github.com/dustysys/ddetailer/commit/22a17414bbca1fa4681d427b8aae5f970d17e896) Mon Nov 28 09:33:31 2022 unknown deforum https://github.com/deforum-art/deforum-for-automatic1111-webui automatic1111-webui [858c4dd6](https://github.com/deforum-art/deforum-for-automatic1111-webui/commit/858c4dd6fd030449c23882724c67ee9398b4fd05) Sun Jul 2 16:52:11 2023 unknown depthmap2mask https://github.com/Extraltodeus/depthmap2mask.git main [377e9224](https://github.com/Extraltodeus/depthmap2mask/commit/377e9224dbdb169ede588a6d447ca886aab67140) Thu Apr 13 04:10:08 2023 unknown dynamic-prompts https://github.com/adieyal/sd-dynamic-prompting/ main [26ce66bb](https://github.com/adieyal/sd-dynamic-prompting//commit/26ce66bbac7a4c5c34d250d45c2327807fad148f) Tue Jul 18 17:52:11 2023 unknown images-browser https://github.com/yfszzx/stable-diffusion-webui-images-browser main [a42c7a30](https://github.com/yfszzx/stable-diffusion-webui-images-browser/commit/a42c7a30181636a05815e62426d5eff4d3340529) Sat Dec 10 11:01:30 2022 unknown infinite-zoom-automatic1111-webui https://github.com/v8hid/infinite-zoom-automatic1111-webui.git main [1139764b](https://github.com/v8hid/infinite-zoom-automatic1111-webui/commit/1139764bf715d848dc5b8b4c8d95e2e734c7e4eb) Wed May 3 17:08:52 2023 unknown sd-canvas-editor https://github.com/jtydhr88/sd-canvas-editor.git master [12e7f72c](https://github.com/jtydhr88/sd-canvas-editor/commit/12e7f72cdccb3ede788aa3a6f81e5c060638842d) Fri Jun 30 01:16:49 2023 unknown sd-model-organizer https://github.com/alexandersokol/sd-model-organizer.git main [dae3299b](https://github.com/alexandersokol/sd-model-organizer/commit/dae3299b2cb902873db78615b76bf28d4cfbd4e0) Sat Jun 24 14:03:50 2023 unknown sd-pixel https://github.com/Leodotpy/sd-pixel.git master [ceb493db](https://github.com/Leodotpy/sd-pixel/commit/ceb493db323b1cf425274fb32661de2ff2516f1b) Wed May 31 19:57:01 2023 unknown sd-webui-controlnet https://github.com/Mikubill/sd-webui-controlnet main [098f6cd](https://github.com/Mikubill/sd-webui-controlnet/commit/098f6cd887ac5f6f5f0e7cc9d81460095d2be012) Tue Jul 18 05:06:14 2023 unknown sd-webui-infinite-image-browsing https://github.com/zanllp/sd-webui-infinite-image-browsing.git main [d3b3599b](https://github.com/zanllp/sd-webui-infinite-image-browsing/commit/d3b3599b73a22f742323a52da9c3db8ff56ceeda) Thu Jul 20 19:16:11 2023 unknown sd-webui-inpaint-anything https://github.com/Uminosachi/sd-webui-inpaint-anything.git main [420835b8](https://github.com/Uminosachi/sd-webui-inpaint-anything/commit/420835b8d97db95a77807a14720395a27333c972) Thu Jul 20 21:35:08 2023 unknown sd-webui-openpose-editor https://github.com/huchenlei/sd-webui-openpose-editor.git main [9ed77768](https://github.com/huchenlei/sd-webui-openpose-editor/commit/9ed7776842fd61e8acd80c37a6cc977403842056) Sun Jul 16 21:22:37 2023 unknown sd-webui-prompt-history https://github.com/namkazt/sd-webui-prompt-history main [bde3e95e](https://github.com/namkazt/sd-webui-prompt-history/commit/bde3e95e078b107efe78f0608a62b163daceb6d3) Sat Jul 15 06:23:45 2023 unknown sd-webui-regional-prompter https://github.com/hako-mikan/sd-webui-regional-prompter.git main [2bf0e8c1](https://github.com/hako-mikan/sd-webui-regional-prompter/commit/2bf0e8c14abc167a43a431a4bc181f77ff646079) Thu Jul 20 16:27:14 2023 unknown sd-webui-roop https://github.com/s0md3v/sd-webui-roop main [e6333fbe](https://github.com/s0md3v/sd-webui-roop/commit/e6333fbe5a0f3e6a515852388151f1db2315c45d) Fri Jul 7 09:22:59 2023 unknown sd-webui-text2video https://github.com/deforum-art/sd-webui-text2video.git main [8f0af8c9](https://github.com/deforum-art/sd-webui-text2video/commit/8f0af8c95a3c3a3af09c63cbdbdacc34b7a45f8d) Fri Jul 14 12:41:05 2023 unknown sd-webui-txt-img-to-3d-model https://github.com/jtydhr88/sd-webui-txt-img-to-3d-model.git master [33bde577](https://github.com/jtydhr88/sd-webui-txt-img-to-3d-model/commit/33bde577a4700be23211cb45dc9acc55b63d5311) Fri Jul 7 03:42:17 2023 unknown stable-diffusion-webui-eyemask https://github.com/ilian6806/stable-diffusion-webui-eyemask.git master [7b803a43](https://github.com/ilian6806/stable-diffusion-webui-eyemask/commit/7b803a438f02b381903916b65cc5b15c98e3231c) Fri Jun 2 11:15:19 2023 unknown stable-diffusion-webui-rembg https://github.com/AUTOMATIC1111/stable-diffusion-webui-rembg.git master [3d9eedbb](https://github.com/AUTOMATIC1111/stable-diffusion-webui-rembg/commit/3d9eedbbf0d585207f97d5b21e42f32c0042df70) Sun Jun 4 13:35:24 2023 unknown stable-diffusion-webui-tokenizer https://github.com/AUTOMATIC1111/stable-diffusion-webui-tokenizer.git master [ac6d541c](https://github.com/AUTOMATIC1111/stable-diffusion-webui-tokenizer/commit/ac6d541c7032e9f9c69c8ead2ed201302b06a4fe) Sat Dec 10 12:58:31 2022 unknown wildcards https://github.com/AUTOMATIC1111/stable-diffusion-webui-wildcards master [6ed81ed1](https://github.com/AUTOMATIC1111/stable-diffusion-webui-wildcards/commit/6ed81ed1eaee9145b596ab6385c38ffd8ce7b13f) Sat Oct 29 16:18:48 2022 unknown LDSR [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 Lora [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 ScuNET [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 SwinIR [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 canvas-zoom-and-pan [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 extra-options-section [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023 prompt-bracket-checker [built-in](http://127.0.0.1:7860/) None Thu Jul 20 21:49:49 2023

Console logs

https://pastebin.com/JJDSSSnX

Additional information

No response

The text was updated successfully, but these errors were encountered:

Sparkwave2 · 2023-07-21T00:40:12Z

Issue fixed by completely removing and uninstalling both torch and xformers and letting the WebUI install them again.

Sparkwave2 added the bug-report Report of a bug, yet to be confirmed label Jul 20, 2023

Sparkwave2 closed this as completed Jul 21, 2023

cyril23 mentioned this issue Nov 4, 2023

auto (AUTOMATIC1111): TypeError: AsyncConnectionPool.__init__() got an unexpected keyword argument 'socket_options' AbdBarho/stable-diffusion-webui-docker#608

Closed

2 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Bug]: "xFormers wasn't build with CUDA support" after running with --reinstall-xformers #11905

[Bug]: "xFormers wasn't build with CUDA support" after running with --reinstall-xformers #11905

Sparkwave2 commented Jul 20, 2023

Sparkwave2 commented Jul 21, 2023

[Bug]: "xFormers wasn't build with CUDA support" after running with --reinstall-xformers #11905

[Bug]: "xFormers wasn't build with CUDA support" after running with --reinstall-xformers #11905

Comments

Sparkwave2 commented Jul 20, 2023

Is there an existing issue for this?

What happened?

Steps to reproduce the problem

What should have happened?

Version or Commit where the problem happens

What Python version are you running on ?

What platforms do you use to access the UI ?

What device are you running WebUI on?

Cross attention optimization

What browsers do you use to access the UI ?

Command Line Arguments

List of extensions

Console logs

Additional information

Sparkwave2 commented Jul 21, 2023