I got some problems with the ControlNet API inside Unity. Ask for help!

[Fanian0429]

First, thanks for sharing the project online.

I have used stable diffusion with automatic 1111 for a few months, and I am trying to use ControlNet API inside unity just like you, but I met some problems with TypeError.

I followed the steps to install this project and ran the following steps with a1111 running (I also added –api in webui-user.bat), then I got this bug:

WebException: The remote server returned an error: (500) Internal Server Error.

in webui:

2024-01-31 17:46:36,757 - ControlNet - WARNING - Guess Mode is removed since 1.1.136. Please use Control Mode instead.
*** API error: POST: http://127.0.0.1:7860/sdapi/v1/txt2img {'error': 'TypeError', 'detail': '', 'body': '', 'errors': "ControlNetUnit.init() got an unexpected keyword argument 'guess_mode'"}

At this time, my controlnet version is ControlNet v1.1.419 which is over then v1.1.136.
—------------------------------------------------------------------------------------------------------------------

Then, I decided to reinstall the previous version of controlNet before v1.1.3136 (which is using the type “guess mode”) and generated again.

This time, a1111 will generate an image and show in unity successfully but I found that the ControlNet is not applied…..

and I got this error in webui:

*** Error running process: D:\School\StableDiffusion\webui\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py

I’m frustrated now because I searched for a solution for few months, so I post this question here to ask for some help. Thanks.

2024/01/31

[Enlopo]

This is caused by controlNet model was hard coded in script, you don't have to reinstall your controlNet.
Line 234 in Assets\HACKMANS\OpenPoseUnity\Scripts\API\OpenPoseControlNet.cs.
Change args.model = "control_sd15_openpose [fef5e48e]"; to args.model = "YOUR_CONTROL_NET_MODEL[HERE]";
You can find your controlNet model in webUI and copy to here: