ControlNet errors

I am transitioning to Comfy from Auto111 and so far I really love it. It seems fast and the nodes make a lot of sense for flexibility. However, I am having big trouble getting controlnet to work at all, which is the last thing that keeps bringing me back to Auto111. Do any of you have any suggestions to get this working? I am on a Mac M2. I am trying to use XL models like Juggernaut XL v6 with Control Net. I have searched this reddit and didn't find anything that seems relevant.

I have put the following models in Users/Username/ComfyUI/models/controlnet

kohya_controllllite_xl_canny.safetensors

kohya_controllllite_xl_depth.safetensors

kohya_controllllite_xl_openpose_anime.safetensors

kohya_controllllite_xl_scribble_anime.safetensors

t2i-adapter_diffusers_xl_canny.safetensors

t2i-adapter_diffusers_xl_sketch.safetensors

I load controlnet by having a Load Control Net model with one of the above checkpoints loaded. This connects to the Apply Control Net node at the control_net input. The image to be used as a control net reference connects to the image input, and the positive text prompt connects to the conditioning input on the same node. The output of the node goes to the positive input on the KSampler.

The issues are as follows. When I run the t2i models, I see no effect, as if controlnet isn't working at all. When I run the kohya models, I get the following error immediately and the generations don't finish.

Error occurred when executing ControlNetApply:

​

'NoneType' object has no attribute 'copy'

​

File "/Users/User/ComfyUI/execution.py", line 153, in recursive_execute

output_data, output_ui = get_output_data(obj, input_data_all)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/Users/User/ComfyUI/execution.py", line 83, in get_output_data

return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/Users/User/ComfyUI/execution.py", line 76, in map_node_over_list

results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/Users/User/ComfyUI/nodes.py", line 644, in apply_controlnet

c_net = control_net.copy().set_cond_hint(control_hint, strength)

^^^^^^^^^^^^^^^^

Any ideas to get this working?

Thanks in advance!

​