---
title: flux-controlnet-collections
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/flux-controlnet-collections"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/flux-controlnet-collections.md"
repository: AI-ModelScope/flux-controlnet-collections
last_updated: 2024-09-05
license: other
pipeline_tag: text-to-image-synthesis
tasks:
  - text-to-image-synthesis
parameters: 6.0B
tensor_type:
  - BF16
library_name:
  - diffusers
  - safetensors
  - pytorch
frameworks:
  - pytorch
language:
  - en
downloads: 2891
stars: 5
tags:
  - "Stable Diffusion"
  - image-generation
  - Flux
  - diffusers
---

# flux-controlnet-collections

> flux-controlnet-collections - AI-ModelScope 在 ModelScope 开源的模型。This repository provides a collection of ControlNet checkpoints for FLUX.1-dev model by Black Forest Labs

AI-ModelScope/flux-controlnet-collections 是 ModelScope 魔搭社区上的 6.0B 参数text-to-image-synthesis模型，采用 other 许可。

- **Repository**: AI-ModelScope/flux-controlnet-collections
- **License**: other
- **Tasks**: text-to-image-synthesis
- **Parameters**: 6.0B
- **Tags**: Stable Diffusion, image-generation, Flux, diffusers
- **Downloads**: 2891
- **Stars**: 5
- **Last updated**: 2024-09-05

Source: https://www.modelscope.cn/models/AI-ModelScope/flux-controlnet-collections

---

![Controlnet collections for Flux](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/light/flux-controlnet-collections.png?raw=true)
[<img src="https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/light/join-our-discord-rev1.png?raw=true">](https://discord.gg/FHY2guThfy)

This repository provides a collection of ControlNet checkpoints for
[FLUX.1-dev model](https://huggingface.co/black-forest-labs/FLUX.1-dev) by Black Forest Labs

![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/depth_result1.png?raw=true)

[See our github](https://github.com/XLabs-AI/x-flux-comfyui) for comfy ui workflows.
![Example Picture 1](https://github.com/XLabs-AI/x-flux-comfyui/blob/main/assets/image1.png?raw=true)

[See our github](https://github.com/XLabs-AI/x-flux) for train script, train configs and demo script for inference.

# Models

Our collection supports 3 models:
- Canny
- HED
- Depth (Midas)

Each ControlNet is trained on 1024x1024 resolution and works for 1024x1024 resolution.
We release **v3 versions** - better and realistic versions, which can be used directly in ComfyUI!   

Please, see our [ComfyUI custom nodes installation guide](https://github.com/XLabs-AI/x-flux-comfyui)


# Examples

See examples of our models results below.  
Also, some generation results with input images are provided in "Files and versions"

# Inference

To try our models, you have 2 options:
1. Use main.py from our [official repo](https://github.com/XLabs-AI/x-flux)
2. Use our custom nodes for ComfyUI and test it with provided workflows (check out folder /workflows)
3. Use gradio demo

See examples how to launch our models:

## Canny ControlNet (version 3)

1. Clone our [x-flux-comfyui](https://github.com/XLabs-AI/x-flux-comfyui) custom nodes
2. Launch ComfyUI
3. Try our canny_workflow.json

![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/canny_result1.png?raw=true)
![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/canny_result2.png?raw=true)


## Depth ControlNet (version 3)

1. Clone our [x-flux-comfyui](https://github.com/XLabs-AI/x-flux-comfyui) custom nodes
2. Launch ComfyUI
3. Try our depth_workflow.json

![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/depth_result1.png?raw=true)
![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/depth_result2.png?raw=true)


## HED ControlNet (version 3)

1. Clone our [x-flux-comfyui](https://github.com/XLabs-AI/x-flux-comfyui) custom nodes
2. Launch ComfyUI
3. Try our hed_workflow.json

![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/hed_result1.png?raw=true)

## License

Our weights fall under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License<br/>