---
title: FLUX.1-dev-LoRA-blended-realistic-illustration
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/FLUX.1-dev-LoRA-blended-realistic-illustration"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/FLUX.1-dev-LoRA-blended-realistic-illustration.md"
repository: AI-ModelScope/FLUX.1-dev-LoRA-blended-realistic-illustration
last_updated: 2024-09-05
license: other
pipeline_tag: text-to-image-synthesis
tasks:
  - text-to-image-synthesis
base_model:
  - black-forest-labs/FLUX.1-dev
base_model_relation: adapter
parameters: 343.7M
tensor_type:
  - BF16
library_name:
  - pytorch
  - lora
  - diffusers
  - safetensors
frameworks:
  - pytorch
language:
  - en
downloads: 103
stars: 1
tags:
  - text-to-image
  - stable-diffusion
  - lora
  - diffusers
  - image-generation
  - flux
  - safetensors
---

# FLUX.1-dev-LoRA-blended-realistic-illustration

> FLUX.1-dev-LoRA-blended-realistic-illustration - AI-ModelScope 在 ModelScope 开源的模型。FLUX.1-dev-LoRA-blended-realistic-illustration

AI-ModelScope/FLUX.1-dev-LoRA-blended-realistic-illustration 是 ModelScope 魔搭社区上的 343.7M 参数text-to-image-synthesis模型，采用 other 许可，基于 black-forest-labs/FLUX.1-dev 构建。

- **Repository**: AI-ModelScope/FLUX.1-dev-LoRA-blended-realistic-illustration
- **License**: other
- **Tasks**: text-to-image-synthesis
- **Parameters**: 343.7M
- **Base model**: black-forest-labs/FLUX.1-dev
- **Tags**: text-to-image, stable-diffusion, lora, diffusers, image-generation, flux, safetensors
- **Downloads**: 103
- **Stars**: 1
- **Last updated**: 2024-09-05

Source: https://www.modelscope.cn/models/AI-ModelScope/FLUX.1-dev-LoRA-blended-realistic-illustration

---

# FLUX.1-dev-LoRA-blended-realistic-illustration

This is a LoRA (Vector Journey) trained on FLUX.1-dev for blended realistic illustration by [Muertu](https://www.shakker.ai/userpage/562c8ddb15e147c9b1c31878f865c901/publish), the front character is in illustration style, while the background is realistic. For training details, [Muertu](https://www.shakker.ai/userpage/562c8ddb15e147c9b1c31878f865c901/publish) provides a [step-by-step tutorial on Reddit](https://www.reddit.com/r/StableDiffusion/comments/1f9o8p5/training_tutorial_vectorjourney/).

<div class="container">
  <img src="./images/poster.jpeg" width="1024"/>
</div>


## Showcases
<Gallery />

## Trigger words

You should use `artistic style blends reality and illustration elements.` to trigger the image generation. The recommended scale is `1.0` in diffusers, but for ComfyUI or WebUI, the scale may be different.

## Inference

```python
import torch
from diffusers import FluxPipeline

pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
pipe.load_lora_weights("Shakker-Labs/FLUX.1-dev-LoRA-blended-realistic-illustration", weight_name="FLUX-dev-lora-blended_realistic_illustration.safetensors")
pipe.fuse_lora(lora_scale=1.0)
pipe.to("cuda")

prompt = "A peaceful outdoor scene,surrounded by lush green leaves and vibrant vegetation on the stone road. A cartoon style man sits on white clothes,gently caressing two animated cats,one orange and one white. Soft sunlight creates shadows,simple walls and pebble floors create a peaceful atmosphere,blending reality and animation elements,and natural and procedural characters. The artistic style blends elements of reality and illustration."

image = pipe(prompt, 
             num_inference_steps=24, 
             guidance_scale=3.5,
             width=768, height=1024,
            ).images[0]
image.save(f"example.png")
```


## Online Inference

You can also download this model at [Shakker AI](https://www.shakker.ai/modelinfo/4ea23c6ad148462589ea42e4eeac9897?from=personal_page), where we provide an online interface to generate images.


## Acknowledgements
This model is trained by our copyrighted users [Muertu](https://www.shakker.ai/userpage/562c8ddb15e147c9b1c31878f865c901/publish). We release this model under permissions. The model follows [flux-1-dev-non-commercial-license](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) and the generated images are also non commercial.