---
title: japanese-stable-diffusion-xl
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/japanese-stable-diffusion-xl"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/japanese-stable-diffusion-xl.md"
repository: AI-ModelScope/japanese-stable-diffusion-xl
last_updated: 2023-11-24
license: other
pipeline_tag: text-to-image-synthesis
tasks:
  - text-to-image-synthesis
parameters: 5.5B
tensor_type:
  - F16
  - F32
library_name:
  - lora
  - safetensors
  - diffusers
  - pytorch
frameworks:
  - pytorch
language:
  - ja
downloads: 114
stars: 0
tags:
  - text-to-image
  - stable-diffusion
  - japanese-stable-diffusion
---

# japanese-stable-diffusion-xl

> japanese-stable-diffusion-xl - AI-ModelScope 在 ModelScope 开源的模型。Japanese Stable Diffusion XL

AI-ModelScope/japanese-stable-diffusion-xl 是 ModelScope 魔搭社区上的 5.5B 参数text-to-image-synthesis模型，采用 other 许可。

- **Repository**: AI-ModelScope/japanese-stable-diffusion-xl
- **License**: other
- **Tasks**: text-to-image-synthesis
- **Parameters**: 5.5B
- **Tags**: text-to-image, stable-diffusion, japanese-stable-diffusion
- **Downloads**: 114
- **Stars**: 0
- **Last updated**: 2023-11-24

Source: https://www.modelscope.cn/models/AI-ModelScope/japanese-stable-diffusion-xl

---

# Japanese Stable Diffusion XL

![image](./jsdxl.png)

## Model Details

Japanese Stable Diffusion XL (JSDXL) is a Japanese-specific [SDXL](https://arxiv.org/abs/2307.01952) model that is capable of inputting prompts in Japanese and generating Japanese-style images. 

## 示例代码

```python
from modelscope.utils.constant import Tasks
from modelscope.pipelines import pipeline
import cv2

pipe = pipeline(task=Tasks.text_to_image_synthesis, 
                model='AI-ModelScope/japanese-stable-diffusion-xl',
                use_safetensors=True,
                model_revision='master')

prompt = '柴犬、カラフルアート'
output = pipe({'text': prompt})
cv2.imwrite('result.png', output['output_imgs'][0])
```

## Model Details

* **Developed by**: [Stability AI](https://stability.ai/)
* **Model type**: Diffusion-based text-to-image generative model
* **Model Description**: This model is a fine-tuned model based on [SDXL 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0).
In order to maximize the understanding of the Japanese language and Japanese culture/expressions while preserving the versatility of the pre-trained model, we performed a PEFT training using one Japanese-specific compatible text encoder.
As a PEFT method, we applied [Orthogonal Fine-tuning (OFT)](https://arxiv.org/abs/2306.07280) for better results and training stability. 
* **License**: [STABILITY AI JAPANESE STABLE DIFFUSION XL COMMUNITY LICENSE](./LICENSE)

## Uses

### Direct Use

The model is intended for research purposes only. Possible research areas and tasks include

- Generation of artworks and use in design and other artistic processes.
- Applications in educational or creative tools.
- Research on generative models.
- Safe deployment of models which have the potential to generate harmful content.
- Probing and understanding the limitations and biases of generative models.

Excluded uses are described below.

### Out-of-Scope Use

The model was not trained to be factual or true representations of people or events, and therefore using the model to generate such content is out-of-scope for the abilities of this model.

## Limitations and Bias

### Limitations

- The model does not achieve perfect photorealism
- The model cannot render legible text
- The model struggles with more difficult tasks which involve compositionality, such as rendering an image corresponding to “A red cube on top of a blue sphere”
- Faces and people in general may not be generated properly.
- The autoencoding part of the model is lossy.

### Bias
While the capabilities of image generation models are impressive, they can also reinforce or exacerbate social biases.


## How to cite

```bibtex
@misc{JSDXL, 
    url    = {[https://huggingface.co/stabilityai/japanese-stable-diffusion-xl](https://huggingface.co/stabilityai/japanese-stable-diffusion-xl)}, 
    title  = {Japanese Stable Diffusion XL}, 
    author = {Shing, Makoto and Akiba, Takuya}
}
```

## Contact
* For questions and comments about the model, please join [Stable Community Japan](https://discord.com/invite/StableJP).
* For future announcements / information about Stability AI models, research, and events, please follow https://twitter.com/StabilityAI_JP.
* For business and partnership inquiries, please contact partners-jp@stability.ai. ビジネスや協業に関するお問い合わせはpartners-jp@stability.aiにご連絡ください。