---
title: Bunny-Llama-3-8B-V-4bit
canonical_url: "https://www.modelscope.cn/models/mlx-community/Bunny-Llama-3-8B-V-4bit"
md_url: "https://www.modelscope.cn/models/mlx-community/Bunny-Llama-3-8B-V-4bit.md"
repository: mlx-community/Bunny-Llama-3-8B-V-4bit
last_updated: 2024-12-19
license: apache-2.0
pipeline_tag: image-text-to-text
tasks:
  - image-text-to-text
model_type:
  - bunny-llama
architectures:
  - BunnyLlamaForCausalLM
parameters: 1.3B
tensor_type:
  - F32
  - U32
  - F16
library_name:
  - mlx
  - safetensors
  - pytorch
frameworks:
  - pytorch
downloads: 997
stars: 0
tags:
  - mlx
---

# Bunny-Llama-3-8B-V-4bit

> Bunny-Llama-3-8B-V-4bit - mlx-community 在 ModelScope 开源的模型。mlx-community/Bunny-Llama-3-8B-V-4bit This model was converted to MLX format from BAAI/Bunny-Llama-3-8B-V using mlx-vlm version 0.0.11. Refer to the original model card for more details on the model.…

mlx-community/Bunny-Llama-3-8B-V-4bit 是 ModelScope 魔搭社区上的 1.3B 参数image-text-to-text模型，采用 apache-2.0 许可。

- **Repository**: mlx-community/Bunny-Llama-3-8B-V-4bit
- **License**: apache-2.0
- **Tasks**: image-text-to-text
- **Parameters**: 1.3B
- **Tags**: mlx
- **Downloads**: 997
- **Stars**: 0
- **Last updated**: 2024-12-19

Source: https://www.modelscope.cn/models/mlx-community/Bunny-Llama-3-8B-V-4bit

---

# mlx-community/Bunny-Llama-3-8B-V-4bit
This model was converted to MLX format from [`BAAI/Bunny-Llama-3-8B-V`]() using mlx-vlm version **0.0.11**.
Refer to the [original model card](https://huggingface.co/BAAI/Bunny-Llama-3-8B-V) for more details on the model.
## Use with mlx

```bash
pip install -U mlx-vlm
```

```bash
python -m mlx_vlm.generate --model  mlx-community/Bunny-Llama-3-8B-V-4bit --max-tokens 100 --temp 0.0
```