---
title: TowerInstruct-v0.1-bfloat16-mlx
canonical_url: "https://www.modelscope.cn/models/mlx-community/TowerInstruct-v0.1-bfloat16-mlx"
md_url: "https://www.modelscope.cn/models/mlx-community/TowerInstruct-v0.1-bfloat16-mlx.md"
repository: mlx-community/TowerInstruct-v0.1-bfloat16-mlx
last_updated: 2025-02-06
license: cc-by-nc-4.0
pipeline_tag: translation
tasks:
  - translation
model_type:
  - llama
architectures:
  - LlamaForCausalLM
parameters: 6.7B
tensor_type:
  - BF16
library_name:
  - mlx
  - safetensors
  - pytorch
frameworks:
  - pytorch
language:
  - en
  - de
  - fr
  - zh
  - pt
  - nl
  - ru
  - ko
  - it
  - es
inference_backends:
  - "deploy_task text/emb"
  - "lmdeploy 0.9.1"
  - "lmdeploy_turbomind 0.9.1"
  - "sglang 0.5.2"
  - "vllm 0.9.2"
downloads: 1015
stars: 1
tags:
  - mlx
---

# TowerInstruct-v0.1-bfloat16-mlx

> TowerInstruct-v0.1-bfloat16-mlx - mlx-community 在 ModelScope 开源的模型。mlx-community/TowerInstruct-v0.1-bfloat16-mlx This model was converted to MLX format from Unbabel/TowerInstruct-v0.1. Refer to the original model card for more details on the model.

mlx-community/TowerInstruct-v0.1-bfloat16-mlx 是 ModelScope 魔搭社区上的 6.7B 参数translation模型，采用 cc-by-nc-4.0 许可，可用 deploy_task text/emb、lmdeploy 0.9.1、lmdeploy_turbomind 0.9.1 部署。

- **Repository**: mlx-community/TowerInstruct-v0.1-bfloat16-mlx
- **License**: cc-by-nc-4.0
- **Tasks**: translation
- **Parameters**: 6.7B
- **Inference backends**: deploy_task text/emb, lmdeploy 0.9.1, lmdeploy_turbomind 0.9.1, sglang 0.5.2, vllm 0.9.2
- **Tags**: mlx
- **Downloads**: 1015
- **Stars**: 1
- **Last updated**: 2025-02-06

Source: https://www.modelscope.cn/models/mlx-community/TowerInstruct-v0.1-bfloat16-mlx

---

# mlx-community/TowerInstruct-v0.1-bfloat16-mlx
This model was converted to MLX format from [`Unbabel/TowerInstruct-v0.1`]().
Refer to the [original model card](https://huggingface.co/Unbabel/TowerInstruct-v0.1) for more details on the model.

## Intended uses & limitations (from the [original model card](https://huggingface.co/Unbabel/TowerInstruct-v0.1))

The model was initially fine-tuned on a filtered and preprocessed supervised fine-tuning dataset ([TowerBlocks](https://huggingface.co/datasets/Unbabel/TowerBlocks-v0.1)), which contains a diverse range of data sources:
- Translation (sentence and paragraph-level)
- Automatic Post Edition
- Machine Translation Evaluation
- Context-aware Translation
- Terminology-aware Translation
- Multi-reference Translation
- Named-entity Recognition
- Paraphrase Generation
- Synthetic Chat data 
- Code instructions

You can find the dataset and all data sources of [TowerBlocks](https://huggingface.co/datasets/Unbabel/TowerBlocks-v0.1) here.


## Use with mlx

```bash
pip install mlx-lm
```

```python
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/TowerInstruct-v0.1-bfloat16-mlx")
prompt="Translate the following text from Portuguese into French.\nPortuguese: Um grupo de investigadores lançou um novo modelo para tarefas relacionadas com tradução.\nFrench:"
response = generate(model, tokenizer, prompt=prompt, verbose=True)
# Un groupe d'investigateurs a lancé un nouveau modèle pour les tâches liées à la traduction.
```