---
title: NeuralReyna-Mini-1.8B-v0.2
canonical_url: "https://www.modelscope.cn/models/QwenCollection/NeuralReyna-Mini-1.8B-v0.2"
md_url: "https://www.modelscope.cn/models/QwenCollection/NeuralReyna-Mini-1.8B-v0.2.md"
repository: QwenCollection/NeuralReyna-Mini-1.8B-v0.2
last_updated: 2024-11-21
license: apache-2.0
pipeline_tag: text-generation
tasks:
  - text-generation
model_type:
  - qwen2
architectures:
  - Qwen2ForCausalLM
parameters: 1.8B
tensor_type:
  - F16
library_name:
  - safetensors
  - pytorch
frameworks:
  - pytorch
language:
  - en
inference_backends:
  - "deploy_task text/emb"
  - "lmdeploy 0.9.1"
  - "lmdeploy_turbomind 0.9.1"
  - "sglang 0.5.2"
  - "vllm 0.9.2"
downloads: 2249
stars: 0
tags:
  - conversational
---

# NeuralReyna-Mini-1.8B-v0.2

> NeuralReyna-Mini-1.8B-v0.2 - QwenCollection 在 ModelScope 开源的模型。NeuralReyna-Mini-1.8B-v0.2 Description Taken aloobun/Reyna-Mini-1.8B-v0.2 and further fine-tuned it using DPO using the Intel/orcadpopairs dataset.

QwenCollection/NeuralReyna-Mini-1.8B-v0.2 是 ModelScope 魔搭社区上的 1.8B 参数text-generation模型，采用 apache-2.0 许可，可用 deploy_task text/emb、lmdeploy 0.9.1、lmdeploy_turbomind 0.9.1 部署。

- **Repository**: QwenCollection/NeuralReyna-Mini-1.8B-v0.2
- **License**: apache-2.0
- **Tasks**: text-generation
- **Parameters**: 1.8B
- **Inference backends**: deploy_task text/emb, lmdeploy 0.9.1, lmdeploy_turbomind 0.9.1, sglang 0.5.2, vllm 0.9.2
- **Tags**: conversational
- **Downloads**: 2249
- **Stars**: 0
- **Last updated**: 2024-11-21

Source: https://www.modelscope.cn/models/QwenCollection/NeuralReyna-Mini-1.8B-v0.2

---

# NeuralReyna-Mini-1.8B-v0.2
![Reyna image](https://th.bing.com/th/id/OIG3.8IBxuT77hh6Y_r1DZ6WK?dpr=2.6&pid=ImgDetMain)
# Description
Taken aloobun/Reyna-Mini-1.8B-v0.2 and further fine-tuned it using DPO using the Intel/orca_dpo_pairs dataset. 

This model has capabilities in coding, math, science, roleplay, and function calling. 

This model was trained on OpenAI's ChatML prompt format.
# Evaluation
AGIEval:
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6437292ecd93f4c9a34b0d47/eQXYDTQYMaVii-_U0vewF.png)

GPT4ALL:
|    Tasks    |Version|Filter|n-shot| Metric |Value |   |Stderr|
|-------------|------:|------|-----:|--------|-----:|---|-----:|
|arc_challenge|      1|none  |     0|acc     |0.3208|±  |0.0136|
|             |       |none  |     0|acc_norm|0.3336|±  |0.0138|
|arc_easy     |      1|none  |     0|acc     |0.6035|±  |0.0100|
|             |       |none  |     0|acc_norm|0.5833|±  |0.0101|
|boolq        |      2|none  |     0|acc     |0.6526|±  |0.0083|
|hellaswag    |      1|none  |     0|acc     |0.4556|±  |0.0050|
|             |       |none  |     0|acc_norm|0.6076|±  |0.0049|
|openbookqa   |      1|none  |     0|acc     |0.2600|±  |0.0196|
|             |       |none  |     0|acc_norm|0.3460|±  |0.0213|
|piqa         |      1|none  |     0|acc     |0.7236|±  |0.0104|
|             |       |none  |     0|acc_norm|0.7307|±  |0.0104|
|winogrande   |      1|none  |     0|acc     |0.6062|±  |0.0137|


# Disclaimer

This model may have overfitted to the DPO training data, and may not perform well. 

# Contributions

Thanks to @aloobun and @Locutusque for their contributions to this model. 
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_M4-ai__NeuralReyna-Mini-1.8B-v0.2)

|             Metric              |Value|
|---------------------------------|----:|
|Avg.                             |44.85|
|AI2 Reasoning Challenge (25-Shot)|37.80|
|HellaSwag (10-Shot)              |60.51|
|MMLU (5-Shot)                    |45.04|
|TruthfulQA (0-shot)              |37.75|
|Winogrande (5-shot)              |60.93|
|GSM8k (5-shot)                   |27.07|