---
title: readflow-rwkv-4-world-ctx32k
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/readflow-rwkv-4-world-ctx32k"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/readflow-rwkv-4-world-ctx32k.md"
repository: AI-ModelScope/readflow-rwkv-4-world-ctx32k
last_updated: 2023-10-28
license: apache-2.0
pipeline_tag: text-generation
tasks:
  - text-generation
library_name:
  - pytorch
frameworks:
  - Pytorch
downloads: 29
stars: 0
---

# readflow-rwkv-4-world-ctx32k

> readflow-rwkv-4-world-ctx32k - AI-ModelScope 在 ModelScope 开源的模型。This is full finetuned model from RWKV 4 world 7B CHNTuned model using data from Readflow tech (readflow.com.cn) ,

AI-ModelScope/readflow-rwkv-4-world-ctx32k 是 ModelScope 魔搭社区上的text-generation模型，采用 apache-2.0 许可。

- **Repository**: AI-ModelScope/readflow-rwkv-4-world-ctx32k
- **License**: apache-2.0
- **Tasks**: text-generation
- **Downloads**: 29
- **Stars**: 0
- **Last updated**: 2023-10-28

Source: https://www.modelscope.cn/models/AI-ModelScope/readflow-rwkv-4-world-ctx32k

---

This is full finetuned model from RWKV 4 world 7B CHNTuned model using data from Readflow tech (readflow.com.cn) ,

finetuned for  32k context length, used to summary news article 

using inf-ctx training https://github.com/SynthiaDL/TrainChatGalRWKV with fixed VRAM

you can test summary prompt using RWKV runner(https://github.com/josStorer/RWKV-Runner) in chat mode , and check conversation files in examples folders.

https://discord.gg/pWH5MkvtNR

![QQ图片20230721210758.jpg](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/NTa346CoQzH-k0civqG1Q.jpeg)

-------------------------------------------------------------------------------------------------


这是和会读Readflow合作的模型（ readflow.com.cn），用于超长微信文章的摘要，训练了32k的context长度，能一次性输入整篇文章进行摘要，如下图以及在example文件夹中的例子，

23k tokens一次性输入摘要，不增显存，如果有state状态，可以秒出，可以反复重试多种可能性，

“Assistant:"是模型输出内容


可以使用runner进行测试 https://github.com/josStorer/RWKV-Runner

RWKV world的token对中文以及各类语言效率很高，token和字比例，基本是1:1,甚至1:n，欢迎测试，并加入微调QQ群讨论439087067



![微信截图_20230720145202.png](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/3prZb97XOKeHhVQyYevA_.png)