---
title: RWKV-v4-world-7B-one-state-65k
canonical_url: "https://www.modelscope.cn/models/AI-ModelScope/RWKV-v4-world-7B-one-state-65k"
md_url: "https://www.modelscope.cn/models/AI-ModelScope/RWKV-v4-world-7B-one-state-65k.md"
repository: AI-ModelScope/RWKV-v4-world-7B-one-state-65k
last_updated: 2023-10-28
license: apache-2.0
pipeline_tag: text-generation
tasks:
  - text-generation
library_name:
  - pytorch
frameworks:
  - Pytorch
downloads: 38
stars: 0
---

# RWKV-v4-world-7B-one-state-65k

> RWKV-v4-world-7B-one-state-65k - AI-ModelScope 在 ModelScope 开源的模型。RWKV v4 world 7B 65k context

AI-ModelScope/RWKV-v4-world-7B-one-state-65k 是 ModelScope 魔搭社区上的text-generation模型，采用 apache-2.0 许可。

- **Repository**: AI-ModelScope/RWKV-v4-world-7B-one-state-65k
- **License**: apache-2.0
- **Tasks**: text-generation
- **Downloads**: 38
- **Stars**: 0
- **Last updated**: 2023-10-28

Source: https://www.modelscope.cn/models/AI-ModelScope/RWKV-v4-world-7B-one-state-65k

---

# RWKV v4 world 7B 65k context

This is the model to replace the old rwkv 65k claude model, with special token and lower learning rate to maintain model former abilities.
and trained a lots of English high quality textbooks and chinese novels with 65k context length.

using it with rwkv runner only need 16G vram.(https://github.com/josStorer/RWKV-Runner)

## contributor

[@KevinMr](https://huggingface.co/KevinMr)
[@Remixa](https://huggingface.co/Remixa)

## trainning details
https://wandb.ai/one-/one-rwkv-64k/runs/jn05hyc4

![image/png](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/mpq2VrOaMZ_nXvV_yL-6o.png)



## Testcase
https://rwkv-next-web.ai-creator.net/ (temporary)

https://rwkv.ai-creator.net/risu



## how to use
use vocabs files in runner config

![image/png](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/9V3J6uxaJESCC7WhIOD7p.png)