---
title: tigerbot-70b-chat-v4
canonical_url: "https://www.modelscope.cn/models/TigerResearch/tigerbot-70b-chat-v4"
md_url: "https://www.modelscope.cn/models/TigerResearch/tigerbot-70b-chat-v4.md"
repository: TigerResearch/tigerbot-70b-chat-v4
last_updated: 2024-02-18
license: "Apache License 2.0"
pipeline_tag: text-generation
tasks:
  - text-generation
model_type:
  - llama
architectures:
  - LlamaForCausalLM
library_name:
  - pytorch
frameworks:
  - Pytorch
inference_backends:
  - "deploy_task text/emb"
  - "lmdeploy 0.9.1"
  - "lmdeploy_turbomind 0.9.1"
  - "sglang 0.5.2"
  - "vllm 0.9.2"
downloads: 184
stars: 0
---

# tigerbot-70b-chat-v4

> tigerbot-70b-chat-v4 - TigerResearch 在 ModelScope 开源的模型。A cutting-edge foundation for your very own LLM. 💻 Github • 🌐 TigerBot • 🤗 Hugging Face

TigerResearch/tigerbot-70b-chat-v4 是 ModelScope 魔搭社区上的text-generation模型，采用 Apache License 2.0 许可，可用 deploy_task text/emb、lmdeploy 0.9.1、lmdeploy_turbomind 0.9.1 部署。

- **Repository**: TigerResearch/tigerbot-70b-chat-v4
- **License**: Apache License 2.0
- **Tasks**: text-generation
- **Inference backends**: deploy_task text/emb, lmdeploy 0.9.1, lmdeploy_turbomind 0.9.1, sglang 0.5.2, vllm 0.9.2
- **Downloads**: 184
- **Stars**: 0
- **Last updated**: 2024-02-18

Source: https://www.modelscope.cn/models/TigerResearch/tigerbot-70b-chat-v4

---

<div style="width: 100%;">
    <p align="center" width="20%">
      <img src="http://x-pai.algolet.com/bot/img/logo_core.png" alt="TigerBot" width="20%", style="display: block; margin: auto;"></img>
    </p>
</div>
<p align="center">
<font face="黑体" size=5"> A cutting-edge foundation for your very own LLM. </font>
</p>
<p align="center">
	💻<a href="https://github.com/TigerResearch/TigerBot" target="_blank">Github</a> • 🌐 <a href="https://tigerbot.com/" target="_blank">TigerBot</a> • 🤗 <a href="https://huggingface.co/TigerResearch" target="_blank">Hugging Face</a>
</p>

# 快速开始

- 方法1，通过transformers使用

  - 下载 TigerBot Repo

     ```shell
     git clone https://github.com/TigerResearch/TigerBot.git
     ```

  - 启动infer代码

    ```shell
    python infer.py --model_path TigerResearch/tigerbot-70b-chat-v4
    ```

- 方法2:

  - 下载 TigerBot Repo
    
     ```shell
    git clone https://github.com/TigerResearch/TigerBot.git
    ```

  - 安装git lfs： `git lfs install`

  - 通过huggingface或modelscope平台下载权重
    ```shell
    git clone https://huggingface.co/TigerResearch/tigerbot-70b-chat-v4
    git clone https://www.modelscope.cn/TigerResearch/tigerbot-70b-chat-v4.git
    ```
    
  - 启动infer代码
    
    ```shell
    python infer.py --model_path tigerbot-70b-chat-v4
    ```

------

# Quick Start

- Method 1, use through transformers

  - Clone TigerBot Repo

     ```shell
     git clone https://github.com/TigerResearch/TigerBot.git
     ```

  - Run infer script

    ```shell
    python infer.py --model_path TigerResearch/tigerbot-70b-chat-v4
    ```

- Method 2:

  - Clone TigerBot Repo

    ```shell
    git clone https://github.com/TigerResearch/TigerBot.git
    ```

  - install git lfs： `git lfs install`

  - Download weights from huggingface or modelscope
    ```shell
    git clone https://huggingface.co/TigerResearch/tigerbot-70b-chat-v4
    git clone https://www.modelscope.cn/TigerResearch/tigerbot-70b-chat-v4.git
    ```
  
  - Run infer script
  
     ```shell
     python infer.py --model_path tigerbot-70b-chat-v4
     ```