---
title: nlp_mgimn_faq-question-answering_chinese-finance-base
canonical_url: "https://www.modelscope.cn/models/damo/nlp_mgimn_faq-question-answering_chinese-finance-base"
md_url: "https://www.modelscope.cn/models/damo/nlp_mgimn_faq-question-answering_chinese-finance-base.md"
repository: damo/nlp_mgimn_faq-question-answering_chinese-finance-base
chinese_name: "MGIMN FAQ问答-中文-金融领域-base"
last_updated: 2023-02-18
license: "Apache License 2.0"
pipeline_tag: faq-question-answering
tasks:
- faq-question-answering
- sentence-similarity
model_type:
- structbert
library_name:
- pytorch
frameworks:
- pytorch
language:
- cn
domain:
- nlp
downloads: 651
stars: 7
tags:
- MGIMN
- "arXiv:2204.04952"
---
# nlp_mgimn_faq-question-answering_chinese-finance-base
> nlp_mgimn_faq-question-answering_chinese-finance-base - damo 在 ModelScope 开源的模型。金融领域MGIMN FAQ问答模型以MGIMN FAQ问答-中文-通用领域-base模型为基础，在金融领域数据上微调得到，适用于金融领域FAQ问答任务，包括但不局限于：银行、保险等场景；MGIMN系列模型相对于StructBERT FAQ系列模型效果更优；
damo/nlp_mgimn_faq-question-answering_chinese-finance-base 是 ModelScope 魔搭社区上的faq-question-answering、sentence-similarity模型，采用 Apache License 2.0 许可。
- **Repository**: damo/nlp_mgimn_faq-question-answering_chinese-finance-base
- **License**: Apache License 2.0
- **Tasks**: faq-question-answering, sentence-similarity
- **Tags**: MGIMN, arXiv:2204.04952
- **Downloads**: 651
- **Stars**: 7
- **Last updated**: 2023-02-18
Source: https://www.modelscope.cn/models/damo/nlp_mgimn_faq-question-answering_chinese-finance-base
---
# FAQ问答任务介绍
FAQ问答是智能对话系统(特别是垂直领域对话系统)的核心业务场景，业务专家基于经验或数据挖掘的结果，将用户会频繁问到的业务知识以Q&A的形式维护起来，称之为知识库，
当用户使用对话系统时，提问一个业务方面的问题，机器自动从知识库中找到最合适的回答。机器找答案的过程通常包含**检索**和**排序**两个阶段;
本模型基于MGIMN FAQ问答-中文-通用领域-base模型在金融数据上进行finetune得到，适用于金融领域FAQ问答任务；包括但不局限于银行、保险等场景；
**[FAQ问答开发实践](https://developer.aliyun.com/article/1027733?spm=a2c6h.14164896.0.0.1c1d3483goazti)**
## 相关模型
- [StructBERT FAQ问答-中文-通用领域-base](https://www.modelscope.cn/models/damo/nlp_structbert_faq-question-answering_chinese-base/summary) 通用FAQ问答模型，适用于各个领域，效果和性能兼具，落地应用的最优选择；
- [StructBERT FAQ问答-中文-政务领域-base](https://www.modelscope.cn/models/damo/nlp_structbert_faq-question-answering_chinese-gov-base/summary) 基于StructBERT FAQ问答-中文-通用领域-base模型在政务数据上进行finetune得到，适用于政务领域FAQ问答任务，包括但不局限于社保、公积金等场景；
- [StructBERT FAQ问答-中文-金融领域-base](https://www.modelscope.cn/models/damo/nlp_structbert_faq-question-answering_chinese-finance-base/summary) 基于StructBERT FAQ问答-中文-通用领域-base模型在金融数据上进行finetune得到，适用于金融领域FAQ问答任务，包括但不局限于银行、保险等场景；
- [MGIMN FAQ问答-中文-通用领域-base](https://www.modelscope.cn/models/damo/nlp_mgimn_faq-question-answering_chinese-base/summary) 采用多粒度交互式小样本模型设计，相对StructBERT FAQ问答-中文-通用领域-base模型，效果更优，但推理速度会下降，方法参考论文：[NAACL2022](https://aclanthology.org/2022.naacl-main.141/)
- [MGIMN FAQ问答-中文-政务领域-base](https://www.modelscope.cn/models/damo/nlp_mgimn_faq-question-answering_chinese-gov-base/summary) 基于MGIMN FAQ问答-中文-通用领域-base模型在政务数据上进行finetune得到，适用于政务领域FAQ问答任务；包括但不局限于社保、公积金等场景；
- [MGIMN FAQ问答-中文-金融领域-base](https://www.modelscope.cn/models/damo/nlp_mgimn_faq-question-answering_chinese-finance-base/summary) 基于MGIMN FAQ问答-中文-通用领域-base模型在金融数据上进行finetune得到，适用于金融领域FAQ问答任务；包括但不局限于银行、保险等场景；
- [FAQ问答-多语言-通用领域-base](https://www.modelscope.cn/models/damo/nlp_faq-question-answering_multilingual-base/summary)，多语言FAQ模型，支持英、俄、西、法、阿、韩、葡、越南、泰语、印尼语、菲律宾语、马来语、粤语等多种语言；
## 模型描述
本模型以structbert-base-chinese预训练模型为底座，模型结构采用多粒度交互式匹配小样本模型结构（如下图所示），核心的模块主要有：Instance Matching Layer和Class-wise Aggregation Layer，
详细的模型结构设计请参考NAACL2022论文[MGIMN:Multi-Grained Interactive Matching Network for Few-shot Text Classification](https://aclanthology.org/2022.naacl-main.141/)，模型通过小样本meta-learning的训练方式，在海量数据上进行预训练(亿级)、微调(百万级)；适用于
FAQ问答任务和通用小样本分类任务；（说明：模型结构与论文中一致，但训练方式由于框架约束会略有差异）；
本模型基于MGIMN FAQ问答-中文-通用领域-base模型在金融数据上进行finetune得到，适用于金融领域FAQ问答任务；包括但不局限于银行、保险等场景；
## 期望模型使用方式及适用范围
### 如何使用
在安装完成ModelScope之后即可使用damo/nlp_mgimn_faq-question-answering_chinese-finance-base的的FAQ问答能力
#### 代码范例
```python
from modelscope.pipelines import pipeline
from modelscope.utils.constant import Tasks
# query_set: query
# support_set: faq候选列表，一般实际应用场景中通过检索得到
faq_pipeline = pipeline(Tasks.faq_question_answering, 'damo/nlp_mgimn_faq-question-answering_chinese-finance-base',model_revision='v1.0.1')
outputs = faq_pipeline({"query_set": ["如何理解附加险", "保额是什么", "什么是期初自留风险保额"],
"support_set": [{"text": "附加险是什么意思", "label": "1"},
{"text": "什么是附加险", "label": "1"},
{"text": "保险金额指什么", "label": "2"},
{"text": "保单上有保额是什么意思", "label": "2"},
{"text": "解释一下期初自留风险保额", "label": "3"},
{"text": "期初自留风险保额指什么", "label": "3"}]})
# outputs
# 输出每一个类的分值，并进行排序
#{'output': [[{'label': '1', 'score': 0.9998192191123962},
# {'label': '2', 'score': 1.2921004710619854e-08},
# {'label': '3', 'score': 4.0499856801545775e-09}],
# [{'label': '2', 'score': 0.99662184715271},
# {'label': '3', 'score': 3.922691576008219e-06},
# {'label': '1', 'score': 8.163622737811238e-07}],
# [{'label': '3', 'score': 0.9995924830436707},
# {'label': '2', 'score': 4.018017918383521e-08},
# {'label': '1', 'score': 5.991804274962931e-10}]]}
```
备注：我们不限定query_set 和 support_set大小，使用者需要基于基于显存大小以及对性能的要求输入合适大小的候选集；
```python
from modelscope.pipelines import pipeline
from modelscope.utils.constant import Tasks
# 获取句子向量表示，可用于构建向量索引；
faq_pipeline = pipeline(Tasks.faq_question_answering, 'damo/nlp_mgimn_faq-question-answering_chinese-finance-base',model_revision='v1.0.1')
sentence_vecs = faq_pipeline.get_sentence_embedding(["如何理解附加险", "保额是什么", "什么是期初自留风险保额"], max_len=30)
```
备注：同样，我们也不对输入进行大小限制，使用者需要基于显存大小输入合适大小的数据；
### 模型局限性及可能的偏差
虽然我们的数据尽量覆盖各行业，但仍有可能不适用于某些特定行业；
## 训练数据介绍
训练数据来源于业务数据
## 模型训练&Finetune
```python
import os
from modelscope.metainfo import Trainers
from modelscope.msdatasets import MsDataset
from modelscope.pipelines import pipeline
from modelscope.trainers import build_trainer
from modelscope.utils.config import Config
from modelscope.utils.hub import read_config
model_id = 'damo/nlp_mgimn_faq-question-answering_chinese-finance-base'
model_revision='v1.0.1'
tmp_dir='./work_dir'
# 我们仅以此数据作为示例，并不能作为faq任务的训练数据
train_dataset = MsDataset.load(
'jd', namespace='DAMO_NLP',
split='train').remap_columns({'sentence': 'text'})
# 用户可以加载自己的数据集，格式如下，训练数据少时会报错，尽量保证label数和每个label对应样本数不少于5；
#train_dataset = [{'text':'测试数据1','label':'label1'},{'text':'测试数据3','label':'label1'},
# {'text':'测试数据2','label':'label2'},{'text':'测试数据4','label':'label2'},.....]
eval_dataset = MsDataset.load(
'jd', namespace='DAMO_NLP',
split='validation').remap_columns({'sentence': 'text'})
cfg: Config = read_config(model_id,revision=model_revision)
cfg.train.train_iters_per_epoch = 50
cfg.evaluation.val_iters_per_epoch = 2
cfg.evaluation.metrics = 'accuracy'
cfg.train.seed = 1234
cfg.train.hooks = [{
'type': 'CheckpointHook',
'by_epoch': False,
'interval': 50
}, {
'type': 'EvaluationHook',
'by_epoch': False,
'interval': 50
}, {
'type': 'TextLoggerHook',
'by_epoch': False,
'rounding_digits': 5,
'interval': 10
}]
cfg_file = os.path.join(tmp_dir, 'config.json')
cfg.dump(cfg_file)
trainer = build_trainer(
Trainers.faq_question_answering_trainer,
default_args=dict(
model=model_id,
work_dir=tmp_dir,
train_dataset=train_dataset,
eval_dataset=eval_dataset,
cfg_file=cfg_file,
model_revision=model_revision))
trainer.train()
evaluate_result = trainer.evaluate()
print(evaluate_result)
```
## 数据评估及结果
由于公开的垂直领域FAQ数据较少，我们选择几个公开的意图分类数据进行数据评估，其中banking/OOS/clinic为中文翻译数据；
- 评测方式：划分训练集和测试集，对于测试集中的每一个query，从训练集中检索top10个类，每个类至多5条样本，基于检索出的样本数据对query进行分类
- 评测指标：ACC
（政务和金融领域模型待评测)
| Model | fewjoint | nlpccst4 | banking | clinic | OOS | Average |
| --- | --- | --- | --- | --- | --- | -- |
| SentenceTransformer(paraphrase-multilingual-mpnet-base-v2) | 79.1 | 81.9 | 75.7 | 86.1 | 66.1 | 77.8
| SentenceTransformer(paraphrase-multilingual-MiniLM-L12-v2) | 82.5 | 81.0 | 77.4 | 84.1 | 64.6 | 77.9
| StructBERT FAQ问答-中文-通用领域-base | 89.9 | 87.6 | 78.8 | 88.1 | 68.0 | 82.5
| MGIMN FAQ问答-中文-通用领域-base | 89.7 | 91.4 | 80.6 | 88.8 | 69.2 | 83.9
| **MGIMN FAQ问答-中文-金融领域-base(当前模型)** | - | - | - | - | - | -
```
@inproceedings{zhang-etal-2022-mgimn,
title = "{MGIMN}: Multi-Grained Interactive Matching Network for Few-shot Text Classification",
author = "Zhang, Jianhai and
Maimaiti, Mieradilijiang and
Xing, Gao and
Zheng, Yuanhang and
Zhang, Ji",
booktitle = "Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies",
year = "2022",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2022.naacl-main.141",
abstract = "Text classification struggles to generalize to unseen classes with very few labeled text instances per class.In such a few-shot learning (FSL) setting, metric-based meta-learning approaches have shown promising results. Previous studies mainly aim to derive a prototype representation for each class.However, they neglect that it is challenging-yet-unnecessary to construct a compact representation which expresses the entire meaning for each class.They also ignore the importance to capture the inter-dependency between query and the support set for few-shot text classification. To deal with these issues, we propose a meta-learning based method MGIMN which performs instance-wise comparison followed by aggregation to generate class-wise matching vectors instead of prototype learning.The key of instance-wise comparison is the interactive matching within the class-specific context and episode-specific context. Extensive experiments demonstrate that the proposed method significantly outperforms the existing SOTA approaches, under both the standard FSL and generalized FSL settings.",
}
```
