--- title: FrViDoc2Bot canonical_url: "https://www.modelscope.cn/datasets/DAMO_ConvAI/FrViDoc2Bot" md_url: "https://www.modelscope.cn/datasets/DAMO_ConvAI/FrViDoc2Bot.md" repository: DAMO_ConvAI/FrViDoc2Bot chinese_name: "French and Vietnamese document-grounded dialogue data set (法语及越南语对话数据集)" last_updated: 2024-09-02 license: "Apache License 2.0" storage_size: "12 MB" domain: - configs - text tasks: - "{config_name=FrViDoc2Bot, data_files=[{path=train_frvi.csv, split=train}]}" - conversational size_scale: - 100-10k type: - kg-qa downloads: 2599 stars: 3 --- # FrViDoc2Bot > FrViDoc2Bot - DAMO_ConvAI 在 ModelScope 开源的数据集。French and Vietnamese document-grounded dialogue data set (法语及越南语对话数据集) DAMO_ConvAI/FrViDoc2Bot 是 ModelScope 魔搭社区上的{config_name=FrViDoc2Bot, data_files=[{path=train_frvi.csv, split=train}]}、conversational数据集，涉及 configs、text 领域，存储大小 12 MB，采用 Apache License 2.0 许可。 - **Repository**: DAMO_ConvAI/FrViDoc2Bot - **License**: Apache License 2.0 - **Tasks**: {config_name=FrViDoc2Bot, data_files=[{path=train_frvi.csv, split=train}]}, conversational - **Domain**: configs, text - **Storage size**: 12 MB - **Downloads**: 2599 - **Stars**: 3 - **Last updated**: 2024-09-02 Source: https://www.modelscope.cn/datasets/DAMO_ConvAI/FrViDoc2Bot --- # Documen-grounded dialogue Goal-oriented document-grounded dialogue systems enable end users to interactively query about domain-specific information based on the given documents. The tasks of querying document knowledge via conversational systems continue to attract a lot of attention from both research and industrial communities for various applications. The previous works addressed the task of English and Chinese document-grounded dialogue systems, leaving other languages less well explored. Thus, large communities of users are prevented access to automated services and information. We aim to extend the effort by introducing the Third ACL DialDoc Workshop shared task involving documents and dialogues in diverse languages. For the first time, we provide training and evaluation data for document-grounded dialogue in Vietnamese and French, and organize the currently available Chinese and English document-grounded dialogue data. We hope that participants can leverage the linguistic similarities, for example, a large number of Vietnamese words are derived from Chinese, and English and French both belong to the Indo-European language family, to improve their models' performance in Vietnamese and French. ### Description **This Project contains our annotated Vietnamese and French document-grounded dialogue training data, the development data that the participants are required to provide the model predicts, as well as the passage corpus that the training and development data depend on.** ### Dataset Format Each piece of data in the [training set](https://modelscope.cn/api/v1/datasets/DAMO_ConvAI/FrViDoc2Bot/repo?Revision=master&FilePath=train_frvi.csv) contains three attributes: query, passages, and response. The query is a concatenation of the conversation history in reverse order, with the last turn marked as "", and the rest marked with "" for user input and "" for system output. For example： ' Quelle est la situation dans laquelle l'établissement scolaire se trouve en tant que juge et partie ? déclaration d’accident scolaire » et destiné au recteur d’académie dont il dépend. Quel est le rapport que le médecin scolaire doit rédiger après un accident scolaire? Les assurances « individuelle accident » ont souvent plusieurs niveaux de garantie. Quelle est la caractéristique des assurances "individuelle accident"?' The 'passages' attribute contains the passage arranged according to reply dependencies, followed by a reverse-ordered chain of titles concatenated with "//" as the delimiter. Example: 'En effet, dans ce cas, l’établissement scolaire est à la fois juge (rédacteur du rapport d’accident) et partie ! // Responsabilité[modifier | modifier le code] // En cas d'accident[modifier | modifier le code] // Assurance scolaire — Wikipédia // fr-Insurance' The response attribute is the desired output, beginning with "". Here's an example: ' En effet, dans ce cas, l’établissement scolaire est à la fois juge (rédacteur du rapport d’accident) et partie !' We have provided the [passage corpus](https://modelscope.cn/api/v1/datasets/DAMO_ConvAI/FrViDoc2Bot/repo?Revision=master&FilePath=passages.csv) that all dialogues in the training, validation, and test sets rely on in passages.csv. The [dev.json](https://modelscope.cn/api/v1/datasets/DAMO_ConvAI/FrViDoc2Bot/repo?Revision=master&FilePath=dev.json) file contains the development data that participants need to provide model predictions for. We have also provided a baseline model for the competition on [Github](https://github.com/AlibabaResearch/DAMO-ConvAI/acl23doc2dial). ### Loading Method In addition to directly downloading by clicking the hyperlink above, we also offer a method to load the training data from ModelScope. ```python from modelscope.msdatasets import MsDataset from modelscope.utils.constant import DownloadMode dataset = MsDataset.load( 'DAMO_ConvAI/FrViDoc2Bot', download_mode=DownloadMode.FORCE_REDOWNLOAD) print(dataset[0]) # {'query': ' Quelle est la situation dans laquelle l\'établissement scolaire se trouve en tant que juge et partie ? déclaration d’accident scolaire » et destiné au recteur d’académie dont il dépend. Quel est le rapport que le médecin scolaire doit rédiger après un accident scolaire? Les assurances « individuelle accident » ont souvent plusieurs niveaux de garantie. Quelle est la caractéristique des assurances "individuelle accident"?', 'passages': "En effet, dans ce cas, l’établissement scolaire est à la fois juge (rédacteur du rapport d’accident) et partie\xa0! // Responsabilité[modifier | modifier le code] // En cas d'accident[modifier | modifier le code] // Assurance scolaire — Wikipédia // fr-Insurance", 'response': ' En effet, dans ce cas, l’établissement scolaire est à la fois juge (rédacteur du rapport d’accident) et partie !'} ```