Commit63ebb6a

committed

update tool learning dataset download in readme

1 parentadce2b1 commit63ebb6aCopy full SHA for 63ebb6a

File tree

-1

lines changed

-1

lines changed

Lines changed: 6 additions & 0 deletions

Original file line number	Diff line number	Diff line change
`@@ -174,6 +174,12 @@ Below are zero-shot and five-shot accuracies from the models that we evaluate in`
`174`	`174`	`print(dataset['val'][0])`
`175`	`175`	# {"id": 1, "question": "单元测试应该覆盖以下哪些方面？", "A": "正常路径", "B": "异常路径", "C": "边界值条件"，"D": 所有以上，"answer": "D", "explanation": ""} ```
`176`	`176`
	`177`	`+* Method3: Directly load the datase t using [ModelScope datasets](https://modelscope.cn/datasets/codefuse-ai/devopseval-exam/files):`
	`178`	+```python
	`179`	`+from modelscope.msdatasetsimport MsDataset`
	`180`	`+ MsDataset.clone_meta(dataset_work_dir='./xxx',dataset_id='codefuse-ai/devopseval-exam')`
	`181`	+```
	`182`	`+`
`177`	`183`	`####👀 Notes`
`178`	`184`	`To facilitate usage, we have organized the category name handlers and English/Chinese names corresponding to 55 subcategories. Please refer to[category_mapping.json](resources/categroy_mapping.json) for details. The format is:`
`179`	`185`

Lines changed: 2 additions & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -177,7 +177,8 @@ DevOps-Eval是一个专门为DevOps领域大模型设计的综合评估数据集`
`177`	`177`	`* 方法三：使用modelscope下载相关所有数据。示例如下：`
`178`	`178`	```python
`179`	`179`	`from modelscope.msdatasetsimport MsDataset`
`180`		- MsDataset.clone_meta(dataset_work_dir='./xxx',dataset_id='codefuse-ai/devopseval-exam')```
	`180`	`+ MsDataset.clone_meta(dataset_work_dir='./xxx',dataset_id='codefuse-ai/devopseval-exam')`
	`181`	+```
`181`	`182`
`182`	`183`	`####👀 说明`
`183`	`184`	`为了方便使用，我们已经整理出了 55 个细分类别以及它们的中英文名称。具体细节请查看[category_mapping.json](resources/categroy_mapping.json) 。格式如下：`

Comments

(0)