Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

data 指引文件 #6027

Closed
1 task done
Beyond0831 opened this issue Nov 14, 2024 · 2 comments
Closed
1 task done

data 指引文件 #6027

Beyond0831 opened this issue Nov 14, 2024 · 2 comments
Labels
solved This problem has been already solved

Comments

@Beyond0831
Copy link

Reminder

  • I have read the README and searched the existing issues.

System Info

我想尝试用qwen2.5 instruct 进行微调,在介绍中看到instruct的模型要使用对应的template
image
我想请问 这里的template和 data_info 中的数据库格式有关联吗? 是代表data_info 和数据库也需要照着template进行设计吗?
还有就是想问下, sft 是不是必须要用问答对来进行训练, 预训练则是只能用不分类的文本训练,之前好像看到哪里说明过,但是找不到了,麻烦了

Reproduction

我想尝试用qwen2.5 instruct 进行微调,在介绍中看到instruct的模型要使用对应的template
image
我想请问 这里的template和 data_info 中的数据库格式有关联吗? 是代表data_info 和数据库也需要照着template进行设计吗?
还有就是想问下, sft 是不是必须要用问答对来进行训练, 预训练则是只能用不分类的文本训练,之前好像看到哪里说明过,但是找不到了,麻烦了

Expected behavior

No response

Others

No response

@github-actions github-actions bot added the pending This problem is yet to be addressed label Nov 14, 2024
@hiyouga
Copy link
Owner

hiyouga commented Nov 14, 2024

@hiyouga hiyouga closed this as completed Nov 14, 2024
@hiyouga hiyouga added solved This problem has been already solved and removed pending This problem is yet to be addressed labels Nov 14, 2024
@Beyond0831
Copy link
Author

https://github.com/hiyouga/LLaMA-Factory/tree/main/data
好的,还有想请问下template和 data_info 中的数据库格式有关联吗? 是代表data_info 和数据库也需要照着template进行设计吗?

@Beyond0831 Beyond0831 changed the title template 和 data_info.json 中数据格式的关系 data 指引文件 Nov 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
solved This problem has been already solved
Projects
None yet
Development

No branches or pull requests

2 participants