New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

test data #125

Open

Tomsentable opened this issue Sep 6, 2023 · 2 comments

Tomsentable commented

我想请问一下您，为什么测试数据除了问题会有一个api_list呢，作用是什么

Author

Tomsentable commented

我觉得是不是为了构建prompt的task_description？另外prompt中（下方图片后面）表示能够完成该任务的部分工具还是全部工具呢

Collaborator

pooruss commented

hi，测试时有两种不同的setting，一种是close-domain，如您所提供的第一张图中，query和api list绑定，模型只能在给定的api list中选择调用api完成query；在prompt中会拼入api list中所有api的具体信息

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment