[go: nahoru, domu]
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

大模型运行推理的时候，请求日志，打印重复 #4690

Open
1 task done
caijx168 opened this issue Jul 5, 2024 · 0 comments
Open
1 task done

大模型运行推理的时候，请求日志，打印重复 #4690

caijx168 opened this issue Jul 5, 2024 · 0 comments
Labels
pending This problem is yet to be addressed

Comments

@caijx168
Copy link
caijx168 commented Jul 5, 2024

Reminder

  • I have read the README and searched the existing issues.

System Info

1

Reproduction

CUDA_VISIBLE_DEVICES=0 API_PORT=8002 nohup python src/api.py
--model_name_or_path /home/Arcee-Spark-GPTQ-Int8
--template qwen
--infer_backend vllm
--vllm_maxlen 8000
--vllm_enforce_eager &
使用这个命令运行大模型，为啥日志输出的会一直重复一次如下
image
看源码只有一个地方有打印日志，不知道到为什么会重复？
image

Expected behavior

1

Others

帮助我解决问题
@github-actions github-actions bot added the pending This problem is yet to be addressed label Jul 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
pending This problem is yet to be addressed
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@caijx168