We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
- paddlepaddle: - paddlepaddle-gpu: - paddlenlp:
llm/README.mnd python -m paddle.distributed.launch --gpus "0,1,2,3,4,5,6,7" ./predict/flask_server.py \ --model_name_or_path meta-llama/Llama-2-7b-chat \ --port 8010 \ --flask_port 8011 \ --dtype "float16" 这里建议 port 8011, flask_port 8010,不然按这个 request_flask_server.py 直接跑会报错容易误解
The text was updated successfully, but these errors were encountered:
ZHUI
No branches or pull requests
软件环境
详细描述
The text was updated successfully, but these errors were encountered: