[go: nahoru, domu]
Skip to content

Issues: hiyouga/LLaMA-Factory

🚨FAQs | 常见问题🚨
#4614 opened Jun 28, 2024 by hiyouga
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
45 Open 4,067 Closed
45 Open 4,067 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Have we added VeRA (Vector Based Random Matrix Adaption) , it recently got published at ICLR 2024 pending This problem is yet to be addressed
#2238 opened Jan 18, 2024 by Akshay1-6180
[TODO] Update merging QLoRA workaround pending This problem is yet to be addressed
#2448 opened Feb 6, 2024 by hiyouga
Erroneous/high loss with DeepSpeed Zero3 and bf16 pending This problem is yet to be addressed
#2483 opened Feb 15, 2024 by mnmueller
1 task done
Feature Request: Support Representation Fine-Tuning (ReFT) pending This problem is yet to be addressed
#3183 opened Apr 8, 2024 by indiejoseph
1 task done
昇腾多卡训练问题 npu This problem is related to NPU devices pending This problem is yet to be addressed
#3810 opened May 19, 2024 by 1737686924
1 task done
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning enhancement New feature or request pending This problem is yet to be addressed
#3970 opened May 29, 2024 by backroom-coder
MODPO: Multi-Objective Direct Preference Optimization enhancement New feature or request pending This problem is yet to be addressed
#3973 opened May 30, 2024 by AlexYoung757
How to specify eval set during training process? pending This problem is yet to be addressed
#3974 opened May 30, 2024 by may012345
1 task done
用openai库 请求时，流式请求时缺stream_options={"include_usage": True}的处理，用于计算流式tokens pending This problem is yet to be addressed
#3998 opened May 30, 2024 by sasicDHH
1 task done
sft+freeze训练internlm2-base-7b报错，RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn npu This problem is related to NPU devices pending This problem is yet to be addressed
#4101 opened Jun 6, 2024 by 1737686924
1 task done
data.utils.split_dataset中的切分和随机逻辑能否迁移到data.loader.get_dataset中? pending This problem is yet to be addressed
#4140 opened Jun 7, 2024 by luoqishuai
1 task done
在npu上，对大模型用zero3进行全参微调，初始换参数很大，是什么原因造成的？ npu This problem is related to NPU devices pending This problem is yet to be addressed
#4272 opened Jun 14, 2024 by fjw1049
1 task done
可以支持英伟达的新模型Nemotron 340B吗? pending This problem is yet to be addressed
#4313 opened Jun 16, 2024 by laosuan
1 task done
Function tool calling inference without llama-factory openai style api. pending This problem is yet to be addressed
#4364 opened Jun 18, 2024 by svjack
1 task done
[Feature request] 支持Qwen-VL pending This problem is yet to be addressed
#4375 opened Jun 19, 2024 by marko1616
1
8卡A800全参数预训练GLM4-9B-base,使用bf16,loss在暴涨后突然消失 pending This problem is yet to be addressed
#4597 opened Jun 28, 2024 by lclcjj
1 task done
[PPU]大佬有对ppu环境进行过测试么 pending This problem is yet to be addressed
#4606 opened Jun 28, 2024 by willionZS
1 task done
🚨FAQs | 常见问题🚨 good first issue Good for newcomers
#4614 opened Jun 28, 2024 by hiyouga
关于对话模板作用以及其在lm-evaluation-harness仓库下对评测效果影响的问题 pending This problem is yet to be addressed
#4618 opened Jun 29, 2024 by marvelcell
1 task done
[Feature request / help] Evaluate on different dataset to training dataset pending This problem is yet to be addressed
#2290 opened Jan 22, 2024 by Peter-Devine
1 task done
1
推理阶段，预测文件中label显示不全问题 bug Something isn't working pending This problem is yet to be addressed
#3775 opened May 16, 2024 by jy-101361-1810897
1 task done
1
errors while in finetune intermlm2-chat-20b with qlora pending This problem is yet to be addressed
#3798 opened May 17, 2024 by a1exyu
1 task done
1
Feature suggestion: cutoff_len could optionally drop too long examples from dataset. pending This problem is yet to be addressed
#3995 opened May 30, 2024 by s4s0l
1
昇腾卡训练不支持offload npu This problem is related to NPU devices pending This problem is yet to be addressed
#4146 opened Jun 7, 2024 by wangbing35
1 task done
1
fsdp + DPO + fullyfintune会报错 bug Something isn't working pending This problem is yet to be addressed
#4608 opened Jun 28, 2024 by qy1026
1 task done
1
ProTip! Adding no:label will show everything without a label.