[go: nahoru, domu]
Skip to content

Pull requests: NVIDIA/Megatron-LM

New pull request New
130 Open 184 Closed
130 Open 184 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

modify typo in megatron/core/models/bert/bert_model.py
#888 opened Jun 24, 2024 by wplf Loading…
modify typo in bert_model.py
#887 opened Jun 24, 2024 by wplf Loading…
Rename the correct variable of seed
#886 opened Jun 23, 2024 by FancyXun Loading…
OPTIM get_batch traffic when enable context-parallel
#885 opened Jun 22, 2024 by Superkeyv Loading…
[BUG] Wrong lr multiplier
#882 opened Jun 21, 2024 by artyomtugaryov Loading…
Fix(memory optimization): inplace subtract vocab_parallel_logits
#863 opened Jun 13, 2024 by Andy666G Loading…
[BUG] wrong scale softmax for local transformer implement
#848 opened May 29, 2024 by Superkeyv Loading…
Fix the bug where the optimizer doesn't actually call multi_tensor_applier under float16.
#847 opened May 29, 2024 by Gstdioh Loading…
Fix Bug: Configuring Datasets with train-data-path, valid-data-path, test-data-path
#840 opened May 27, 2024 by Eisenhower Loading…
[Fix] Assertion to check if num_layers is divisible by the pipeline size
#823 opened May 13, 2024 by kenkenpa2126 Loading…
1
[bug] fix xavier uniform init for output layers
#814 opened May 8, 2024 by hjlee1371 Loading…
Support for Megatron-VLM training
#806 opened May 5, 2024 by 1049451037 Loading…
5
Add dataset packing
#802 opened May 2, 2024 by shamanez Loading…
fix finalize_model_grads when sp is on stale No activity in 60 days on issue or PR
#798 opened Apr 29, 2024 by zhaoyinglia Loading…
1
Speed up the creation of attention mask
#797 opened Apr 29, 2024 by yuantailing Loading…
1
Fix incorrect src argument in broadcast_params function stale No activity in 60 days on issue or PR
#796 opened Apr 26, 2024 by Yuxin-CV Loading…
1
fix loading distributed checkpoint when enable auto-detect-ckpt-format but disable use-dist-ckpt stale No activity in 60 days on issue or PR
#794 opened Apr 24, 2024 by imh966 Loading…
1
modifed the model parreleized gpt pre-trainign script stale No activity in 60 days on issue or PR
#789 opened Apr 22, 2024 by shamanez Loading…
1
forward step missing arg stale No activity in 60 days on issue or PR
#784 opened Apr 18, 2024 by malay-nagda Loading…
1
fix a mistake when check if num_layers dividable by vpp stale No activity in 60 days on issue or PR
#781 opened Apr 16, 2024 by constroy Loading…
1
Update pretrain_bert.py stale No activity in 60 days on issue or PR
#772 opened Apr 9, 2024 by ocryptocode Loading…
1
[very simple change] Remove duplicated code stale No activity in 60 days on issue or PR
#765 opened Apr 3, 2024 by NoelBird Loading…
2
fix new bucket when param require new bucket stale No activity in 60 days on issue or PR
#762 opened Apr 2, 2024 by wangxicoding Loading…
1
Updated fused_kernels import path stale No activity in 60 days on issue or PR
#760 opened Mar 31, 2024 by Yazeed7 Loading…
1
use new methods for communication stale No activity in 60 days on issue or PR
#758 opened Mar 30, 2024 by mayank31398 Loading…
1
ProTip! Follow long discussions with comments:>50.