Skip to content

Issues: alibaba/Pai-Megatron-Patch

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

24 Open 111 Closed
24 Open 111 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

llama3.1 8b训练32k的上下文模型，训练时间长、并且loss偏大
#348 opened Sep 20, 2024 by ARQlalala
[[: not found Zarr-based strategies will not be registered because of missing packages Traceback (most recent call last)
#346 opened Sep 14, 2024 by aJupyter
1
有适配minicpm的打算吗？
#345 opened Sep 13, 2024 by adol001
建议对deepseek-v2-coder-lite进行sft测试
#342 opened Sep 12, 2024 by bao-xiaoyi
1
有适配qwen2-vl的打算吗？
#339 opened Sep 11, 2024 by divisionblur
DeepSeek Vocab-size Mismatch
#338 opened Sep 10, 2024 by Jiayi-Pan
1
AssertionError: First dimension of the tensor should be divisible by tensor parallel size
#332 opened Sep 4, 2024 by pizts
llava run error
#330 opened Aug 30, 2024 by yangzhipeng1108
2
deepseek模型转换问题
#327 opened Aug 25, 2024 by bao-xiaoyi
7
qwen2-sft 训练起步阶段就卡住
#325 opened Aug 22, 2024 by baisechundu
4
Channel Loss支持
#316 opened Aug 7, 2024 by echo-valor
1
optimizer offloading 太强了
#311 opened Aug 2, 2024 by 154912369
1
群满了
#310 opened Aug 2, 2024 by zgf1005
3
Flash-Attn 3的支持
#308 opened Aug 1, 2024 by echo-valor
1
是否支持sharegpt格式数据？或者带"history"字段的多轮对话数据？
#306 opened Jul 31, 2024 by jiejie1993
1
[rank31]: OSError: error stat()ing file 数据集map问题
#305 opened Jul 30, 2024 by shyzzz521
QwenTokenizer与Qwen2Tokenizer
#295 opened Jul 23, 2024 by sexan
3
[rank2]: AttributeError: 'IndexedDataset' object has no attribute 'sizes'
#293 opened Jul 22, 2024 by wccccp
1
qwen2 MG and HF mismatch
#289 opened Jul 16, 2024 by vlad-karpuhin
qwen-moe-megablocks权重转换问题
#282 opened Jul 10, 2024 by yingzhao27
1
qwen2模型切片为什么num_query_groups必须大于target_tensor_model_parallel_size
#279 opened Jun 27, 2024 by jianhai0527
qwen2-7b 开启 context parallel 后，logits中对应padding 的位置为 nan
#262 opened Jun 13, 2024 by WallE-Chang
hf2mcore_qwen1.5_dense_mha_to_moe.py 有个逻辑不太懂的地方
#261 opened Jun 13, 2024 by steins048596
关于二阶段训练的问题
#247 opened Jun 2, 2024 by jianhai0527
4
ProTip! Exclude everything labeled bug with -label:bug.