Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

23 Open 37 Closed
23 Open 37 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀
[RFC] Provide Communication Profiler as a Context Manager enhancement
#326 opened Mar 8, 2022 by FrankLeeeee
2
Need an integrated configuration tutorial for users to customize their applications
#314 opened Mar 4, 2022 by kurisusnowdeng
[RFC] Activation CPU Offloading
#262 opened Feb 25, 2022 by feifeibear
[RFC] A tracer to monitor the memory usage during training help wanted
#261 opened Feb 25, 2022 by feifeibear
@xcetos
Add GPT benchmark code of DeepSpeed and FairScale
#260 opened Feb 25, 2022 by feifeibear
Enhance fp16 compatibility with SyncBN enhancement
#258 opened Feb 24, 2022 by FrankLeeeee
1
2
Do we have activation CPU offloading? enhancement
#257 opened Feb 24, 2022 by feifeibear
@feifeibear @Gy-Lu
2
Any checkpoint saving/loading tutorial provided? documentation
#256 opened Feb 24, 2022 by kurisusnowdeng
@FrankLeeeee
2
Need more runtime hooks during a training step enhancement
#250 opened Feb 23, 2022 by kurisusnowdeng
5
ZeRO compatibility with gradient accumulation bug
#247 opened Feb 20, 2022 by FrankLeeeee
@FrankLeeeee
Need experiment results to show superiority documentation
#238 opened Feb 16, 2022 by binmakeswell
1
API on collective operations
#237 opened Feb 16, 2022 by ExtremeViscent
2
Need a finetuning example enhancement
#236 opened Feb 15, 2022 by binmakeswell
1
Requirements for README and Documentation in Chinese documentation
#234 opened Feb 15, 2022 by binmakeswell
@binmakeswell
2
Lack of quick demo link about hybrid parallel in Documentation documentation
#225 opened Feb 14, 2022 by binmakeswell
1
Masking is missing in triangle masked softmax kernel bug
#208 opened Feb 8, 2022 by kurisusnowdeng
How to define a model with only one layer? stale
#155 opened Jan 18, 2022 by Arsmart123
2
[Discussion] About 3D Parallelism stale
#131 opened Jan 7, 2022 by feifeibear
5
The performance of model parallelism (MP) is not good stale
#124 opened Jan 6, 2022 by feifeibear
5
Compatabilities to various batch formats[FEATURE] enhancement stale
#120 opened Jan 5, 2022 by ExtremeViscent
2
[BUG] The project is not compatible with torch v1.8.1 bug stale
#107 opened Jan 4, 2022 by feifeibear
1
4
[BUG] initialize context failed using pytorch 1.10 bug stale
#105 opened Jan 4, 2022 by feifeibear
3
LAMB is not suited for tensor parallel bug stale
#22 opened Nov 12, 2021 by FrankLeeeee
3
ProTip! Adding no:label will show everything without a label.