Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

418 Open 433 Closed
418 Open 433 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀
[BUG] GPT-J InferenceEngine Initialization Failure: RuntimeError bug
#1946 opened May 10, 2022 by joehoover
[BUG] ZeRO 1 and ZeRO 2 produces different losses bug
#1945 opened May 10, 2022 by szhengac
[BUG] Error on loading saved optimizer after training (zero-3) bug
#1940 opened May 6, 2022 by base-y
3
[BUG] bug
#1937 opened May 5, 2022 by hjkrt92
1
Can't run ZeRO on single GPU with windows11[BUG] bug
#1928 opened Apr 30, 2022 by Sagivfer
[BUG] No Model Parameters Specified with Latest Release bug
#1926 opened Apr 29, 2022 by jmwoloso
5
[BUG] Floating Point Exception (core dump) at launch_attn_softmax_v2<float> bug
#1925 opened Apr 29, 2022 by codertimo
1
3
[BUG] OpenMPI backend doesn't support custom mpi launch args bug
#1924 opened Apr 29, 2022 by flyhighzy
3
[BUG] Multi-Node Address in Use Error bug
#1923 opened Apr 28, 2022 by Sanger2000
11
[BUG] attention_mask is overwritten by dummy tensor at DeepSpeedSelfAttentionFunction bug
#1912 opened Apr 26, 2022 by codertimo
1
[BUG] pip install . bug
#1909 opened Apr 22, 2022 by gabrielhuang
5
[BUG] Autotuner is not launching experiments with correct hostfile setting bug
#1904 opened Apr 20, 2022 by grzywada
[REQUEST] torch equivalent api model.no_sync() enhancement
#1902 opened Apr 20, 2022 by tangzhy
5
[REQUEST] SSG GPU support enhancement
#1898 opened Apr 19, 2022 by LifeIsStrange
1
[BUG] bug
#1897 opened Apr 19, 2022 by maheshsp123
1
[BUG] DeepSpeed zero_to_fp32.py script ignores some layers while creating FP32 checkpoints from DS ZeRO checkpoints. bug
#1896 opened Apr 19, 2022 by rohitdwivedula
@tjruwase
[BUG] Zero3 Checkpointing doesn't include HF T5's token embeddings bug
#1893 opened Apr 15, 2022 by m3rlin45
1
[REQUEST] cpu offload needs a max cpu memory config + pointers to cgroups/cpu oom handlers enhancement
#1891 opened Apr 12, 2022 by stas00
Instructions for building the AIO op using libaio from conda enhancement
#1890 opened Apr 12, 2022 by stas00
[REQUEST] removing the requirement for all layers to always execute in sync enhancement
#1888 opened Apr 12, 2022 by stas00
Loading fp16 model checkpoints with MoE layers bug
#1876 opened Mar 31, 2022 by joeljang
@tjruwase
4
[Question] How to check if DeepSpeed is initialized
#1870 opened Mar 30, 2022 by gahdritz
[Question] How to parallelize XGLM for inference?
#1864 opened Mar 29, 2022 by z-bookworm
6
[QUESTION] How to do inference during deepspeed training
#1863 opened Mar 28, 2022 by skpig
How to calculate Transformer/Bert layer's activation memory?
#1861 opened Mar 26, 2022 by cailun01
ProTip! Follow long discussions with comments:>50.