Highlights
- Arctic Code Vault Contributor
- Pro
Create your own GitHub profile
Sign up for your own profile on GitHub, the best place to host code, manage projects, and build software alongside 50 million developers.
Sign up
Popular repositories
-
-
Forked from netty/netty
Netty project - an event-driven asynchronous network application framework
Java
-
-
Forked from chef-boneyard/chef-repo
A blank Chef repository - use as a base to build your own
Ruby 1
-
Forked from SWIMProjectUCB/SWIM
Statistical Workload Injector for MapReduce - Project at UC Berkeley AMP Lab
Java
-
978 contributions in the last year
Contribution activity
September 2020
- jeffra/triton C++
- Reyazda/support different intermediate size
- Revert "supporting different intermediate sizes other than 4 * hidden_dim"
- guard 1bit adam reqs and update cond build for cpu-adam
- Landing page updates
- fix zero-offload test with 16GB v100 nodes
- ZeRO-Offload release
- Update 404.html
- Fix zero-2 pre-divide issue
- ZeRO-Offload (squash)
- updated launcher to support pdsh and openmpi
- Fix datatype issue with Sparse Attention softmax
- Import path fixes + conditional imports
- 1bit adam
- 1-bit Adam v1 (squash)
- ZeRO-Offload v1 (squash)
- Sparse attn + ops/runtime refactor + v0.3.0
- Sparse attention + refactor + v0.3.0
- readthedocs upgrade
- Update ZeRO-Offload blog post link
- Website edits
- Minjiaz/zero offload
- Sparse attention: updating code tag in documentation
- Pipeline parallel training engine.
- Update documentation for 1-bit Adam
- Fixing a link issue with SA tutorial
- Add 1-bit Adam support to DeepSpeed
- support avx2 by default
- Adding sparse attention to feature index page
- fix cpu adam compilation for AVX2
- 1-bit adam
- Update Sparse Attention Tutorial
- Move code quality tests to Azure-hosted agents.
- fixed a typo; this was fixed before but seems like it has been lost in the refactor
- Generalize detection of ZeRO supported optimizers
- Adding link to Sparse Attention in Navigation page
- Assert ZeRO-Offload incompatible with gradient accumulation
- Add ZeRO-Offload checkpointing model tests
- Improved testing matrix.
- Enable ZeRO checkpointing for ZeRO-Offload
30
contributions
in private repositories
Sep 1 – Sep 10