jon-tow
Follow
Pinned
726 contributions in the last year
Contribution activity
April 2023
Created 10 commits in 3 repositories
Created 2 repositories
- jon-tow/tinypar Python
- jon-tow/cc_net Python
Created a pull request in CarperAI/trlx that received 4 comments
fix(CI): use pinned deps for CI testing
Use the pinned dependencies in requirements.txt for unit testing in CI re discussion in the recent trlx meeting.
+6
−1
•
4
comments
Opened 2 other pull requests in 2 repositories
Stability-AI/StableLM
1
merged
CarperAI/trlx
1
merged
Reviewed 10 pull requests in 2 repositories
CarperAI/trlx
9 pull requests
-
fix(base_trainer): gather weights in
save_pretrainedunder zero3 -
fix(sft_trainer):
total_stepscalculation when running distributed - [fix] update pairwise dataloader.
- [feat] Support tying metadata to each prompt
- fix(CI): use pinned deps for CI testing
- Convert tensors in the stats dict into scalars
- Set pad_token for all tokenizers in tests
- Add Supervised Fine-Tuning (SFT) support for NeMo backend
- Add Translation Finetuning Example with T5
CarperAI/tclx
1 pull request
Created an issue in CarperAI/trlx that received 1 comment
Migrate to peft from opendelta for parameter efficient tuning methods
peft.
Tasks
Doing so will require the following updates:
Replace the opendelta setup in the A…
1
comment
39
contributions
in private repositories
Apr 4 – Apr 20