Hello, I'm Teknium1 👋
I'm a Python Programmer, AI Enthusiast, and a Co-founder of NousResearch.
My work primarily involves AI and Data Engineering, contributing primarily by releasing open source Large Language Model (LLMs) and datasets.
🚀 My Work
💼 Nous Research
I've contributed significantly to the development of several opensource LLMs under Nous Research's huggingface organization.
Here are a couple of them:
- Nous-Hermes-Llama2-13b - A Hermes model built on llama 1 and llama 2.
- GPT4-x-Vicuna-13b - A Vicuna model built on GPT-4.
💼 CarperAI / StabilityAI
Have worked on researching, planning ablations, and cleaning/filtering the dataset for:
- Beluga/Free Willy 2 - Orca replication on 70b Llama-2
- Beluga/Free-Willy-1 - Orca replication on 65b Llama-1
Both are 10% Orca replications trained on Llama-1 and Llama-2 70B. Also working on domain expert knowledge and task distillation.
💼 Open Orca
Working with the Open Orca team on data cleaning, networking, ablations, and more:
Another Orca paper replication, and more
🚀 Personal Projects
On my personal huggingface, Teknium, I have released several models, including my work on Replit-3b Model:
- Replit-Instruct 3B - This model doubled the code performance of the LLM.
💻 Github Projects
I've been part of several intriguing projects on GitHub. Here are a few of them:
- GPTeacher - A collection of modular datasets generated by GPT-4, for training LLMs.
- RawTransform - A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.
- stanford_alpaca-replit - Modified Stanford-Alpaca Trainer for Training Replit's Code Model.
- alpaca-discord - A Simple Discord Bot for the Alpaca LLM.
- alpaca-roleplay-discordbot - An LLM discord bot that roleplays!
📫 Get in Touch
- Twitter: https://twitter.com/Teknium1
- Discord: Teknium