SJTU-IPADS / PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
See what the GitHub community is most excited about today.
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
Simple, minimal implementation of the Mamba SSM in one file of PyTorch.
Dev tool that writes scalable apps from scratch while the developer oversees the implementation
A collective list of free APIs
🌟 The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo
Specify what you want it to build, the AI asks for clarification, and then builds it.
一个带web界面的声音克隆工具,使用?的音色或任意声音来录制音频
Get up and running with Llama 2 and other large language models locally
Master the command line, in one page
Adds AMD FSR3 Frame Generation to games by replacing Nvidia DLSS-G Frame Generation (nvngx_dlssg).
Learn how to design systems at scale and prepare for system design interviews
Deliver web apps with confidence 🚀
Revolutionizing Database Interactions with Private LLM Technology
Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.
ComfyUI related stuff and things
An open-source cross-platform alternative to AirDrop
科技爱好者周刊,每周五发布
🚂 🦀 The one-person framework for Rust for side-projects and startups
Database-backed Active Job backend
🎓 Path to a free self-taught education in Computer Science!
Reflective x64 PE/DLL Loader implemented using Dynamic Indirect Syscalls
Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
This repository contains a simple vulnerability scanner for the Terrapin attack present in the paper "Terrapin Attack: Breaking SSH Channel Integrity By Sequence Number Manipulation".
Official implementations for paper: Anydoor: zero-shot object-level image customization
A collection of Solana programs maintained by Solana Labs