HPC-AI Tech

Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training

Optimizing Protein Structure Prediction Model Training and Inference on GPU Clusters

Examples of training models with hybrid parallelism using ColossalAI

Storing publicly available assets such as images, animations and texts

Scalable PaLM implementation of PyTorch

Performance benchmarking with ColossalAI

Sky Computing: Accelerating Geo-distributed Computing in Federated Learning