A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilizatio…

Development repository for the Triton language and compiler

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Efficient Training (including pre-training and fine-tuning) for Big Models

Example models using DeepSpeed

Microsoft Collective Communication Library

Bio-Computing Platform Featuring Large-Scale Representation Learning and Multi-Task Deep Learning “螺旋桨”生物计算工具集

Ongoing research training transformer models at scale

👑 Easy-to-use and powerful NLP library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Ques…

手把手带你实战 Huggingface Transformers 课程视频同步更新在B站与YouTube

Caffe: a fast open framework for deep learning.

Documentations for PaddlePaddle

PaddlePaddle Developer Community

PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)

The C++ Core Guidelines are a set of tried-and-true guidelines, rules, and best practices about coding in C++

深度学习经典、新论文逐段精读

A General-purpose Parallel and Heterogeneous Task Programming System

System for AI Education Resource.

tvm learn

为 Eijhout 教授的Introduction to HPC提供中文翻译、 PPT和Lab。

an implement of a memorypool