Open-Sora: Democratizing Efficient Video Production for All

Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions

[NeurIPS23 (Spotlight)] "Model Sparsity Can Simplify Machine Unlearning" by Jinghan Jia*, Jiancheng Liu*, Parikshit Ram, Yuguang Yao, Gaowen Liu, Yang Liu, Pranay Sharma, Sijia Liu

MACE - Fast and accurate machine learning interatomic potentials with higher order equivariant message passing.

You like pytorch? You like micrograd? You love tinygrad! ❤️

Implementation of Nougat Neural Optical Understanding for Academic Documents

What would you do with 1000 H100s...

open-source nanotech CAD

Fit interpretable models. Explain blackbox machine learning.

Must-read Papers on Knowledge Editing for Large Language Models.

commaVQ is a dataset of compressed driving video

Making a bridge between NLP models and Brain data

LLM inference in C/C++

AI Observability & Evaluation

A walkthrough of transformer architecture code

Official code and checkpoint release for "GNM: A General Navigation Model to Drive Any Robot".

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Custom…

Accessible large language models via k-bit quantization for PyTorch.

Creating a chess engine using GPT-3

APPS: Automated Programming Progress Standard (NeurIPS 2021)

Prompt programming with FMs.

Toolkit for creating, sharing and using natural language prompts.

Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"