A Python Interpreter written in Rust

An Optimized Speech-to-Text Pipeline for the Whisper Model Supporting Multiple Inference Engine

FlashInfer: Kernel Library for LLM Serving

A web tool to explore the ASTs generated by various parsers.

FastAPI framework, high performance, easy to learn, fast to code, ready for production

Solve puzzles. Learn CUDA.

A benchmark framework for LLM serving performance, based on API call

Fast and memory-efficient exact attention

dstack is an open-source alternative to Kubernetes, designed to simplify development, training, and deployment of AI across any cloud or on-prem. It supports NVIDIA, AMD, and TPU.

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.

A Decentralized Operating System for ZK Applications

Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"

Assembly code editor

A modular graph-based Retrieval-Augmented Generation (RAG) system

Python composable command line interface toolkit

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Retro groove color scheme for Vim

LLM101n: Let's build a Storyteller

Simplifying reinforcement learning for complex game environments

👩🏿‍💻👨🏾‍💻👩🏼‍💻👨🏽‍💻👩🏻‍💻 Awesome Developers, Streaming

Implementation for MatMul-free LM.

Projects for an undergraduate OS course

List of Computer Science courses with video lectures.

🌸 A command-line fuzzy finder

Examples for TLAPS (TLA+ Proof System)

Robust Speech Recognition via Large-Scale Weak Supervision

A deep-dive on the entire history of deep-learning