Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

✨✨Latest Advances on Multimodal Large Language Models

Python Library to evaluate VLM models' robustness across diverse benchmarks

Official release of InternLM2.5 base and chat models. 1M context support

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use th…

SEED-Story: Multimodal Long Story Generation with Large Language Model

next gen smart vlm reasoner

Continual Few-Shot Learning of New Actions With Prompt Tuning

Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"

The open-source tool for building high-quality datasets and computer vision models

🔥 [CVPR 2024] The official repo for Zero-Painter!

[CVPR 2024] Code release for "InstanceDiffusion: Instance-level Control for Image Generation"

OpenCOLE: Towards Reproducible Automatic Graphic Design Generation [Inoue+, CVPRW2024 (GDUG)]

Recent LLM-based CV and related works. Welcome to comment/contribute!

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

[CVPR24 Oral] Official repository for RALF: Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation

Go ahead and axolotl questions

Create Magic Story!

Multimodal language model benchmark, featuring challenging examples

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

Official Repo of Graphist

A Framework of Continual Learning

[CVPR 2024] AMUSE: Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion

Control Color: Multimodal Diffusion-based Interactive Image Colorization