Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
kkahatapitiya committed Mar 22, 2024
1 parent d0cc8d8 commit ec7e323
Showing 1 changed file with 13 additions and 12 deletions.
25 changes: 13 additions & 12 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Language Repository (LangRepo)
# Language Repository

This is official implementation for paper: [Language Repository for Long Video Understanding]().
This is a [WIP] implementation for the paper, [Language Repository for Long Video Understanding](https://arxiv.org/abs/2403.14622).

## **Installation**

Expand Down Expand Up @@ -31,7 +31,7 @@ Download [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-

## EgoSchema

### Create repo
**Create repository.**

```bash
python main_repo.py \
Expand All @@ -52,7 +52,7 @@ python main_repo.py \
--read_scales [-1]
```

### Log-likelihood eval
**Answer multiple-choice questions.**

```bash
python main_ll_eval.py \
Expand All @@ -67,7 +67,7 @@ python main_ll_eval.py \

## NExT-QA

### Create repo
**Create repository.**

```bash
python main_repo.py \
Expand All @@ -91,7 +91,7 @@ python main_repo.py \
--read_scales [-2,-1]
```

### Log-likelihood eval
**Answer multiple-choice questions.**

```bash
python main_ll_eval.py \
Expand All @@ -108,7 +108,7 @@ python main_ll_eval.py \

## IntentQA

### Create repo
**Create repository.**

```bash
python main_repo.py \
Expand All @@ -132,7 +132,7 @@ python main_repo.py \
--read_scales [-1]
```

### Log-likelihood eval
**Answer multiple-choice questions.**

```bash
python main_ll_eval.py \
Expand All @@ -149,7 +149,7 @@ python main_ll_eval.py \

## NExT-GQA

### Create repo
**Create repository.**

```bash
python main_repo.py \
Expand All @@ -173,7 +173,7 @@ python main_repo.py \
--read_scales [-3,-2,-1]
```

### Log-likelihood eval
**Answer multiple-choice questions.**

```bash
python main_ll_eval.py \
Expand All @@ -188,7 +188,7 @@ python main_ll_eval.py \
--prompt_type qa_ll_mistral_nextqa
```

### Grounding
**Ground answers in time.**

```bash
python main.py \
Expand All @@ -215,11 +215,12 @@ If you find this useful, please consider citing our work:
title={Language Repository for Long Video Understanding},
author={Kahatapitiya, Kumara and Ranasinghe, Kanchana and Park, Jongwoo and Ryoo, Michael S},
year={2024},
eprint={2403.14622},
archivePrefix={arXiv},
primaryClass={cs.CV}
}
```

## Acknowledgement

This implementation is based on [LLoVi](https://github.com/CeeZh/LLoVi) and [tomesd](https://github.com/dbolya/tomesd). I would like to thank the original authors for their inspiring work and open-source implementations.
This implementation is based on [LLoVi](https://github.com/CeeZh/LLoVi) and [tomesd](https://github.com/dbolya/tomesd). I would like to thank the original authors for their inspiring work and open-source implementations.

0 comments on commit ec7e323

Please sign in to comment.