-
Notifications
You must be signed in to change notification settings - Fork 3.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Creating the experiment folder and adding initial analysis of Devin's evaluation outputs #50
Conversation
Should we always include |
@yufansong That makes sense, I just removed this file. I think in general we could allow some important and relatively small files. For other data files, I agree it would be better to keep them somewhere else and have people pull the data locally. |
Agree.
If we have many large experiements file, public google drive maybe a good choice. Welcome any other ideas. |
LGTM. I just updated the folder naming and logistics. |
… evaluation outputs (All-Hands-AI#50) * Creating the folder for experiments, adding initial analysis of Devin's outputs on SWE-bench * typo fixed * update devin's evaluation outputs analysis * remove data files from commit * add logistics for managing the experiment folder in README * Change folder naming and update logistics. --------- Co-authored-by: Bowen Li <libowen.ne@gmail.com>
No description provided.