Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Some SWE-Bench infer fixes and improvements #2065

Merged
merged 18 commits into from
May 26, 2024
Merged

Some SWE-Bench infer fixes and improvements #2065

merged 18 commits into from
May 26, 2024

Conversation

xingyaoww
Copy link
Contributor

@xingyaoww xingyaoww commented May 26, 2024 •
edited
Loading

  • Bump version of swe-bench sandbox to 1.2 to support agentskill's dependencies
  • Fix the Python interpreter for Jupyter - otherwise it will interfere with SWE-Bench testing (each instance has a different python environment)
  • Make sure plugins are only initialized ONCE for swe_env_box
  • Fix issue of repeatly assigning workspace_base to config

li-boxuan
li-boxuan approved these changes May 26, 2024
View reviewed changes
evaluation/swe_bench/scripts/run_infer.sh Outdated Show resolved Hide resolved
@xingyaoww xingyaoww marked this pull request as ready for review May 26, 2024 09:52
@xingyaoww xingyaoww enabled auto-merge (squash) May 26, 2024 09:55
@xingyaoww xingyaoww merged commit 5114230 into main May 26, 2024
2 checks passed
@xingyaoww xingyaoww deleted the xw/reset-swe-bench-config-properly branch May 26, 2024 10:02
@xingyaoww xingyaoww mentioned this pull request Jul 5, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@li-boxuan li-boxuan li-boxuan approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@xingyaoww @li-boxuan