关于SWE-Bench-Pro复现的疑问
#51
by Clumsy1 - opened
Minimax Team 的朋友们好！
我根据discussion 17(https://huggingface.co/MiniMaxAI/MiniMax-M2.5/discussions/17)的回复的方法复现SWE-Bench Pro的分数，对user prompt略做改动：
{problem_statement}
{requirements}
{interface}
Can you help me implement the necessary changes to this repository so that the issue can be resolved?
---------
# INSTRUCTIONS
Follow these steps to resolve the issue:
1. As a first step, it might be a good idea to explore the repo to familiarize yourself with its structure.
2. Create a script to reproduce the error and execute it using the BashTool, to confirm the error
3. Edit the sourcecode of the repo to resolve the issue
4. Rerun your reproduce script and confirm that the error is fixed!
5. Think about edgecases and make sure your fix handles them as well
Your thinking should be thorough and so it's fine if it's very long.
You should use tools as much as possible, ideally more than 100 times. You should also implement your own tests first before attempting the problem.
I will export your changes and apply suitable test patches to verify if your fix is correct when you finish this task. This means you MUST NOT modify the testing logic or any of the tests in any way!
--------
**Workspace Path**: The repository is located at `{working_dir}`. All file operations should be performed relative to this directory.
但复现出来分数只有50%左右，排查后没有环境和api问题，是还有其他setting没对齐吗