SWE-PolyBench (full set sample): every task, with its verdict
SWE-PolyBench, published by Amazon Science. Paper authors: Muhammad Shihab Rashid, Christian Bock, Yuan Zhuang, Alexander Buchholz, Tim Esler, Simon Valentin, Luca Franceschi, Martin Wistuba, Prabhu Teja Sivaprasad, Woo Jung Kim, Anoop Deoras, Giovanni Zappella and Laurent Callot. SWE-PolyBench (arXiv) · This page covers a random 100-task sample of the 2,110 tasks (AmazonScience/SWE-PolyBench on Hugging Face). The sample is the 100 instance IDs with the lowest SHA-256 of "own1:swe-polybench:<instance_id>", so anyone can redraw it. · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.
| Task | Verdict | Issue title |
|---|---|---|
| microsoft__vscode-124621 | no overlap found (rule check) | Codespaces progress notification makes links not clickable |
| microsoft__vscode-127071 | no overlap found (rule check) | TreeItem State None to Expanded |
| microsoft__vscode-154262 | no overlap found (rule check) | File links without folders when command detection should prefer searching over matching a file in the initial cwd |
| microsoft__vscode-159144 | no overlap found (rule check) | Broken image resources in getting started walktrough |
| microsoft__vscode-159321 | no overlap found (rule check) | Sticky scroll doesn't work with C++ 17 nested namespaces |
| microsoft__vscode-162945 | no overlap found (rule check) | Remove keybindings with when clause does not work |
| microsoft__vscode-169916 | no overlap found (rule check) | `ExtensionsWorkbenchService.updateActivity` is slow during startup |
| microsoft__vscode-171718 | no overlap found (rule check) | Doing `code <file>` from integrated terminal in portable mode uses wrong user data |
| microsoft__vscode-183368 | no overlap found (rule check) | .gitignore files don't take effect in Search if there is no .git folder |