SWE-PolyBench (full set sample): every task, with its verdict
SWE-PolyBench, published by Amazon Science. Paper authors: Muhammad Shihab Rashid, Christian Bock, Yuan Zhuang, Alexander Buchholz, Tim Esler, Simon Valentin, Luca Franceschi, Martin Wistuba, Prabhu Teja Sivaprasad, Woo Jung Kim, Anoop Deoras, Giovanni Zappella and Laurent Callot. SWE-PolyBench (arXiv) · This page covers a random 100-task sample of the 2,110 tasks (AmazonScience/SWE-PolyBench on Hugging Face). The sample is the 100 instance IDs with the lowest SHA-256 of "own1:swe-polybench:<instance_id>", so anyone can redraw it. · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.
| Task | Verdict | Issue title |
|---|---|---|
| mui__material-ui-16252 | Tier C: the issue text repeats lines of the gold patch | Slider stepValue < 1 gives rounding errors |
| mui__material-ui-21370 | Tier C: the issue text repeats lines of the gold patch | [StepConnector] Step connector does not get completed or active styles when alternative |
| mui__material-ui-23884 | Tier C: the issue text repeats lines of the gold patch | [Autocomplete] candidate.toLowerCase is not a function |
| mui__material-ui-13452 | no overlap found (rule check) | createMuiTheme uses default spacing for createMixins instead of overrides |
| mui__material-ui-13494 | no overlap found (rule check) | [ToggleButtonGroup] Falsy values cause the background/shadow to disappear |
| mui__material-ui-15304 | no overlap found (rule check) | [Tooltip] Suppress "disabled button" console warning when tooltip is controlled |
| mui__material-ui-15578 | no overlap found (rule check) | Overriding "selected" style in MuiListItem has side effect on MuiTabs |
| mui__material-ui-16275 | no overlap found (rule check) | Slider mark formatting not honouring change to min/max values |
| mui__material-ui-16585 | no overlap found (rule check) | [Modal] focus-trap fails when a focused element in the modal unmounts |
| mui__material-ui-20401 | no overlap found (rule check) | Cannot read property 'pulsate' of null |
| mui__material-ui-24968 | no overlap found (rule check) | [Slider] Improve thumb and track animation |
| mui__material-ui-25547 | no overlap found (rule check) | [Slider] Allow disabling the left and right thumbs swap |
| mui__material-ui-26470 | no overlap found (rule check) | Tab indicator Animates from the left on RTL |
| mui__material-ui-26576 | no overlap found (rule check) | [docs] missing role="link" for Button with Link |
| mui__material-ui-26746 | no overlap found (rule check) | [theme] Improve the breakpoints values |
| mui__material-ui-30768 | no overlap found (rule check) | MobileDatePicker's Cancel button does not work. |
| mui__material-ui-33873 | no overlap found (rule check) | [InputUnstyled] not forwarding textarea specific props (rows, maxRows, minRows) |
| mui__material-ui-38247 | no overlap found (rule check) | [docs] The documentation for <Icon/> doesn't render an icon for the SandBox |
| mui__material-ui-39536 | no overlap found (rule check) | [material-ui][ToggleButton] Can't customize it with `fullWidth` |
| mui__material-ui-41300 | no overlap found (rule check) | [material-ui][Autocomplete] The options list is added to the DOM even when there are no options, causing style problems |