SWE-PolyBench (full set sample): every task, with its verdict
SWE-PolyBench, published by Amazon Science. Paper authors: Muhammad Shihab Rashid, Christian Bock, Yuan Zhuang, Alexander Buchholz, Tim Esler, Simon Valentin, Luca Franceschi, Martin Wistuba, Prabhu Teja Sivaprasad, Woo Jung Kim, Anoop Deoras, Giovanni Zappella and Laurent Callot. SWE-PolyBench (arXiv) · This page covers a random 100-task sample of the 2,110 tasks (AmazonScience/SWE-PolyBench on Hugging Face). The sample is the 100 instance IDs with the lowest SHA-256 of "own1:swe-polybench:<instance_id>", so anyone can redraw it. · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.
| Task | Verdict | Issue title |
|---|---|---|
| mui__material-ui-16252 | Tier C: the issue text repeats lines of the gold patch | Slider stepValue < 1 gives rounding errors |
| mui__material-ui-21370 | Tier C: the issue text repeats lines of the gold patch | [StepConnector] Step connector does not get completed or active styles when alternative |
| mui__material-ui-23884 | Tier C: the issue text repeats lines of the gold patch | [Autocomplete] candidate.toLowerCase is not a function |
| prettier__prettier-14109 | Tier C: the issue text repeats lines of the gold patch | less format problem |
| Significant-Gravitas__AutoGPT-4652 | no overlap found (rule check) | COMMAND = list_files - openai.error.InvalidRequestError: This model's maximum context length is 4097 tokens |
| apache__dubbo-4521 | no overlap found (rule check) | PojoUtils realize error |
| apache__dubbo-5356 | no overlap found (rule check) | optimize : constant names should be all uppercase, separated by underscores |
| apache__dubbo-6351 | no overlap found (rule check) | [Bug]Consul config center can not publish config correncly |
| apache__rocketmq-3862 | no overlap found (rule check) | enhance the cal of latency for putting message |
| apache__rocketmq-3881 | no overlap found (rule check) | Nameserver RouteInfoManager logic can be simplified. |
| google__gson-2071 | no overlap found (rule check) | `EnumMap` deserialization fails with `ClassCastException` |
| google__gson-2345 | no overlap found (rule check) | Support single line pretty-printed JSON output |
| huggingface__transformers-13573 | no overlap found (rule check) | Upcasting of attention computation for reliable pretraining of GPT-2 models |
| huggingface__transformers-17053 | no overlap found (rule check) | Bug: Finetuning large models resume checkpoint error |
| huggingface__transformers-25429 | no overlap found (rule check) | NLLB MoE router_state referenced before assignment |
| huggingface__transformers-25765 | no overlap found (rule check) | RuntimeError: The size of tensor a (16) must match the size of tensor b (16000) at non-singleton dimension 2 |
| huggingface__transformers-26568 | no overlap found (rule check) | SWIN2SR: Allow to choose number of in_channels and out_channels |
| huggingface__transformers-29838 | no overlap found (rule check) | Trainer: Functions to inspect model and optimizer status |
| huggingface__transformers-31128 | no overlap found (rule check) | get_wsd_schedule gets passed num_training_steps because not handled |
| keras-team__keras-18553 | no overlap found (rule check) | depthwise_conv ops padding same is not working in on torch backend |
| keras-team__keras-19201 | no overlap found (rule check) | Typo in keras.distribution.initialize() |
| keras-team__keras-19484 | no overlap found (rule check) | keras adamw optimizer failed with callable parameters in TensorFlow2.16 |
| keras-team__keras-19973 | no overlap found (rule check) | Inconsistent assertion in keras.layers.MultiHeadAttention |
| langchain-ai__langchain-3367 | no overlap found (rule check) | Terminal tool gives `ValueError: Could not parse LLM output:` when there is a new libe before action string. |
| langchain-ai__langchain-7653 | no overlap found (rule check) | SQLite LLM cache clear does not take effect |
| microsoft__vscode-124621 | no overlap found (rule check) | Codespaces progress notification makes links not clickable |
| microsoft__vscode-127071 | no overlap found (rule check) | TreeItem State None to Expanded |
| microsoft__vscode-154262 | no overlap found (rule check) | File links without folders when command detection should prefer searching over matching a file in the initial cwd |
| microsoft__vscode-159144 | no overlap found (rule check) | Broken image resources in getting started walktrough |
| microsoft__vscode-159321 | no overlap found (rule check) | Sticky scroll doesn't work with C++ 17 nested namespaces |
| microsoft__vscode-162945 | no overlap found (rule check) | Remove keybindings with when clause does not work |
| microsoft__vscode-169916 | no overlap found (rule check) | `ExtensionsWorkbenchService.updateActivity` is slow during startup |
| microsoft__vscode-171718 | no overlap found (rule check) | Doing `code <file>` from integrated terminal in portable mode uses wrong user data |
| microsoft__vscode-183368 | no overlap found (rule check) | .gitignore files don't take effect in Search if there is no .git folder |
| mrdoob__three.js-14566 | no overlap found (rule check) | LOD: Consider adding hysteresis option. |
| mui__material-ui-13452 | no overlap found (rule check) | createMuiTheme uses default spacing for createMixins instead of overrides |
| mui__material-ui-13494 | no overlap found (rule check) | [ToggleButtonGroup] Falsy values cause the background/shadow to disappear |
| mui__material-ui-15304 | no overlap found (rule check) | [Tooltip] Suppress "disabled button" console warning when tooltip is controlled |
| mui__material-ui-15578 | no overlap found (rule check) | Overriding "selected" style in MuiListItem has side effect on MuiTabs |
| mui__material-ui-16275 | no overlap found (rule check) | Slider mark formatting not honouring change to min/max values |
| mui__material-ui-16585 | no overlap found (rule check) | [Modal] focus-trap fails when a focused element in the modal unmounts |
| mui__material-ui-20401 | no overlap found (rule check) | Cannot read property 'pulsate' of null |
| mui__material-ui-24968 | no overlap found (rule check) | [Slider] Improve thumb and track animation |
| mui__material-ui-25547 | no overlap found (rule check) | [Slider] Allow disabling the left and right thumbs swap |
| mui__material-ui-26470 | no overlap found (rule check) | Tab indicator Animates from the left on RTL |
| mui__material-ui-26576 | no overlap found (rule check) | [docs] missing role="link" for Button with Link |
| mui__material-ui-26746 | no overlap found (rule check) | [theme] Improve the breakpoints values |
| mui__material-ui-30768 | no overlap found (rule check) | MobileDatePicker's Cancel button does not work. |
| mui__material-ui-33873 | no overlap found (rule check) | [InputUnstyled] not forwarding textarea specific props (rows, maxRows, minRows) |
| mui__material-ui-38247 | no overlap found (rule check) | [docs] The documentation for <Icon/> doesn't render an icon for the SandBox |
| mui__material-ui-39536 | no overlap found (rule check) | [material-ui][ToggleButton] Can't customize it with `fullWidth` |
| mui__material-ui-41300 | no overlap found (rule check) | [material-ui][Autocomplete] The options list is added to the DOM even when there are no options, causing style problems |
| prettier__prettier-10346 | no overlap found (rule check) | Markdown code-block with wrong language yields garbage |
| prettier__prettier-14170 | no overlap found (rule check) | Angular templates self closing tags |
| prettier__prettier-6133 | no overlap found (rule check) | Parens incorrectly dropped when trying to type a function expression |
| prettier__prettier-830 | no overlap found (rule check) | Unstable behaviours when using comments around variables |
| prettier__prettier-8465 | no overlap found (rule check) | Pug plugin doesn't work for the .vue files |
| prettier__prettier-8675 | no overlap found (rule check) | SCSS: unexpected format |
| serverless__serverless-2576 | no overlap found (rule check) | Can't deploy with master branch: "Cannot read property 'endsWith' of null" |
| serverless__serverless-2743 | no overlap found (rule check) | Cloud Formation Resource Dependencies: Function, Role and Policy |
| serverless__serverless-3622 | no overlap found (rule check) | Referencing external config files using ${file()} fails and breaks Cloudformation template |
| serverless__serverless-3705 | no overlap found (rule check) | S3 implementation fails sometimes due a CloudFormation race condition |
| serverless__serverless-3846 | no overlap found (rule check) | When http indenting in yml isn't correct error message doesn't mention function name that has the issue |
| serverless__serverless-4372 | no overlap found (rule check) | Change Authorizer type to "REQUEST" (instead of "TOKEN") |
| serverless__serverless-5256 | no overlap found (rule check) | An error occurred: ApiGatewayDeploymentxxxxx - No integration defined for method - when v1.28 was used |
| serverless__serverless-5299 | no overlap found (rule check) | Allow specifying a custom prefix under which the artifacts will be deployed to S3 |
| serverless__serverless-5865 | no overlap found (rule check) | Allow non-alphanumeric characters for websocket routes |
| serverless__serverless-6000 | no overlap found (rule check) | Support authorization scopes for COGNITO_USER_POOLS authorizer |
| serverless__serverless-6272 | no overlap found (rule check) | Support shared websocket API |
| serverless__serverless-6808 | no overlap found (rule check) | Can't parse variable system when a second argument is hard-coded |
| serverless__serverless-7322 | no overlap found (rule check) | ALB event Target Group names should have a prefix and not be completely random |
| serverless__serverless-7333 | no overlap found (rule check) | Enabling API Gateway Logs in serverless.yml tries to create new IAM Role and a new Lambda |
| serverless__serverless-7625 | no overlap found (rule check) | AWS: Extend ${ssm} syntax to get output from another region |
| sveltejs__svelte-1199 | no overlap found (rule check) | bug with select_block_type function |
| sveltejs__svelte-1384 | no overlap found (rule check) | Deduplicate each_context generation |
| sveltejs__svelte-1610 | no overlap found (rule check) | addResizeListener bug |
| sveltejs__svelte-1925 | no overlap found (rule check) | Internal state can be exposed |
| sveltejs__svelte-1932 | no overlap found (rule check) | missing semi-colon after `export` generates invalid code |
| sveltejs__svelte-1942 | no overlap found (rule check) | scope issue in v3 |
| sveltejs__svelte-3170 | no overlap found (rule check) | `get_store_value` doesn't account for RxJS observables |
| sveltejs__svelte-3792 | no overlap found (rule check) | Spread and scoping class problems |
| sveltejs__svelte-4107 | no overlap found (rule check) | Whitespace is removed around <tspan> elements |
| sveltejs__svelte-4279 | no overlap found (rule check) | capture, passive modes not working for svelte:body special element. |
| sveltejs__svelte-4398 | no overlap found (rule check) | Radio/checkbox input with bind:group and spread props makes variable undefined |
| sveltejs__svelte-4522 | no overlap found (rule check) | Prop initialization in web/standalone components |
| sveltejs__svelte-4634 | no overlap found (rule check) | Component nested in if_block will fail to unmount if it has an element using an outro nested in a truthy if_block |
| sveltejs__svelte-4766 | no overlap found (rule check) | Immediate tweened store value update with { duration: 0 } option |
| sveltejs__svelte-501 | no overlap found (rule check) | Grouped checkbox bindings behaving badly |
| sveltejs__svelte-5323 | no overlap found (rule check) | A11y: A form label must be associated with a control. (When label actually has control element) |
| sveltejs__svelte-5835 | no overlap found (rule check) | bind:group on nested loop not working as expected |
| sveltejs__svelte-6414 | no overlap found (rule check) | Slot prop not update when transition finished |
| sveltejs__svelte-6612 | no overlap found (rule check) | Parser unexpected behavior on value-less attribute |
| sveltejs__svelte-6687 | no overlap found (rule check) | Selected <select> value disappears in svelte 3.42.2 |
| sveltejs__svelte-709 | no overlap found (rule check) | Two-way binding observers not initialised in some circumstances |
| sveltejs__svelte-7858 | no overlap found (rule check) | Invalidating functions cannot be declared as `@const` |
| trinodb__trino-1584 | no overlap found (rule check) | presto select query fails with permission denied for kerberized Hive metastore with hive metastore impersonation enabled. |
| trinodb__trino-2944 | no overlap found (rule check) | New WebUI Authentication Manager Breaks Forwarded HTTPS |
| trinodb__trino-5010 | no overlap found (rule check) | PrestoS3FileSystem should skip DeepArchive in addition to Glacier |
| trinodb__trino-725 | no overlap found (rule check) | NullPointerException when local memory limits are exceeded |
| yt-dlp__yt-dlp-8917 | no overlap found (rule check) | Use ; as separator for metadata instead of , for vorbis comments and / for ID3 |