SWE-PolyBench (full set sample): every task, with its verdict
SWE-PolyBench, published by Amazon Science. Paper authors: Muhammad Shihab Rashid, Christian Bock, Yuan Zhuang, Alexander Buchholz, Tim Esler, Simon Valentin, Luca Franceschi, Martin Wistuba, Prabhu Teja Sivaprasad, Woo Jung Kim, Anoop Deoras, Giovanni Zappella and Laurent Callot. SWE-PolyBench (arXiv) · This page covers a random 100-task sample of the 2,110 tasks (AmazonScience/SWE-PolyBench on Hugging Face). The sample is the 100 instance IDs with the lowest SHA-256 of "own1:swe-polybench:<instance_id>", so anyone can redraw it. · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.
| Task | Verdict | Issue title |
|---|---|---|
| serverless__serverless-2576 | no overlap found (rule check) | Can't deploy with master branch: "Cannot read property 'endsWith' of null" |
| serverless__serverless-2743 | no overlap found (rule check) | Cloud Formation Resource Dependencies: Function, Role and Policy |
| serverless__serverless-3622 | no overlap found (rule check) | Referencing external config files using ${file()} fails and breaks Cloudformation template |
| serverless__serverless-3705 | no overlap found (rule check) | S3 implementation fails sometimes due a CloudFormation race condition |
| serverless__serverless-3846 | no overlap found (rule check) | When http indenting in yml isn't correct error message doesn't mention function name that has the issue |
| serverless__serverless-4372 | no overlap found (rule check) | Change Authorizer type to "REQUEST" (instead of "TOKEN") |
| serverless__serverless-5256 | no overlap found (rule check) | An error occurred: ApiGatewayDeploymentxxxxx - No integration defined for method - when v1.28 was used |
| serverless__serverless-5299 | no overlap found (rule check) | Allow specifying a custom prefix under which the artifacts will be deployed to S3 |
| serverless__serverless-5865 | no overlap found (rule check) | Allow non-alphanumeric characters for websocket routes |
| serverless__serverless-6000 | no overlap found (rule check) | Support authorization scopes for COGNITO_USER_POOLS authorizer |
| serverless__serverless-6272 | no overlap found (rule check) | Support shared websocket API |
| serverless__serverless-6808 | no overlap found (rule check) | Can't parse variable system when a second argument is hard-coded |
| serverless__serverless-7322 | no overlap found (rule check) | ALB event Target Group names should have a prefix and not be completely random |
| serverless__serverless-7333 | no overlap found (rule check) | Enabling API Gateway Logs in serverless.yml tries to create new IAM Role and a new Lambda |
| serverless__serverless-7625 | no overlap found (rule check) | AWS: Extend ${ssm} syntax to get output from another region |