Leaklens

SWE-Gym (training set sample): every task, with its verdict

SWE-Gym, published by the SWE-Gym authors. Paper authors: Jiayi Pan, Xingyao Wang, Graham Neubig, Navdeep Jaitly, Heng Ji, Alane Suhr and Yizhe Zhang. SWE-Gym (arXiv) · This page covers a random 100-task sample of the 2,438 training tasks (SWE-Gym/SWE-Gym on Hugging Face). The sample is the 100 instance IDs with the lowest SHA-256 of "own1:swe-gym:<instance_id>", so anyone can redraw it. · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
getmoto__moto-4956no overlap found (rule check)elbv2.describe_listeners the results are not the same as those returned by AWS
getmoto__moto-5134no overlap found (rule check)EventBridge rule doesn't match null value with "exists" filter
getmoto__moto-5286no overlap found (rule check)Cognito client describe_user_pool does not return with associated domain
getmoto__moto-5504no overlap found (rule check)DynamoDB UpdateItem error: Two document paths overlap with each other
getmoto__moto-5601no overlap found (rule check)Implement filter 'route.vpc-peering-connection-id' for DescribeRouteTables
getmoto__moto-6190no overlap found (rule check)S3 CreateBucket raising 411 when no Content-Length header is set
getmoto__moto-6687no overlap found (rule check)@mock_cloudtrail is not being able to retrieve the trail status in a different region for a multiregion trail
getmoto__moto-6720no overlap found (rule check)Secrets Manager: UpdateSecret without secret value breaks GetSecretValue
getmoto__moto-6756no overlap found (rule check)[Feature request] SageMaker list and notebook instances
getmoto__moto-6998no overlap found (rule check)RDS cluster with instances can be deleted in moto
getmoto__moto-7081no overlap found (rule check)IoT - thingId not present after create_thing()
getmoto__moto-7328no overlap found (rule check)route53.list_hosted_zones() does not page results
getmoto__moto-7331no overlap found (rule check)Call `GetId` on Cognito Identity when Access Control is available
getmoto__moto-7490no overlap found (rule check)Adding `StreamSummaries` to kinesis.list_streams response
getmoto__moto-7608no overlap found (rule check)Cryptic error when using start_execution with Moto 5.0.5