Leaklens

SWE-Gym (training set sample): every task, with its verdict

SWE-Gym, published by the SWE-Gym authors. Paper authors: Jiayi Pan, Xingyao Wang, Graham Neubig, Navdeep Jaitly, Heng Ji, Alane Suhr and Yizhe Zhang. SWE-Gym (arXiv) · This page covers a random 100-task sample of the 2,438 training tasks (SWE-Gym/SWE-Gym on Hugging Face). The sample is the 100 instance IDs with the lowest SHA-256 of "own1:swe-gym:<instance_id>", so anyone can redraw it. · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
facebookresearch__hydra-1276no overlap found (rule check)Consider deprecating automatic schema support in favor of extending a config via recursive defaults
facebookresearch__hydra-1741no overlap found (rule check)[Bug] failure while sanitiainzg exception stack trace in some cases