Leaklens

SWE-Gym (training set sample): every task, with its verdict

SWE-Gym, published by the SWE-Gym authors. Paper authors: Jiayi Pan, Xingyao Wang, Graham Neubig, Navdeep Jaitly, Heng Ji, Alane Suhr and Yizhe Zhang. SWE-Gym (arXiv) · This page covers a random 100-task sample of the 2,438 training tasks (SWE-Gym/SWE-Gym on Hugging Face). The sample is the 100 instance IDs with the lowest SHA-256 of "own1:swe-gym:<instance_id>", so anyone can redraw it. · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
python__mypy-11870Tier C: the issue text repeats lines of the gold patchmypy 0.930: regression: no longer keeping contextmanager generic return value
python__mypy-10424no overlap found (rule check)Narrowing types using a metaclass can cause false positives
python__mypy-10658no overlap found (rule check)regression: typevar with bound and type check causes narrowing to nothing
python__mypy-10777no overlap found (rule check)PEP 593 Annotated containing string literal is marked incorrect
python__mypy-11290no overlap found (rule check)Use `_typeshed.NoneType` for the type of `None`
python__mypy-11361no overlap found (rule check)The `[unreachable]` check fails for module scope code and allows unreachable raising of Exceptions
python__mypy-11483no overlap found (rule check)`dataclasses` plugins does not respect `slots=True` argument
python__mypy-11717no overlap found (rule check)Type inference regression with "and" and strict optional disabled
python__mypy-15366no overlap found (rule check)False-negative `type-abstract` in dictionary initialization
python__mypy-15440no overlap found (rule check)dmypy ignores flags and config file
python__mypy-15629no overlap found (rule check)Crash when iterating a Tuple list of @dataclass Protocol
python__mypy-15920no overlap found (rule check)false positive: `functools.lru_cache()` breaks `assert_type(..., SomeEnum)`
python__mypy-16061no overlap found (rule check)Introduce error category [unsafe-overload].
python__mypy-5617no overlap found (rule check)Can't assign to ()
python__mypy-9102no overlap found (rule check)New plugin hook: get_function_signature_hook