Leaklens

SWE-rebench (V1 filtered sample): every task, with its verdict

SWE-rebench, published by Nebius. Paper authors: Ibragim Badertdinov, Alexander Golubev, Maksim Nekrashevich, Anton Shevtsov, Simon Karasik, Andrei Andriushchenko, Maria Trofimova, Daria Litvintseva and Boris Yangel. SWE-rebench (arXiv) · This page covers a random 100-task sample of the V1 filtered split (nebius/SWE-rebench, 6,542 tasks). The sample is the 100 instance IDs with the lowest SHA-256 of "own1:swe-rebench:<instance_id>", so anyone can redraw it. · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
Azure__azure-cli-3354no overlap found (rule check)az vm open-port returns error but executes successfully
DataDog__datadog-lambda-python-214no overlap found (rule check)When the response of lambda contain data of type Decimal, datadog raise except TypeError: 'decimal.Decimal' object is not iterable
EvoluxBR__greenswitch-85no overlap found (rule check)ESLProtocol.connect: Socket is not cleaned up if socket is closed
HewlettPackard__oneview-python-65no overlap found (rule check)In correct endpoint passed when uploading a downloaded appliance backup
Justintime50__github-archive-33no overlap found (rule check)Add a "Forks" flag to clone/pull forks
Materials-Consortia__optimade-python-tools-2250no overlap found (rule check)Client can be forced into infinite loop by bad API responses
NCAR__geocat-comp-319no overlap found (rule check)Upstream CI: Pint
NCAS-CMS__cf-python-418no overlap found (rule check)Creating time bounds - differing time units causes uncaptured error when collapsing
NREL__hescore-hpxml-98no overlap found (rule check)Workaround for conditioned attics in HPXML 2.3
OSOceanAcoustics__echopype-428no overlap found (rule check)Using open_raw for AZFP data files with name other than .01A
PMEAL__porespy-465no overlap found (rule check)enhance trim_nearby_peaks to accept a tolerance or threshold
PyFilesystem__pyfilesystem2-473no overlap found (rule check)FTPFS does not list certain folders
ResearchObject__ro-crate-py-161no overlap found (rule check)Support indirect data entity linking from root
ReviewNB__treon-25no overlap found (rule check)Allow multiple PATHs to be provided
Skyscanner__cfripper-80no overlap found (rule check)Error while parsing template with pycfmodel
Textualize__textual-2532no overlap found (rule check)App title and sub_title should be converted to strings
Toblerity__rtree-141no overlap found (rule check)nearest picking just first item
VirtusLab__git-machete-330no overlap found (rule check)`AttributeError: 'str' object has no attribute 'full_name'` due to (?) mistyped `CommandLineOptions.opt_branch`
Yelp__py_zipkin-153no overlap found (rule check)One-way tracing
aio-libs__aiohttp-devtools-549no overlap found (rule check)Cleanup context is not run on reload on Windows
astanin__python-tabulate-96no overlap found (rule check)Shift headers wrongly when do tabulate(headers="keys", showindex=False) with pandas.DataFrame with named index
astropy__photutils-1805no overlap found (rule check)Limit offsets when fitting
beeware__briefcase-1417no overlap found (rule check)Add support for OpenSuSE
beeware__briefcase-927no overlap found (rule check)Briefcase `v0.3.12.dev0+xxx` is not Treated as a Dev Version
bids-standard__pybids-328no overlap found (rule check)Warn or error on misspecified (or changed due to pybids changes) target value
bobthemighty__punq-191no overlap found (rule check)support kwonlyargs
borgbackup__borg-2566no overlap found (rule check)Restrict file names generated by Location.to_keyfile_name
borgbackup__borg-5713no overlap found (rule check)add debug output to files cache checking
bridgecrewio__checkov-648no overlap found (rule check)Cloudformation NLB Listener Rules are incorrectly detected as ALB rules and fail the HTTPS expectation
cekit__cekit-429no overlap found (rule check)Plain artifacts and cache_url does not work well together
civisanalytics__civis-python-316no overlap found (rule check)CLI: GET /aliases/{alias} endpoint is inaccessible
conan-io__conan-14727no overlap found (rule check)[feature] Same host and build profile option?
conan-io__conan-3373no overlap found (rule check)scm query
cosmicBboy__pandera-64no overlap found (rule check)handle `self` argument when using check_input in class method when str obj_getter is supplied
devopshq__artifactory-cleanup-100no overlap found (rule check)Output format to Json
dlr-eoc__ukis-pysat-72no overlap found (rule check)Handle case where pad_width<0 in _pad_to_bbox
dr-prodigy__python-holidays-1257no overlap found (rule check)Missing Orthodox Good Friday in Greece national holiday
dwavesystems__dwave-system-368no overlap found (rule check)Reverse-annealing composites should not silently forward anneal
encode__starlette-2711no overlap found (rule check)When the directory itself being a symlink does not work.
erikrose__parsimonious-113no overlap found (rule check)Unnamed nodes should make up useful names for themselves
fitnr__visvalingamwyatt-6no overlap found (rule check)first & last position not the same in coordinates after simplify_geometry
fniessink__next-action-162no overlap found (rule check)Next-action can't be told to not read the current configuration file when generating one
goldmann__docker-squash-208no overlap found (rule check)ERROR maximum recursion depth exceeded while calling a Python object
google__flax-4705no overlap found (rule check)Adding `dot_general` to `Einsum` Module
googleapis__python-storage-107no overlap found (rule check)"Anonymous credentials cannot be refreshed" with fake-gcs-server
gurumitts__pylutron-caseta-58no overlap found (rule check)Lights lack SUPPORT_TRANSITION
huggingface__smolagents-285no overlap found (rule check)local interpreter overrides in-place operators
hylang__hy-1955no overlap found (rule check)Make hy-history location configurable
ipython__ipython-14503no overlap found (rule check)Raising SystemExit leads to internal inspect module error
ipython__ipython-14693no overlap found (rule check)Jupyter shebang cells ignore exit code on SIGINT
iterative__dvc-2612no overlap found (rule check)Warning messages in stdout
iterative__dvc-3843no overlap found (rule check)run-cache: fails for params
jackdewinter__pymarkdown-428no overlap found (rule check)Support for file extensions other than .md
juju__python-libjuju-569no overlap found (rule check)Bundles are not deployed from CharmHub
kedro-org__kedro-3947no overlap found (rule check)Deprecate (mark for future removal) `get_pkg_version` from the public API
lektor__lektor-960no overlap found (rule check)Disable deprecated implicit thumbnail upscaling?
lepture__mistune-277no overlap found (rule check)Task lists cannot be nested
lukasgeiter__mkdocs-awesome-pages-plugin-75no overlap found (rule check)order_by title does not work with folder
mapbox__mapbox-sdk-py-192no overlap found (rule check)Isn't `forward()` supporting the language query?
marcelm__cutadapt-781no overlap found (rule check)Pipe multiple adatper trimming steps is unsupported when using the python API.
marcosschroh__dataclasses-avroschema-172no overlap found (rule check)Nested metadata not respected
matrix-org__synapse-5415no overlap found (rule check)crypto.keyring: TypeError '<' not supported between instances of 'NoneType' and 'int'
mirumee__prices-26no overlap found (rule check)Price can be created with net and gross with different currencies
mkdocs__mkdocs-2290no overlap found (rule check)Config.validate keeps 'mdx_configs' values across different instances
mne-tools__mne-python-11939no overlap found (rule check)MAINT: deprecate mne maxfilter command line tool
mne-tools__mne-python-12507no overlap found (rule check)Potential problem with causal filters
nipreps__nibabies-351no overlap found (rule check)Proposed change to the __repr__ method of the Derivatives class
numba__numba-5721no overlap found (rule check)issue with >1d array iteration
pika__pika-1132no overlap found (rule check)Python 3.7.0 support
poliastro__poliastro-658no overlap found (rule check)Cannot propagate orbits around custom bodies
pyro-ppl__numpyro-1894no overlap found (rule check)Incorrect event dimension for `ComposeTransform` if transform reduces event dimensions
pyscript__pyscript-cli-84no overlap found (rule check)Add `pyscript serve` subcommand
pyvista__pyvista-5246no overlap found (rule check)Wrong result - Rename the "implicit_distance" after compute_implicit_distance filter
qiboteam__qibo-699no overlap found (rule check)Fuse of inverse of multiple gates gives multiple gates
qutech__qupulse-625no overlap found (rule check)RepetitionWaveform sample error due to TimeType time
reata__sqllineage-40no overlap found (rule check)white space in left join
reata__sqllineage-593no overlap found (rule check)Clickhouse SQL 'GLOBAL IN' not support
rigetti__pyquil-1564no overlap found (rule check)Support CHANNEL-DELAY in DefFrames
rthalley__dnspython-255no overlap found (rule check)Inherited TTL when parsing zone master files defaults to zero
sayanarijit__expandvars-41no overlap found (rule check)Right Hand Side Variable Not Expanded with the '-' Operator
scikit-learn-contrib__imbalanced-learn-1003no overlap found (rule check)SMOTEN does not support sparse matricies
scipp__plopp-428no overlap found (rule check)Cannot plot data with bin edges left over from slicing
scrapy__scrapy-3371no overlap found (rule check)AttributeError from contract errback
snowblink14__smatch-30no overlap found (rule check)interpretation of TOP property
spacetelescope__jwst-8433no overlap found (rule check)Extraction background edge case bug
streamlink__streamlink-6491no overlap found (rule check)plugins.kick: 403 error
streamlink__streamlink-886no overlap found (rule check)Nightly Hosting Costs
tefra__xsdata-1132no overlap found (rule check)Add a way for <Extension> to match class path
tensorflow__addons-2369no overlap found (rule check)Failing to restore RectifiedAdam optimizer from checkpoint
tobymao__sqlglot-1304no overlap found (rule check)ARRAY_AGG() conversion between Trino and Spark
tobymao__sqlglot-1375no overlap found (rule check)Issue with parsing of timestamp functions with time zones
tobymao__sqlglot-4206no overlap found (rule check)can't parse JSON query when using `with` keyword
tomMoral__loky-134no overlap found (rule check)initializer for get_reusable_executor
vaidik__commentjson-46no overlap found (rule check)Feature request: Ignore trailing commas
vitalik__django-ninja-187no overlap found (rule check)Path param with converter(s)
wemake-services__wemake-python-styleguide-1915no overlap found (rule check)Constant condition is not detected when used with `and` or `or`
wemake-services__wemake-python-styleguide-2343no overlap found (rule check)WPS472 only detecting one pure variable assignment
xonsh__xonsh-3141no overlap found (rule check)ls broken with $XONSH_COLOR_STYLE = 'bw'
zarr-developers__zarr-python-2548no overlap found (rule check)Rename `exists_ok` to `overwrite`
zopefoundation__zope.configuration-37no overlap found (rule check)Regression in 4.2: GlobalObject fields no longer allow just "."