Leaklens

SWE-PolyBench (full set sample): every task, with its verdict

SWE-PolyBench, published by Amazon Science. Paper authors: Muhammad Shihab Rashid, Christian Bock, Yuan Zhuang, Alexander Buchholz, Tim Esler, Simon Valentin, Luca Franceschi, Martin Wistuba, Prabhu Teja Sivaprasad, Woo Jung Kim, Anoop Deoras, Giovanni Zappella and Laurent Callot. SWE-PolyBench (arXiv) · This page covers a random 100-task sample of the 2,110 tasks (AmazonScience/SWE-PolyBench on Hugging Face). The sample is the 100 instance IDs with the lowest SHA-256 of "own1:swe-polybench:<instance_id>", so anyone can redraw it. · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
sveltejs__svelte-1199no overlap found (rule check)bug with select_block_type function
sveltejs__svelte-1384no overlap found (rule check)Deduplicate each_context generation
sveltejs__svelte-1610no overlap found (rule check)addResizeListener bug
sveltejs__svelte-1925no overlap found (rule check)Internal state can be exposed
sveltejs__svelte-1932no overlap found (rule check)missing semi-colon after `export` generates invalid code
sveltejs__svelte-1942no overlap found (rule check)scope issue in v3
sveltejs__svelte-3170no overlap found (rule check)`get_store_value` doesn't account for RxJS observables
sveltejs__svelte-3792no overlap found (rule check)Spread and scoping class problems
sveltejs__svelte-4107no overlap found (rule check)Whitespace is removed around <tspan> elements
sveltejs__svelte-4279no overlap found (rule check)capture, passive modes not working for svelte:body special element.
sveltejs__svelte-4398no overlap found (rule check)Radio/checkbox input with bind:group and spread props makes variable undefined
sveltejs__svelte-4522no overlap found (rule check)Prop initialization in web/standalone components
sveltejs__svelte-4634no overlap found (rule check)Component nested in if_block will fail to unmount if it has an element using an outro nested in a truthy if_block
sveltejs__svelte-4766no overlap found (rule check)Immediate tweened store value update with { duration: 0 } option
sveltejs__svelte-501no overlap found (rule check)Grouped checkbox bindings behaving badly
sveltejs__svelte-5323no overlap found (rule check)A11y: A form label must be associated with a control. (When label actually has control element)
sveltejs__svelte-5835no overlap found (rule check)bind:group on nested loop not working as expected
sveltejs__svelte-6414no overlap found (rule check)Slot prop not update when transition finished
sveltejs__svelte-6612no overlap found (rule check)Parser unexpected behavior on value-less attribute
sveltejs__svelte-6687no overlap found (rule check)Selected <select> value disappears in svelte 3.42.2
sveltejs__svelte-709no overlap found (rule check)Two-way binding observers not initialised in some circumstances
sveltejs__svelte-7858no overlap found (rule check)Invalidating functions cannot be declared as `@const`