Leaklens

SWE-PolyBench (full set sample): every task, with its verdict

SWE-PolyBench, published by Amazon Science. Paper authors: Muhammad Shihab Rashid, Christian Bock, Yuan Zhuang, Alexander Buchholz, Tim Esler, Simon Valentin, Luca Franceschi, Martin Wistuba, Prabhu Teja Sivaprasad, Woo Jung Kim, Anoop Deoras, Giovanni Zappella and Laurent Callot. SWE-PolyBench (arXiv) · This page covers a random 100-task sample of the 2,110 tasks (AmazonScience/SWE-PolyBench on Hugging Face). The sample is the 100 instance IDs with the lowest SHA-256 of "own1:swe-polybench:<instance_id>", so anyone can redraw it. · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
apache__dubbo-4521no overlap found (rule check)PojoUtils realize error
apache__dubbo-5356no overlap found (rule check)optimize : constant names should be all uppercase, separated by underscores
apache__dubbo-6351no overlap found (rule check)[Bug]Consul config center can not publish config correncly