Leaklens

Multi-SWE-bench (flash): every task, with its verdict

Multi-SWE-bench, published by ByteDance Seed. Paper authors: Daoguang Zan, Zhirong Huang, Wei Liu, Hanwu Chen, Linhao Zhang, Shulin Xin, Lu Chen, Qi Liu, Xiaojian Zhong, Aoyan Li, Siyao Liu, Yongsheng Xiao, Liangqiang Chen, Yuyu Zhang, Jing Su, Tianyu Liu, Rui Long, Kai Shen and Liang Xiang. Multi-SWE-bench (arXiv) · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
ponylang__ponyc-1035no overlap found (rule check)Compiler crash on lambda capturing not-yet declared variables
ponylang__ponyc-1051no overlap found (rule check)Using control flow instructions in parenthesis suppresses error checks
ponylang__ponyc-1057no overlap found (rule check)Compiler doesn't allow use of sendable fields in recover expressions.
ponylang__ponyc-1095no overlap found (rule check)Unhelpful compiler message on match error
ponylang__ponyc-1124no overlap found (rule check)Capability violation with tuple recovery
ponylang__ponyc-1260no overlap found (rule check)Bad error message if Main actor has no constructor
ponylang__ponyc-1339no overlap found (rule check)Type inference with circular dependency
ponylang__ponyc-1411no overlap found (rule check)RFC: Sugar for Method Chaining
ponylang__ponyc-1486no overlap found (rule check)Sendable members in recover expressions are broken
ponylang__ponyc-1516no overlap found (rule check)Unclear error message on match over different capabilities
ponylang__ponyc-1536no overlap found (rule check)RFC: Packed Structures
ponylang__ponyc-1726no overlap found (rule check)Identity comparison for boxed types is weird
ponylang__ponyc-1867no overlap found (rule check)Using `this` in a constructor results in failed assertion in 0.13.1
ponylang__ponyc-2007no overlap found (rule check)Iftype-narrowed constraint doesn't pass through prior types' type arguments.
ponylang__ponyc-2126no overlap found (rule check)Array literal with explicit `as` type uses alias of given type.
ponylang__ponyc-2176no overlap found (rule check)Segfault on Compilation of Tuple of Unions
ponylang__ponyc-2201no overlap found (rule check)Compiler assert when using `_` as an argument to Array
ponylang__ponyc-2203no overlap found (rule check)Unreported internal failure at gen_box
ponylang__ponyc-2205no overlap found (rule check)FFI call LLVM type signatures are not checked for conflicts
ponylang__ponyc-2214no overlap found (rule check)Character literal quirks
ponylang__ponyc-2221no overlap found (rule check)inconsistent treatment of triple-quoted strings
ponylang__ponyc-2261no overlap found (rule check)Problems compiling with partial call
ponylang__ponyc-671no overlap found (rule check)Shared libraries in nonstandard locations are not found on Linux