Multi-SWE-bench (flash): every task, with its verdict
Multi-SWE-bench, published by ByteDance Seed. Paper authors: Daoguang Zan, Zhirong Huang, Wei Liu, Hanwu Chen, Linhao Zhang, Shulin Xin, Lu Chen, Qi Liu, Xiaojian Zhong, Aoyan Li, Siyao Liu, Yongsheng Xiao, Liangqiang Chen, Yuyu Zhang, Jing Su, Tianyu Liu, Rui Long, Kai Shen and Liang Xiang. Multi-SWE-bench (arXiv) · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.
| Task | Verdict | Issue title |
|---|---|---|
| catchorg__Catch2-1422 | no overlap found (rule check) | unregistered reporter is not considered a command line error |
| catchorg__Catch2-1448 | no overlap found (rule check) | Capturer destructor asserts due to bad expression parsing |
| catchorg__Catch2-1608 | no overlap found (rule check) | CAPTURE("text, with comma") fails |
| catchorg__Catch2-1609 | no overlap found (rule check) | Type parametrised test case: support for non-type template parameters |
| catchorg__Catch2-1614 | no overlap found (rule check) | Allow custom precision in error reports for floating-point numbers |
| catchorg__Catch2-1616 | no overlap found (rule check) | Rename #define BENCHMARK or allow disabling benchmark feature |
| catchorg__Catch2-2128 | no overlap found (rule check) | Problem with user provided operator == (with proposed fix) |
| catchorg__Catch2-2187 | no overlap found (rule check) | Make CHECKED_IF and CHECKED_ELSE "ok to fail" |
| catchorg__Catch2-2288 | no overlap found (rule check) | Approx::operator() not const-correct |
| catchorg__Catch2-2394 | no overlap found (rule check) | Test case name hashing should consider tags and class name too |
| catchorg__Catch2-2723 | no overlap found (rule check) | Exception is treated as passing when used CHECKED_ELSE before in xml reporter |
| catchorg__Catch2-2849 | no overlap found (rule check) | Handle ANSI escape sequences during text wrapping |