Leaklens

Multi-SWE-bench (flash): every task, with its verdict

Multi-SWE-bench, published by ByteDance Seed. Paper authors: Daoguang Zan, Zhirong Huang, Wei Liu, Hanwu Chen, Linhao Zhang, Shulin Xin, Lu Chen, Qi Liu, Xiaojian Zhong, Aoyan Li, Siyao Liu, Yongsheng Xiao, Liangqiang Chen, Yuyu Zhang, Jing Su, Tianyu Liu, Rui Long, Kai Shen and Liang Xiang. Multi-SWE-bench (arXiv) · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
fmtlib__fmt-1171no overlap found (rule check)fmt::prepare fails to compile formatting to an array of chars
fmtlib__fmt-1663no overlap found (rule check)Dynamic construction of *named* argument lists?
fmtlib__fmt-1837no overlap found (rule check)Feature Request: Print std::chrono::time_point
fmtlib__fmt-2070no overlap found (rule check)format_to uses wrong overload when formatting to memory_buffer with a text_style
fmtlib__fmt-2158no overlap found (rule check)truncating_iterator is no std::output_iterator
fmtlib__fmt-2292no overlap found (rule check)Printed seconds precision does not match C++20 spec
fmtlib__fmt-2310no overlap found (rule check)Numeric zero fill is applied to inf/nan
fmtlib__fmt-2317no overlap found (rule check)Hex float default alignment
fmtlib__fmt-2394no overlap found (rule check)Add more emphases
fmtlib__fmt-2610no overlap found (rule check)Formatting of function pointers should be disallowed
fmtlib__fmt-2940no overlap found (rule check)tuple-formatter doesn't check that the tuple-elements are formattable.
fmtlib__fmt-3158no overlap found (rule check)Some ranges of char are misprinted or don't compile
fmtlib__fmt-3272no overlap found (rule check)Alignment of floating-point numbers is incorrect if the output is localized and the integer part is zero
fmtlib__fmt-3279no overlap found (rule check)Add formatters for STL container adapters
fmtlib__fmt-3537no overlap found (rule check)Consider format_string as a string for enable-if
fmtlib__fmt-493no overlap found (rule check)MemoryWriter allocation issue
fmtlib__fmt-967no overlap found (rule check)Colored print improvements
fmtlib__fmt-974no overlap found (rule check)Support ASCII color escape code numbers