Leaklens

Multi-SWE-bench (flash): every task, with its verdict

Multi-SWE-bench, published by ByteDance Seed. Paper authors: Daoguang Zan, Zhirong Huang, Wei Liu, Hanwu Chen, Linhao Zhang, Shulin Xin, Lu Chen, Qi Liu, Xiaojian Zhong, Aoyan Li, Siyao Liu, Yongsheng Xiao, Liangqiang Chen, Yuyu Zhang, Jing Su, Tianyu Liu, Rui Long, Kai Shen and Liang Xiang. Multi-SWE-bench (arXiv) · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
jqlang__jq-1793no overlap found (rule check)"contains" filter behaves improperly with NUL characters
jqlang__jq-2133no overlap found (rule check)Assigning empty to multiple paths
jqlang__jq-2157no overlap found (rule check)@uri is not percent-encoding all reserved characters
jqlang__jq-2624no overlap found (rule check)gsub loops infinitely with "^" or ""
jqlang__jq-2646no overlap found (rule check)Core dumped on implode
jqlang__jq-2654no overlap found (rule check)Commit 6d3d2750 now requires '-e' to detect syntax error in input
jqlang__jq-2658no overlap found (rule check)Assertion failure when using --jsonargs with invalid JSON and printing $ARGS
jqlang__jq-2674no overlap found (rule check)nth/2 semantic is strange
jqlang__jq-2728no overlap found (rule check)[Feature] support no_color env to disable ansi_color output
jqlang__jq-2821no overlap found (rule check)Get/set inconsistency for fractional array indices
jqlang__jq-2824no overlap found (rule check)Low contrast for null coloring
jqlang__jq-2839no overlap found (rule check)Calling jv_cmp() on two decNumber numbers can still cause a segfault
jqlang__jq-2840no overlap found (rule check)Array indexing of negative indices wraps twice
jqlang__jq-2919no overlap found (rule check)Allow `--` to come just before the jq program
jqlang__jq-3161no overlap found (rule check)uri decode function
jqlang__jq-3165no overlap found (rule check)Add builtin to output to file
jqlang__jq-3238no overlap found (rule check)capture returns inconsistent results for optional named group