Leaklens

Multi-SWE-bench (flash): every task, with its verdict

Multi-SWE-bench, published by ByteDance Seed. Paper authors: Daoguang Zan, Zhirong Huang, Wei Liu, Hanwu Chen, Linhao Zhang, Shulin Xin, Lu Chen, Qi Liu, Xiaojian Zhong, Aoyan Li, Siyao Liu, Yongsheng Xiao, Liangqiang Chen, Yuyu Zhang, Jing Su, Tianyu Liu, Rui Long, Kai Shen and Liang Xiang. Multi-SWE-bench (arXiv) · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
simdjson__simdjson-485no overlap found (rule check)Consider creating a JsonFactory that holds memory necessary for parsing
simdjson__simdjson-524no overlap found (rule check)Make simdjson.h the only way to #include simdjson
simdjson__simdjson-543no overlap found (rule check)More discoverable API to parse a file
simdjson__simdjson-545no overlap found (rule check)Support << for parsed JSON DOM
simdjson__simdjson-559no overlap found (rule check)Allow compilation with -fno-exceptions
simdjson__simdjson-644no overlap found (rule check)Possible confusion between key access and jsonpointer