Leaklens

Multi-SWE-bench (flash): every task, with its verdict

Multi-SWE-bench, published by ByteDance Seed. Paper authors: Daoguang Zan, Zhirong Huang, Wei Liu, Hanwu Chen, Linhao Zhang, Shulin Xin, Lu Chen, Qi Liu, Xiaojian Zhong, Aoyan Li, Siyao Liu, Yongsheng Xiao, Liangqiang Chen, Yuyu Zhang, Jing Su, Tianyu Liu, Rui Long, Kai Shen and Liang Xiang. Multi-SWE-bench (arXiv) · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
google__gson-1093no overlap found (rule check)JsonWriter#value(java.lang.Number) can be lenient, but JsonWriter#value(double) can't,
google__gson-1391no overlap found (rule check)Recursive TypeVariable resolution results in ClassCastException when type var is referenced multiple times
google__gson-1555no overlap found (rule check)JsonAdapter nullSafe parameter is ignored by JsonSerializer/JsonDeserializer type adapters
google__gson-1703no overlap found (rule check)Gson.toJson: CharSequence passed to Appendable does not implement toString()
google__gson-1787no overlap found (rule check)TypeAdapterRuntimeTypeWrapper prefers cyclic adapter for base type over reflective adapter for sub type