Multi-SWE-bench (flash): every task, with its verdict
Multi-SWE-bench, published by ByteDance Seed. Paper authors: Daoguang Zan, Zhirong Huang, Wei Liu, Hanwu Chen, Linhao Zhang, Shulin Xin, Lu Chen, Qi Liu, Xiaojian Zhong, Aoyan Li, Siyao Liu, Yongsheng Xiao, Liangqiang Chen, Yuyu Zhang, Jing Su, Tianyu Liu, Rui Long, Kai Shen and Liang Xiang. Multi-SWE-bench (arXiv) · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.
| Task | Verdict | Issue title |
|---|---|---|
| clap-rs__clap-5527 | Tier C: the issue text repeats lines of the gold patch | `num_args = 2..` does not error with 0 args and error has incorrect wording with 1 arg |
| clap-rs__clap-2075 | no overlap found (rule check) | Error message for conflicted args outputs conflicting USAGE |
| clap-rs__clap-3394 | no overlap found (rule check) | Show possible values when an arguments value is missing |
| clap-rs__clap-4667 | no overlap found (rule check) | Singular used even when multiple suggestions exist `note: subcommand 'foo', 'bar' exist` |
| clap-rs__clap-4902 | no overlap found (rule check) | Show subcommand `about` on same line, even in `--help` |
| clap-rs__clap-4909 | no overlap found (rule check) | Using index_of()/indices_of() with optional arguments that take optional values |
| clap-rs__clap-5075 | no overlap found (rule check) | Support custom suggested fix messages for specific flags |
| clap-rs__clap-5080 | no overlap found (rule check) | `UnknownArgumentValueParser` eagerly errors out |
| clap-rs__clap-5228 | no overlap found (rule check) | `flatten_help` shows a `hide(true)` annotated subcommand in the overview |
| clap-rs__clap-5298 | no overlap found (rule check) | Subcommand flags can't conflict with arguments |