Leaklens

Multi-SWE-bench (flash): every task, with its verdict

Multi-SWE-bench, published by ByteDance Seed. Paper authors: Daoguang Zan, Zhirong Huang, Wei Liu, Hanwu Chen, Linhao Zhang, Shulin Xin, Lu Chen, Qi Liu, Xiaojian Zhong, Aoyan Li, Siyao Liu, Yongsheng Xiao, Liangqiang Chen, Yuyu Zhang, Jing Su, Tianyu Liu, Rui Long, Kai Shen and Liang Xiang. Multi-SWE-bench (arXiv) · Report a correction · flags show what the public text and git history contain: public exposure was possible, nothing more.

Download CSV
TaskVerdictIssue title
cli__cli-1069no overlap found (rule check)Creating an issue from a template doesn't apply template labels to newly created issue
cli__cli-1103no overlap found (rule check)gh alias delete
cli__cli-1155no overlap found (rule check)support detached HEAD git state whenever applicable
cli__cli-1279no overlap found (rule check)Gracefully handle when branches automatically deleted when PR is merged
cli__cli-1337no overlap found (rule check)show issue title after using 'issue close'
cli__cli-1343no overlap found (rule check)issue scriptability improvements
cli__cli-1366no overlap found (rule check)`gh {pr,issue} create` does not support {ISSUE,PULL_REQUEST}_TEMPLATE without `.md` extension
cli__cli-1373no overlap found (rule check)pr scriptability improvements
cli__cli-1494no overlap found (rule check)"json: cannot unmarshal string" error message for unsuccessful "gh api" request
cli__cli-1580no overlap found (rule check)Provide all metadata fields in scripted `pr view`
cli__cli-1642no overlap found (rule check)gh auth login --web
cli__cli-2034no overlap found (rule check)gist: edit command doesn't check gist ownership before editing
cli__cli-2146no overlap found (rule check)For `pr checks` cmd, add -w flag to view checks tab on github.com
cli__cli-2222no overlap found (rule check)Support cloning a gist (just like cloning a repo)
cli__cli-2263no overlap found (rule check)Supply --web to gist create to streamline create & view process
cli__cli-2279no overlap found (rule check)Update messaging when `gh pr check` run on repo w/o CI
cli__cli-278no overlap found (rule check)Be explicit in pr status about what you are looking at
cli__cli-302no overlap found (rule check)Support `checkout` for PRs whose head matches an unrelated local branch
cli__cli-352no overlap found (rule check)Support opening Pull Request by commit sha
cli__cli-362no overlap found (rule check)non-web PR creation fails for forks
cli__cli-402no overlap found (rule check)Segmentation violation at previewing an issue without description
cli__cli-405no overlap found (rule check)Nil pointer dereference while previewing PR and Issues with empty body
cli__cli-474no overlap found (rule check)Clarify error message when someone uses #<num> instead of <num> for pr and issue commands
cli__cli-477no overlap found (rule check)gh pr status -R cli/cli fails to get PRs status if not inside any repository directory
cli__cli-495no overlap found (rule check)Panic running "gh pr list at /home/runner/work/cli/cli/utils/table_printer.go:179
cli__cli-513no overlap found (rule check)`gh pr list --state=closed` excludes `merged` — differs from `is:closed` behavior on web UI?
cli__cli-545no overlap found (rule check)Add ability to clone a repo
cli__cli-590no overlap found (rule check)Autofill PR title and body with commit message and body
cli__cli-624no overlap found (rule check)For merged/closed PRs on current branch, show that instead of checks/review status
cli__cli-625no overlap found (rule check)Support filtering by author for issues
cli__cli-638no overlap found (rule check)Only show the most recent PR for current branch
cli__cli-665no overlap found (rule check)Swap default behavior of "view" actions to display in terminal instead of web
cli__cli-690no overlap found (rule check)View a repo in the terminal
cli__cli-696no overlap found (rule check)Support `pr status` in a repository that doesn't have any commits
cli__cli-708no overlap found (rule check)`gh repo fork` should detect existing remote
cli__cli-727no overlap found (rule check)repo clone should support cloning into a specific directory
cli__cli-728no overlap found (rule check)Enable configuration in gh (gh config)
cli__cli-810no overlap found (rule check)support defaulting to SSH remotes
cli__cli-842no overlap found (rule check)Closed PRs for merging master into a branch will never disappear
cli__cli-869no overlap found (rule check)Allow a local branch name to be provided when checking out a pull request
cli__cli-879no overlap found (rule check)Name of issue template is not retrieved and displayed
cli__cli-885no overlap found (rule check)Ability to review a pull request
cli__cli-962no overlap found (rule check)gh pr diff
cli__cli-970no overlap found (rule check)gh alias set
cli__cli-981no overlap found (rule check)Feature request: add command to create gist