Skip to content

Pull requests: AISBench/benchmark

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort

Pull requests list

fix(livecodebench): support sys.stdin.buffer no_review PR 未包含任何检视意见,合入前必须包含检视意见
#570 opened Sep 21, 2026 by zhongzhouTan-coder Collaborator Loading…
[Bugfix] Ignore API CLI overrides for local models bugfix review_opened PR 中存在未闭环的检视意见,所有检视意见必须闭环后才能合入
#569 opened Sep 21, 2026 by zhongzhouTan-coder Collaborator Loading…
4 of 15 tasks
docs: polish response anomaly docs wording in models.md and tutorial docs
#566 opened Sep 21, 2026 by Libotry Collaborator Loading…
2 of 15 tasks
[Bugfix] Suppress verbose evaluation artifacts in task logs bugfix no_review PR 未包含任何检视意见,合入前必须包含检视意见
#565 opened Sep 21, 2026 by zhongzhouTan-coder Collaborator Loading…
4 of 15 tasks
[bugfix] simplify run output and fix model import bugfix no_issue PR 未关联任何 Issue,合入前必须关联 Issue no_review PR 未包含任何检视意见,合入前必须包含检视意见
#564 opened Sep 20, 2026 by jschen069 Collaborator Loading…
1 of 15 tasks
0914 tele bench large_pr PR 新增代码超过 1000 行,建议拆分为更小的 PR no_issue PR 未关联任何 Issue,合入前必须关联 Issue no_review PR 未包含任何检视意见,合入前必须包含检视意见
#563 opened Sep 20, 2026 by jschen069 Collaborator Loading…
15 tasks
[bugfix] fix prefixcache desc bugfix no_review PR 未包含任何检视意见,合入前必须包含检视意见 no_UT feature / bugfix 类型 PR 缺少 tests/UT 下的单元测试新增或修改
#562 opened Sep 20, 2026 by jschen069 Collaborator Loading…
1 of 15 tasks
[bugfix]Modified the prefix cache import method to check only for the existence of the physical package. bugfix no_issue PR 未关联任何 Issue,合入前必须关联 Issue no_review PR 未包含任何检视意见,合入前必须包含检视意见
#561 opened Sep 20, 2026 by jschen069 Collaborator Loading…
1 of 15 tasks
[Docs] Add FAQ for Harbor docker subnet exhaustion in sidecar mode no_review PR 未包含任何检视意见,合入前必须包含检视意见
#560 opened Sep 20, 2026 by ivanbao9783 Collaborator Loading…
[Bugfix] Constrain setuptools to retain pkg_resources compatibility bugfix no_review PR 未包含任何检视意见,合入前必须包含检视意见
#558 opened Sep 20, 2026 by zhongzhouTan-coder Collaborator Loading…
5 of 15 tasks
2
2
0914 muti input understand large_pr PR 新增代码超过 1000 行,建议拆分为更小的 PR no_review PR 未包含任何检视意见,合入前必须包含检视意见
#554 opened Sep 17, 2026 by jschen069 Collaborator Loading…
15 tasks
[fix][datasets] Support \boxed{X} answer extraction in GPQA_Simple_Eval_postprocess bugfix no_review PR 未包含任何检视意见,合入前必须包含检视意见
#546 opened Sep 15, 2026 by tunglambk Loading…
4 of 15 tasks
Escape backslash in HLE judge prompt config no_issue PR 未关联任何 Issue,合入前必须关联 Issue no_review PR 未包含任何检视意见,合入前必须包含检视意见
#543 opened Sep 14, 2026 by MBK-fr Loading…
bugfix: cmmlu数据集请求模板和答案判定的pattern不一致的问题修复 bugfix no_review PR 未包含任何检视意见,合入前必须包含检视意见
#524 opened Sep 9, 2026 by ytlds Loading…
5 of 15 tasks
fix(livecodebench): expose .buffer on mocked stdin/stdout no_issue PR 未关联任何 Issue,合入前必须关联 Issue no_review PR 未包含任何检视意见,合入前必须包含检视意见
#518 opened Sep 6, 2026 by yqy003 Loading…
15 tasks
fix: skip id: lines in streaming response parsing bugfix no_issue PR 未关联任何 Issue,合入前必须关联 Issue no_review PR 未包含任何检视意见,合入前必须包含检视意见
#481 opened Aug 21, 2026 by navtrade Loading…
1 of 9 tasks
0819 fix itl no_issue PR 未关联任何 Issue,合入前必须关联 Issue no_review PR 未包含任何检视意见,合入前必须包含检视意见
#479 opened Aug 19, 2026 by jschen069 Collaborator Loading…
15 tasks
Add din_integration/: SWE-bench DinD evaluation pipeline integration large_pr PR 新增代码超过 1000 行,建议拆分为更小的 PR no_issue PR 未关联任何 Issue,合入前必须关联 Issue no_review PR 未包含任何检视意见,合入前必须包含检视意见 other
#456 opened Aug 12, 2026 by Huafubing Contributor Loading…
1 of 2 tasks
feat(acc): add gpqa 5-shot-prompt feature
#450 opened Aug 11, 2026 by ivanbao9783 Collaborator Loading…
1 of 15 tasks
feat: add aa_lcr unit test
#420 opened Jul 24, 2026 by jschen069 Collaborator Loading…
15 tasks
fix: add cross-platform file locking and background progress thread bugfix
#414 opened Jul 23, 2026 by jschen069 Collaborator Loading…
1 of 15 tasks
feat: add ifbench unit test test-cases
#413 opened Jul 23, 2026 by jschen069 Collaborator Loading…
1 of 15 tasks
[Feature][CI/CD] Support agent runtime env auto deploy feature
#410 opened Jul 23, 2026 by SJTUyh Collaborator Loading…
2 of 15 tasks
【WIP】 control Prefill con in aisbench
#396 opened Jul 14, 2026 by vasede Loading…
15 tasks
bugfix: Support for extracting answers expressed in thousand separato… bugfix
#360 opened Jun 24, 2026 by yejj710 Collaborator Loading…
1 of 9 tasks
ProTip! Follow long discussions with comments:>50.