You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Since it's multiple choice with four options, random guessing should give at least 25%.
Have you released the outputs from your evaluation runs anywhere?
Activity
tuantuanzhang commentedon May 14, 2025
the context is long and noisy. LLMs tend to "think" rather than guessing. The output is also posted under our repo