add EN prompts for XCOPA (selected languages) - #795
Conversation
|
will add id translation |
There was a problem hiding this comment.
Nice! 👻
-
There's a lot of double spaces. I didn't mark all, cuz maybe this is on purpose? As humans would still answer correctly.. (@VictorSanh, @stephenbach?)
-
Do we need to repeat the same template for each lang? If it's easiest, let's do it, else I think we can use something like @lintangsutawika described here & just use the same template for different langs.
Yes this kind of noise/variance is totally fine. Some prompts have a single \n, others have triple \n, and we encouraged this kind of variations. |
Co-authored-by: Niklas Muennighoff <n.muennighoff@gmail.com>
Co-authored-by: Niklas Muennighoff <n.muennighoff@gmail.com>
Co-authored-by: Niklas Muennighoff <n.muennighoff@gmail.com>
Co-authored-by: Niklas Muennighoff <n.muennighoff@gmail.com>
VictorSanh
left a comment
There was a problem hiding this comment.
lgtm, thanks! will merge as soon as the tests pass
This PR adds EN prompts (from COPA) for the XCOPA languages that are in Bloom's training data, so we can use it for training Bloom-T0++ (name TBD :P)
@Muennighoff @thomasw21 @lintangsutawika