Some short options are broken #13

Activity

1. ypeels commented on Jan 20, 2016

   

   ypeels

   on Jan 20, 2016

   More actions

   It looks like -P is also affected, and this does change the behavior of multeval from what is expected (see table below)... Sorry this comment is so long; I wrote most of it up before seeing this existing ticket.

   tl;dr
   Use --ter.punctuation instead of -P

   ---

   Steps to reproduce in commit bd93ed, using the following command (default setting is false, from TER.java - alternatively, you can instrument the value of punctuation)

   $ ./multeval.sh eval --refs example/refs.test2010.lc.tok.en.0 \
   > --hyps-baseline example/hyps.lc.tok.en.baseline.opt0 \
   > --metrics ter \  
   > $punctFlag $punctOption
   

   And here are the resulting TER scores, for command-line arguments. Only --ter.punctuation true seems to have any effect.

   $punctFlag	$punctOption	Result
   		baseline 65.5 (0.4/*/-)
   -P		baseline 65.5 (0.4/*/-)
   -P	true	baseline 65.5 (0.4/*/-) <-- should be 68.6?
   -P	false	baseline 65.5 (0.4/*/-)
   -P=true		baseline 65.5 (0.4/*/-)
   -Ptrue		baseline 65.5 (0.4/*/-)
   --ter.punctuation	1	baseline 65.5 (0.4/*/-)
   --ter.punctuation	true	baseline 68.6 (0.4/*/-) <--
2. ozancaglayan commented on Apr 11, 2017

   

   ozancaglayan

   on Apr 11, 2017

   More actions

   I think all of them are broken actually.
3. ozancaglayan

   added a commit that references this issue on Apr 11, 2017

   Remove short names for cmdline args

   ...

   1d71139