SIGN IN SIGN UP

CharacTER: MT metric (#286)

* init character MT metric

* Update README.md

* make style

* add isorts fixes

* make style

* fix example in README

* add cer dependency for tests

* Update metrics/character/requirements.txt

Co-authored-by: helen <31600291+mathemakitten@users.noreply.github.com>

* Update metrics/character/README.md

Co-authored-by: helen <31600291+mathemakitten@users.noreply.github.com>

* Update metrics/character/README.md

Co-authored-by: helen <31600291+mathemakitten@users.noreply.github.com>

* Update metrics/character/character.py

Co-authored-by: helen <31600291+mathemakitten@users.noreply.github.com>

* Update metrics/character/character.py

Co-authored-by: helen <31600291+mathemakitten@users.noreply.github.com>

* Delete .gitattributes

* require cer >=1.1.0

* use calculate_cer when given a string

* add separate test for single/corpus

* streamline output format

the corpus version now only adds attributes, but cer_scores will always be present and always a list

* style

* update documentation

* add singleton example

* update cer dependency to 1.2.0

* make metric more robust

Now correctly accepts single strings and lists as input. Now only returns cer_scores and not other statistics as this seems rather uncommon and might be confusing for users.

* fix doctest formatting

* use non-local metric name

* update dependency

* simplify metric, assume we always work with batches

* aggregate scores

add aggregate and return_all_scores arguments

* add multi-reference option

* remove "Literal"

* Delete tests.py

Do tests via doctest instead

* Apply suggestions from code review

Co-authored-by: helen <31600291+mathemakitten@users.noreply.github.com>

* Update description

Co-authored-by: helen <31600291+mathemakitten@users.noreply.github.com>
Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>
B
Bram Vanroy committed
544f1e8a5f30663d59ed6ba94b2b7380e8b4c309
Parent: 83322c1
Committed by GitHub <noreply@github.com> on 12/8/2022, 3:20:28 PM