Incorporate facilities for computation of inter-annotator agreement and other evaluation

[proycon]

We need user-friendly tools for researchers to compute inter-annotator agreement of arbitrary FoLiA annotations.

Computation of IAA is an important evaluation metric evaluation tools are currently not provided by FLAT at all; having such a facility as an interface for end-users in FLAT makes evaluation more accessible and prevent researchers from having to write their own evaluation scripts.

(proposed for CLARIAH-PLUS)

[proycon]

Depends on proycon/folia#39

[OsmanMutlu]

Hi proycon,

You can check this script that i wrote for our own annotations. It is not generic enough though.

[proycon]

@OsmanMutlu Thanks! I'll take a look! I do already have a fairly generic foliaeval tool though, this issue is more about integrating it into FLAT and providing an interface.