lexical/TRANSLATE at main · ekinakyurek/lexical · GitHub

Name		Name	Last commit message	Last commit date
parent directory ..
alignments		alignments
README.md		README.md
cmn.tsv		cmn.tsv
cmn.txt		cmn.txt
cmn.txt_dev_tokenized.tsv		cmn.txt_dev_tokenized.tsv
cmn.txt_test_tokenized.tsv		cmn.txt_test_tokenized.tsv
cmn.txt_train_tokenized.tsv		cmn.txt_train_tokenized.tsv
cmn.txt_train_tokenized.tsv.fast		cmn.txt_train_tokenized.tsv.fast
cmn.txt_train_tokenized_geca.tsv		cmn.txt_train_tokenized_geca.tsv

README.md

Attribution / License

We use the data obtained from ManyThings.org which collected this data from tatoeba.org corpus.
The data is licensed under the Creative Commons - Attribution 2.0 France license. (terms of use page on tatoeba.org)

Copyright

Though the source data is available under the CC BY license, the downloaded datafile on this repository have been edited by ManyThings.org and are copyrighted.

Tokenized Files

You can find tokenized files produced using original data under this folder *.tsv. We use these files in our experiments.