v0.5.0
v0.5.0 (2019-06-06)
Closed issues:
- Add TokTok tokenizer (#15)
Merged pull requests:
- Fix inconsistency between tabs and spaces (#25) (Ayushk4)
- appveyor badge fix (#23) (aquatiko)
- Fix indentation in nltk_word.jl (#22) (Ayushk4)
- Fix indentation. (#21) (Ayushk4)
- Minor doc fixes in fast.jl (#20) (Ayushk4)
- some cleanup, inclusing changing TokenBuffer to use replaces rather than splits (#19) (oxinabox)
- add toktok tokenizer (#18) (aquatiko)