The project.yml
defines the data assets required by the
project, as well as the available commands and workflows. For details, see the
Weasel documentation.
The following commands are defined by the project. They
can be executed using weasel run [name]
.
Commands are only re-run if their inputs have changed.
Command | Description |
---|---|
corpus |
Convert the data to spaCy's format |
vectors |
Convert, truncate and prune the vectors. |
train |
Train the full pipeline |
evaluate |
Evaluate on the test data and save the metrics |
clean |
Remove intermediate files |
The following workflows are defined by the project. They
can be executed using weasel run [name]
and will run the specified commands in order. Commands are only re-run if their
inputs have changed.
Workflow | Steps |
---|---|
all |
vectors → corpus → train → evaluate |
The following assets are defined by the project. They can
be fetched by running weasel assets
in the project directory.
File | Source | Description |
---|---|---|
assets/vectors.zip |
URL | GloVe vectors |
assets/conll2003/dev.iob |
Local | Development data (not available publicly so you have to add the file yourself) |
assets/conll2003/test.iob |
Local | Test data (not available publicly so you have to add the file yourself) |
assets/conll2003/train.iob |
Local | Training data (not available publicly so you have to add the file yourself) |
assets/orth_variants.json |
URL | A file containing orth variants for data augmentation |