New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Overhaul error correction #21

Open

JockLawrie opened this issue Aug 13, 2020 · 1 comment

Owner

JockLawrie commented Aug 13, 2020

Currently invalid values are set to missing.
We can view this as an error correction function: f(invalid_value) = missing.

Allow other functions.
E.g., f(invalid_value) = filter(isascii, invalid_value)
Use regexes to define other functions.

Owner Author

JockLawrie commented Aug 13, 2020

Use an ordered sequence of remediation steps, analogous to the ordered linkage criteria in SpineBasedRecordLinkage.jl.

Can restrict this feature to regexes. E.g., a regex can filter out non-ascii characters.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment