New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

embedded R #9

Open

piccolbo opened this issue Mar 10, 2016 · 0 comments

Member

piccolbo commented Mar 10, 2016

we could use renjin to define R UDFS UDAFs etc.

Some obstacles

UDF interface is record at a time. With R is vectorize or bust. There is somebody working on this for SparkR but it's unclear, actually, unlikely the goodness will trickle to SQL. UDAF is a better opportunity. Imagine grouping by a col then fitting a linear model on each group

subtasks

support binary cols in backend. There is a problem in RJDBC preventing this. Could us ASCII instead.
support automatic serde of cols. Question is where do we store the metadata that says that? Or do we autodetect?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment