Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added a tool that prints the Hive username and password from inside a… #1

Closed
wants to merge 2 commits into from

Conversation

georgepachitariu
Copy link
Owner

@georgepachitariu georgepachitariu commented Mar 24, 2020

I'm storing this pull request here because I prefer to have another pull-request merged first:
jcrist#210 (afterward I would like to merge this as well to the original skein project)

The context: I would like to be able to connect to Hive using a pure-python library (PyHive) and authenticate with the Hive Delegation Token.

The problem: The Hadoop delegation token file is written in Hadoop Text format(gihub-link1, stackoverflow-link1)

I would like to have a small tool based on the same idea as the gihub-link1 repo above as part of the skein library.
The alternative is re-implementing a File Reader in Python. That is a big effort that I would like to avoid.

I think that this approach is similar to PySpark. There there is a connection (gateway) between the Python program and the one running on JVM. (I couldn't find the code that gets the credentials through the gateway, but I can look again.)

I wrote the code with a self-centered view, only addressing my specific problem because to me it looks like each database has its own way of authenticating and I didn't spend the time to read&understand all of them to be able to write a generic tool here. I assume that this code will evolve to be more generic in the future.

As always I appreciate any feedback.

@georgepachitariu
Copy link
Owner Author

In case anyone finds this page.
The solution in this pull-request works.
However, we decided to use Pyspark in my company which has this step already implemented.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant