Skip to content

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

License

Notifications You must be signed in to change notification settings

datawaves-xyz/ethereum-etl-airflow

 
 

Repository files navigation

Ethereum ETL Airflow

The repository forks from ethereum-etl-airflow.

deploy-airflow.sh

  • namespace [required]: namespace scope for this request
  • pg-url [required]: url of the postgresql, the format should be user:password@host:port/db
  • fernet-key [required]: to encrypt passwords in the connection configuration and the variable configuration, changing the key will cause decryption of existing credentials to fail
  • eks-host [required]: host url of the AWS EKS (the script just server for the EKS users)
  • image-name [required]: name of the docker image, like: airflow
  • image-tag [required]: version tag of the docker image, like: 1.10.15-b11
  • build-image: if set, will build a new image by the Dockerfile and use it

About

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 96.7%
  • Shell 1.7%
  • Dockerfile 1.6%