You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello,
i try to adapt "docker-compose.spark_bitnami.yml" to used it with an existing installation of spark on docker (also an bitnami container).
I have an error about SPARK_HOME variable corrected in docker compose.
If i have understood this variable is used to get configuration of spark.
Is it possible to have only spark configuration in dockerfile instead to have a full spark installation ?
Hello,
i try to adapt "docker-compose.spark_bitnami.yml" to used it with an existing installation of spark on docker (also an bitnami container).
I have an error about SPARK_HOME variable corrected in docker compose.
If i have understood this variable is used to get configuration of spark.
Is it possible to have only spark configuration in dockerfile instead to have a full spark installation ?
Thanks for your work.
Best regards
Seb
docker compose file:
services:
spark:
build: .
environment:
- SPARK_MODE=master
......
spark-worker-1:
build: .
environment:
- SPARK_MODE=worker
.....
livy:
image: livy-ofekhod
container_name: livy
environment:
- SPARK_HOME=/opt/bitnami/spark
- SPARK_CONF_DIR=/opt/bitnami/spark/conf
......
The text was updated successfully, but these errors were encountered: