Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

hive configuration hive.optimize.sort.dynamic.partition.threshold does not exists #28

Open
powerLambda opened this issue Aug 31, 2020 · 4 comments

Comments

@powerLambda
Copy link

failed to execute tpch-setup.sh in hive2.3.5, hadoop2.8.5

DEBUG_SCRIPT=ON FORMAT=textfile ./tpch-setup.sh 100 /data
Logging initialized using configuration in file:/usr/local/service/hive/conf/hive-log4j2.properties Async: true
Query returned non-zero code: 1, cause: hive configuration hive.optimize.sort.dynamic.partition.threshold does not exists.

@p-forest
Copy link

which file to configure the item and a valid value? i have no idea.

@lyzGithub
Copy link

you can modify the setting sql in the settings/load-flat.sql

@herrytco
Copy link

herrytco commented Sep 2, 2021

I had the same issue, my Hive version did not support the setting configuration hive.optimize.sort.dynamic.partition.threshold. In the file settings/load-flat.sql, I changed the line

set hive.optimize.sort.dynamic.partition.threshold=0;

to

set hive.optimize.sort.dynamic.partition=true;

which fixed the issue

@davi16sm
Copy link

davi16sm commented Jun 3, 2023

I had the same issue, my Hive version did not support the setting configuration hive.optimize.sort.dynamic.partition.threshold. In the file settings/load-flat.sql, I changed the line

set hive.optimize.sort.dynamic.partition.threshold=0;

to

set hive.optimize.sort.dynamic.partition=true;

which fixed the issue

Great! This fix the issue!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants