Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot run program "./dsdgen" (in directory "dsdgen/tools"): error=2, No such file or directory #50

Open
eyys opened this issue Jul 25, 2024 · 0 comments

Comments

@eyys
Copy link

eyys commented Jul 25, 2024

Hello, after I have compiled using hive-testbench, use the command on the server
. / TPCDS - setup. Sh 10 / warehouse/in tablespace/managed/hivetestold.
An error occurs during the generation process. Viewing the yarn log, it is found that the file exists.
24/07/25 15:10:47 INFO mapreduce.Job: Task Id : attempt_1721119391114_0062_m_000000_2, Status : FAILED Error: java.io.IOException: Cannot run program "./dsdgen" (in directory "dsdgen/tools"): error=2, No such file or directory at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048) at java.lang.Runtime.exec(Runtime.java:620) at org.notmysock.tpcds.GenTable$DSDGen.map(GenTable.java:190) at org.notmysock.tpcds.GenTable$DSDGen.map(GenTable.java:163) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:800) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:348) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172) Caused by: java.io.IOException: error=2, No such file or directory at java.lang.UNIXProcess.forkAndExec(Native Method) at java.lang.UNIXProcess.<init>(UNIXProcess.java:247) at java.lang.ProcessImpl.start(ProcessImpl.java:134) at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029) ... 11 more
yarn.log
2147526411 564 -r-xr-xr-x 1 yarn hadoop 574256 Jul 24 17:03 ./dsdgen/tools/dsdgen
What is the cause

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant