Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

This version of %1 is not compatible with the version of Windows you're running #20

Open
molotch opened this issue Mar 8, 2021 · 5 comments

Comments

@molotch
Copy link

molotch commented Mar 8, 2021

Windows 10 Pro 10.0.18363 Build 18363
AdoptOpenJDK build 1.8.0_282-b08
Spark 2.4.5
Scala 2.12.13

I'm getting this error trying to save a dataframe in Spark parquet locally on my Windows 10 computer. Anyone got any ideas on how to fix this or why it throws an exception? I've tried changing java version, spark version, scala version and winutils.exe version with the same result. Seems to be a Windows issue.

"java.io.IOException: Cannot run program "C:\hadoop\bin\winutils.exe": CreateProcess error=216, This version of %1 is not compatible with the version of Windows you're running. Check your computer's system information and then contact the software publisher"

@geekalyssa
Copy link

I am also facing this issue for Windows 10. How did you resolved?

@molotch
Copy link
Author

molotch commented Apr 4, 2021

I used the 2.7.1 version from Steve Loughrans repo. I had used that before so I just copied it from another project I have. Though you might be lucky trying the 2.7.3 version from this repo. I have no idea what the root cause is though.

https://github.com/steveloughran/winutils/tree/master/hadoop-2.7.1/bin

@Wenjing323
Copy link

I met the same issue when trying to write to Parquet file in Windows 10 when using winutils.exe version 2.7.1. My spark environment is spark-3.1.1-bin-hadoop2.7.
After replacing winutils.exe version 2.7.1 with the version 2.8.1 below, I fixed this issue.

@kristoffSC
Copy link

kristoffSC commented Dec 13, 2021

In my case none of those work.
2.7.1, 2.8.1 and 3.0.0 All are failing with This version of %1 is not compatible with the version of Windows you're running

Windows 10 Pro 21H1
Build: 19043.1348

64-bitowy OS, procesor x64

EDIT:
Ok it worked with 3.0.1 but I had to download entire bin folder content not only hadoop.dll and winutils.exe

@abhinavsoti
Copy link

I was also facing the same issue for any version (https://github.com/cdarlint/winutils) I try to point to (i.e. 2.7.2, 2.8.1 etc) . However, the same version (2.7.2) started working when I downloaded and extracted the complete winutils master folders from git and again pointed to 2.7.2 version. Looks like, while downloading only file, it does something to it (which I am not interested in finding out) But that's how my error got resolved. The version of spark/hadoop and winutils are as follow:
Spark - spark-3.0.3
hadoop - 2.7
winutils - 2.7.2 from https://github.com/cdarlint/winutils

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants