Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update method for locating cufile and remove unused libcudf cmake options #2594

Merged
merged 4 commits into from
Nov 15, 2024

Conversation

jlowe
Copy link
Member

@jlowe jlowe commented Nov 14, 2024

Relates to rapidsai/cudf#17298 and rapidsai/cudf#17315. FindcuFile.cmake was removed, so this updates the spark-rapids-jni CMakeLists.txt to use a similar approach as to the RAPIDS PRs. Like those PRs, this adds a backported FindCUDAToolkit.cmake to work around a bug in older cmake versions where libcufile could not be found.

This also adds the upcoming CUDA_STATIC_CUFILE flag so we do not dynamically link libcufile, and some unused libcudf cmake options were removed.

@jlowe jlowe added the build label Nov 14, 2024
@jlowe jlowe self-assigned this Nov 14, 2024
hyperbolic2346
hyperbolic2346 previously approved these changes Nov 14, 2024
pom.xml Show resolved Hide resolved
@jlowe
Copy link
Member Author

jlowe commented Nov 14, 2024

build

pxLi
pxLi previously approved these changes Nov 14, 2024
Copy link
Collaborator

@pxLi pxLi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks!

gerashegalov
gerashegalov previously approved these changes Nov 14, 2024
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In this repo we could just upgrade CMake

@NvTimLiu
Copy link
Collaborator

CI FAILED #764

09:27:32  [INFO]      [exec] -- Configuring done (78.7s)
09:27:33  [INFO]      [exec] CMake Error in CMakeLists.txt:
09:27:33  [INFO]      [exec]   IMPORTED_LOCATION not set for imported target "CUDA::nvml" configuration
09:27:33  [INFO]      [exec]   "Release".
09:27:33  [INFO]      [exec] 

@jlowe
Copy link
Member Author

jlowe commented Nov 15, 2024

Waiting for new CI images to be published with the changes from #2597 before kicking off another CI run.

@jlowe
Copy link
Member Author

jlowe commented Nov 15, 2024

build

@jlowe jlowe merged commit b96aa67 into NVIDIA:branch-24.12 Nov 15, 2024
3 checks passed
@jlowe jlowe deleted the findcufile branch November 15, 2024 22:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants