Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add cuvs_bench.run python code and build #279

Merged
merged 29 commits into from
Sep 27, 2024

Conversation

dantegd
Copy link
Member

@dantegd dantegd commented Aug 6, 2024

Builds on top of #275

@cjnolet cjnolet added improvement Improves an existing functionality non-breaking Introduces a non-breaking change labels Sep 4, 2024
@github-actions github-actions bot added the ci label Sep 17, 2024
@divyegala divyegala marked this pull request as ready for review September 18, 2024 21:24
@divyegala divyegala requested review from a team as code owners September 18, 2024 21:24
cpp/CMakeLists.txt Outdated Show resolved Hide resolved
@divyegala
Copy link
Member

@rapidsai/packaging-codeowners could we get a review here please?

Copy link
Contributor

@bdice bdice left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A couple questions on dependencies.yaml usage. I assume this is basically the same as the RAFT code but ported to cuVS so I didn’t inspect it all super closely.

dependencies.yaml Show resolved Hide resolved
python/cuvs_bench/pyproject.toml Show resolved Hide resolved
Copy link
Contributor

@bdice bdice left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some necessary changes, and some questions for developers to determine whether changes are needed.

.gitignore Outdated
@@ -79,3 +79,6 @@ cagra_index
ivf_flat_index
ivf_pq_index

# cuvs_bench
datasets/
*.json
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can this be more specific? We use .json files for configuration and this would cause them to never have changes committed.

Examples:

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point, I'll remove this. Thanks!

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, I meant I'll make it more specific to only ignore .json files from root directory

build.sh Outdated Show resolved Hide resolved
conda/recipes/libcuvs/build_libcuvs_tests.sh Outdated Show resolved Hide resolved
python/cuvs_bench/cuvs_bench/run/__main__.py Show resolved Hide resolved
python/cuvs_bench/cuvs_bench/run/__main__.py Outdated Show resolved Hide resolved
python/cuvs_bench/pyproject.toml Outdated Show resolved Hide resolved
Copy link
Contributor

@bdice bdice left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @divyegala.

@@ -79,3 +79,6 @@ cagra_index
ivf_flat_index
ivf_pq_index

# cuvs_bench
datasets/
/*.json
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add back the trailing newline? And is there a name pattern that we can attach to this? Like “/bench*.json”? It’s very possible that we might want top level configuration in JSON.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We'll rework this if we add top-level JSON configurations later on. For now, this tool sometimes create top-level JSON files so we'll refactor it, if needed, so it doesn't do that

@cjnolet
Copy link
Member

cjnolet commented Sep 27, 2024

/merge

@rapids-bot rapids-bot bot merged commit d9eec69 into rapidsai:branch-24.10 Sep 27, 2024
54 checks passed
rapids-bot bot pushed a commit that referenced this pull request Oct 1, 2024
Builds on top of #279, will change from draft after that merge, or we can merge into one single PR if reviewers prefer so.

Authors:
  - Dante Gama Dessavre (https://github.com/dantegd)
  - Corey J. Nolet (https://github.com/cjnolet)
  - Divye Gala (https://github.com/divyegala)
  - rhdong (https://github.com/rhdong)

Approvers:
  - Corey J. Nolet (https://github.com/cjnolet)

URL: #347
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CMake cpp improvement Improves an existing functionality non-breaking Introduces a non-breaking change Python
Projects
Development

Successfully merging this pull request may close these issues.

5 participants