I configured a GPU for Milvus, why is it not used?

[luli817]

[haorenfsa]

Hi @luli817: I assume you're following https://milvus.io/docs/install_standalone-helm-gpu.md#Install-Milvus-Standalone-with-GPU-Support. You would also need to use Milvus' gpu image, which is not mentioned in this doc.

image:
  all:
    repository: milvusdb/milvus
    tag: v2.3.12-gpu

We will update the doc soon. Thank you for your feedback!

[luli817]

Okay, thank you, I'll give it a try. By the way, it seems that you can't specify runtimeclass in values. I need to modify the deoloyment manually.

好的，谢谢您，我试试，我顺便说一下，你们values里面好像没法指定runtimeclass.我需要手动修改deoloyment

[haorenfsa]

@luli817 thank you again, it's true that runtimeclass is not supported yet. By the way, would you like to make a patch to support it?

[haorenfsa]

I'll translate the words to english for more users to follow.

[luli817]

Adding a patch to set up runtimeclass is actually quite simple, but I don't have experience in collaborative development on GitHub and am not familiar with the process. I would like to add you on WeChat and ask for your advice. Then I would like to explain why I need to add the runtimeclass parameter, because my CNI is Cilium, but Cilium cannot start in NVIDIA runtime, which means I have to configure two runtimes on this node.

[luli817]

@haorenfsa hi,I have set up the GPU image, but he hasn't used GPC yet.

[haorenfsa]

@LoveEachDay @liliu-z Any idea about this?

[liliu-z]

Can I have the script you create the GPU index?

[luli817]

@liliu-z I didn't specifically create a GPU index.

[liliu-z]

@liliu-z I didn't specifically create a GPU index.

Then you need to do so, Plz check MIlvus' doc

[luli817]

@liliu-z I need to create a GPU index first before Milvus can use the GPU, right?

[haorenfsa]

@luli817 I guess yes. does it work?