How to get dataset size in vector db client

[hust-xing]

I'm adding a new vecoter db client, i need to get the dataset size in optimize function, how can i get it

[alwayslove2013]

@hust-xing Since the optimize function is executed after the insert, it is strongly recommended that you consider querying the amount of inserted data directly from the vector database server. This way, you won't need to modify the VDBBench testing framework.

The second approach is to modify the VDBBench test code by passing the current dataset size self.ca.dataset.data.size to self.db.optimize(). However, this modification may impact the testing of other vector database clients.

VectorDBBench/vectordb_bench/backend/task_runner.py

Lines 238 to 241 in 6a63416

	@utils.time_it
	def _task(self) -> None:
	with self.db.init():
	self.db.optimize()