Code

Add mixed workload#1

Code

Open

Sheharyar570 wants to merge 32 commits intomasterEmumbaOrg/HammerDB:masterfrom add-mixed-workloadEmumbaOrg/HammerDB:add-mixed-workloadCopy head branch name to clipboard

+3,680-55

Commits

Commits on Aug 28, 2024

• POC done, running vector and OLTP queryies in parallel.

  Sheharyar570

  committed
  3b4ae36

• DB functions, prepared statment, and store procedures added for vector queries.

  Sheharyar570

  committed
  e7f8869

• Assign vector and OLTP workload to different set of virtual users to control workload distribution.

  Sheharyar570

  committed
  e515598

• Bug fixed: vu 1 exits with finished failed status, because not all virtual users are reporting to monitor vu.

  Sheharyar570

  committed
  2cb8bd0

• Added QPS metric for vector queries.

  Sheharyar570

  committed
  9561caf

• Added Recall metric calculation for vector queries

  Sheharyar570

  committed
  7329a02

Commits on Aug 29, 2024

• Add QPS calculation in xtprof

  wahajali

  committed
  93f9c61

• Vector QPS calculation - ignore rampup data

  wahajali

  committed
  f2718d4

• Merge pull request #2 from EmumbaOrg/add-qps-calculation

  Show description for 8a01ff2
  Sheharyar570

  authored
  8a01ff2

Commits on Aug 30, 2024

• Dataset load in memory adn read optimization and some refactoring

  Sheharyar570

  committed
  1be4d57

• Updated OLTP workload to start profiling after rampup time.

  Sheharyar570

  committed
  e6a4a06

• Recall calculated after test run using custom script.

  Sheharyar570

  committed
  44cf3bf

Commits on Sep 5, 2024

• Vector workload related params configuration enabled from config file.

  Sheharyar570

  committed
  9ad3d01

• Update vector related params from HammerDB CLI.

  Sheharyar570

  committed
  cded18c

Commits on Sep 11, 2024

• Fixed issue with setting session params.

  Sheharyar570

  committed
  5f8667e

• Added automation script to run mixed workload with different configuration cases.

  Sheharyar570

  committed
  6ab1e21

• Updated xtprof module to store results in path defined in a separate env variable RESULTS_LOCAL_DIR.

  Sheharyar570

  committed
  7ff3f30

Commits on Sep 12, 2024

• Add distance operator dynamically to prepared statement. Updated vectordb config structure.

  Sheharyar570

  committed
  9dfcea1

• Use relative path to test and ground_truth data files.

  Sheharyar570

  committed
  485d84e

• Configure vectordb dict in hammerdb before running each benchmark case.

  Sheharyar570

  committed
  79dbd3e

Commits on Sep 17, 2024

• Update config.json to support optional build schema, warehouse count, and VU num for schema build.

  Sheharyar570

  committed
  e9ddb0c

• Add NOPM and TPM metric in xtprof module

  Sheharyar570

  committed
  ab0a4ad

Commits on Sep 19, 2024

• Added pgdiskann support

  Sheharyar570

  committed
  27a7d8a

• Updated config file name

  Show description for 8e2fc30
  Sheharyar570

  committed
  8e2fc30

• Fixed diskann automation script

  Sheharyar570

  committed
  ccde878

Commits on Sep 24, 2024

• Fixed bug

  Sheharyar570

  committed
  735a8df

• Add mixed workload distribution between vu ratio configration param

  Sheharyar570

  committed
  1d44c44

• Add vector table name configuration parameter.

  Sheharyar570

  committed
  95a0177

Commits on Oct 2, 2024

• Removed stored procedures option for vector search.

  Sheharyar570

  committed
  898f83a

• Script to combine benchmark results in multiple files into single json file.

  Sheharyar570

  committed
  4a26393

Commits on Oct 4, 2024

• Dump HammerDB config in logs

  Sheharyar570

  committed
  09d1614

• Updated script to handle results in multiple directories

  Sheharyar570

  committed
  d15d1ed