Skip to content

Commit

Permalink
NFR Test Results for NGF version edge (#2779)
Browse files Browse the repository at this point in the history 
Co-authored-by: Saylor Berman <[email protected]>
  • Loading branch information
@nginx-bot @sjberman
nginx-bot and sjberman authored Nov 22, 2024
1 parent d54377f commit 38a23bc
Show file tree
Hide file tree
Showing 70 changed files with 414 additions and 413 deletions.
40 changes: 20 additions & 20 deletions tests/results/dp-perf/edge/edge-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: 3a08fdafadfe0fb4a9c25679da1a1fcd6b181474
- Date: 2024-10-15T13:45:52Z
- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
- Date: 2024-11-14T18:42:55Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.30.5-gke.1014001
- k8s version: v1.30.5-gke.1443001
- vCPUs per node: 16
- RAM per node: 65853972Ki
- Max pods per node: 110
Expand All @@ -23,9 +23,9 @@ GKE Cluster:
## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 724.131µs
Latencies [min, mean, 50, 90, 95, 99, max] 506.273µs, 701.347µs, 679.076µs, 779.282µs, 819.797µs, 976.515µs, 12.161ms
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 546.336µs
Latencies [min, mean, 50, 90, 95, 99, max] 466.328µs, 652.455µs, 635.612µs, 733.819µs, 775.191µs, 898.404µs, 12.115ms
Bytes In [total, mean] 4830000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -36,9 +36,9 @@ Error Set:
## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 692.989µs
Latencies [min, mean, 50, 90, 95, 99, max] 532.886µs, 721.993µs, 706.02µs, 812.366µs, 860.289µs, 1.018ms, 4.297ms
Requests [total, rate, throughput] 30000, 1000.03, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 726.771µs
Latencies [min, mean, 50, 90, 95, 99, max] 516.729µs, 667.447µs, 651.234µs, 748.002µs, 789.132µs, 912.936µs, 12.01ms
Bytes In [total, mean] 4860000, 162.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -49,22 +49,22 @@ Error Set:
## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 713.827µs
Latencies [min, mean, 50, 90, 95, 99, max] 538.212µs, 722.813µs, 705.872µs, 813.629µs, 859.743µs, 1.009ms, 7.374ms
Bytes In [total, mean] 5100000, 170.00
Requests [total, rate, throughput] 29999, 1000.02, 1000.00
Duration [total, attack, wait] 29.999s, 29.998s, 775.462µs
Latencies [min, mean, 50, 90, 95, 99, max] 509.103µs, 675.843µs, 660.979µs, 753.464µs, 790.594µs, 915.896µs, 10.924ms
Bytes In [total, mean] 5099830, 170.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Status Codes [code:count] 200:29999
Error Set:
```

## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30s, 30s, 690.398µs
Latencies [min, mean, 50, 90, 95, 99, max] 530.942µs, 709.483µs, 690.422µs, 800.878µs, 843.812µs, 975.935µs, 9.135ms
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
Duration [total, attack, wait] 30s, 29.999s, 579.805µs
Latencies [min, mean, 50, 90, 95, 99, max] 495.375µs, 663.275µs, 645.382µs, 747.059µs, 791.431µs, 925.516µs, 10.063ms
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -75,9 +75,9 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 773.112µs
Latencies [min, mean, 50, 90, 95, 99, max] 512.273µs, 709.133µs, 692.254µs, 793.501µs, 832.049µs, 968.373µs, 11.168ms
Requests [total, rate, throughput] 30000, 1000.01, 999.99
Duration [total, attack, wait] 30s, 30s, 604.093µs
Latencies [min, mean, 50, 90, 95, 99, max] 499.363µs, 654.309µs, 639.452µs, 737.027µs, 777.872µs, 904.014µs, 8.053ms
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand Down
40 changes: 20 additions & 20 deletions tests/results/dp-perf/edge/edge-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: 3a08fdafadfe0fb4a9c25679da1a1fcd6b181474
- Date: 2024-10-15T13:45:52Z
- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
- Date: 2024-11-14T18:42:55Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.30.5-gke.1014001
- k8s version: v1.30.5-gke.1443001
- vCPUs per node: 16
- RAM per node: 65853972Ki
- Max pods per node: 110
Expand All @@ -23,9 +23,9 @@ GKE Cluster:
## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 621.777µs
Latencies [min, mean, 50, 90, 95, 99, max] 493.496µs, 682.208µs, 666.971µs, 771.821µs, 812.592µs, 935.803µs, 9.613ms
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 852.811µs
Latencies [min, mean, 50, 90, 95, 99, max] 484.762µs, 663.414µs, 647.232µs, 739.971µs, 776.515µs, 867.279µs, 19.761ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -36,9 +36,9 @@ Error Set:
## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 696.203µs
Latencies [min, mean, 50, 90, 95, 99, max] 529.204µs, 709.079µs, 694.929µs, 791.712µs, 834.953µs, 960.962µs, 9.219ms
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
Duration [total, attack, wait] 30s, 29.999s, 592.984µs
Latencies [min, mean, 50, 90, 95, 99, max] 532.501µs, 697.491µs, 682.822µs, 782.979µs, 820.727µs, 919.977µs, 11.809ms
Bytes In [total, mean] 4830000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -49,22 +49,22 @@ Error Set:
## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 29999, 1000.00, 999.98
Duration [total, attack, wait] 30s, 29.999s, 659.516µs
Latencies [min, mean, 50, 90, 95, 99, max] 542.362µs, 719.357µs, 701.71µs, 805.054µs, 848.72µs, 980.33µs, 11.954ms
Bytes In [total, mean] 5069831, 169.00
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 757.242µs
Latencies [min, mean, 50, 90, 95, 99, max] 522.486µs, 706.577µs, 693.391µs, 796.96µs, 837.354µs, 944.635µs, 9.484ms
Bytes In [total, mean] 5070000, 169.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:29999
Status Codes [code:count] 200:30000
Error Set:
```

## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 677.532µs
Latencies [min, mean, 50, 90, 95, 99, max] 509.01µs, 703.22µs, 689.619µs, 790.875µs, 832.349µs, 970.323µs, 7.744ms
Requests [total, rate, throughput] 30000, 1000.00, 999.98
Duration [total, attack, wait] 30.001s, 30s, 793.958µs
Latencies [min, mean, 50, 90, 95, 99, max] 515.143µs, 694.579µs, 679.924µs, 783.488µs, 823.079µs, 935.749µs, 8.619ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -75,9 +75,9 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.99
Duration [total, attack, wait] 30s, 30s, 687.367µs
Latencies [min, mean, 50, 90, 95, 99, max] 520.251µs, 696.116µs, 682.682µs, 780.437µs, 820.818µs, 945.164µs, 8.67ms
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 755.564µs
Latencies [min, mean, 50, 90, 95, 99, max] 524.265µs, 684.282µs, 671.402µs, 770.187µs, 806.135µs, 906.279µs, 9.069ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand Down
20 changes: 10 additions & 10 deletions tests/results/ngf-upgrade/edge/edge-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: 3a08fdafadfe0fb4a9c25679da1a1fcd6b181474
- Date: 2024-10-15T13:45:52Z
- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
- Date: 2024-11-14T18:42:55Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.30.5-gke.1014001
- k8s version: v1.30.5-gke.1443001
- vCPUs per node: 16
- RAM per node: 65853972Ki
- Max pods per node: 110
Expand All @@ -23,10 +23,10 @@ GKE Cluster:
## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 879.857µs
Latencies [min, mean, 50, 90, 95, 99, max] 472.733µs, 846.68µs, 831.757µs, 948.108µs, 989.426µs, 1.13ms, 12.461ms
Bytes In [total, mean] 968005, 161.33
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 587.326µs
Latencies [min, mean, 50, 90, 95, 99, max] 439.889µs, 859.995µs, 849.253µs, 977.006µs, 1.024ms, 1.211ms, 15.355ms
Bytes In [total, mean] 974028, 162.34
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Expand All @@ -39,9 +39,9 @@ Error Set:

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 802.597µs
Latencies [min, mean, 50, 90, 95, 99, max] 646.501µs, 872.011µs, 851.784µs, 961.79µs, 1.006ms, 1.137ms, 12.519ms
Bytes In [total, mean] 930000, 155.00
Duration [total, attack, wait] 59.991s, 59.99s, 792.386µs
Latencies [min, mean, 50, 90, 95, 99, max] 664.1µs, 910.376µs, 874.685µs, 1.007ms, 1.063ms, 1.271ms, 16.146ms
Bytes In [total, mean] 936000, 156.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Expand Down
20 changes: 10 additions & 10 deletions tests/results/ngf-upgrade/edge/edge-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: 3a08fdafadfe0fb4a9c25679da1a1fcd6b181474
- Date: 2024-10-15T13:45:52Z
- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
- Date: 2024-11-14T18:42:55Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.30.5-gke.1014001
- k8s version: v1.30.5-gke.1443001
- vCPUs per node: 16
- RAM per node: 65853972Ki
- Max pods per node: 110
Expand All @@ -24,9 +24,9 @@ GKE Cluster:

```text
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 913.585µs
Latencies [min, mean, 50, 90, 95, 99, max] 660.737µs, 910.81µs, 889.797µs, 1.034ms, 1.093ms, 1.262ms, 14.865ms
Bytes In [total, mean] 968001, 161.33
Duration [total, attack, wait] 59.991s, 59.99s, 772.721µs
Latencies [min, mean, 50, 90, 95, 99, max] 596.14µs, 835.746µs, 798.892µs, 926.941µs, 975.553µs, 1.151ms, 14.047ms
Bytes In [total, mean] 956060, 159.34
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Expand All @@ -38,10 +38,10 @@ Error Set:
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 939.801µs
Latencies [min, mean, 50, 90, 95, 99, max] 484.682µs, 898.425µs, 890.482µs, 1.025ms, 1.079ms, 1.209ms, 13.209ms
Bytes In [total, mean] 932025, 155.34
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 955.654µs
Latencies [min, mean, 50, 90, 95, 99, max] 630.575µs, 856.057µs, 818.559µs, 939.26µs, 986.329µs, 1.177ms, 14.025ms
Bytes In [total, mean] 918000, 153.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Expand Down
Binary file modified tests/results/ngf-upgrade/edge/http-oss.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/http-plus.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-oss.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-plus.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 38a23bc

Please sign in to comment.