-
Notifications
You must be signed in to change notification settings - Fork 4
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
release logs and GRS 0.1.0 release log (#119)
* release logs * remove test results * perf results file * perf link in change log
- Loading branch information
Showing
3 changed files
with
79 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,30 @@ | ||
# Release Summary | ||
|
||
This is the first release of the Global Resource Service, one of the corner stones for the Regionless Cloud Platform. | ||
|
||
### The 0.1.0 release includes the following components: | ||
|
||
* Global Resource Service API server, that supports REST APIs for client registration, List Assigned nodes and Watch for node changes. | ||
* Performant distributor, event queues and cache to support large scale of node changes | ||
* Data Aggregator that collects nodes and node changes from each region | ||
* Client development SDK that provides APIs for building scheduler or other clients to the Global Resource Service | ||
* A Region manager simulator that provides region level, multiple Resource Provider simulation of data changes | ||
* A simulated scheduler with the cache layer | ||
* A test infrastructure to automate service deployment, cross region test setup, test execution and result collection | ||
|
||
|
||
|
||
### Key Features: | ||
|
||
* Client registration, Node List and Watch APIs | ||
* Distributor algorithms to support multiple region and resource clusters | ||
* Distributor algorithms for efficient, balanced node resource distribution to schedulers | ||
* Scalability: Scale up to 1m nodes cross multiple regions, with up to 40 schedulers | ||
* Performance: End to end latency just 300ms for normal node failures cases (Daily change pattern) and within 1.3 seconds for disaster scenarios(RP outage pattern) | ||
* Abstraction of node resources, aka, logical min. record for node resource | ||
* Abstraction of resource version, aka, Composite RV ( or CRV ) from nodes from different and global origins. | ||
* Cross region data change simulation of both "Daily" and "RP outage" test scenarios | ||
* Automatic test environment setup, test execution and result collection routines. | ||
|
||
|
||
P.S. [Performance test results](../resource-management/docs/performance/730-2022-perf-results.md) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,3 @@ | ||
# CHANGELOGs | ||
|
||
- [CHANGELOG-0.1.md](./CHANGELOG-0.1.md) |
46 changes: 46 additions & 0 deletions
46
resource-management/docs/performance/730-2022-perf-results.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,46 @@ | ||
|
||
### Performance test results for the 0.1.0 release: | ||
|
||
| Test | Total Nodes | Regions|Nodes per Region| RPs per Region | Nodes per RP | Schedulers| Nodes per scheduler list | Notes | Register<br>Latency<br>(ms) | List<br>Latency<br>(ms) | Watch<br>P50(ms) | P90(ms) | P99(ms) | | ||
|:--------:| :---: | :---:|----:|----:|----:|----:|----:| ----:|----:|----:|----:|----:| ----:| | ||
| test-1 | 1m | 5 | 200K | 10 | 20K | 20 | 25K| disable metric, daily data change pattern|301|871|108|175|211| | ||
| test-1.1 | 1m | 5 | 200K | 10 | 20K | 20 | 25K| disable metric, RP down data change pattern|374|1012|1021|1137|1156| | ||
| test-2 | 1m | 5 | 200K | 10 | 20K | 20 | 25K| enable metric, daily data change pattern|298|1097|116|181|201| | ||
| test-2.1 | 1m | 5 | 200K | 10 | 20K | 20 | 25K| enable metric,RP down data change pattern|359|1012|1002|1074|1093| | ||
| test-3 | 1m | 5 | 200K | 10 | 20K | 20 | 50K| disable metric, daily data change pattern|369|1766|109|173|217| | ||
| test-3.1 | 1m | 5 | 200K | 10 | 20K | 20 | 50K| disable metric, RP down data change pattern|337|1679|877|1174|1200| | ||
| test-4 | 1m | 5 | 200K | 10 | 20K | 40 | 25K| disable metric, daily data change pattern|135|811|92|161|195| | ||
| test-5 | 1m | 5 | 200K | 10 | 20K | 20 | 25K| disable metric, rp down, all in one region|209|641|451|513|529| | ||
|
||
*Service is gce n1-standard-32 VM with 32 core and 120GB Ram, 500GB SSD, premium network. | ||
*Scheduler and the resource simulators are can with n1-standard-8 VMs* | ||
|
||
|
||
#### Regions each component deployed | ||
|
||
|
||
#### Service: | ||
|
||
| Region | Location | | ||
|--------------:|---------------------:| | ||
| us Central-1a | Council bluffs, IOWA | | ||
|
||
|
||
|
||
#### Simulators: | ||
|
||
| Region | Location | | ||
|--------------:|---------------------:| | ||
| us Central-1a | Council bluffs, IOWA | | ||
| us east1-b | Moncks COrner, SC | | ||
| us west2-a | LA, CA | | ||
| us west3-c | Salt Lake city, Utah | | ||
| us west4-a | las Vegas, Nevada | | ||
|
||
|
||
#### Schedulers: | ||
|
||
| Region | Location | | ||
|-----------:|---------------------:| | ||
| us west3-b | Salt Lake city, Utah | | ||
| us east4-b | Ashburn, Virginia | |