Skip to content

Commit

Permalink
taurus
Browse files Browse the repository at this point in the history
Signed-off-by: Zhao Junwang <[email protected]>
  • Loading branch information
zhjwpku committed Jul 17, 2024
1 parent 8674aa1 commit 8dc4b78
Show file tree
Hide file tree
Showing 4 changed files with 39 additions and 0 deletions.
1 change: 1 addition & 0 deletions src/SUMMARY.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@
- [databases](./databases/README.md)
- [cloudnative](./databases/cloudnative/README.md)
- [aurora](./databases/cloudnative/aurora.md)
- [taurus](./databases/cloudnative/taurus.md)
- [columnstores vs rowstores](./databases/column-stores-vs-row-stores.md)
- [kv](./databases/kv/README.md)
- [rocksdb cidr17](./databases/kv/optimizing-space-amplification-in-rocksdb.md)
Expand Down
2 changes: 2 additions & 0 deletions src/databases/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@

- **[Cloud Native Database Systems](cloudnative/index.html)**
- **[Amazon Aurora: Design Considerations for High Throughput Cloud-Native Relational Databases][aurora]**
- **[Taurus Database: How to be Fast, Available, and Frugal in the Cloud][taurus]**
- **[Column-stores vs. row-stores: how different are they really?][column-stores-vs-row-stores]**
- **[Main Memory Database Systems](mmdb/index.html)**
- **[Main Memory Database Systems: An Overview][mmdb-overview]**
Expand Down Expand Up @@ -60,3 +61,4 @@
[diskann]: vectordb/diskann.md
[duckdb]: olap/duckdb.md
[aurora]: cloudnative/aurora.md
[taurus]: cloudnative/taurus.md
2 changes: 2 additions & 0 deletions src/databases/cloudnative/README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
## Cloud Native Database Systems

- **[Amazon Aurora: Design Considerations for High Throughput Cloud-Native Relational Databases][aurora]**
- **[Taurus Database: How to be Fast, Available, and Frugal in the Cloud][taurus]**

[aurora]: aurora.md
[taurus]: taurus.md
34 changes: 34 additions & 0 deletions src/databases/cloudnative/taurus.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
### [Taurus Database: How to be Fast, Available, and Frugal in the Cloud]()

> SIGMOD 2020
>
> https://dl.acm.org/doi/10.1145/3318464.3386129
本文介绍了一种名为 Taurus 的新型多云租户数据库系统的设计。Taurus 通过类似 Amazon Aurora 和 Microsoft Socrates 的方式分离计算和存储层,并提供类似的优势,如读副本支持、低网络利用率、硬件共享和可扩展性。然而,Taurus 架构具有几个独特的优势:

- 改进的可用性和可扩展性:与传统的本地部署相比,使用云数据库服务(DBaaS)越来越普遍,其主要优势包括提高可用性和可扩展性,并且成本更低。
- 异步步骤对延迟的影响:在 Taurus 的设计中,所有步骤都是异步的,只有前两个步骤位于前台路径中,可能会对延迟产生影响。
- 独特的复制和恢复算法:Taurus 提供了新颖的复制和恢复算法,使用相同数量或更少的副本,提供更好的可用性。

#### 架构

Taurus 包含 4 个主要组件:

- 数据库前端: 基于 MySQL 的修改版,包含 Master 实例(提供读写服务)和若干个 RO 实例(提供只读服务)。Master 实例生成 redo log,这些日志描述了事务对数据页的修改。Master 将 redo log 发送给 LogStore 和 PageStore,并周期性地通知 RO 实例最新的 LSN,以便 RO 实例可以读取到最新的 log
- SAL(Storage Abstraction Layer): 嵌入到计算层的库,隔离了远程存储、数据分片、故障恢复、主从复制等存储层的复杂性。主要负责计算引擎与存储层的 LogStore/PageStore 的交互,管理 PageStore 的 Slices,以及页面在 Slices 上的映射关系
- Log Store: 负责持久化日志(写入 PLog),事务的所有日志一旦持久化,计算层即可通知客户端事务提交完成。同时,为 RO 实例提供日志内容,RO 实例通过回放 redo log 来更新其缓冲区中的页面
- Page Store: 负责存储数据库的数据页,主节点更新 Page 的时候,通过 LSN 来表示这个 Page 的版本。PageID+LSN 可以唯一标识一个 page version,Page Store 根据 Master 或 RO 的读请求可以构造任意版本的 page version

Page Store 提供了几个主要的 API 供 SAL 调用:

```
(1) WriteLogs is used to ship a buffer with log records
(2) ReadPage is used to read a specific version of a page
(3) SetRecycleLSN is used to specify the oldest LSN of pages belonging to the same database that the front end might request (recycle LSN)
(4) GetPersistentLSN returns the highest LSN that the Page Store can serve
```


### Further readings

[Taurus MM: bringing multi-master to the cloud](https://www.vldb.org/pvldb/vol16/p3488-depoutovitch.pdf)

0 comments on commit 8dc4b78

Please sign in to comment.