Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to use compression for titan? #263

Closed
hiqsociety opened this issue Sep 30, 2022 · 6 comments
Closed

how to use compression for titan? #263

hiqsociety opened this issue Sep 30, 2022 · 6 comments

Comments

@hiqsociety
Copy link

how to use compression for titan? i saw the delta compression, is there a configuration setting to enable it?

@tabokie
Copy link
Member

tabokie commented Oct 1, 2022

CompressionType blob_file_compression{kNoCompression};

The compression type is defined here:
https://github.com/facebook/rocksdb/blob/79f08d7ffa6d34d9ca3357777bcb335884a56cfb/include/rocksdb/compression_type.h#L17

@hiqsociety
Copy link
Author

hiqsociety commented Oct 1, 2022

how do i do this configuration in tidb?

why then it's mentioned as a new feature on May?
#245

@tabokie
Copy link
Member

tabokie commented Oct 1, 2022

https://github.com/tikv/tikv/blob/47d8c9e483db762cefe8725abac9f5110e97ae63/etc/config-template.toml#L873

"Delta compression" is a feature request (which is far from production-ready and we don't have the resources to accept it yet), compression in general is supported long ago.

@vipsland
Copy link

vipsland commented Oct 1, 2022

ok thx. everything make sense now.

looking forward to delta compression... seems like a great storage savings but not sure how much cpu time it takes

@cscetbon
Copy link

cscetbon commented Mar 1, 2023

@tabokie did someone look into that feature proposal though ?

@tabokie
Copy link
Member

tabokie commented Mar 1, 2023

@cscetbon Unfortunately no. We don't have the bandwidth and this is a very low-priority feature in the scope of TiKV. (An intern implemented zstd dictionary compression years ago and we haven't gotten around to test it in TiKV...)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants