Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

metrics: the number of oversized-region-count may changed frequently and can not be used as a reference. #8917

Open
AndreMouche opened this issue Dec 14, 2024 · 1 comment
Labels
affects-8.1 This bug affects the 8.1.x(LTS) versions. report/customer Customers have encountered this bug. severity/moderate type/bug The issue is confirmed as a bug.

Comments

@AndreMouche
Copy link
Member

AndreMouche commented Dec 14, 2024

Bug Report

When the configuration of tikv instances in the cluster are not keep consistent,
the number of oversized-region-count may changed frequently and can not be used as a reference.

What did you do?

make the configuration region-max-size and region-max-keys not the same between tikv instances.

What did you expect to see?

I have no idea

What did you see instead?

the number of oversized-region-count may changed frequently and can not be used as a reference.

What version of PD are you using (pd-server -V)?

master

PD will randomly pull configuration from a TiKV and persist it locally(ref pd/server/cluster/cluster.go at release-8.1 · tikv/pd ).
If the configuration region-max-size and region-max-keys not the same between tikv instances, PD will pick the one it get recently and use it (region-max-size and region-max-keys) to determine if a region is oversized pd/pkg/core/region.go at 03488a478cd395d3bbbdc0a3f64abca5d69fcdc6 · tikv/pd , that is the root caused that the number of oversized regions changed frequently

Workaround: adjust the configuration region-max-size and region-max-keys of all tikv instances in the cluster to be consistent.

Impact: There is no specific impact on performance, but the number of oversized regions on region healthy cannot be used as a reference.

@AndreMouche AndreMouche added the type/bug The issue is confirmed as a bug. label Dec 14, 2024
@seiya-annie
Copy link

/report customer

@ti-chi-bot ti-chi-bot bot added report/customer Customers have encountered this bug. affects-8.1 This bug affects the 8.1.x(LTS) versions. labels Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-8.1 This bug affects the 8.1.x(LTS) versions. report/customer Customers have encountered this bug. severity/moderate type/bug The issue is confirmed as a bug.
Projects
None yet
Development

No branches or pull requests

3 participants