Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Limit proxy's memory from TiFlash's side #408

Merged
merged 6 commits into from
Jan 2, 2025

Conversation

CalvinNeo
Copy link
Member

@CalvinNeo CalvinNeo commented Dec 30, 2024

What is changed and how it works?

Issue Number: Close tiflash#9745

What's Changed:


Related changes

  • PR to update pingcap/docs/pingcap/docs-cn:
  • Need to cherry-pick to the release branch

Check List

Tests

  • Unit test
  • Integration test
  • Manual test (add detailed scripts or steps below)
  • No code

Side effects

  • Performance regression: Consumes more CPU
  • Performance regression: Consumes more Memory
  • Breaking backward compatibility

Release note


Signed-off-by: Calvin Neo <[email protected]>
@ti-chi-bot ti-chi-bot bot added the size/L label Dec 30, 2024
@CalvinNeo
Copy link
Member Author

/retest

@CalvinNeo
Copy link
Member Author

/hold for tiflash pr

Signed-off-by: Calvin Neo <[email protected]>
Signed-off-by: Calvin Neo <[email protected]>
@CalvinNeo
Copy link
Member Author

/retest

@CalvinNeo CalvinNeo requested a review from JinheLin December 31, 2024 09:13
@@ -281,6 +281,18 @@ pub unsafe fn run_proxy(
.help("Set engine role label")
.takes_value(true),
)
.arg(
Arg::with_name("memory-limit-size")
Copy link
Member Author

@CalvinNeo CalvinNeo Dec 31, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Or _bytes? Seems that in proxy they don't append bytes as a suffix here

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think "memory-limit-size" is OK. TiKV usually use "-size" for the config item in bytes
https://docs.pingcap.com/tidb/stable/tikv-configuration-file#blob-cache-size

@ti-chi-bot ti-chi-bot bot added the lgtm label Dec 31, 2024
Copy link

ti-chi-bot bot commented Dec 31, 2024

[LGTM Timeline notifier]

Timeline:

  • 2024-12-31 09:58:02.645471289 +0000 UTC m=+430818.001475832: ☑️ agreed by JinheLin.

@ti-chi-bot ti-chi-bot bot added the approved label Dec 31, 2024
@CalvinNeo
Copy link
Member Author

CalvinNeo commented Dec 31, 2024

/hold memory limit high water ratio to 0.9

@ti-chi-bot ti-chi-bot bot removed the approved label Jan 2, 2025
Copy link
Collaborator

@JaySon-Huang JaySon-Huang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link

ti-chi-bot bot commented Jan 2, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: JaySon-Huang, JinheLin
Once this PR has been reviewed and has the lgtm label, please assign yudongusa for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Signed-off-by: Calvin Neo <[email protected]>
Signed-off-by: Calvin Neo <[email protected]>
@CalvinNeo
Copy link
Member Author

/unhold

@CalvinNeo CalvinNeo merged commit 396724d into pingcap:raftstore-proxy Jan 2, 2025
3 of 5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

memory_usage_limit is deduced much less then expected
3 participants