Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Internal] Binary Encoding: Fixes Performance Regression #4901

Conversation

kundadebdatta
Copy link
Member

@kundadebdatta kundadebdatta commented Nov 22, 2024

Pull Request Template

Description

Recently during our v3 sdk CI rolling runs, we observed some performance regressions on the ItemStreamAsync() APIs. They regressed beyond 5%.

image

Upon doing further investigation, we figured out that during the non-binary flow, we end up converting the incoming stream into CloneableStream which might be the reason for this regression. Please note that the reason this was not caught during the original version of the binary encoding PR was that the performance test used to capture the benchmark for the original PR, was targeted a real cosmos container, where for the CI runs, we use our mocked containers.

This PR skips CloneableStream conversation for non-binary encoding flow.

With the above change in place, our CI builds started passing:

image

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)

Closing issues

To automatically close an issue: closes #IssueNumber

@kundadebdatta kundadebdatta marked this pull request as ready for review November 22, 2024 21:48
@kirankumarkolli kirankumarkolli enabled auto-merge (squash) November 23, 2024 01:50
@kundadebdatta kundadebdatta self-assigned this Nov 23, 2024
@kundadebdatta kundadebdatta added the auto-merge Enables automation to merge PRs label Nov 23, 2024
@kirankumarkolli kirankumarkolli merged commit 998dec0 into master Nov 25, 2024
24 checks passed
@kirankumarkolli kirankumarkolli deleted the users/dkunda/4644_binary_encoding_test_fix_perf_regression branch November 25, 2024 18:57
kundadebdatta added a commit that referenced this pull request Jan 8, 2025
# Pull Request Template

## Description

Recently during our v3 sdk CI rolling runs, we observed some performance
regressions on the `ItemStreamAsync()` APIs. They regressed beyond 5%.


![image](https://github.com/user-attachments/assets/66cc4f01-2ec6-47e0-b885-5ad74e02bb63)

Upon doing further investigation, we figured out that during the
non-binary flow, we end up converting the incoming stream into
`CloneableStream` which might be the reason for this regression. Please
note that the reason this was not caught during the [original version of
the binary encoding
PR](#4652) was that
the performance test used to capture the benchmark for the original PR,
was targeted a real cosmos container, where for the CI runs, we use our
mocked containers.

This PR skips `CloneableStream` conversation for non-binary encoding
flow.

With the above change in place, our CI builds started passing:


![image](https://github.com/user-attachments/assets/8293a6e5-6fbc-4953-9de0-37162a081194)

## Type of change

Please delete options that are not relevant.

- [x] Bug fix (non-breaking change which fixes an issue)

## Closing issues

To automatically close an issue: closes #IssueNumber
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-merge Enables automation to merge PRs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants