Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Idle time in tests #328

Open
mram0509 opened this issue Oct 23, 2023 · 2 comments
Open

Idle time in tests #328

mram0509 opened this issue Oct 23, 2023 · 2 comments
Labels

Comments

@mram0509
Copy link

Web browsing and interactivity with web pages inherently includes idle time between actions. How can this be better reflected in the tests included in Speedometer? Further discussion and analysis are required for concrete proposals to reflect the actual experience of users while interacting with a webpage. For instance, idle time could influence CPU scaling and GC, which in turn could influence responsiveness. Would the idle time be customized to a particular test or would it be benchmark wide, that is incorporated in the runner?

@rniwa
Copy link
Member

rniwa commented Oct 23, 2023

Since we're driving each test case with rAF, there is already plenty of idle time during the benchmark.

@bgrins
Copy link
Contributor

bgrins commented Oct 24, 2023

IIRC in the meeting we discussed this in the context of matching longer and realistic delays (e.g. when a user is waiting for some long running async action like a network request to complete, or physical delay between clicks or other input which would be longer than a rAF, etc). It's a tricky problem as we saw in #201, but worth discussing further for v4+, and seems maybe related to supporting async steps (#83).

@bgrins bgrins added the v4 label Oct 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants