You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It is recommended to align the xharness references.
NOTE
An additional consideration would be to switch from hardcoding xharness versions to use darc subscriptions instead.
Security
While this currently "works" on CI, any changes to the tools or its references (like adb) will not be available for perf testing.
With that, all recent improvements regarding security/SDL work on XHarness will not be included.
Description
Problem 1: using an outdated version
MAUI scenarios on Android are using an outdated version of XHarness.
More specifically, the version used in perf jobs is:
performance/eng/performance/maui_scenarios_android.proj
Line 7 in acac700
For reference, the current version of XHarness is:
10.0.0-prerelease.24524.9
Problem 2: using outdated commands
Bumping the version manually will not be the only fix/change for this issue as the code in:
performance/src/scenarios/shared/androidhelper.py
Line 25 in acac700
xharness android state --adb
which is not a supported command anymoreProblem 3: mismatch between referenced xharness versions
MAUI scenarios for iOS are using a different xharness version:
performance/eng/performance/maui_scenarios_ios.proj
Line 6 in acac700
It is recommended to align the xharness references.
NOTE
An additional consideration would be to switch from hardcoding xharness versions to use darc subscriptions instead.
Security
While this currently "works" on CI, any changes to the tools or its references (like adb) will not be available for perf testing.
With that, all recent improvements regarding security/SDL work on XHarness will not be included.
/cc: @vitek-karas
The text was updated successfully, but these errors were encountered: