-
criterion performance measurements
-
-
overview
-
-
want to understand this report?
-
-
-
-
-
-
-
- |
- lower bound |
- estimate |
- upper bound |
-
-
-
- Mean execution time |
- 7.950250148027324e-7 |
- 8.087233523139602e-7 |
- 8.263881789521396e-7 |
-
-
- Standard deviation |
- 6.469576002518438e-8 |
- 7.962093335887086e-8 |
- 9.595188287095253e-8 |
-
-
-
-
-
- Outlying measurements have severe
- (0.789683189845111%)
- effect on estimated standard deviation.
-
-
-
-
-
- |
- lower bound |
- estimate |
- upper bound |
-
-
-
- Mean execution time |
- 9.397387721886237e-5 |
- 9.511279240520537e-5 |
- 9.683396722581508e-5 |
-
-
- Standard deviation |
- 5.084981483933464e-6 |
- 7.060410460215048e-6 |
- 9.916444086871226e-6 |
-
-
-
-
-
- Outlying measurements have severe
- (0.6764999252677036%)
- effect on estimated standard deviation.
-
-
-
-
-
- |
- lower bound |
- estimate |
- upper bound |
-
-
-
- Mean execution time |
- 1.1405421545418602e-2 |
- 1.1464177420052388e-2 |
- 1.166933422318349e-2 |
-
-
- Standard deviation |
- 1.5835878091381052e-4 |
- 5.030517750313856e-4 |
- 1.146763021342376e-3 |
-
-
-
-
-
- Outlying measurements have moderate
- (0.414995643896579%)
- effect on estimated standard deviation.
-
-
-
-
-
- |
- lower bound |
- estimate |
- upper bound |
-
-
-
- Mean execution time |
- 5.030530741127831e-3 |
- 5.067442705544335e-3 |
- 5.11489753952871e-3 |
-
-
- Standard deviation |
- 1.7601420712288937e-4 |
- 2.14104721044797e-4 |
- 2.796949297562274e-4 |
-
-
-
-
-
- Outlying measurements have moderate
- (0.39528660323872544%)
- effect on estimated standard deviation.
-
-
-
-
-
- |
- lower bound |
- estimate |
- upper bound |
-
-
-
- Mean execution time |
- 1.3004106333168846e-2 |
- 1.3085197260292869e-2 |
- 1.317617540589223e-2 |
-
-
- Standard deviation |
- 3.817067615429757e-4 |
- 4.4020726935288003e-4 |
- 5.281243811580562e-4 |
-
-
-
-
-
- Outlying measurements have moderate
- (0.2967324863902443%)
- effect on estimated standard deviation.
-
-
-
-
-
- |
- lower bound |
- estimate |
- upper bound |
-
-
-
- Mean execution time |
- 1.772755031815419e-2 |
- 1.782442693940053e-2 |
- 1.794612770310293e-2 |
-
-
- Standard deviation |
- 4.572927417104507e-4 |
- 5.554628346393567e-4 |
- 7.805157733235236e-4 |
-
-
-
-
-
- Outlying measurements have moderate
- (0.2673858721467461%)
- effect on estimated standard deviation.
-
-
-
-
-
In this report, each function benchmarked by criterion is assigned
- a section of its own. In each section, we display two charts, each
- with an x axis that represents measured execution time.
- These charts are active; if you hover your mouse over data points
- and annotations, you will see more details.
-
-
- - The chart on the left is a
- kernel
- density estimate (also known as a KDE) of time
- measurements. This graphs the probability of any given time
- measurement occurring. A spike indicates that a measurement of a
- particular time occurred; its height indicates how often that
- measurement was repeated.
-
- - The chart on the right is the raw data from which the kernel
- density estimate is built. Measurements are displayed on
- the y axis in the order in which they occurred.
-
-
-
Under the charts is a small table displaying the mean and standard
- deviation of the measurements. We use a statistical technique
- called
- the bootstrap
- to provide confidence intervals on our estimates of these values.
- The bootstrap-derived upper and lower bounds on the mean and
- standard deviation let you see how accurate we believe those
- estimates to be. (Hover the mouse over the table headers to see
- the confidence levels.)
-
-
A noisy benchmarking environment can cause some or many
- measurements to fall far from the mean. These outlying
- measurements can have a significant inflationary effect on the
- estimate of the standard deviation. We calculate and display an
- estimate of the extent to which the standard deviation has been
- inflated by outliers.
-
-
-
-