criterion performance measurements

overview

want to understand this report?

Word32/printf

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.5902463191913092e-6 1.6079207751455926e-6 1.6316864001654255e-6
Standard deviation 4.336344330673594e-8 6.545533116286895e-8 9.656903570388384e-8

Outlying measurements have severe (0.5541782574604617%) effect on estimated standard deviation.

Word32/showHex

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3284505947808133e-7 1.3371016363644937e-7 1.346887319436348e-7
Standard deviation 2.6704161321085184e-9 3.1243495635317303e-9 3.644898892072124e-9

Outlying measurements have moderate (0.33414144589460376%) effect on estimated standard deviation.

Word32/xbuild

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.10208472748541e-8 5.147697024585255e-8 5.2011033953674285e-8
Standard deviation 1.451592489704464e-9 1.677484040311518e-9 2.1675162192928876e-9

Outlying measurements have severe (0.5142500800345148%) effect on estimated standard deviation.

Word32/xbuildu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.2415817072199302e-7 1.27565913833866e-7 1.333206526713327e-7
Standard deviation 9.382787124518876e-9 1.5294234547094517e-8 2.305465105345418e-8

Outlying measurements have severe (0.9329886536744986%) effect on estimated standard deviation.

Word32/xshowl

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.2702002340371576e-7 2.310748160767773e-7 2.3772934327346456e-7
Standard deviation 9.380620320895746e-9 1.7360878325445887e-8 2.6149929182140697e-8

Outlying measurements have severe (0.8382431949847455%) effect on estimated standard deviation.

Word32/xshowlp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.4320901338226114e-7 2.492508297133572e-7 2.642924167653241e-7
Standard deviation 1.562904587966273e-8 2.981605970962739e-8 4.8639803107701885e-8

Outlying measurements have severe (0.9293700505200196%) effect on estimated standard deviation.

Word32/xshowlu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.0629751483611423e-7 3.1306231455831494e-7 3.2603160113968595e-7
Standard deviation 1.5945750860390424e-8 3.344974187518295e-8 5.4828291552009787e-8

Outlying measurements have severe (0.9100186756041924%) effect on estimated standard deviation.

Word32/xshowlpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.2591020203000225e-7 3.31389176859293e-7 3.4562587295786124e-7
Standard deviation 1.1488065606318639e-8 3.2519546501635666e-8 5.963507177116966e-8

Outlying measurements have severe (0.8960714020685163%) effect on estimated standard deviation.

Word32/xshow

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.459770058814019e-7 2.500034993949213e-7 2.55756647425296e-7
Standard deviation 1.3021042162475901e-8 1.782168297991653e-8 2.266433463195088e-8

Outlying measurements have severe (0.8196220709620265%) effect on estimated standard deviation.

Word32/xshowp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.469582232238709e-7 2.4850702727537894e-7 2.503025168474896e-7
Standard deviation 4.997767389278488e-9 6.088902048318125e-9 7.61206746757439e-9

Outlying measurements have moderate (0.34440873820460527%) effect on estimated standard deviation.

Word32/xshowu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.088440739263271e-7 3.1083007406410847e-7 3.133766152905679e-7
Standard deviation 7.178245746847827e-9 8.50494204340873e-9 1.0958921588943244e-8

Outlying measurements have moderate (0.38974199160856804%) effect on estimated standard deviation.

Word32/xshowpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.285753123971973e-7 3.308470725524558e-7 3.341308627241526e-7
Standard deviation 7.346306835811037e-9 9.171704265480654e-9 1.2084031833729533e-8

Outlying measurements have moderate (0.3956323008756349%) effect on estimated standard deviation.

understanding this report

In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.

Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.

We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)

A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.