criterion performance measurements

overview

want to understand this report?

Word32/printf

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6301860681572999e-6 1.64991797510425e-6 1.6778917472487838e-6
Standard deviation 6.567073709702848e-8 8.506490496789005e-8 1.2333134264774235e-7

Outlying measurements have severe (0.6680058757679628%) effect on estimated standard deviation.

Word32/showHex

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3117991133444912e-7 1.3228564817365236e-7 1.3391988955803814e-7
Standard deviation 3.412053938828178e-9 4.239034448563446e-9 5.2614831894406e-9

Outlying measurements have moderate (0.48682123115345177%) effect on estimated standard deviation.

Word32/xbuild

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.831413151234625e-7 1.8435855287610662e-7 1.857101441564575e-7
Standard deviation 3.2492696412509282e-9 4.244278463486568e-9 6.507526553865619e-9

Outlying measurements have moderate (0.3237560069157455%) effect on estimated standard deviation.

Word32/xbuildu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.6087109843001956e-7 2.628689223391683e-7 2.6641410665313824e-7
Standard deviation 5.895715486547513e-9 8.890345345568055e-9 1.3741980693787576e-8

Outlying measurements have severe (0.5034429764903678%) effect on estimated standard deviation.

Word32/xshowl

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.510445499148185e-7 3.532410275628207e-7 3.565296360124466e-7
Standard deviation 7.469655278853529e-9 9.78875847038056e-9 1.2596742713794862e-8

Outlying measurements have moderate (0.39719260839990583%) effect on estimated standard deviation.

Word32/xshowlp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.8270715302524403e-7 3.853923507466852e-7 3.8805278795388534e-7
Standard deviation 6.5893388219111285e-9 8.746428684064692e-9 1.1641219206213609e-8

Outlying measurements have moderate (0.3029021295713051%) effect on estimated standard deviation.

Word32/xshowlu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.482462244633791e-7 4.559530906657114e-7 4.6316973066584234e-7
Standard deviation 1.9896017025737265e-8 2.4875802532731215e-8 2.9798713853859092e-8

Outlying measurements have severe (0.7146543494219822%) effect on estimated standard deviation.

Word32/xshowlpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.826893195738711e-7 4.980016487361144e-7 5.291396133407261e-7
Standard deviation 3.3158005904433766e-8 7.197500878045091e-8 1.1916084624630195e-7

Outlying measurements have severe (0.94810366311433%) effect on estimated standard deviation.

Word32/xshow

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.044745132482428e-7 4.152561121034222e-7 4.3546739353046766e-7
Standard deviation 2.3936153900402474e-8 4.352191895022783e-8 7.525195781908149e-8

Outlying measurements have severe (0.907489806422786%) effect on estimated standard deviation.

Word32/xshowp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.19154482701838e-7 4.2678113183292724e-7 4.471791913977795e-7
Standard deviation 1.9986046238027507e-8 3.733672588902108e-8 6.770181991658184e-8

Outlying measurements have severe (0.8703030742594315%) effect on estimated standard deviation.

Word32/xshowu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.608292309481599e-7 4.653802193049445e-7 4.753832239150118e-7
Standard deviation 1.1252621323986193e-8 1.9555930988199962e-8 3.532378870389962e-8

Outlying measurements have severe (0.5977187220520438%) effect on estimated standard deviation.

Word32/xshowpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.987339166298277e-7 5.098956983853566e-7 5.295349013519276e-7
Standard deviation 3.5298998841269196e-8 5.3880029503146116e-8 7.702297329818456e-8

Outlying measurements have severe (0.9063600074091082%) effect on estimated standard deviation.

understanding this report

In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.

Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.

We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)

A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.