criterion performance measurements

overview

want to understand this report?

Word32/printf

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6122867660225741e-6 1.6483604322925192e-6 1.7075831379076126e-6
Standard deviation 9.787355943051333e-8 1.4707275434173567e-7 2.0892497475371232e-7

Outlying measurements have severe (0.8583540149223592%) effect on estimated standard deviation.

Word32/showHex

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.2931861787456682e-7 1.3027967970172352e-7 1.314286344545188e-7
Standard deviation 2.7628109032527324e-9 3.6854724445520967e-9 5.345601890823785e-9

Outlying measurements have moderate (0.4275639258011681%) effect on estimated standard deviation.

Word32/xshowl

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.04688505195051e-8 5.0764410921206486e-8 5.1149664023098585e-8
Standard deviation 9.109171183152016e-10 1.2101706368698075e-9 2.012264580277942e-9

Outlying measurements have moderate (0.3607852529144606%) effect on estimated standard deviation.

Word32/xshowlp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.0456634675501293e-8 5.083604422736536e-8 5.122470333482416e-8
Standard deviation 8.735874511335091e-10 1.182994760353865e-9 1.5292261399667937e-9

Outlying measurements have moderate (0.3499178305183357%) effect on estimated standard deviation.

Word32/xshowlu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.112145934114954e-8 5.14034084270862e-8 5.174418556763211e-8
Standard deviation 8.259432110290844e-10 1.0986052379121826e-9 1.419181846495793e-9

Outlying measurements have moderate (0.3103656758409271%) effect on estimated standard deviation.

Word32/xshowlpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.054442359139648e-8 5.082257703542966e-8 5.115301713727698e-8
Standard deviation 8.557139255421704e-10 1.1170190021046438e-9 1.4585343137051778e-9

Outlying measurements have moderate (0.3246308371283357%) effect on estimated standard deviation.

Word32/xshow

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.873748083053696e-8 4.8977311379674815e-8 4.9332191294958e-8
Standard deviation 7.64251068094491e-10 1.0600804512639087e-9 1.644760130527889e-9

Outlying measurements have moderate (0.31639243150256646%) effect on estimated standard deviation.

Word32/xshowp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.696938152909335e-8 4.732275886928569e-8 4.778462568116095e-8
Standard deviation 8.75405570286954e-10 1.3809391172128038e-9 2.019605131525128e-9

Outlying measurements have moderate (0.4627947705551185%) effect on estimated standard deviation.

Word32/xshowu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.891654614735225e-8 4.933669470665421e-8 5.0010589792472705e-8
Standard deviation 9.986516308131815e-10 1.8493720963748332e-9 3.0017778596413443e-9

Outlying measurements have severe (0.5860328056323373%) effect on estimated standard deviation.

Word32/xshowpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.703694143368256e-8 4.758709763225942e-8 4.855891928207948e-8
Standard deviation 8.208172758516421e-10 2.462767866993798e-9 3.871410639893751e-9

Outlying measurements have severe (0.7327234240551318%) effect on estimated standard deviation.

understanding this report

In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.

Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.

We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)

A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.