criterion performance measurements

overview

want to understand this report?

Word32/printf

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.539551243995545e-6 1.5589130323125787e-6 1.5849988019942204e-6
Standard deviation 4.960688930264046e-8 7.183233204082669e-8 1.0940117333618744e-7

Outlying measurements have severe (0.6143123835096731%) effect on estimated standard deviation.

Word32/showHex

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.2729687698338612e-7 1.2812370134297266e-7 1.2929459285377702e-7
Standard deviation 2.403086250216587e-9 3.0380795083425414e-9 4.641045342545666e-9

Outlying measurements have moderate (0.34183156573512236%) effect on estimated standard deviation.

Word32/xbuild

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.1063298866100725e-8 5.154437262322186e-8 5.2212788413462746e-8
Standard deviation 1.4298312913995397e-9 1.8895196928667544e-9 2.3793472994922398e-9

Outlying measurements have severe (0.5734437691823665%) effect on estimated standard deviation.

Word32/xbuildu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.2523050459261264e-7 1.2596161185060993e-7 1.267453171736703e-7
Standard deviation 1.9131762737751828e-9 2.4988443872440736e-9 3.524674368619907e-9

Outlying measurements have moderate (0.26731424376011376%) effect on estimated standard deviation.

Word32/xshowl

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.267626340176722e-7 2.2902218024545394e-7 2.321938657988442e-7
Standard deviation 8.33568303423573e-9 1.0060072367926694e-8 1.3819745773672048e-8

Outlying measurements have severe (0.633223931606136%) effect on estimated standard deviation.

Word32/xshowlp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.3877564138832526e-7 2.418639532672538e-7 2.448264589227799e-7
Standard deviation 8.790159888510598e-9 1.0227082036234593e-8 1.1878848123787936e-8

Outlying measurements have severe (0.6147528494485681%) effect on estimated standard deviation.

Word32/xshowlu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.037117172227406e-7 3.0654713796229316e-7 3.123704777729444e-7
Standard deviation 9.9764594954483e-9 1.54640692527748e-8 2.7661902181108275e-8

Outlying measurements have severe (0.6905177972614017%) effect on estimated standard deviation.

Word32/xshowlpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.152212110697396e-7 3.170375776328674e-7 3.196411713801271e-7
Standard deviation 6.372764955758333e-9 8.263761845956587e-9 1.1629005169324498e-8

Outlying measurements have moderate (0.36862490806576415%) effect on estimated standard deviation.

Word32/xshow

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.408867739219842e-7 2.429370731805984e-7 2.4534434720133633e-7
Standard deviation 6.990357933549531e-9 8.218568468012006e-9 1.00305070685108e-8

Outlying measurements have severe (0.50148131317813%) effect on estimated standard deviation.

Word32/xshowp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.660075444495216e-7 2.687759946186462e-7 2.717038430228509e-7
Standard deviation 8.652604123850872e-9 1.0455559835666143e-8 1.3516248290842174e-8

Outlying measurements have severe (0.5732235346203792%) effect on estimated standard deviation.

Word32/xshowu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.212873752261161e-7 3.2348235991462085e-7 3.262766858026834e-7
Standard deviation 7.51688295551181e-9 9.192903681588754e-9 1.1894712696767513e-8

Outlying measurements have moderate (0.40827770980451433%) effect on estimated standard deviation.

Word32/xshowpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.402572124810588e-7 3.4291788037620507e-7 3.4557422965777257e-7
Standard deviation 7.217678966243104e-9 9.078184524240653e-9 1.1272714332901229e-8

Outlying measurements have moderate (0.37198966735310546%) effect on estimated standard deviation.

Word64/printf

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.5119675050325777e-6 2.5326791328318e-6 2.5564092716561253e-6
Standard deviation 6.00461794512078e-8 7.573352450042778e-8 1.0607876003177012e-7

Outlying measurements have moderate (0.38640366482632044%) effect on estimated standard deviation.

Word64/showHex

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.100195563547278e-6 1.1167115276809923e-6 1.1555916728108675e-6
Standard deviation 2.770663694203705e-8 7.540646606420552e-8 1.4942505917450925e-7

Outlying measurements have severe (0.7839150006803168%) effect on estimated standard deviation.

Word64/xbuild

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 7.323629495396701e-7 7.374535504792254e-7 7.435108417661329e-7
Standard deviation 1.376586715567509e-8 1.8257397560891245e-8 2.4813074537593146e-8

Outlying measurements have moderate (0.3273524043413431%) effect on estimated standard deviation.

Word64/xbuildu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.352753777853264e-6 1.361272557302455e-6 1.380139468541663e-6
Standard deviation 1.9598235364587432e-8 4.07516494124508e-8 8.34233332880796e-8

Outlying measurements have moderate (0.404544492660223%) effect on estimated standard deviation.

Word64/xshowl

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.0875516552092333e-6 1.0966957088347028e-6 1.1058422950180902e-6
Standard deviation 2.2667475515034085e-8 2.879437783419636e-8 3.727157121146552e-8

Outlying measurements have moderate (0.34488604294333086%) effect on estimated standard deviation.

Word64/xshowlp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.0922988436824344e-6 1.0983247449851202e-6 1.1054464114323135e-6
Standard deviation 1.8236548732749784e-8 2.1327745692030043e-8 2.623307618553694e-8

Outlying measurements have moderate (0.22355180710381437%) effect on estimated standard deviation.

Word64/xshowlu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6896441161885606e-6 1.7031141897177443e-6 1.7202790201366478e-6
Standard deviation 3.633678281321265e-8 4.548367500774614e-8 6.089871059479121e-8

Outlying measurements have moderate (0.3411954207061619%) effect on estimated standard deviation.

Word64/xshowlpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6848828308382013e-6 1.6968250056084947e-6 1.7106438918769434e-6
Standard deviation 3.68462053079625e-8 4.5482000051111454e-8 6.081938777756616e-8

Outlying measurements have moderate (0.3459074353950724%) effect on estimated standard deviation.

Word64/xshow

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1128174045325463e-6 1.1200900010562236e-6 1.1276717702000303e-6
Standard deviation 2.115971206133862e-8 2.8202252517642164e-8 4.6191206636891285e-8

Outlying measurements have moderate (0.32610360849412845%) effect on estimated standard deviation.

Word64/xshowp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1237973058872806e-6 1.1296855021185462e-6 1.1391551542167813e-6
Standard deviation 2.038059444781979e-8 2.4729599571021043e-8 3.0344503570530664e-8

Outlying measurements have moderate (0.26549711881261295%) effect on estimated standard deviation.

Word64/xshowu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.7273714302435382e-6 1.7397813349062635e-6 1.7535661010630404e-6
Standard deviation 3.659338693445681e-8 4.352482393993057e-8 5.152162932582409e-8

Outlying measurements have moderate (0.3118152457110844%) effect on estimated standard deviation.

Word64/xshowpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.74620297023447e-6 1.7586105109410536e-6 1.774579716216229e-6
Standard deviation 3.8417595891722326e-8 4.7924254393185754e-8 5.9825479762924e-8

Outlying measurements have moderate (0.3509846367374291%) effect on estimated standard deviation.

understanding this report

In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.

Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.

We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)

A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.