criterion performance measurements

overview

want to understand this report?

Word32/printf

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6016252004976007e-6 1.6285494093784149e-6 1.6649889321278971e-6
Standard deviation 7.224573495364423e-8 9.95203395841216e-8 1.5420250211345362e-7

Outlying measurements have severe (0.7394957813449197%) effect on estimated standard deviation.

Word32/showHex

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3450262394472672e-7 1.3770792678265434e-7 1.4327162352983477e-7
Standard deviation 8.487617994858348e-9 1.669849765680726e-8 2.8504437920185365e-8

Outlying measurements have severe (0.9367464537614809%) effect on estimated standard deviation.

Word32/xbuild

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.752050393682777e-8 5.851168522121491e-8 5.973091784337753e-8
Standard deviation 2.52747544782431e-9 3.451599233643481e-9 4.855744307738388e-9

Outlying measurements have severe (0.7777364615209934%) effect on estimated standard deviation.

Word32/xbuildu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.4312180147757782e-7 1.4516201332437045e-7 1.4754045384616462e-7
Standard deviation 5.597707884224265e-9 7.372807164168249e-9 1.0376660134595739e-8

Outlying measurements have severe (0.7085669103623051%) effect on estimated standard deviation.

Word32/xshowl

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.3063074961515742e-7 2.3451770863349733e-7 2.434336572887626e-7
Standard deviation 9.615152871258365e-9 1.840875738238378e-8 3.460362901526109e-8

Outlying measurements have severe (0.8511584774995175%) effect on estimated standard deviation.

Word32/xshowlp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.430991012188593e-7 2.452896813145008e-7 2.473234736121693e-7
Standard deviation 5.868959089308006e-9 6.862149950365888e-9 8.647178973051235e-9

Outlying measurements have moderate (0.40610114715879153%) effect on estimated standard deviation.

Word32/xshowlu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.1708244843842305e-7 3.1976396867706996e-7 3.2220293358654195e-7
Standard deviation 6.692437147481387e-9 8.469539233731718e-9 1.0282730482906713e-8

Outlying measurements have moderate (0.3769638454559543%) effect on estimated standard deviation.

Word32/xshowlpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.3900779222826723e-7 3.522207994379351e-7 3.7119237513845666e-7
Standard deviation 3.1161915839778395e-8 5.392279540582665e-8 7.100082427214414e-8

Outlying measurements have severe (0.95446066474705%) effect on estimated standard deviation.

Word32/xshow

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.463039301562573e-7 2.487997058935334e-7 2.514659082852672e-7
Standard deviation 7.4342322181016294e-9 9.178464071719282e-9 1.1195052497070097e-8

Outlying measurements have severe (0.5473639156722334%) effect on estimated standard deviation.

Word32/xshowp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.7339492400199355e-7 2.786740053475215e-7 2.8410599212525917e-7
Standard deviation 1.3328029583794893e-8 1.882933408786015e-8 2.834448967023785e-8

Outlying measurements have severe (0.8047693638852009%) effect on estimated standard deviation.

Word32/xshowu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.4037111567552735e-7 3.456838006991218e-7 3.593737252586922e-7
Standard deviation 1.6839443391448652e-8 2.8737073344728342e-8 5.0927158815822107e-8

Outlying measurements have severe (0.8596594240786988%) effect on estimated standard deviation.

Word32/xshowpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.607432196923818e-7 3.635921831527445e-7 3.6723086360390786e-7
Standard deviation 9.580815331225425e-9 1.130230376152634e-8 1.4035372973154662e-8

Outlying measurements have moderate (0.4504130073051803%) effect on estimated standard deviation.

Word64/printf

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.711511612299028e-6 2.7528227137050807e-6 2.80635790223301e-6
Standard deviation 1.0692341803211278e-7 1.5404506701664407e-7 1.9967733531499251e-7

Outlying measurements have severe (0.6887121774632242%) effect on estimated standard deviation.

Word64/showHex

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1754226590252097e-6 1.185483056884554e-6 1.1932422988093402e-6
Standard deviation 2.5531254003401724e-8 3.1386818614689206e-8 3.884009369631961e-8

Outlying measurements have moderate (0.34664379416155283%) effect on estimated standard deviation.

Word64/xbuild

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 8.110203621217203e-7 8.188670270952612e-7 8.296570956846825e-7
Standard deviation 2.0283757829854917e-8 2.7568231483893958e-8 3.723842754376768e-8

Outlying measurements have moderate (0.47307911027059724%) effect on estimated standard deviation.

Word64/xbuildu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3939448602254988e-6 1.413633878388007e-6 1.4495030559383694e-6
Standard deviation 4.035926517743095e-8 8.876890053128677e-8 1.3875019683236357e-7

Outlying measurements have severe (0.7533471222295661%) effect on estimated standard deviation.

Word64/xshowl

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1357675904042515e-6 1.1473206602252222e-6 1.1614887780657719e-6
Standard deviation 3.106796175755111e-8 4.0112887418129057e-8 5.353307939337298e-8

Outlying measurements have moderate (0.4846362058818959%) effect on estimated standard deviation.

Word64/xshowlp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1370997701205985e-6 1.1442578640217582e-6 1.1535251497995429e-6
Standard deviation 2.150100693092882e-8 2.6073421316955163e-8 3.461750716334567e-8

Outlying measurements have moderate (0.28082576211801236%) effect on estimated standard deviation.

Word64/xshowlu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.7601769477709933e-6 1.7717305882307048e-6 1.7862265983930623e-6
Standard deviation 3.9301592518456697e-8 4.579437582788109e-8 5.559971367919113e-8

Outlying measurements have moderate (0.32648179765766006%) effect on estimated standard deviation.

Word64/xshowlpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.7429423673219294e-6 1.755174115688812e-6 1.7689615492734903e-6
Standard deviation 3.844538109831584e-8 4.487125003369323e-8 5.557323501820472e-8

Outlying measurements have moderate (0.3215852149325772%) effect on estimated standard deviation.

Word64/xshow

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.178938303907517e-6 1.2286660584742248e-6 1.2900649754808911e-6
Standard deviation 1.0542795291166876e-7 1.8179627747756776e-7 2.534720249084742e-7

Outlying measurements have severe (0.9485680570558254%) effect on estimated standard deviation.

Word64/xshowp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1602372003964595e-6 1.171686815678233e-6 1.1796346631362067e-6
Standard deviation 2.6337565350186493e-8 3.2631643570556284e-8 3.9191479293852856e-8

Outlying measurements have moderate (0.3702883871504615%) effect on estimated standard deviation.

Word64/xshowu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.7579241834050762e-6 1.7704877582316642e-6 1.7837047438379467e-6
Standard deviation 3.558359942349901e-8 4.498874699513697e-8 5.758296539008547e-8

Outlying measurements have moderate (0.31828227700895095%) effect on estimated standard deviation.

Word64/xshowpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.78398269190213e-6 1.7941047809561872e-6 1.808743466835585e-6
Standard deviation 3.50425012778865e-8 4.223753116370111e-8 5.48269115368668e-8

Outlying measurements have moderate (0.2886291393458829%) effect on estimated standard deviation.

understanding this report

In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.

Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.

We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)

A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.