criterion performance measurements

overview

want to understand this report?

Word32/printf

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6109037793418845e-6 1.6249533150393261e-6 1.6413472908386855e-6
Standard deviation 4.709572057809109e-8 5.5318558544853426e-8 7.164204766390441e-8

Outlying measurements have moderate (0.4623111315695725%) effect on estimated standard deviation.

Word32/showHex

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.307106353336804e-7 1.3180521637291006e-7 1.3330739484904326e-7
Standard deviation 3.475698365362677e-9 4.0485988409913735e-9 4.643804806284278e-9

Outlying measurements have moderate (0.46699276671492523%) effect on estimated standard deviation.

Word32/xshow

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.9430778946875976e-7 1.9612290275012346e-7 1.985454904172203e-7
Standard deviation 5.765468571998953e-9 7.402275582602032e-9 9.87400977351949e-9

Outlying measurements have severe (0.5645526418405843%) effect on estimated standard deviation.

Word32/xshowp

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.0649028348457086e-7 2.082034975478501e-7 2.099787213216021e-7
Standard deviation 4.413821525177491e-9 5.8991912828486815e-9 7.31452772825182e-9

Outlying measurements have moderate (0.41714430017969645%) effect on estimated standard deviation.

Word32/xshowu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.695623042618499e-7 5.723692238103102e-7 5.75963727546657e-7
Standard deviation 9.068745368255367e-9 1.0778672723704823e-8 1.3466036892461504e-8

Outlying measurements have moderate (0.22244064562090468%) effect on estimated standard deviation.

Word32/xshowpu

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.807078292629927e-7 5.842141388737548e-7 5.891413522934408e-7
Standard deviation 1.1591552775448477e-8 1.3712034375030089e-8 1.6433902047285097e-8

Outlying measurements have moderate (0.30675154857329356%) effect on estimated standard deviation.

understanding this report

In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.

Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.

We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)

A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.