This articleneeds additional citations forverification. Please helpimprove this article byadding citations to reliable sources. Unsourced material may be challenged and removed. Find sources: "Sample maximum and minimum" – news ·newspapers ·books ·scholar ·JSTOR(July 2021) (Learn how and when to remove this message) |
Instatistics, thesample maximum andsample minimum, also called thelargest observation andsmallest observation, are the values of the greatest and least elements of asample.[1] They are basicsummary statistics, used indescriptive statistics such as thefive-number summary andBowley's seven-figure summary and the associatedbox plot.

The minimum and the maximum value are the first and lastorder statistics (often denotedX(1) andX(n) respectively, for a sample size ofn).
If the sample hasoutliers, they necessarily include the sample maximum or sample minimum, or both, depending on whether they are extremely high or low. However, the sample maximum and minimum need not be outliers, if they are not unusually far from other observations.
Robustness
editThe sample maximum and minimum are theleastrobust statistics: they are maximally sensitive to outliers.
This can either be an advantage or a drawback: if extreme values are real (not measurement errors), and of real consequence, as in applications ofextreme value theory such as building dikes or financial loss, then outliers (as reflected in sample extrema) are important. On the other hand, if outliers have little or no impact on actual outcomes, then using non-robust statistics such as the sample extrema simply clouds the statistics, and robust alternatives should be used, such as otherquantiles: the 10th and 90thpercentiles (first and lastdecile) are more robust alternatives.
Derived statistics
editIn addition to being a component of every statistic that uses all elements of the sample, the sample extrema are important parts of therange, a measure of dispersion, andmid-range, a measure of location. They also realize themaximum absolute deviation: one of them is thefurthest point from any given point, particularly a measure of center such as the median or mean.
Applications
editSmooth maximum
editFor a sample set, the maximum function is non-smooth and thus non-differentiable. For optimization problems that occur in statistics it often needs to be approximated by a smooth function that is close to the maximum of the set.
Asmooth maximum, for example,
- g(x1,x2, …,xn) = log( exp(x1) + exp(x2) + … + exp(xn) )
is a good approximation of the sample maximum.
Summary statistics
editThe sample maximum and minimum are basicsummary statistics, showing the most extreme observations, and are used in thefive-number summary and a version of theseven-number summary and the associatedbox plot.
Prediction interval
editThe sample maximum and minimum provide a non-parametricprediction interval:in a sample from a population, or more generally anexchangeable sequence of random variables, each observation is equally likely to be the maximum or minimum.
Thus if one has a sample and one picks another observation then this has probability of being the largest value seen so far, probability of being the smallest value seen so far, and thus the other of the time, falls between the sample maximum and sample minimum of Thus, denoting the sample maximum and minimum byM andm, this yields an prediction interval of [m,M].
For example, ifn = 19, then [m,M] gives an 18/20 = 90% prediction interval – 90% of the time, the 20th observation falls between the smallest and largest observation seen heretofore. Likewise,n = 39 gives a 95% prediction interval, andn = 199 gives a 99% prediction interval.
Estimation
editDue to their sensitivity to outliers, the sample extrema cannot reliably be used asestimators unless data is clean – robust alternatives include the first and lastdeciles.
However, with clean data or in theoretical settings, they can sometimes prove very good estimators, particularly forplatykurtic distributions, where for small data sets themid-range is the mostefficient estimator.
They are inefficient estimators of location for mesokurtic distributions, such as thenormal distribution, and leptokurtic distributions, however.
Uniform distribution
editFor sampling without replacement from auniform distribution with one or two unknown endpoints (so withN unknown, or with bothM andN unknown), the sample maximum, or respectively the sample maximum and sample minimum, aresufficient andcomplete statistics for the unknown endpoints; thus an unbiased estimator derived from these will beUMVU estimator.
If only the top endpoint is unknown, the sample maximum is a biased estimator for the population maximum, but the unbiased estimator (wherem is the sample maximum andk is the sample size) is the UMVU estimator; seeGerman tank problem for details.
If both endpoints are unknown, then the sample range is a biased estimator for the population range, but correcting as for maximum above yields the UMVU estimator.
If both endpoints are unknown, then themid-range is an unbiased (and hence UMVU) estimator of the midpoint of the interval (here equivalently the population median, average, or mid-range).
The reason the sample extrema are sufficient statistics is that the conditional distribution of the non-extreme samples is just the distribution for the uniform interval between the sample maximum and minimum – once the endpoints are fixed, the values of the interior points add no additional information.
Normality testing
editThe sample extrema can be used for a simplenormality test, specifically of kurtosis: one computes thet-statistic of the sample maximum and minimum (subtractssample mean and divides by thesample standard deviation), and if they are unusually large for the sample size (as per thethree sigma rule and table therein, or more precisely aStudent's t-distribution), then the kurtosis of the sample distribution deviates significantly from that of the normal distribution.
For instance, a daily process should expect a 3σ event once per year (of calendar days; once every year and a half of business days), while a 4σ event happens on average every 40 years of calendar days, 60 years of business days (once in a lifetime), 5σ events happen every 5,000 years (once in recorded history), and 6σ events happen every 1.5 million years (essentially never). Thus if the sample extrema are 6 sigmas from the mean, one has a significant failure of normality.
Further, this test is very easy to communicate without involved statistics.
These tests of normality can be applied if one faceskurtosis risk, for instance.
Extreme value theory
editSample extrema play two main roles inextreme value theory:
- first, they give a lower bound on extreme events – events can be at least this extreme, and for this size sample;
- second, they can sometimes be used in estimators of probability of more extreme events.
However, caution must be used in using sample extrema as guidelines: inheavy-tailed distributions or fornon-stationary processes, extreme events can be significantly more extreme than any previously observed event. This is elaborated inblack swan theory.
See also
editReferences
edit- ^"NEDARC - Min, Max, and Range".www.nedarc.org. Retrieved2023-02-17.