The CMP distribution was originally proposed by Conway and Maxwell in 1962[3] as a solution to handlingqueueing systems with state-dependent service rates. The CMP distribution was introduced into the statistics literature by Boatwright et al. 2003[4] and Shmueli et al. (2005).[2] The first detailed investigation into theprobabilistic and statistical properties of the distribution was published by Shmueli et al. (2005).[2] Some theoretical probability results of COM-Poisson distribution is studied and reviewed by Li et al. (2019),[5] especially the characterizations of COM-Poisson distribution.
The function serves as anormalization constant so the probability mass function sums to one. Note that does not have a closed form.
The domain of admissible parameters is, and,.
The additional parameter which does not appear in thePoisson distribution allows for adjustment of the rate of decay. This rate of decay is a non-linear decrease in ratios of successive probabilities, specifically
Many important summary statistics, such as moments and cumulants, of the CMP distribution can be expressed in terms of the normalizing constant.[2][7] Indeed, Theprobability generating function is, and themean andvariance are given by
For general values of, there does not exist closed form formulas for the mean, variance and moments of the CMP distribution. We do, however, have the following neat formula.[7] Let denote thefalling factorial. Let,. Then
for.
Since in general closed form formulas are not available for moments and cumulants of the CMP distribution, the following asymptotic formulas are of interest. Let, where. Denote theskewness andexcess kurtosis, where. Then, as,[8]
Let have theConway–Maxwell–binomial distribution with parameters, and. Fix and. Then, converges in distribution to the distribution as.[7] This result generalises the classical Poisson approximation of the binomial distribution. More generally, the CMP distribution arises as a limiting distribution of Conway–Maxwell–Poisson binomial distribution.[7] Apart from the fact that COM-binomial approximates to COM-Poisson, Zhang et al. (2018)[9] illustrates that COM-negative binomial distribution withprobability mass function
convergents to a limiting distribution which is the COM-Poisson, as .
There are a few methods of estimating the parameters of the CMP distribution from the data. Two methods will be discussed: weighted least squares and maximum likelihood. The weighted least squares approach is simple and efficient but lacks precision. Maximum likelihood, on the other hand, is precise, but is more complex and computationally intensive.
Theweighted least squares provides a simple, efficient method to derive rough estimates of the parameters of the CMP distribution and determine if the distribution would be an appropriate model. Following the use of this method, an alternative method should be employed to compute more accurate estimates of the parameters if the model is deemed appropriate.
This method uses the relationship of successive probabilities as discussed above. By taking logarithms of both sides of this equation, the following linear relationship arises
where denotes. When estimating the parameters, the probabilities can be replaced by therelative frequencies of and. To determine if the CMP distribution is an appropriate model, these values should be plotted against for all ratios without zero counts. If the data appear to be linear, then the model is likely to be a good fit.
Once the appropriateness of the model is determined, the parameters can be estimated by fitting a regression of on. However, the basic assumption ofhomoscedasticity is violated, so aweighted least squares regression must be used. The inverse weight matrix will have the variances of each ratio on the diagonal with the one-step covariances on the first off-diagonal, both given below.
where and. Maximizing the likelihood yields the following two equations
which do not have an analytic solution.
Instead, themaximum likelihood estimates are approximated numerically by theNewton–Raphson method. In each iteration, the expectations, variances, and covariance of and are approximated by using the estimates for and from the previous iteration in the expression
The basic CMP distribution discussed above has also been used as the basis for ageneralized linear model (GLM) using a Bayesian formulation. A dual-link GLM based on the CMP distribution has been developed,[10]and this model has been used to evaluate traffic accident data.[11][12] The CMP GLM developed by Guikema and Coffelt (2008) is based on a reformulation of the CMP distribution above, replacing with. The integral part of is then the mode of the distribution. A full Bayesian estimation approach has been used withMCMC sampling implemented inWinBugs withnon-informative priors for the regression parameters.[10][11] This approach is computationally expensive, but it yields the full posterior distributions for the regression parameters and allows expert knowledge to be incorporated through the use of informative priors.
A classical GLM formulation for a CMP regression has been developed which generalizesPoisson regression andlogistic regression.[13] This takes advantage of theexponential family properties of the CMP distribution to obtain elegant model estimation (viamaximum likelihood), inference, diagnostics, and interpretation. This approach requires substantially less computational time than the Bayesian approach, at the cost of not allowing expert knowledge to be incorporated into the model.[13] In addition it yields standard errors for the regression parameters (via the Fisher Information matrix) compared to the full posterior distributions obtainable via the Bayesian formulation. It also provides astatistical test for the level of dispersion compared to a Poisson model. Code for fitting a CMP regression, testing for dispersion, and evaluating fit is available.[14]
The two GLM frameworks developed for the CMP distribution significantly extend the usefulness of this distribution for data analysis problems.
^abcdefShmueli G., Minka T., Kadane J.B., Borle S., and Boatwright, P.B. "A useful distribution for fitting discrete data: revival of the Conway–Maxwell–Poisson distribution."Journal of the Royal Statistical Society: Series C (Applied Statistics) 54.1 (2005): 127–142.[1]
^Conway, R. W.; Maxwell, W. L. (1962), "A queuing model with state dependent service rates",Journal of Industrial Engineering,12:132–136
^Li B., Zhang H., Jiao H. "Some Characterizations and Properties of COM-Poisson Random Variables."Communications in Statistics - Theory and Methods, (2019).[2]
^abcNadarajah, S. "Useful moment and CDF formulations for the COM–Poisson distribution." Statistical Papers 50 (2009): 617–622.
^abcdefghijDaly, F. and Gaunt, R.E. " The Conway–Maxwell–Poisson distribution: distributional theory and approximation." ALEA Latin American Journal of Probability and Mathematical Statistics 13 (2016): 635–658.
^abcGaunt, R.E., Iyengar, S., Olde Daalhuis, A.B. and Simsek, B. "An asymptotic expansion for the normalizing constant of the Conway–Maxwell–Poisson distribution." To appear in Annals of the Institute of Statistical Mathematics (2017+) DOI 10.1007/s10463-017-0629-6
^Zhang H., Tan K., Li B. "COM-negative binomial distribution: modeling overdispersion and ultrahigh zero-inflated count data." Frontiers of Mathematics in China, 2018, 13(4): 967–998.[3]
^abGuikema, S.D. and J.P. Coffelt (2008) "A Flexible Count Data Regression Model for Risk Analysis",Risk Analysis, 28 (1), 213–223.doi:10.1111/j.1539-6924.2008.01014.x
^abLord, D., S.D. Guikema, and S.R. Geedipally (2008) "Application of the Conway–Maxwell–Poisson Generalized Linear Model for Analyzing Motor Vehicle Crashes,"Accident Analysis & Prevention, 40 (3), 1123–1134.doi:10.1016/j.aap.2007.12.003
^Lord, D., S.R. Geedipally, and S.D. Guikema (2010) "Extension of the Application of Conway–Maxwell–Poisson Models: Analyzing Traffic Crash Data Exhibiting Under-Dispersion,"Risk Analysis, 30 (8), 1268–1276.doi:10.1111/j.1539-6924.2010.01417.x