Movatterモバイル変換


[0]ホーム

URL:


Jump to content
WikipediaThe Free Encyclopedia
Search

Logarithmically concave function

From Wikipedia, the free encyclopedia
Type of mathematical function

Inconvex analysis, anon-negative functionf :RnR+ islogarithmically concave (orlog-concave for short) if itsdomain is aconvex set, and if it satisfies the inequality

f(θx+(1θ)y)f(x)θf(y)1θ{\displaystyle f(\theta x+(1-\theta )y)\geq f(x)^{\theta }f(y)^{1-\theta }}

for allx,y ∈ domf and0 < θ < 1. Iff is strictly positive, this is equivalent to saying that thelogarithm of the function,log ∘f, isconcave; that is,

logf(θx+(1θ)y)θlogf(x)+(1θ)logf(y){\displaystyle \log f(\theta x+(1-\theta )y)\geq \theta \log f(x)+(1-\theta )\log f(y)}

for allx,y ∈ domf and0 < θ < 1.

Examples of log-concave functions are the 0-1indicator functions of convex sets (which requires the more flexible definition), and theGaussian function.

Similarly, a function islog-convex if it satisfies the reverse inequality

f(θx+(1θ)y)f(x)θf(y)1θ{\displaystyle f(\theta x+(1-\theta )y)\leq f(x)^{\theta }f(y)^{1-\theta }}

for allx,y ∈ domf and0 < θ < 1.

Properties

[edit]
  • A log-concave function is alsoquasi-concave. This follows from the fact that the logarithm is monotone implying that thesuperlevel sets of this function are convex.[1]
  • Every concave function that is nonnegative on its domain is log-concave. However, the reverse does not necessarily hold. An example is theGaussian functionf(x) = exp(−x2/2) which is log-concave sincelogf(x) = x2/2 is a concave function ofx. Butf is not concave since thesecond derivative is positive for |x| > 1:
f(x)=ex22(x21)0{\displaystyle f''(x)=e^{-{\frac {x^{2}}{2}}}(x^{2}-1)\nleq 0}
f(x)2f(x)f(x)f(x)T{\displaystyle f(x)\nabla ^{2}f(x)\preceq \nabla f(x)\nabla f(x)^{T}},[1]
i.e.
f(x)2f(x)f(x)f(x)T{\displaystyle f(x)\nabla ^{2}f(x)-\nabla f(x)\nabla f(x)^{T}} is
negative semi-definite. For functions of one variable, this condition simplifies to
f(x)f(x)(f(x))2{\displaystyle f(x)f''(x)\leq (f'(x))^{2}}

Operations preserving log-concavity

[edit]
  • Products: The product of log-concave functions is also log-concave. Indeed, iff andg are log-concave functions, thenlog f andlog g are concave by definition. Therefore
logf(x)+logg(x)=log(f(x)g(x)){\displaystyle \log \,f(x)+\log \,g(x)=\log(f(x)g(x))}
is concave, and hence alsof g is log-concave.
  • Marginals: iff(x,y) : Rn+m → R is log-concave, then
g(x)=f(x,y)dy{\displaystyle g(x)=\int f(x,y)dy}
is log-concave (seePrékopa–Leindler inequality).
  • This implies thatconvolution preserves log-concavity, sinceh(x,y) = f(x-yg(y) is log-concave iff andg are log-concave, and therefore
(fg)(x)=f(xy)g(y)dy=h(x,y)dy{\displaystyle (f*g)(x)=\int f(x-y)g(y)dy=\int h(x,y)dy}
is log-concave.

Log-concave distributions

[edit]

Log-concave distributions are necessary for a number of algorithms, e.g.adaptive rejection sampling. Every distribution with log-concave density is amaximum entropy probability distribution with specified meanμ andDeviation risk measureD.[2] As it happens, many commonprobability distributions are log-concave. Some examples:[3]

Note that all of the parameter restrictions have the same basic source: The exponent of non-negative quantity must be non-negative in order for the function to be log-concave.

The following distributions are non-log-concave for all parameters:

Note that thecumulative distribution function (CDF) of all log-concave distributions is also log-concave. However, some non-log-concave distributions also have log-concave CDF's:

The following are among the properties of log-concave distributions:

  • If a density is log-concave, so is itscumulative distribution function (CDF).
  • If a multivariate density is log-concave, so is themarginal density over any subset of variables.
  • The sum of two independent log-concaverandom variables is log-concave. This follows from the fact that the convolution of two log-concave functions is log-concave.
  • The product of two log-concave functions is log-concave. This means thatjoint densities formed by multiplying two probability densities (e.g. thenormal-gamma distribution, which always has a shape parameter ≥ 1) will be log-concave. This property is heavily used in general-purposeGibbs sampling programs such asBUGS andJAGS, which are thereby able to useadaptive rejection sampling over a wide variety ofconditional distributions derived from the product of other distributions.
  • If a density is log-concave, so is itssurvival function.[3]
  • If a density is log-concave, it has a monotonehazard rate (MHR), and is aregular distribution since the derivative of the logarithm of the survival function is the negative hazard rate, and by concavity is monotone i.e.
ddxlog(1F(x))=f(x)1F(x){\displaystyle {\frac {d}{dx}}\log \left(1-F(x)\right)=-{\frac {f(x)}{1-F(x)}}} which is decreasing as it is the derivative of a concave function.

See also

[edit]

Notes

[edit]
  1. ^abBoyd, Stephen; Vandenberghe, Lieven (2004)."Log-concave and log-convex functions".Convex Optimization. Cambridge University Press. pp. 104–108.ISBN 0-521-83378-7.
  2. ^Grechuk, Bogdan; Molyboha, Anton; Zabarankin, Michael (May 2009)."Maximum Entropy Principle with General Deviation Measures"(PDF).Mathematics of Operations Research.34 (2):445–467.doi:10.1287/moor.1090.0377.
  3. ^abSeeBagnoli, Mark; Bergstrom, Ted (2005)."Log-Concave Probability and Its Applications"(PDF).Economic Theory.26 (2):445–469.doi:10.1007/s00199-004-0514-4.S2CID 1046688.
  4. ^abPrékopa, András (1971)."Logarithmic concave measures with application to stochastic programming"(PDF).Acta Scientiarum Mathematicarum.32 (3–4):301–316.

References

[edit]
  • Barndorff-Nielsen, Ole (1978).Information and exponential families in statistical theory. Wiley Series in Probability and Mathematical Statistics. Chichester: John Wiley \& Sons, Ltd. pp. ix+238 pp.ISBN 0-471-99545-2.MR 0489333.
  • Dharmadhikari, Sudhakar; Joag-Dev, Kumar (1988).Unimodality, convexity, and applications. Probability and Mathematical Statistics. Boston, MA: Academic Press, Inc. pp. xiv+278.ISBN 0-12-214690-5.MR 0954608.
  • Pfanzagl, Johann; with the assistance of R. Hamböker (1994).Parametric Statistical Theory. Walter de Gruyter.ISBN 3-11-013863-8.MR 1291393.
  • Pečarić, Josip E.; Proschan, Frank; Tong, Y. L. (1992).Convex functions, partial orderings, and statistical applications. Mathematics in Science and Engineering. Vol. 187. Boston, MA: Academic Press, Inc. pp. xiv+467 pp.ISBN 0-12-549250-2.MR 1162312.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Logarithmically_concave_function&oldid=1283891345"
Categories:
Hidden categories:

[8]ページ先頭

©2009-2025 Movatter.jp