Movatterモバイル変換


[0]ホーム

URL:


Jump to content
WikipediaThe Free Encyclopedia
Search

Random effects model

From Wikipedia, the free encyclopedia
Statistical model
Not to be confused withRandom coefficient model.
Part of a series on
Regression analysis
Models
Estimation
Background

Ineconometrics, arandom effects model, also called avariance components model, is astatistical model where the model effects arerandom variables. It is a kind ofhierarchical linear model, which assumes that the data being analysed are drawn from a hierarchy of different populations whose differences relate to that hierarchy. A random effects model is a special case of amixed model.

Contrast this to thebiostatistics definitions,[1][2][3][4][5] as biostatisticians use "fixed" and "random" effects to respectively refer to the population-average and subject-specific effects (and where the latter are generally assumed to be unknown,latent variables).

Qualitative description

[edit]

Random effect models assist in controlling forunobserved heterogeneity when the heterogeneity is constant over time and not correlated with independent variables. This constant can be removed from longitudinal data through differencing, since taking a first difference will remove any time invariant components of the model.[6]

Two common assumptions can be made about the individual specific effect: the random effects assumption and the fixed effects assumption. The random effects assumption is that the individual unobserved heterogeneity is uncorrelated with the independent variables. The fixed effect assumption is that the individual specific effect is correlated with the independent variables.[6]

If the random effects assumption holds, the random effects estimator is moreefficient than the fixed effects model.

Simple example

[edit]

Supposem{\displaystyle m} large elementary schools are chosen randomly from among thousands in a large country. Suppose also thatn{\displaystyle n} pupils of the same age are chosen randomly at each selected school. Their scores on a standard aptitude test are ascertained. LetYij{\displaystyle Y_{ij}} be the score of thej{\displaystyle j}-th pupil at thei{\displaystyle i}-th school.

A simple way to model this variable is

Yij=μ+Ui+Wij,{\displaystyle Y_{ij}=\mu +U_{i}+W_{ij},\,}

whereμ{\displaystyle \mu } is the average test score for the entire population.

In this modelUi{\displaystyle U_{i}} is the school-specificrandom effect: it measures the difference between the average score at schooli{\displaystyle i} and the average score in the entire country. The termWij{\displaystyle W_{ij}} is the individual-specific random effect, i.e., it's the deviation of thej{\displaystyle j}-th pupil's score from the average for thei{\displaystyle i}-th school.

The model can be augmented by including additional explanatory variables, which would capture differences in scores among different groups. For example:

Yij=μ+β1Sexij+β2ParentsEducij+Ui+Wij,{\displaystyle Y_{ij}=\mu +\beta _{1}\mathrm {Sex} _{ij}+\beta _{2}\mathrm {ParentsEduc} _{ij}+U_{i}+W_{ij},\,}

whereSexij{\displaystyle \mathrm {Sex} _{ij}} is a binarydummy variable andParentsEducij{\displaystyle \mathrm {ParentsEduc} _{ij}}records, say, the average education level of a child's parents. This is amixed model, not a purely random effects model, as it introducesfixed-effects terms for Sex and Parents' Education.

Variance components

[edit]

The variance ofYij{\displaystyle Y_{ij}} is the sum of the variancesτ2{\displaystyle \tau ^{2}} andσ2{\displaystyle \sigma ^{2}} ofUi{\displaystyle U_{i}} andWij{\displaystyle W_{ij}} respectively.

Let

Y¯i=1nj=1nYij{\displaystyle {\overline {Y}}_{i\bullet }={\frac {1}{n}}\sum _{j=1}^{n}Y_{ij}}

be the average, not of all scores at thei{\displaystyle i}-th school, but of those at thei{\displaystyle i}-th school that are included in therandom sample. Let

Y¯=1mni=1mj=1nYij{\displaystyle {\overline {Y}}_{\bullet \bullet }={\frac {1}{mn}}\sum _{i=1}^{m}\sum _{j=1}^{n}Y_{ij}}

be thegrand average.

Let

SSW=i=1mj=1n(YijY¯i)2{\displaystyle SSW=\sum _{i=1}^{m}\sum _{j=1}^{n}(Y_{ij}-{\overline {Y}}_{i\bullet })^{2}\,}
SSB=ni=1m(Y¯iY¯)2{\displaystyle SSB=n\sum _{i=1}^{m}({\overline {Y}}_{i\bullet }-{\overline {Y}}_{\bullet \bullet })^{2}\,}

be respectively the sum of squares due to differenceswithin groups and the sum of squares due to differencebetween groups. Then it can be shown[citation needed] that

1m(n1)E(SSW)=σ2{\displaystyle {\frac {1}{m(n-1)}}E(SSW)=\sigma ^{2}}

and

1(m1)nE(SSB)=σ2n+τ2.{\displaystyle {\frac {1}{(m-1)n}}E(SSB)={\frac {\sigma ^{2}}{n}}+\tau ^{2}.}

These "expected mean squares" can be used as the basis forestimation of the "variance components"σ2{\displaystyle \sigma ^{2}} andτ2{\displaystyle \tau ^{2}}.

Theσ2{\displaystyle \sigma ^{2}} parameter is also called theintraclass correlation coefficient.

Marginal likelihood

[edit]
This article mayrequirecleanup to meet Wikipedia'squality standards. The specific problem is:need to show formulas. Please helpimprove this article if you can.(April 2024) (Learn how and when to remove this message)

For random effects models themarginal likelihoods are important.[7]

Applications

[edit]

Random effects models used in practice include theBühlmann model of insurance contracts and theFay-Herriot model used forsmall area estimation.

See also

[edit]

Further reading

[edit]

References

[edit]
  1. ^Diggle, Peter J.; Heagerty, Patrick; Liang, Kung-Yee; Zeger, Scott L. (2002).Analysis of Longitudinal Data (2nd ed.). Oxford University Press. pp. 169–171.ISBN 0-19-852484-6.
  2. ^Fitzmaurice, Garrett M.; Laird, Nan M.; Ware, James H. (2004).Applied Longitudinal Analysis. Hoboken: John Wiley & Sons. pp. 326–328.ISBN 0-471-21487-6.
  3. ^Laird, Nan M.; Ware, James H. (1982). "Random-Effects Models for Longitudinal Data".Biometrics.38 (4):963–974.doi:10.2307/2529876.JSTOR 2529876.PMID 7168798.
  4. ^Gardiner, Joseph C.; Luo, Zhehui; Roman, Lee Anne (2009). "Fixed effects, random effects and GEE: What are the differences?".Statistics in Medicine.28 (2):221–239.doi:10.1002/sim.3478.PMID 19012297.
  5. ^Gomes, Dylan G.E. (20 January 2022)."Should I use fixed effects or random effects when I have fewer than five levels of a grouping factor in a mixed-effects model?".PeerJ.10 e12794.doi:10.7717/peerj.12794.PMC 8784019.PMID 35116198.
  6. ^abWooldridge, Jeffrey (2010).Econometric analysis of cross section and panel data (2nd ed.). Cambridge, Mass.: MIT Press. p. 252.ISBN 978-0-262-23258-6.OCLC 627701062.
  7. ^Hedeker, D., Gibbons, R. D. (2006). Longitudinal Data Analysis. Deutschland: Wiley. Page 163https://books.google.com/books?id=f9p9iIgzQSQC&pg=PA163

External links

[edit]
Retrieved from "https://en.wikipedia.org/w/index.php?title=Random_effects_model&oldid=1322733760"
Categories:
Hidden categories:

[8]ページ先頭

©2009-2026 Movatter.jp