Movatterモバイル変換

You are notlogged in. Your edit will be placed in a queue until it ispeer reviewed.

We welcome edits that make the post easier to understand and more valuable for readers. Because community members review edits, please try to make the post substantially better than how you found it, for example, by fixing grammar or adding additional resources and hyperlinks.

Required fields*

Rev

Required fields *

Extreme outlier in real data

I'm looking at the amount of carbon in seven forest pools. For dead trees left on the landscape across many locations and over several harvest retention (logging) treatments, there is an extreme value that I happen to know is real.

Data is fairly zero inflated (10 of 190 obs) and right skewed.

Min. = 0.0000
1st Qu. = 0.1733
Median = 0.6664
Mean = 7.0793
3rd Qu. = 3.2283
Max. = 468.9519

Histogram with outlier:

Histogram of data without outlier:

A massive coastal old growth snag results in a plot having 469 Mg C ha⁻¹ in the dead trees when the next most C-rich measurement is 83 Mg C ha⁻¹. This is a real tree in my actual plot, but it completely skews the estimates of my GLMMs away from meaningful inference of the rest the data. It's random that this tree wound up in this particular treatment as plots were randomly assigned treatments. It is not random that a tree is at this location because it is our most southern/humid research forest.

How do you handle a totally real but seriously destructive outlier?

Answer*

If you were to read some of my past answers/comments about outliers, and outlier removal, you would note that I am very sanguine about people who think very little about removing so-called outliers.

So first let me commend you for at least having some scruples.

And second, maybe surprisingly coming from me, I see nothing wrong with you simply ignoring said "anomaly". As long as you clearly disclose this (as yo did in the question), note that you know it is "true data" (and not an error), but that it is so exceptional as to bias your model, then simply ignore it.\
And you may also want to ignore the datapoints at 83 and 61 (only 1 observation in these ranges of your data).\
And if you then clearly state that your model is only valid in the range of 0 to ~40 Mg C ha<sup>&minus;1</sup> (it really would be pushing it to claim up to 50, as you have essentially no observations in that range), then there is no issue. That is the range your model can claim to be valid in, and you are simply excluding datapoints beyond that range.\
And trying to use "robust models" or other such tools is fool's gold; you have basically no observation beyond ~40, so making claims that you are modelling beyond this value is pointless.\
Now, if you had observed a lot of values between ~40 and ~400, you could make a broader claim, but then you would not have an outlier, would you? You would have an extreme value, and it would be fair to account for it in your (broader) model.

MathJax reference.

To learn more, see ourtips on writing great answers.

Draft saved

Draft discarded

Edit Summary*

Cancel

Add a comment |

How to Edit

Correct minor typos or mistakes
Clarify meaning without changing it
Add related resources or links
Always respect the author’s intent
Don’t use edits to reply to the author

How to Format

create code fences with backticks ` or tildes ~
```
like so
```
add language identifier to highlight code
```python
def function(foo):
print(foo)
```
put returns between paragraphs
for linebreak add 2 spaces at end
_italic_ or**bold**
indent code by 4 spaces
backtick escapes`like _so_`
quote by placing > at start of line
to make links (use https whenever possible)
<https://example.com>
[example](https://example.com)
<a href="https://example.com">example</a>
MathJax equations $\sin^2 \theta$

formatting help »
answering help »

MathJax help »

How to Tag

A tag is a keyword or label that categorizes your question with other, similar questions. Choose one or more (up to 5) tags that will help answerers to find and interpret your question.

complete the sentence:my question is about...
use tags that describe things or concepts that areessential, not incidental to your question
favor usingexisting popular tags
read the descriptions that appear below the tag

If your question is primarily about a topic for which you can't find a tag:

combine multiple words into single-words with hyphens (e.g.machine-learning), up to a maximum of 35 characters
creating new tags is a privilege; if you can't yet create a tag you need, then post this question without it, thenask the community to create it for you

popular tags »

lang-r