| species | \nsex | \nn() | \n
|---|---|---|
| Adelie | \nfemale | \n73 | \n
| Adelie | \nmale | \n73 | \n
| Chinstrap | \nfemale | \n34 | \n
| Chinstrap | \nmale | \n34 | \n
| Gentoo | \nfemale | \n58 | \n
| Gentoo | \nmale | \n61 | \n
# Fit data\nflipper_fit <- stats::aov(flipper_length_mm ~ species, data = df)\n# Run anova\nflipper_anova <- car::Anova(flipper_fit)\n\n\n# Extract estimated marginal means\nflipper_emmeans <- emmeans::emmeans(flipper_fit, specs = pairwise ~ species)\n\n# convert estimated marginal mean contrasts to dataframe\nflipper_emmeans_contrasts <- data.frame(flipper_emmeans$contrasts)\n\nknitr::kable(flipper_emmeans_contrasts)| contrast | \nestimate | \nSE | \ndf | \nt.ratio | \np.value | \n
|---|---|---|---|---|---|
| Adelie - Chinstrap | \n-5.72079 | \n0.9796493 | \n330 | \n-5.83963 | \n0 | \n
| Adelie - Gentoo | \n-27.13255 | \n0.8240767 | \n330 | \n-32.92479 | \n0 | \n
| Chinstrap - Gentoo | \n-21.41176 | \n1.0143492 | \n330 | \n-21.10887 | \n0 | \n
effectsize::t_to_d(t = flipper_emmeans_contrasts[flipper_emmeans_contrasts$contrast == \"Adelie - Chinstrap\", \"t.ratio\"],\n df_error = flipper_emmeans_contrasts[flipper_emmeans_contrasts$contrast == \"Adelie - Chinstrap\", \"df\"]\n )\n#> d | 95% CI\n#> ----------------------\n#> -0.64 | [-0.86, -0.42]Created on 2023-11-05 with reprex v2.0.2
","upvoteCount":1,"answerCount":1,"acceptedAnswer":{"@type":"Answer","text":"Hey, this will give approximate d effect sizes (see discussion here #212). But if you are using {emmeans} you can use emmeans::eff_size() to get d effect sizes directly:
library(palmerpenguins) # dataset\nlibrary(car) # anova functions\nlibrary(effectsize) # effect sizes\nlibrary(dplyr)\n\n# assigns data to a dataframe we call \"df\"\ndf <- palmerpenguins::penguins\n\n# drop rows with missing values\ndf <- df[complete.cases(df)==TRUE, ]\n\nflipper_fit <- stats::aov(flipper_length_mm ~ species, data = df)\n\n# Extract estimated marginal means\nflipper_emmeans <- emmeans::emmeans(flipper_fit, specs = ~ species)\n\nemmeans::eff_size(\n flipper_emmeans,\n method = \"pairwise\",\n sigma = sigma(flipper_fit),\n edf = df.residual(flipper_fit)\n)\n#> contrast effect.size SE df lower.CL upper.CL\n#> (Adelie - Chinstrap) -0.857 0.151 330 -1.15 -0.561\n#> (Adelie - Gentoo) -4.066 0.201 330 -4.46 -3.671\n#> (Chinstrap - Gentoo) -3.209 0.197 330 -3.60 -2.822\n#> \n#> sigma used for effect sizes: 6.673 \n#> Confidence level used: 0.95(This suggestion also appears in t_to_d() documentation:
\n\nThe resulting d effect size is an approximation to Cohen's d, and assumes two equal group sizes. When possible, it is advised to directly estimate Cohen's d, with
\ncohens_d(),emmeans::eff_size(), or similar functions.
I suggest reading emmeans::eff_size() docs about how to select sigma in more complex models.
Hope this helps!
","upvoteCount":2,"url":"https://github.com/easystats/effectsize/discussions/617#discussioncomment-7484856"}}}Appropriate to use t_to_d() on estimated marginal mean contrasts from ANOVA? #617
-
|
Question and context I'm running some factorial anova analyses, and would like to use t_to_d() with emmeans to retrieve cohen's d effect sizes for my pairwise contrasts. I'm just wondering whether this is statistically sound? I see the degrees of freedom are the same all across the contrasts, and am not sure whether these large df values might lead to some inflated and inaccurate estimates of cohen's d. Reprex: library(palmerpenguins) # dataset
#> Warning: package 'palmerpenguins' was built under R version 4.1.3
library(car) # anova functions
#> Warning: package 'car' was built under R version 4.1.3
#> Loading required package: carData
#> Warning: package 'carData' was built under R version 4.1.3
library(effectsize) # effect sizes
library(dplyr)
#> Warning: package 'dplyr' was built under R version 4.1.3
#>
#> Attaching package: 'dplyr'
#> The following object is masked from 'package:car':
#>
#> recode
#> The following objects are masked from 'package:stats':
#>
#> filter, lag
#> The following objects are masked from 'package:base':
#>
#> intersect, setdiff, setequal, union
# assigns data to a dataframe we call "df"
df <- palmerpenguins::penguins
# drop rows with missing values
df <- df[complete.cases(df)==TRUE, ]
df %>%
group_by(species, sex) %>% # Group by the specified variables
dplyr::summarise(n()) %>%
knitr::kable()
#> `summarise()` has grouped output by 'species'. You can override using the
#> `.groups` argument.
# Fit data
flipper_fit <- stats::aov(flipper_length_mm ~ species, data = df)
# Run anova
flipper_anova <- car::Anova(flipper_fit)
# Extract estimated marginal means
flipper_emmeans <- emmeans::emmeans(flipper_fit, specs = pairwise ~ species)
# convert estimated marginal mean contrasts to dataframe
flipper_emmeans_contrasts <- data.frame(flipper_emmeans$contrasts)
knitr::kable(flipper_emmeans_contrasts)
effectsize::t_to_d(t = flipper_emmeans_contrasts[flipper_emmeans_contrasts$contrast == "Adelie - Chinstrap", "t.ratio"],
df_error = flipper_emmeans_contrasts[flipper_emmeans_contrasts$contrast == "Adelie - Chinstrap", "df"]
)
#> d | 95% CI
#> ----------------------
#> -0.64 | [-0.86, -0.42]Created on 2023-11-05 with reprex v2.0.2 |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
Hey, this will give approximate d effect sizes (see discussion here #212). But if you are using library(palmerpenguins) # dataset
library(car) # anova functions
library(effectsize) # effect sizes
library(dplyr)
# assigns data to a dataframe we call "df"
df <- palmerpenguins::penguins
# drop rows with missing values
df <- df[complete.cases(df)==TRUE, ]
flipper_fit <- stats::aov(flipper_length_mm ~ species, data = df)
# Extract estimated marginal means
flipper_emmeans <- emmeans::emmeans(flipper_fit, specs = ~ species)
emmeans::eff_size(
flipper_emmeans,
method = "pairwise",
sigma = sigma(flipper_fit),
edf = df.residual(flipper_fit)
)
#> contrast effect.size SE df lower.CL upper.CL
#> (Adelie - Chinstrap) -0.857 0.151 330 -1.15 -0.561
#> (Adelie - Gentoo) -4.066 0.201 330 -4.46 -3.671
#> (Chinstrap - Gentoo) -3.209 0.197 330 -3.60 -2.822
#>
#> sigma used for effect sizes: 6.673
#> Confidence level used: 0.95(This suggestion also appears in
I suggest reading Hope this helps! |
Beta Was this translation helpful? Give feedback.
-
|
This is terrific. Thank you! If it is of interest to anyone who stumbles here, I wrote a small function for calculating emmeans::eff_size() and merging it into the same dataframe as the raw contrasts: |
Beta Was this translation helpful? Give feedback.
Hey, this will give approximate d effect sizes (see discussion here #212). But if you are using
{emmeans}you can useemmeans::eff_size()to get d effect sizes directly: