Skip to main content

Table 6 Parameter estimates from models of Box-Cox transformed deviation scores from \({\overline{Z} }_{r}\) as a function of continuous and categorical peer ratings, Sorensen scores, and the inclusion of random effects. Standard errors (\({\text{SE}}\)) and 95% confidence intervals (95% CI) are reported for all estimates, while t values, degrees of freedom and p-values are presented for fixed-effects. Note that positive parameter estimates mean that as the predictor variable increases, so does the absolute value of the deviation from the meta-analytic mean

From: Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology

Parameter

Random effect

Coefficient

\({\text{SE}}\)

95% CI

t

df

p

Deviation explained by inclusion of random effects - Eucalyptus

  (Intercept)

 

−2.53

0.27

[−3.06, −1.99]

−9.31

77

<0.001

 Mixed model

 

0.00

0.31

[−0.60, 0.60]

0.00

77

>0.9

Deviation explained by Sorensen’s index - Eucalyptus

  (Intercept)

 

−2.65

1.05

[−4.70, −0.60]

−2.53

77

0.011

 Mean Sorensen's index

 

0.18

1.51

[−2.78, 3.14]

0.12

77

>0.9

Deviation explained by Sorensen’s index - blue tit

  (Intercept)

 

−1.53

0.28

[−2.08, −0.98]

−5.42

129

<0.001

 Mean Sorensen's index

 

0.42

0.47

[−0.49, 1.34]

0.91

129

0.4

Deviation explained by continuous ratings - Eucalyptus

  (Intercept)

 

−2.23

0.23

[−2.69, −1.78]

−9.65

342

<0.001

 RateAnalysis

 

−0.004

0

[−0.011, 0]

−1.44

342

0.15

\({\text{SD}}\)(Intercept)

Reviewer ID

0.37

0.09

[ 0.24, 0.60]

   

\({\text{SD}}\)(Observations)

Residual

1.06

0.04

[0.98, 1.15]

   

Deviation explained by continuous ratings - blue tit

  (Intercept)

 

−1.16

0.11

[−1.37, −0.94]

−10.60

469

<0.001

 RateAnalysis

 

−0.002

0

[−0.004, 0]

−1.22

469

0.2

\({\text{SD}}\)(Intercept)

Reviewer ID

0.16

0.03

[0.10,0.24]

   

\({\text{SD}}\)(Observations)

Residual

0.5

0.02

[0.46,0.53]

   

Deviation explained by categorical ratings - Eucalyptus

  (Intercept)

 

−2.66

0.27

[−3.18, −2.13]

−9.97

340

<0.001

 Publishable with major revision

 

0.29

0.29

[−0.27, 0.85]

1.02

340

0.3

 Publishable with minor revision

 

0.01

0.28

[−0.54, 0.56]

0.04

340

>0.9

 Publishable as is

 

0.05

0.31

[−0.55, 0.66]

0.17

340

0.9

\({\text{SD}}\)(Intercept)

Reviewer ID

0.39

0.09

[ 0.25, 0.61]

   

\({\text{SD}}\)(Observations)

Residual

1.06

0.04

[0.98, 1.15]

   

Deviation explained by categorical ratings - blue tit

  (Intercept)

 

−1.11

0.11

[−1.33, −0.89]

−9.91

467

<0.001

 Publishable with major revision

 

−0.19

0.12

[−0.42, 0.04]

−1.62

467

0.10

 Publishable with minor revision

 

−0.19

0.12

[−0.42, 0.04]

−1.65

467

0.10

 Publishable as is

 

−0.13

0.13

[−0.39, 0.12]

−1.02

467

0.3

\(\text{\hspace{1em}}{\text{SD}}\)(Intercept)

Reviewer ID

0.15

0.04

[ 0.10, 0.24]

   

\({\text{SD}}\)(Observations)

Residual

0.5

0.02

[0.46, 0.53]