|
Log-linear model coefficients
|
---|
Response category
|
Experts
|
RENEX and experts
|
|
E
1
E
2
E
3
|
E
1
E
2
R
|
E
1
E
3
R
|
E
2
E
3
R
|
|
[
δ
m
, (SE)]
|
[
δ
m
1
, (SE)]
|
[
δ
m
2
, (SE)]
|
[
δ
m
3
, (SE)]
|
Non-obstructed
|
0.82* (0.29)
|
0.98* (0.30)
|
0.60 (0.38)
|
0.60 (0.38)
|
Equivocal
|
0.64 (0.28)
|
-0.34 (0.37)
|
0.32 (0.28)
|
-0.21 (0.34)
|
Obstructed
|
0.08 (0.97)
|
1.48* (0.42)
|
-0.45 (0.98)
|
1.89* (0.35)
|
|
p values for tests of hypothesis
|
|
H
0: δ
m
= 1/3 [θ
m 1+ θ
m 2+ θ
m 3]a
|
Non-obstructed
|
0.79
|
Equivocal
|
0.03
|
Obstructed
|
0.49
|
- * Significant positive three-way agreement at α = 0.01. aTests the hypothesis that the overall three-way agreement among experts is the same as the overall three-way agreement between RENEX and any two experts