Skip to main content

Table 4 Three-way agreement within experts and between experts and RENEX

From: Computer-aided diagnosis of renal obstruction: utility of log-linear modeling versus standard ROC and kappa analysis

 

Log-linear model coefficients

Response category

Experts

RENEX and experts

 

E 1 E 2 E 3

E 1 E 2 R

E 1 E 3 R

E 2 E 3 R

 

[ δ m , (SE)]

[ δ m 1 , (SE)]

[ δ m 2 , (SE)]

[ δ m 3 , (SE)]

Non-obstructed

0.82* (0.29)

0.98* (0.30)

0.60 (0.38)

0.60 (0.38)

Equivocal

0.64 (0.28)

-0.34 (0.37)

0.32 (0.28)

-0.21 (0.34)

Obstructed

0.08 (0.97)

1.48* (0.42)

-0.45 (0.98)

1.89* (0.35)

 

p values for tests of hypothesis

 

H 0: δ m = 1/3 [θ m 1+ θ m 2+ θ m 3]a

Non-obstructed

0.79

Equivocal

0.03

Obstructed

0.49

  1. * Significant positive three-way agreement at α = 0.01. aTests the hypothesis that the overall three-way agreement among experts is the same as the overall three-way agreement between RENEX and any two experts