Does clinical decision support system promote expert consensus for appropriate imaging referrals? Chest–abdominal–pelvis CT as a case study

Insights into Imaging

Table 5 Overall percentage agreement (ID expert: 1,2- radiology, 3,4- Emergency Department Physician) before and after consulting the ESR iGuide

Measure	Difference pair 1 and 2	Difference pair 1 and 3	Difference pair 2 and 3	Difference pair 1 and 4	Difference pair 2 and 4	Difference pair 3 and 4
A. Before consulting the ESR iGuide
Original rating (Range 1–7)
Total count of 0 in difference column	20	10	13	13	20	41
Total ratings	100	100	100	100	100	100
Proportion agreement	0.2	0.1	0.13	0.13	0.2	0.41
Percentage agreement	20%	10%	13%	13%	20%	41%
Overall percentage agreement	19.50%
Total count of 0 in difference column	44	36	57	37	54	51
Total ratings	100	100	100	100	100	100
Proportion agreement	0.44	0.36	0.57	0.37	0.54	0.51
Percentage agreement	44%	36%	57%	37%	54%	51%
Overall percentage agreement	46.50%

Measure	Difference pair 1 and 2	Difference pair 1 and 3	Difference pair 2 and 3	Difference pair 1 and 4	Difference pair 2 and 4	Difference pair 3 and 4
B After consulting the ESR iGuide
Original rating (Range 1–7)
Total count of 0 in difference column	43	42	36	33	21	51
Total ratings	100	100	100	100	100	100
Proportion agreement	0.43	0.42	0.36	0.33	0.21	0.51
Percentage agreement	43%	42%	36%	33%	21%	51%
Overall percentage agreement	37.67%
Total count of 0 in difference column	73	78	70	68	63	71
Total ratings	100	100	100	100	100	100
Proportion agreement	0.73	0.78	0.7	0.68	0.63	0.71
Percentage agreement	73%	78%	70%	68%	63%	71%
Overall percentage agreement	70.50%