Assessment of colorectal polyp recognition skill: development and validation of an objective test

The quality of colonoscopy is known to vary. The extent to which colonoscopists can recognize the presence of subtle colorectal lesions by visually distinguishing them from the surrounding mucosa (i.e., polyp recognition skill) may be one of several attributes that influence polyp detection rates. The aim of the present study was to develop and validate the first objective test of polyp recognition skill. Validation study. Twenty-eight experienced colonoscopists and eighty novices took a preliminary 280-item computer-based polyp recognition test. Items were genuine endoscopic images which participants assessed for the presence of "likely polyps." Half included clinically identified polyps. Participants clicked on a suspected lesion or a button marked "no likely polyp", and the main outcome measures were accuracy and response latency. The best items were selected for the final 50-item test. In the preliminary test, experienced colonoscopists correctly identified more polyps than novices (P < .0001) and better discriminated between clinically identified polyps and non-polyp features (as measured by d', P < .0001). For polyp items, the experienced group also responded faster (P < .01). Effect sizes were large for accuracy (Cohen's d = 3.22) and d' (Cohen's d = 3.22). The 50 final test items produced comparable results for accuracy, d', and response latency. For both versions of the test, score scale reliability was high for both polyp and non-polyp items (alpha = .82 to .97). The observed experienced-novice differences support the construct validity of the performance measures derived from the tests, indicating that polyp recognition skill can be quantified objectively. The final test may potentially be used to assess trainees, but test sensitivity may be insufficient to make fine-grained distinctions between different skill levels among experienced colonoscopists. More sensitive future tests may provide a valuable supplement to clinical detection rates, allowing objective comparisons between skilled colonoscopists.