Automatic detection of salient video frames from wireless capsule endoscopy using adaptive singular value decomposition

Wireless capsule endoscopy is a non-invasive diagnosis method which allows recording a video as the capsule travels through the gastrointestinal tract. The practical drawback is producing a long clinical video up to 8 hours and it takes about 2 hours to review the exam by an experienced expert. Video summarization methods can reduce the time required by experts and errors in manual interpretation. This paper presents an automatic method based on unique properties of adaptive singular value decomposition through sliding window that can reduce the long annotation time. By utilizing these properties, we are able to summarize a WCE video by outputting a motion video summary. Moreover, we apply an effective approach based on adaptive contrast diffusion to correct uneven illumination that deal with the low contrast generally caused by poor visibility conditions of the GI tract, WCE power and its structure. Experimental results on WCE videos indicate that a significant reduction in the review time is feasible. Quantitative and qualitative results of summarization show the effectiveness of proposed method that can be adapted to various clinical applications, such as training of young physicians, computer assisted diagnosis, medical decision support or medical document management.