The current state of automatic medical image captioning using deep learning

Image captioning is a new field of artificial intelligence which uses both natural language processing and machine learning methods. Recently, several researches conducted on Image captioning have led to the acceptable results in this field. Moreover, the need of the medical community for automatic interpretation of medical images, prompted researchers to apply this approach in the field of automatic interpretation of medical images. The medical images captioning is more challenging than the problem of image description because medical images are mostly gray and accompanied by noise, the existing data sets have significantly few samples; On the other hand, the provided interpretations are not structured and have variable lengths. In order to achieve the desired results, many algorithms have been proposed, among which methods based on deep learning have achieved proper results. This article introduces datasets, evaluation criteria and methods developed based on deep learning in the field of automatic interpretation of medical images in order to help understand the existing literature and highlight future directions in this field.