The paper introduces the research progress and shortcomings of medical image question-answering, proposes a medical image question-answering model based on semantic graph by using the deep learning semantic graph convolution method, elaborates the model construction method, analyzes the experimental results, and points out that the model can improve the accuracy of medical image question-answering.