| 医学影像与自然语言处理多模态探索研究 |
| 修订日期：2023-09-12 点此下载全文 |
| 引用本文：龚宇新,向菲,应葵.医学影像与自然语言处理多模态探索研究[J].医学信息学杂志,2024,45(1):33-38 |
| 摘要点击次数: |
| 全文下载次数: |
|
|
| 中文摘要:目的/意义 实现医学影像报告的自动生成对减轻放射科医生工作负担、促进临床工作流程标准化具有重要意义。方法/过程 重点查找近几年公开源代码的胸部报告生成模型,开发一种基于CDGPT 2模型的医学影像报告自动生成方法。结果/结论 大参数量的语言模型在报告生成方面的优势仍有待挖掘, 对模型的解码器输入进行修改后生成报告的质量不高。未来研究可采用大型数据集并结合更多临床信息来提高模型性能。 |
| 中文关键词:胸片 多模态 报告自动生成 注意力机制 自然语言处理 |
| |
| An Exploratory Study of Multimodality in Medical Imaging and Natural Language Processing |
|
|
| Abstract:Purpose/Significance Achieving automatic generation of medical imaging reports is important for reducing the workload of radiologists and promoting the standardization of clinical workflow. Method/Process Focusing on finding the chest report generation models with open source code in recent years, the paper develops an automatic medical image report generation method based on the CDGPT2 model. Result/Conclusion The advantages of the model in report generation are still to be explored, the quality of reports generated after modifications to the decoder inputs of the model is not high. Future research could improve the performance of the model by using large datasets and incorporating more clinical information. |
| keywords:chest radiograph multimodal automatic report generation attention mechanism natural language processing |
| 查看全文 查看/发表评论 下载PDF阅读器 |
