The paper analyzes the reasons for barrier of the application of natural language processing in the medical field, proposes the methods for evaluation on Electronic Medical Records(EMR) natural language processing, and introduces the contents and development situations relevant to the evaluation on EMR natural language processing over the years, including text retrieval conference, medical natural language processing evaluation, SHARe/CLEF evaluation, I2B2 evaluation, etc.