The paper constructs first level evaluation indexes of medical college and university library websites based on information architecture theory, then divides them into twelve subordinate indexes. It utilizes analytic hierarchy process to establish three layer structure model, calculates index weight and constructs evaluation matrix, then verifies the practicality of the evaluation system taking Jining Medical College as an example.