Damage to semi-rigid base asphalt pavement is related to improper matching of the pavement structure moduli. This study mainly focused on the modulus matching of structural layers and the development of a pavement structure optimization method. First, the modulus loss of existing pavement structures was analysed, and a three-dimensional finite element model was established based on the existing pavement. Second, the influence of the modulus of each structural layer on the mechanical response indicators and fatigue life was analysed. Based on the results, a pavement structure design method using the smoothness of the stress-strain curve as the modulus matching criterion of the structural layers was proposed. And it was found that a strain convex point was present and that the stress mutation between the structural layers was significant when the modulus matching of the pavement structure was reasonable. Further, the evaluation indicators were divided into two groups, namely, mechanical indicators and fatigue life indicators. And it was proposed an optimized pavement structure design method based on modulus matching and multi-indicator range analysis. Finally, the optimal modulus combination of pavement structure was determined by this method. The research systematically studied the influence of the modulus of each structural layer on the mechanical response and fatigue life of the pavement, and proposed the concept and specific executive criteria of modulus matching for the first time. Meanwhile, it also provided an effective optimization method for pavement structure design.