This research studies the influence of high-peak loads on local relaxation of residual stress and fatigue damage in high-strength steel welded joints treated by high-frequency mechanical impact (HFMI) treatment. The joint behavior is simulated with elastic–plastic finite element analyses that account for the combined effect of geometry, residual stress, and material properties. This simulation uses two treated geometry models: with or without surface roughness on HFMI groove, and two material properties: S690QL and AH36 structural steels. The results show that surface roughness and load history, including high-peak loads, significantly influence fatigue response. It is revealed that the model neglecting the surface roughness cannot represent the amount of residual stress change and fatigue damage at less than 100 µm depth from the surface. In addition, the local yield strength in the HFMI-treated zone affects the plasticity behavior near the surface imperfection under the high-peak loads, which provides comparatively different fatigue damage between S690QL and AH36 in some cases. As a result, this study provides the further understanding needed to develop a robust modeling approach to the fatigue life estimation of HFMI-treated welds subjected to high-peak loads.