Transportation electrification plays a crucial role in mitigating greenhouse gas (GHG) emissions and enabling the decarbonization of power systems. However, current research on electric vehicles (EVs) only provides a fragmented examination of their impact on power system planning and operation, lacking a comprehensive overview across both transmission and distribution levels. This limits the effectiveness and efficiency of power system solutions for greater EV adoption. Conducting a systematic review of the effects of EVs on power transmission and distribution systems (e.g., grid integration, planning, operation, etc.), this paper aims to bridge the fragmented literature on the topic together by focusing on the interplay between transportation electrification and power systems. The study sheds light on the interplay between transportation electrification and power systems, delving into the importance of classifying EVs and charging infrastructure based on powertrain design, duty cycle, and typical features, as well as methods of capturing charging patterns and determining spatial-temporal charging profiles. Furthermore, we provide an in-depth discussion on the benefits of smart charging and the provision of grid-to-vehicle (G2V) and vehicle-to-grid (V2G) services for maintaining power system reliability. With the holistic systems approach, this paper can identify the main objectives and potential barriers of power transmission and distribution systems in accommodating transportation electrification at scale. Concurrently, it paves the way for a comprehensive understanding of technological innovation, transportation-power system decarbonization, policy pathways, environmental advantages, scenario designs, and avenues for future research.