Strategic planning of geo-fenced micro-mobility facilities using reinforcement learning

Abstract

The rise of Lightweight Shared Electric Vehicles (LSEVs) like e-scooters and e-bikes marks a shift towards sustainable urban mobility but brings challenges such as cluttering public spaces and distribution issues. Geo-fenced systems have emerged to mitigate these problems by restricting LSEVs to designated areas. However, integrating these infrastructures effectively remains challenging due to regulatory, convenience, and operational hurdles. In this study, we introduce a facility location optimization problem that strategically places Micro-Mobility Service Facilities (MMSFs) that enable charging, parking, and battery swapping of LSEVs. A utility model with benefit and loss functions accounts for the multiple objectives in this problem, including the impact of MMSF placement on service coverage and user convenience as well as financial and logistical costs. This model is uniquely customizable, allowing urban planners to modify the utility function’s parameters to align with specific local priorities and regulatory conditions. To solve this facility location optimization problem, we present a Deep Reinforcement Learning (RL) method that iteratively learns optimal placement strategies for Micro-Mobility Service Facilities by simulating interactions within real-world urban road networks and adapting to user demand patterns, regulatory constraints, and operational efficiencies. Our experiments in Austin and Louisville demonstrate that strategic placement of these facilities leads to substantial enhancements in infrastructure coverage, with improvements in parking demand by up to 163% in Austin and 72% in Louisville. These results underline the role of our approach in fostering more equitable and efficient urban mobility systems, significantly exceeding traditional simulation-based methods in both coverage and operational logistics. In particular, the results based on various budget scenarios reveal that service coverage and accessibility can be improved, with diminishing returns at higher budget levels due to demand saturation.