Please use this identifier to cite or link to this item:
http://hdl.handle.net/10397/94206
Title: | A mean-field Markov decision process model for spatial-temporal subsidies in ride-sourcing markets | Authors: | Zhu, Z Ke, J Wang, H |
Issue Date: | Aug-2021 | Source: | Transportation research. Part B, Methodological, Aug. 2021, v. 150, p. 540-565 | Abstract: | Ride-sourcing services are increasingly popular because of their ability to accommodate on-demand travel needs. A critical issue faced by ride-sourcing platforms is the supply-demand imbalance, as a result of which drivers may spend substantial time on idle cruising and picking up remote passengers. Some platforms attempt to mitigate the imbalance by providing relocation guidance for idle drivers who may have their own self-relocation strategies and decline to follow the suggestions. Platforms then seek to induce drivers to system-desirable locations by offering them subsidies. This paper proposes a mean-field Markov decision process (MF-MDP) model to depict the dynamics in ride-sourcing markets with mixed agents, whereby the platform aims to optimize some objectives from a system perspective using spatial-temporal subsidies with predefined subsidy rates, and a number of drivers aim to maximize their individual income by following certain self-relocation strategies. To solve the model more efficiently, we further develop a representative-agent reinforcement learning algorithm that uses a representative driver to model the decision-making process of multiple drivers. This approach is shown to achieve significant computational advantages, faster convergence, and better performance. Using case studies, we demonstrate that by providing some spatial-temporal subsidies, the platform is able to well balance a short-term objective of maximizing immediate revenue and a long-term objective of maximizing service rate, while drivers can earn higher income. | Keywords: | Markov decision process Mean-field Mixed agents Ride-sourcing Subsidy |
Publisher: | Pergamon Press | Journal: | Transportation research. Part B, Methodological | ISSN: | 0191-2615 | EISSN: | 1879-2367 | DOI: | 10.1016/j.trb.2021.06.014 | Description: | 24th International Symposium on Transportation and Traffic Theory (ISTTT24), July 24 - 26, 2022, Beihang University, Beijing, China | Rights: | © 2021 Elsevier Ltd. All rights reserved. © 2021. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/ The following publication Zhu, Z., Ke, J., & Wang, H. (2021). A mean-field Markov decision process model for spatial-temporal subsidies in ride-sourcing markets. Transportation Research Part B: Methodological, 150, 540-565 is available at https://doi.org/10.1016/j.trb.2021.06.014. |
Appears in Collections: | Journal/Magazine Article |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Ke_Mean-Field_Markov_Decision.pdf | Pre-Published version | 2.88 MB | Adobe PDF | View/Open |
Page views
42
Last Week
1
1
Last month
Citations as of May 5, 2024
Downloads
16
Citations as of May 5, 2024
SCOPUSTM
Citations
43
Citations as of Apr 26, 2024
WEB OF SCIENCETM
Citations
34
Citations as of May 2, 2024
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.