Toward Interactive Next Location Prediction Driven by Large Language Models

被引:0
|
作者
Chen, Yong [1 ,2 ]
Chi, Ben [1 ,3 ]
Li, Chuanjia [1 ,3 ]
Zhang, Yuliang [1 ,2 ,4 ]
Liao, Chenlei [1 ,2 ]
Chen, Xiqun [1 ,2 ]
Xie, Na [5 ]
机构
[1] Zhejiang Univ, Inst Intelligent Transportat Syst, Hangzhou 310058, Peoples R China
[2] Zhejiang Univ, Coll Civil Engn & Architecture, Hangzhou 310058, Peoples R China
[3] Zhejiang Univ, Polytech Inst, Hangzhou 310058, Peoples R China
[4] Hangzhou City Univ, Intelligent Transportat Syst Res Ctr, Hangzhou 310015, Peoples R China
[5] Cent Univ Finance & Econ, Sch Management Sci & Engn, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Predictive models; Accuracy; Spatiotemporal phenomena; Cognition; Natural languages; Feature extraction; Data models; Computational modeling; Deep learning; Large language models; Human mobility; large language model (LLM); location prediction; multiround continuous dialogue; Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS);
D O I
10.1109/TCSS.2024.3522965
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Individual next location prediction plays a crucial role in location-based applications, such as route navigation and service recommendation. Although the existing research based on deep learning effectively captures users' spatiotemporal travel preferences, there are challenges in the interpretability of location prediction, heavily relying on large-scale historical travel data for model training. Drawing inspiration from the powerful reasoning capabilities of large language models (LLMs), this study proposes a novel multiround continuous dialogue mechanism and candidate set enhancement method, leveraging LLMs for next location prediction through step-by-step reasoning. In the first round of dialogue, we introduce activity prediction as an auxiliary task to narrow down the candidate locations. Subsequently, we establish an activity-aware prompt to enable LLM to achieve accurate location prediction and provide corresponding reasoning. Finally, we incorporate a third round of dialogue to prompt LLM to make necessary corrections by integrating the prediction results of deep learning models. To address the issues of LLMs being affected by element ranking within the candidate set, we propose a new candidate set enhancement method based on the entropy-weighted Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS). Our model can understand user travel preferences by fusing location, activity, and time information through natural language. Extensive experiments are conducted on two public datasets of user check-ins, and the results show that our model achieves prediction performance comparable to deep learning models in full-sample prediction and outperforms them in the few-shot settings. Our model provides logical and explainable reasoning, offering insightful guidance for downstream application tasks.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Context-Driven Interactive Query Simulations Based on Generative Large Language Models
    Engelmann, Bjoern
    Breuer, Timo
    Friese, Jana Isabelle
    Schaer, Philipp
    Fuhr, Norbert
    ADVANCES IN INFORMATION RETRIEVAL, ECIR 2024, PT II, 2024, 14609 : 173 - 188
  • [2] Large language models for depression prediction
    Wang, Yu
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2024, 121 (31)
  • [3] Data-driven building load prediction and large language models: Comprehensive overview
    Zhang, Yake
    Wang, Dijun
    Wang, Guansong
    Xu, Peng
    Zhu, Yihao
    ENERGY AND BUILDINGS, 2025, 326
  • [4] LMEye: An Interactive Perception Network for Large Language Models
    Li, Yunxin
    Hu, Baotian
    Chen, Xinyu
    Ma, Lin
    Xu, Yong
    Zhang, Min
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 10952 - 10964
  • [5] What’s the next word in large language models?
    Nature Machine Intelligence, 2023, 5 : 331 - 332
  • [6] What's the next word in large language models?
    不详
    NATURE MACHINE INTELLIGENCE, 2023, 5 (04) : 331 - 332
  • [7] Large Language Models for Career Readiness Prediction
    Cui, Chenwei
    Abdalla, Amro
    Wijaya, Derry
    Solberg, Scott
    Bargal, Sarah Adel
    ARTIFICIAL INTELLIGENCE IN EDUCATION: POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS, DOCTORAL CONSORTIUM AND BLUE SKY, AIED 2024, PT I, 2024, 2150 : 304 - 311
  • [8] CPLLM: Clinical prediction with large language models
    Ben Shoham, Ofir
    Rappoport, Nadav
    PLOS DIGITAL HEALTH, 2024, 3 (12):
  • [9] Large Language Models for Emotion Evolution Prediction
    Leung, Clement
    Xu, Zhifei
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS-ICCSA 2024 WORKSHOPS, PT I, 2024, 14815 : 3 - 19
  • [10] Toward Keyword Generation through Large Language Models
    Lee, Wanhae
    Chun, Minki
    Jeong, Hyeonhak
    Jung, Hyunggu
    COMPANION PROCEEDINGS OF 2023 28TH ANNUAL CONFERENCE ON INTELLIGENT USER INTERFACES, IUI 2023 COMPANION, 2023, : 37 - 40