Toward Interactive Next Location Prediction Driven by Large Language Models

被引:0
|
作者
Chen, Yong [1 ,2 ]
Chi, Ben [1 ,3 ]
Li, Chuanjia [1 ,3 ]
Zhang, Yuliang [1 ,2 ,4 ]
Liao, Chenlei [1 ,2 ]
Chen, Xiqun [1 ,2 ]
Xie, Na [5 ]
机构
[1] Zhejiang Univ, Inst Intelligent Transportat Syst, Hangzhou 310058, Peoples R China
[2] Zhejiang Univ, Coll Civil Engn & Architecture, Hangzhou 310058, Peoples R China
[3] Zhejiang Univ, Polytech Inst, Hangzhou 310058, Peoples R China
[4] Hangzhou City Univ, Intelligent Transportat Syst Res Ctr, Hangzhou 310015, Peoples R China
[5] Cent Univ Finance & Econ, Sch Management Sci & Engn, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Predictive models; Accuracy; Spatiotemporal phenomena; Cognition; Natural languages; Feature extraction; Data models; Computational modeling; Deep learning; Large language models; Human mobility; large language model (LLM); location prediction; multiround continuous dialogue; Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS);
D O I
10.1109/TCSS.2024.3522965
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Individual next location prediction plays a crucial role in location-based applications, such as route navigation and service recommendation. Although the existing research based on deep learning effectively captures users' spatiotemporal travel preferences, there are challenges in the interpretability of location prediction, heavily relying on large-scale historical travel data for model training. Drawing inspiration from the powerful reasoning capabilities of large language models (LLMs), this study proposes a novel multiround continuous dialogue mechanism and candidate set enhancement method, leveraging LLMs for next location prediction through step-by-step reasoning. In the first round of dialogue, we introduce activity prediction as an auxiliary task to narrow down the candidate locations. Subsequently, we establish an activity-aware prompt to enable LLM to achieve accurate location prediction and provide corresponding reasoning. Finally, we incorporate a third round of dialogue to prompt LLM to make necessary corrections by integrating the prediction results of deep learning models. To address the issues of LLMs being affected by element ranking within the candidate set, we propose a new candidate set enhancement method based on the entropy-weighted Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS). Our model can understand user travel preferences by fusing location, activity, and time information through natural language. Extensive experiments are conducted on two public datasets of user check-ins, and the results show that our model achieves prediction performance comparable to deep learning models in full-sample prediction and outperforms them in the few-shot settings. Our model provides logical and explainable reasoning, offering insightful guidance for downstream application tasks.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] AlloyBERT: Alloy property prediction with large language models
    Chaudhari, Akshat
    Guntuboina, Chakradhar
    Huang, Hongshuo
    Farimani, Amir Barati
    COMPUTATIONAL MATERIALS SCIENCE, 2024, 244
  • [22] LPNL: Scalable Link Prediction with Large Language Models
    Bi, Baolong
    Liu, Shenghua
    Wang, Yiwei
    Mei, Lingrui
    Cheng, Xueqi
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: ACL 2024, 2024, : 3615 - 3625
  • [23] Next word prediction for Urdu language using deep learning models
    Shahid, Ramish
    Wali, Aamir
    Bashir, Maryam
    COMPUTER SPEECH AND LANGUAGE, 2024, 87
  • [24] Chat with the Environment: Interactive Multimodal Perception Using Large Language Models
    Zhao, Xufeng
    Li, Mengdi
    Weber, Cornelius
    Hafez, Muhammad Burhan
    Wermter, Stefan
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 3590 - 3596
  • [25] Leveraging Large Language Models for Goal-aware Interactive Recommendations
    Said, Alan
    Willemsen, Martijn
    Marinho, Leandro Balby
    Silva, Itallo
    PROCEEDINGS OF THE 11TH CONFERENCE ON HUMAN-AGENT INTERACTION, HAI 2023, 2023, : 464 - 466
  • [26] Grounding Large Language Models in Interactive Environments with Online Reinforcement Learning
    Carta, Thomas
    Romac, Clement
    Wolf, Thomas
    Lamprier, Sylvain
    Sigaud, Olivier
    Oudeyer, Pierre-Yves
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 202, 2023, 202
  • [27] Large Language Models for Intent-Driven Session Recommendations
    Sun, Zhu
    Liu, Hongyang
    Qu, Xinghua
    Feng, Kaidong
    Wang, Yan
    Ong, Yew Soon
    PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 324 - 334
  • [28] On the use of large language models in model-driven engineering
    Di Rocco, Juri
    Di Ruscio, Davide
    Di Sipio, Claudio
    Nguyen, Phuong T.
    Rubei, Riccardo
    SOFTWARE AND SYSTEMS MODELING, 2025,
  • [29] Large Language Model Driven Interactive Learning for Real-Time Cognitive Load Prediction in Human-Swarm Systems
    Zang, Wenshuo
    Hu, Mengsha
    Liu, Rui
    2024 33RD IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, ROMAN 2024, 2024, : 97 - 102
  • [30] Hybrid predictors for next location prediction
    Petzold, Jan
    Bagci, Faruk
    Trumler, Wolfgang
    Ungerer, Theo
    UBIQUITOUS INTELLIGENCE AND COMPUTING, PROCEEDINGS, 2006, 4159 : 125 - 134