Reinforced target-driven conversational promotion

• Main Authors: DAO, Huy Quang, LIAO, Lizi, LE, Dung D., NIE, Yuxiang
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Conversational recommendations; Dialogue strategy; Gating mechanisms; Knowledge integrated; Long term planning; Recommendation methods; Reinforcement learnings; Target driven; Tuning method; Artificial Intelligence and Robotics; Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/8581; https://ink.library.smu.edu.sg/context/sis_research/article/9584/viewcontent/Reinforced_target_driven_conversational_promotion.pdf
• Institution: Singapore Management University

The ability to proactively engage with users towards pitching products is highly desired for conversational assistants. However, existing conversational recommendation methods overemphasize on acquiring user preferences while ignore the strategic planning for nudging users towards accepting a designated item. Hence, these methods fail to promote specified items with engaging responses. In this work, we propose a Reinforced Target-driven Conversational Promotion (RTCP) framework for conversational promotion. RTCP integrates short-term and long-term planning via a balanced gating mechanism. Inside which, the dialogue actions are predicted via a knowledge-integrated multi-head attention and guided via reinforcement learning rewards. RTCP then employs action-guided prefix tuning to generate relevant responses. Experimental results demonstrate that our model outperforms state-of-the-art models on both automatic metrics and human evaluation. Moreover, RTCP has a strong capability in quickly adapting to unseen scenarios just by updating prefix parameters without re-training the whole model.