Face to purchase: Predicting consumer choices with structured facial and behavioral traits embedding

• Main Authors: LIU, Zhe, WANG, Xianzhi, YAO, Lina, AN, Jake, BAI, Lei, LIM, Ee-peng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2022
• Subjects: Correlation analysis; Graphical neural networks; Hierarchical embedding; Purchase prediction; Databases and Information Systems; E-Commerce; Numerical Analysis and Scientific Computing
• Online Access: https://ink.library.smu.edu.sg/sis_research/6439; https://ink.library.smu.edu.sg/context/sis_research/article/7442/viewcontent/FaceToPurchase_2022_sv.pdf
• Institution: Singapore Management University

Predicting consumers’ purchasing behaviors is critical for targeted advertisement and sales promotion in e-commerce. Human faces are an invaluable source of information for gaining insights into consumer personality and behavioral traits. However, consumer's faces are largely unexplored in previous research, and the existing face-related studies focus on high-level features such as personality traits while neglecting the business significance of learning from facial data. We propose to predict consumers’ purchases based on their facial features and purchasing histories. We design a semi-supervised model based on a hierarchical embedding network to extract high-level features of consumers and to predict the top-N purchase destinations of a consumer. Our experimental results on a real-world dataset demonstrate the positive effect of incorporating facial information in predicting consumers’ purchasing behaviors.