Learning semantically rich network-based multi-modal mobile user interface embeddings

• Main Authors: ANG, Meng Kiat Gary, LIM, Ee-peng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2022
• Subjects: network embedding; mobile application user interface; unsupervised retrieval; selfsupervised learning; multi-modal; user interface design; Databases and Information Systems; OS and Networks
• Online Access: https://ink.library.smu.edu.sg/sis_research/7269; https://ink.library.smu.edu.sg/context/sis_research/article/8272/viewcontent/3533856.pdf
• Institution: Singapore Management University

Semantically rich information from multiple modalities - text, code, images, categorical and numerical data - co-exist in the user interface (UI) design of mobile applications. Moreover, each UI design is composed of inter-linked UI entities which support different functions of an application, e.g.,...