Alignment-enriched tuning for patch-level pre-trained document image models

• Main Authors: WANG, Lei, HE, Jiabang, XU, Xing, LIU, Ning, LIU, Hui
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Artificial Intelligence and Robotics; Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/9318; https://ink.library.smu.edu.sg/context/sis_research/article/10318/viewcontent/Alignment_Enriched_pv.pdf
• Institution: Singapore Management University

Alignment between image and text has shown promising im provements on patch-level pre-trained document image mod els. However, investigating more effective or finer-grained alignment techniques during pre-training requires a large amount of computation cost and time. Thus, a question natu rally aris...