Do-GOOD: Towards distribution shift evaluation for pre-trained visual document understanding models

• Main Authors: HE, Jiabang, HU, Yi, WANG, Lei, XU, Xing, LIU, Ning, LIU, Hui
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: out-of-distribution; pre-trained models; visual document understanding; document information extraction; Databases and Information Systems; Numerical Analysis and Scientific Computing
• Online Access: https://ink.library.smu.edu.sg/sis_research/8145; https://ink.library.smu.edu.sg/context/sis_research/article/9148/viewcontent/3539618.3591670_pvoa.pdf
• Institution: Singapore Management University

Numerous pre-training techniques for visual document understanding (VDU) have recently shown substantial improvements in performance across a wide range of document tasks. However, these pre-trained VDU models cannot guarantee continued success when the distribution of test data differs from the dis...