Dataset versus reality: understanding model performance from the perspective of information need

• Main Authors: Yu, Mengying, Sun, Aixin
• Other Authors: School of Computer Science and Engineering
• Format: Article
• Language: English
• Published: 2023
• Subjects: Engineering::Computer science and engineering; Model; Deep Learning
• Online Access: https://hdl.handle.net/10356/171253
• Institution: Nanyang Technological University

Deep learning technologies have brought us many models that outperform human beings on a few benchmarks. An interesting question is: can these models well solve real-world problems with similar settings (e.g., identical input/output) to the benchmark datasets? We argue that a model is trained to ans...