Automating dataset updates towards reliable and timely evaluation of Large Language Models

• المؤلفون الرئيسيون: YING, Jiahao, CAO, Yixin, BAI, Yushi, SUN, Qianru, WANG, Bo, TANG, Wei, DING, Zhaojun, YANG, Yizhe, HUANG, Xuanjing, YAN, Shuicheng
• التنسيق: text
• اللغة: English
• منشور في: Institutional Knowledge at Singapore Management University 2024
• الموضوعات: Large language models; LLM; Dataset update; Benchmark update; Automation; Artificial Intelligence and Robotics
• الوصول للمادة أونلاين: https://ink.library.smu.edu.sg/sis_research/9439
• المؤسسة: Singapore Management University

Large language models (LLMs) have achieved impressive performance across various natural language benchmarks, prompting a continual need to curate more difficult datasets for larger LLMs, which is costly and time-consuming. In this paper, we propose to automate dataset updating and provide systemati...