A comprehensive evaluation of large language models on legal judgment prediction

• Main Authors: SHUI, Ruihao, CAO, Yixin, WANG, Xiang, CHUA, Tat-Seng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Databases and Information Systems; Programming Languages and Compilers
• Online Access: https://ink.library.smu.edu.sg/sis_research/8396; https://ink.library.smu.edu.sg/context/sis_research/article/9399/viewcontent/2310.11761.pdf
• Institution: Singapore Management University

Large language models (LLMs) have demonstrated great potential for domain-specific applications, such as the law domain. However, recent disputes over GPT-4’s law evaluation raise questions concerning their performance in real-world legal tasks. To systematically investigate their competency in the...