Llama2 self-improvement using memory-of-thought

• Main Author: Dong, Yuxiu
• Other Authors: Lihui Chen
• Format: Thesis-Master by Coursework
• Language: English
• Published: Nanyang Technological University 2024
• Subjects: Engineering; Memory-of-thought; Llama2; Large language model; Natural language processing
• Online Access: https://hdl.handle.net/10356/179097
• Institution: Nanyang Technological University

Memory-of-Thought (MoT) is a newly proposed mechanism for LLMs to self-improve without annotated datasets and expensive resource consumption for fine-tuning models. This project evaluates the effectiveness of MoT on a pre-trained Large Language Model Llama2 and compares the performance of improved L...