LLM-based column lineage for relational databases

• Main Author: Tan, Yu Ling
• Other Authors: Long Cheng
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2024
• Subjects: Computer and Information Science; LLM; Database; Column lineage
• Online Access: https://hdl.handle.net/10356/181146
• Institution: Nanyang Technological University

This research paper explores a novel approach to deriving column lineage of relational databases, by making use of large language models (LLMs). Column lineage, or column-level lineage, tracks the flow of data for each column across tables, from ingestion to visualization. Traditional methods for de...