APPLICATION DEVELOPMENT WITH LLM FOR GENERATION AND VISUALIZATION OF BPMN FROM LEGAL DOCUMENTS
Legal documents are often the main foothold in determining the structure and rules governing business processes. The process of creating accurate process models based on complex legal documents requires very careful interpretation and interpretation given the rapid growth of legal documents that...
Saved in:
Main Author: | |
---|---|
Format: | Final Project |
Language: | Indonesia |
Online Access: | https://digilib.itb.ac.id/gdl/view/86191 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Institut Teknologi Bandung |
Language: | Indonesia |
id |
id-itb.:86191 |
---|---|
spelling |
id-itb.:861912024-09-16T14:19:31ZAPPLICATION DEVELOPMENT WITH LLM FOR GENERATION AND VISUALIZATION OF BPMN FROM LEGAL DOCUMENTS Wilsen, Willy Indonesia Final Project LLM, Workflow, Legal Document, RAG, BPMN INSTITUT TEKNOLOGI BANDUNG https://digilib.itb.ac.id/gdl/view/86191 Legal documents are often the main foothold in determining the structure and rules governing business processes. The process of creating accurate process models based on complex legal documents requires very careful interpretation and interpretation given the rapid growth of legal documents that are difficult to read and digest all the information. On the other hand, tools such as the Large Language Model (LLM) have brought significant advances in natural language text generation capabilities. These LLMs bring potential in automating the generation of process models from legal documents. The existing research raises the question “How to use pre-trained LLM in applications to generate and visualize legal document workflows that are accurate, easier for users, represent actors clearly, and pay attention to token capacity constraints in processing legal documents?”. The implementation of the solution scheme is based on the draft solution of the problem to provide eight different schemes in the solution architecture. The final solution scheme implemented the use of RAG in the generation of BPMN elements as the workflow of legal documents. The solution architecture using LLM in the form of GPT provides accuracy, precision, and recall rates of 92.85%, 96.42%, and 96.42% respectively and the solution architecture using LLM in the form of Gemini provides accuracy, precision, and recall rates of 67.28%, 81.57%, and 85.71% respectively. However, the exclusiveGateway generated sometimes only gives an if answer. The layout generated by the layout engine to provide the position and size of an element is also still done manually. text |
institution |
Institut Teknologi Bandung |
building |
Institut Teknologi Bandung Library |
continent |
Asia |
country |
Indonesia Indonesia |
content_provider |
Institut Teknologi Bandung |
collection |
Digital ITB |
language |
Indonesia |
description |
Legal documents are often the main foothold in determining the structure and
rules governing business processes. The process of creating accurate process
models based on complex legal documents requires very careful interpretation and
interpretation given the rapid growth of legal documents that are difficult to read
and digest all the information. On the other hand, tools such as the Large
Language Model (LLM) have brought significant advances in natural language
text generation capabilities. These LLMs bring potential in automating the
generation of process models from legal documents.
The existing research raises the question “How to use pre-trained LLM in
applications to generate and visualize legal document workflows that are accurate,
easier for users, represent actors clearly, and pay attention to token capacity
constraints in processing legal documents?”. The implementation of the solution
scheme is based on the draft solution of the problem to provide eight different
schemes in the solution architecture. The final solution scheme implemented the
use of RAG in the generation of BPMN elements as the workflow of legal
documents.
The solution architecture using LLM in the form of GPT provides accuracy,
precision, and recall rates of 92.85%, 96.42%, and 96.42% respectively and the
solution architecture using LLM in the form of Gemini provides accuracy,
precision, and recall rates of 67.28%, 81.57%, and 85.71% respectively. However,
the exclusiveGateway generated sometimes only gives an if answer. The layout
generated by the layout engine to provide the position and size of an element is
also still done manually. |
format |
Final Project |
author |
Wilsen, Willy |
spellingShingle |
Wilsen, Willy APPLICATION DEVELOPMENT WITH LLM FOR GENERATION AND VISUALIZATION OF BPMN FROM LEGAL DOCUMENTS |
author_facet |
Wilsen, Willy |
author_sort |
Wilsen, Willy |
title |
APPLICATION DEVELOPMENT WITH LLM FOR GENERATION AND VISUALIZATION OF BPMN FROM LEGAL DOCUMENTS |
title_short |
APPLICATION DEVELOPMENT WITH LLM FOR GENERATION AND VISUALIZATION OF BPMN FROM LEGAL DOCUMENTS |
title_full |
APPLICATION DEVELOPMENT WITH LLM FOR GENERATION AND VISUALIZATION OF BPMN FROM LEGAL DOCUMENTS |
title_fullStr |
APPLICATION DEVELOPMENT WITH LLM FOR GENERATION AND VISUALIZATION OF BPMN FROM LEGAL DOCUMENTS |
title_full_unstemmed |
APPLICATION DEVELOPMENT WITH LLM FOR GENERATION AND VISUALIZATION OF BPMN FROM LEGAL DOCUMENTS |
title_sort |
application development with llm for generation and visualization of bpmn from legal documents |
url |
https://digilib.itb.ac.id/gdl/view/86191 |
_version_ |
1822283352177115136 |