DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM

The use of combustion engine has become a world serious problem with its emission of dangerous gasses which degrade the air quality and threathen public's health. Amongst the advancing solution is electric vehicle which doesn't directly produce any polutants. However, batteries can degrade...

Full description

Saved in:
Bibliographic Details
Main Author: Syaefulah Farsya, Arya
Format: Final Project
Language:Indonesia
Online Access:https://digilib.itb.ac.id/gdl/view/52592
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Institut Teknologi Bandung
Language: Indonesia
id id-itb.:52592
spelling id-itb.:525922021-02-19T09:34:52ZDEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM Syaefulah Farsya, Arya Indonesia Final Project energy management, electric vehicle, reinforcement learning, hybrid energy storage system, battery, supercapacitor INSTITUT TEKNOLOGI BANDUNG https://digilib.itb.ac.id/gdl/view/52592 The use of combustion engine has become a world serious problem with its emission of dangerous gasses which degrade the air quality and threathen public's health. Amongst the advancing solution is electric vehicle which doesn't directly produce any polutants. However, batteries can degrade over the year which makes ICE vehicles generally last longer than electric vehicle. One of the main reason for such degradation is the high rate or charge/discharge. One solution is to hybridize the energy storage with supercapacitors. Battery has high energy density while having low power density. On the other hand, supercapacitor has high power density but low energy density. This characteristic makes supercapacitor suitable to be used when the vehicle demands high power rate for a short period of time such as when accelerating. With this research, a controller was made to manage the usage of the hybrid energy storage such that the advantages are optimized. Deep deterministic policy gradient, a Reinforcement Learning algorithm was used to train the controller agent. The effect of discount factor and reward function on the agent's performance is also studied. Lastly, the agent's performance is compared to an existing fuzzy logic based controller. It is concluded that the fuzzy logic based controller still outperforms the reinforcement learning based one in terms of maximum battery power rate. It is concluded that the fuzzy logic based controller used as the benchmark still outperforms the reinforcement learning based controller developed in our research in terms of maximum battery power rate minimization. Nevertheless, reinforcement learning method still offer a promising alternative in the design of a decision making agent for its ability to learn strategy without being explicitly programmed. text
institution Institut Teknologi Bandung
building Institut Teknologi Bandung Library
continent Asia
country Indonesia
Indonesia
content_provider Institut Teknologi Bandung
collection Digital ITB
language Indonesia
description The use of combustion engine has become a world serious problem with its emission of dangerous gasses which degrade the air quality and threathen public's health. Amongst the advancing solution is electric vehicle which doesn't directly produce any polutants. However, batteries can degrade over the year which makes ICE vehicles generally last longer than electric vehicle. One of the main reason for such degradation is the high rate or charge/discharge. One solution is to hybridize the energy storage with supercapacitors. Battery has high energy density while having low power density. On the other hand, supercapacitor has high power density but low energy density. This characteristic makes supercapacitor suitable to be used when the vehicle demands high power rate for a short period of time such as when accelerating. With this research, a controller was made to manage the usage of the hybrid energy storage such that the advantages are optimized. Deep deterministic policy gradient, a Reinforcement Learning algorithm was used to train the controller agent. The effect of discount factor and reward function on the agent's performance is also studied. Lastly, the agent's performance is compared to an existing fuzzy logic based controller. It is concluded that the fuzzy logic based controller still outperforms the reinforcement learning based one in terms of maximum battery power rate. It is concluded that the fuzzy logic based controller used as the benchmark still outperforms the reinforcement learning based controller developed in our research in terms of maximum battery power rate minimization. Nevertheless, reinforcement learning method still offer a promising alternative in the design of a decision making agent for its ability to learn strategy without being explicitly programmed.
format Final Project
author Syaefulah Farsya, Arya
spellingShingle Syaefulah Farsya, Arya
DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM
author_facet Syaefulah Farsya, Arya
author_sort Syaefulah Farsya, Arya
title DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM
title_short DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM
title_full DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM
title_fullStr DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM
title_full_unstemmed DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM
title_sort development of reinforcement learning based controller for electric vehicle energy management with hybrid energy storage system
url https://digilib.itb.ac.id/gdl/view/52592
_version_ 1822273152860815360