DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM
The use of combustion engine has become a world serious problem with its emission of dangerous gasses which degrade the air quality and threathen public's health. Amongst the advancing solution is electric vehicle which doesn't directly produce any polutants. However, batteries can degrade...
Saved in:
Main Author: | |
---|---|
Format: | Final Project |
Language: | Indonesia |
Online Access: | https://digilib.itb.ac.id/gdl/view/52592 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Institut Teknologi Bandung |
Language: | Indonesia |
id |
id-itb.:52592 |
---|---|
spelling |
id-itb.:525922021-02-19T09:34:52ZDEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM Syaefulah Farsya, Arya Indonesia Final Project energy management, electric vehicle, reinforcement learning, hybrid energy storage system, battery, supercapacitor INSTITUT TEKNOLOGI BANDUNG https://digilib.itb.ac.id/gdl/view/52592 The use of combustion engine has become a world serious problem with its emission of dangerous gasses which degrade the air quality and threathen public's health. Amongst the advancing solution is electric vehicle which doesn't directly produce any polutants. However, batteries can degrade over the year which makes ICE vehicles generally last longer than electric vehicle. One of the main reason for such degradation is the high rate or charge/discharge. One solution is to hybridize the energy storage with supercapacitors. Battery has high energy density while having low power density. On the other hand, supercapacitor has high power density but low energy density. This characteristic makes supercapacitor suitable to be used when the vehicle demands high power rate for a short period of time such as when accelerating. With this research, a controller was made to manage the usage of the hybrid energy storage such that the advantages are optimized. Deep deterministic policy gradient, a Reinforcement Learning algorithm was used to train the controller agent. The effect of discount factor and reward function on the agent's performance is also studied. Lastly, the agent's performance is compared to an existing fuzzy logic based controller. It is concluded that the fuzzy logic based controller still outperforms the reinforcement learning based one in terms of maximum battery power rate. It is concluded that the fuzzy logic based controller used as the benchmark still outperforms the reinforcement learning based controller developed in our research in terms of maximum battery power rate minimization. Nevertheless, reinforcement learning method still offer a promising alternative in the design of a decision making agent for its ability to learn strategy without being explicitly programmed. text |
institution |
Institut Teknologi Bandung |
building |
Institut Teknologi Bandung Library |
continent |
Asia |
country |
Indonesia Indonesia |
content_provider |
Institut Teknologi Bandung |
collection |
Digital ITB |
language |
Indonesia |
description |
The use of combustion engine has become a world serious problem with its emission of dangerous gasses which degrade the air quality and threathen public's health. Amongst the advancing solution is electric vehicle which doesn't directly produce any polutants. However, batteries can degrade over the year which makes ICE vehicles generally last longer than electric vehicle. One of the main reason for such degradation is the high rate or charge/discharge. One solution is to hybridize the energy storage with supercapacitors. Battery has high energy density while having low power density. On the other hand, supercapacitor has high power density but low energy density. This characteristic makes supercapacitor suitable to be used when the vehicle demands high power rate for a short period of time such as when accelerating.
With this research, a controller was made to manage the usage of the hybrid energy storage such that the advantages are optimized. Deep deterministic policy gradient, a Reinforcement Learning algorithm was used to train the controller agent. The effect of discount factor and reward function on the agent's performance is also studied. Lastly, the agent's performance is compared to an existing fuzzy logic based controller.
It is concluded that the fuzzy logic based controller still outperforms the reinforcement learning based one in terms of maximum battery power rate. It is concluded that the fuzzy logic based controller used as the benchmark still outperforms the reinforcement learning based controller developed in our research in terms of maximum battery power rate minimization. Nevertheless, reinforcement learning method still offer a promising alternative in the design of a decision making agent for its ability to learn strategy without being explicitly programmed.
|
format |
Final Project |
author |
Syaefulah Farsya, Arya |
spellingShingle |
Syaefulah Farsya, Arya DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM |
author_facet |
Syaefulah Farsya, Arya |
author_sort |
Syaefulah Farsya, Arya |
title |
DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM |
title_short |
DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM |
title_full |
DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM |
title_fullStr |
DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM |
title_full_unstemmed |
DEVELOPMENT OF REINFORCEMENT LEARNING BASED CONTROLLER FOR ELECTRIC VEHICLE ENERGY MANAGEMENT WITH HYBRID ENERGY STORAGE SYSTEM |
title_sort |
development of reinforcement learning based controller for electric vehicle energy management with hybrid energy storage system |
url |
https://digilib.itb.ac.id/gdl/view/52592 |
_version_ |
1822273152860815360 |