A new formulation of gradient boosting

• Main Authors: Wozniakowski, Alex, Thompson, Jane, Gu, Mile, Binder, Felix C.
• Other Authors: School of Physical and Mathematical Sciences
• Format: Article
• Language: English
• Published: 2023
• Subjects: Science::Physics; Multi-Target Regression; Ensemble Learning
• Online Access: https://hdl.handle.net/10356/164179
• Institution: Nanyang Technological University

In the setting of regression, the standard formulation of gradient boosting generates a sequence of improvements to a constant model. In this paper, we reformulate gradient boosting such that it is able to generate a sequence of improvements to a nonconstant model, which may contain prior knowledge...