Boosting Algorithms to Analyse Firm’s Performance Based on Return on Equity: An Explanatory Study

Abstract

This study aims to use the boosting techniques especially gradient boosting and its extension extreme gradient boosting in predicting firm performance in terms of return on equity that may be considered as a measure of profitability. The models are evaluated using R-squared, root mean square error, and mean absolute error. The global interpretations in terms of partial dependent plot and local interpretations in terms of local interpretable model-agnostic explanations are performed to interpret the prediction for any individual or group of cases. The results show that the extreme gradient boosting is improving the model by about 39% for training set and about 4% for testing set in terms of R-squared. Interesting results are given by the partial dependent and local model-agnostic explanation plots where they are suggesting that the total assets, the total liability and the board size have the most effect on the predicting and interpreting return on equity.