Evaluation of time series forecasting models applied to municipal expenses in a city in Ceará
- Authors
-
-
Author
-
João Evangelista Dantas dos Santos
Universidade Regional do Cariri – URCA
Author
-
Rodolfo de Sousa Santos
Universidade Regional do Cariri – URCA
Author
-
- Keywords:
- Machine Learning, Forecasting, Statistical Models, Resource Planning
- Abstract
-
To meet the complex financial planning needs of municipalities with high spending volatility, such as those in the interior of Ceará, it is necessary to have predictive models capable of accurately projecting expenses and optimizing resources. The comparison between the Auto ETS and Auto ARIMA models in the performance of expense forecasts was the central question of this study, which verified the results using historical data from 2018 to 2023. The evaluation metrics correspond to MAE, RMSE, MSE, MAPE, R² and correlation, associated with qualitative analysis of models. The results, in this sense, indicate the best performance of Auto ETS in absolute errors, with MAE of 21,510,499.88 and RMSE of 27,275,560.60 and explanation of variance with R² of 0.9139. Meanwhile, Auto ARIMA presents the best relative accuracy, with MAPE = 23.63%. However, the two models have an extremely high correlation, above 0.97, between the actual and predicted values. When testing the forecasts, the models captured historical patterns, demonstrating high adherence to the actual values. For the forecast range from 2024 to 2025, the estimates maintained patterns and seasonal variations in line with the past; Auto ETS smoothed out the most extreme peaks and proved to be more reliable; while Auto ARIMA handled the small variations better, contributing to the city's financial planning.
- Author Biographies
- References
-
Box, G. E., Jenkins, G. M., Reinsel, G. C., & Ljung, G. M. (2015). Time series analysis: forecasting and control.
Brockwell, P. J. & Davis, R. A. (Eds.). (2002). Introduction to time series and forecasting. New York, NY: Springer New York.
Vergara, S. H. C. & Almeida, C. V. L. de. (2003). Propostas para uma gestão pública municipal efetiva. FGV Editora.
Chatfield, C. & Xing, H. (2019). The analysis of time series: an introduction with R. Chapman and hall/CRC.
Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). SAGE Publications.
Denhardt, R. B. & Denhardt, J. V. (2003). The new public service: Serving, not steering (2nd ed.). M.E. Sharpe.
Ferreira, M. T. N., Silva, D. J. V. da, Santos, A. M. N. dos, Henrique, T. G., Tavares, V. H. N. D., & Santana, W. J. de. (2024). Gestão pública e desenvolvimento sustentável. Brazilian Journal of Development, 10(8), e71884-e71884.
Draper, N. R. & Smith, H. (1998). Applied regression analysis (Vol. 326). John Wiley & Sons.
Enders, W. (2008). Applied econometric time series. John Wiley & Sons.
Field, A. (2024). Discovering statistics using IBM SPSS statistics. Sage publications limited.
Hastie, T. (2009). The elements of statistical learning: data mining, inference, and prediction.
Holt, C. C. (2004). Forecasting seasonals and trends by exponentially weighted moving averages. International journal of forecasting, 20(1), 5-10.
Hyndman, R. J. & Athanasopoulos, G. (2021). Forecasting: Principles and practice (3rd ed.). OTexts. https://otexts.com/fpp3/
Hyndman, R. J. & Khandakar, Y. (2008). Automatic time series forecasting: The forecast package for R. Journal of Statistical Software, 27(3). https://doi.org/10.18637/jss.v027.i03
James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013). An introduction to statistical learning: With applications in R. Springer.
Makridakis, S., Spyropoulos, M., Assimakopoulos, V., & Nikolaidis, E. (2018). Statistical and machine learning forecasting methods: Concerns and ways forward. PLOS ONE, 13(3), 1-26. https://doi.org/10.1371/journal.pone.0194889
Makridakis, S., Wheelwright, S. C., & Hyndman, R. J. (2003). Forecasting methods and applications (3rd ed.). Wiley.
Morettin, P. A. & Toloi, C. M. C. (2006). Análise de séries temporais (2nd ed.). Blucher.
Pereira, L. C. B. (1998). Reforma do Estado para a cidadania: a reforma gerencial brasileira na perspectiva internacional. Editora 34.
Shumway, R. H. & Stoffer, D. S. (2017). Time series analysis and its applications: With R examples (4th ed.). Springer.
Silva, M. C., Santos, P. R., & Almeida, J. F. (2020). Portal de Transparência como ferramenta de controle social: Uma análise do período de 2018 a 2020. Revista Gestão Pública, 12(4), 23-45.
Willmott, C. J. & Matsuura, K. (2005). Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance. Climate Research, 30, 79-82.
Winters, P. R. (1960). Forecasting sales by exponentially weighted moving averages. Management Science, 6(3), 324-342. https://doi.org/10.1287/mnsc.6.3.324
- Cover Image
-
- Downloads
- Published
- 2025-04-25
- Section
- ECONOMIC ENGINEERING
- License
-
Copyright (c) 2025 José Wivo Gomes, João Evangelista Dantas dos Santos, Rodolfo de Sousa Santos (Autor)

This work is licensed under a Creative Commons Attribution 4.0 International License.
All works published in the Brazilian Journal of Production Engineering (BJPE) are licensed under Creative Commons Attribution 4.0 International (CC BY 4.0). This means that: Anyone can copy, distribute, display, adapt, remix, and even commercially use the content published in the journal; Provided that due credit is given to the authors and to BJPE as the original source; No additional permission is required for reuse, as long as the license terms are respected. This policy complies with the principles of open access, promoting the broad dissemination of scientific knowledge. 🔗 Click here to access the full license


2.png)







































