EVALUATION OF LONG-SHORT TERM MEMORY (LSTM) AND SEASONAL AUTOREGRESSIVE INTEGRATED MOVING AVERAGE (SARIMA) MODELS FOR RAINFALL PREDICTION IN SUMATRA AREA
Abstract
The demand for weather and climate information remains substantial. Climate change poses complex agricultural issues, underscoring the need for accurate weather and climate forecasts. Achieving highly accurate and consistent weather and climate predictions is a challenge in tropical regions. Numerous weather prediction models have been developed worldwide, yet these models often fail to adequately represent the dynamic parameters specific to Indonesia. Various approaches can be taken to predict upcoming rainfall, such as developing SARIMA and LSTM models. SARIMA enhances the ARIMA model by adding seasonal components, while LSTM has emerged as a competitive model for seasonal data. Rainfall data blending from selected Seasonal Zones (ZOM) in Sumatra is divided into training and test sets. LSTM and SARIMA models are constructed using Python programming language. Model outcomes are verified using metrics like RMSE, Bias, MAPE, and Pearson correlation. Additionally, data is transformed into multi-category contingency tables to verify the calculations for the proportion of correct forecasts and Peirce Skill Score. The SARIMA model produces smaller absolute error statistical values, but exhibits larger bias compared to LSTM. LSTM effectively captures training data patterns. The SARIMA model's outcomes are somewhat flat. Both models exhibit similar levels of accuracy. Peirce Skill Score calculations reveal that the LSTM model outperforms the SARIMA model in terms of the number of ZOMs falling into the "good" category.
Full text article
References
Armstrong, J. S. (2001). Evaluating Forecasting Methods. 443–472. https://doi.org/10.1007/978-0-306-47630-3_20
Brooks, H. E., & Doswell, C. A. (1996). A comparison of measures-oriented and distributions-oriented approaches to forecast verification. In Weather and Forecasting (Vol. 11, Issue 3). https://doi.org/10.1175/1520-0434(1996)011<0288:ACOMOA>2.0.CO;2
CAWCR. (2009). Forecast Verification - Issues, Methods and FAQ.
Gandin, L. S., & Murphy, A. H. (1992). Equitable skill scores for categorical forecasts. Monthly Weather Review, 120(2). https://doi.org/10.1175/1520-0493(1992)120<0361:ESSFCF>2.0.CO;2
Hochreiter, S., & Schmidhuber, J. (1997). Long Short Term Memory. Neural Computation. Neural Computation, 9(8).
Kafara, Z., Rumlawang, F. Y., & Sinay, L. J. (2017). PERAMALAN CURAH HUJAN DENGAN PENDEKATAN SEASONAL AUTOREGRESSIVE INTEGRATED MOVING AVERAGE (SARIMA). BAREKENG: Jurnal Ilmu Matematika Dan Terapan, 11(1). https://doi.org/10.30598/barekengvol11iss1pp63-74
Kustituanto, B., & Rudy, B. (1994). Statistika I. In Gunadarma. https://homel.vsb.cz/~bri10/Teaching/Statistika 1/1uvod.PDF
Muharsyah, R. (2018). Kajian Verifikasi Produk Prakiraan Curah Hujan Bulanan (2003-2012). Jurnal Meteorologi Dan Geofisika, 18(1), 33–44. https://doi.org/10.31172/jmg.v18i1.265
Murphy, A. H. (1989). Skill scores and correlation coefficients in model verification.
Murphy, A. H., & Winkler, R. L. (1987). A general framework for forecast verification. Monthly Weather Review, 115(7). https://doi.org/10.1175/1520-0493(1987)115<1330:AGFFFV>2.0.CO;2
Nuryadi. (2006). Model ARIMA Sebagai Alat Prediksi Curah Hujan. Diklat Teknis Pengolahan dan Analisa Data Klimatologi dan Kualitas Udara. Badan Meteorologi dan Geofisika.
Rumus Statistik. (2021). Cara Menghitung MAPE (Mean Absolute Percentage Error) di Excel dan R. https://www.rumusstatistik.com/2021/05/cara-menghitung-mape-mean-absolute.html
Sinay, L. J., Lembang, F. K., Aulele, S. N., & Mustamu, D. (2020). Analisis Curah Hujan Bulanan Di Kota Ambon Menggunakan Model Heteroskedastisitas: Sarima-Garch. Media Statistika, 13(1), 68–79. https://doi.org/10.14710/medstat.13.1.68-79
Soetamto dan Ulfah, A. M. (2006). Metode ARIMA, Modul Pelatihan Peningkatan Akurasi Prakiraan Musim. Badan Meteorologi dan Geofisika.
Walther, B. A., & Moore, J. L. (2005). The concepts of bias, precision and accuracy, and their use in testing the performance of species richness estimators, with a literature review of estimator performance. In Ecography (Vol. 28, Issue 6). https://doi.org/10.1111/j.2005.0906-7590.04112.x
Authors
Copyright (c) 2023 Bimbing Putra Lumban Tobing, Rista Hernandi Virgianto

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-NonCommercial 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work