Improved LSTM hyperparameters alongside sentiment walk-forward validation for time series prediction

Abstract

This study aims to address the common issue of biased estimation errors in time series modeling by analyzing the error in locating ideal hyperparameters and defining appropriate validation methods. Specifically, it focuses on predicting the stock price of Bank Rakyat Indonesia using a combination of historical stock prices, technical indicators, exchange rates, and news sentiment data, while determining the optimal variables for deep learning models. Employing a deep learning-based Long-Short Term Memory (LSTM) model, the study optimizes hyperparameters alongside walk-forward validation for time series prediction. It explores different combinations of variables and adapts the sliding window approach to the context of the data. The results highlight the importance of optimizing hyperparameters and utilizing walk-forward validation for accurate time series prediction. The model incorporating historical stock prices and sentiment scores outperforms others, achieving an RMSE of 96.61 and MAE of 86.97. Incorporating sentiment scores reduces RMSE by 39.55 % compared to models using only historical stock prices, while adding technical indicators does not yield improvement. This study contributes to the field by addressing the issue of biased estimation errors in time series modeling, offering insights into the optimization of hyperparameters and validation methods for accurate predictions. It also underscores the significance of incorporating sentiment analysis alongside historical stock prices for improved forecasting accuracy.