Analysis of Machine Learning Algorithms for Time Series Prediction
| dc.contributor.advisor | Moodley, Deshendran | |
| dc.contributor.author | Naidoo, Kimendree | |
| dc.date.accessioned | 2022-03-10T09:52:25Z | |
| dc.date.available | 2022-03-10T09:52:25Z | |
| dc.date.issued | 2021 | |
| dc.date.updated | 2022-03-08T09:55:35Z | |
| dc.description.abstract | Due to the rapidly increasing prominence of Artificial Intelligence in the last decade and the advancements in technology such as processing power and data storage, there has been increased interest in applying machine learning algorithms to time series prediction problems. There are many machine learning algorithms that can be used for time series prediction problems but selecting an algorithm can be challenging due to algorithms not being suitable to all types of datasets. This research investigates and evaluates machine learning algorithms that can be used for time series prediction. Experiments were carried out using the Artificial Neural Network (ANN), Support Vector Regressor (SVR) and Long Short-Term Memory (LSTM) algorithms on eight datasets. An empirical analysis was carried out by applying each machine learning algorithm to the selected datasets. A critical comparison of the algorithm performance was carried out using the Mean Absolute Error (MAE), the Mean Squared Error (MSE), the Root Mean Squared Error (RMSE) and the Mean Absolute Scaled Error (MASE). The second experiment focused on evaluating the stability and robustness of the optimal models identified in the first experiment. The key dataset characteristics identified; were the dataset size, stationarity, trend and seasonality. It was found that the LSTM performed the best for majority of the datasets, due to the algorithm's ability to deal with sequential dependency. The performance of the ANN and SVR were similar for datasets with trend and seasonality, while the LSTM overall proved superior to the aforementioned algorithms. The LSTM outperformed the ANN and SVR due to its ability to handle temporal dependency. However, due to its stochastic nature, the LSTM and ANN algorithms can have poor stability and robustness. In this regard, the LSTM was found to be a more robust algorithm than the ANN and SVR. | |
| dc.identifier.apacitation | Naidoo, K. (2021). <i>Analysis of Machine Learning Algorithms for Time Series Prediction</i>. (). ,Faculty of Science ,Department of Computer Science. Retrieved from http://hdl.handle.net/11427/36024 | en_ZA |
| dc.identifier.chicagocitation | Naidoo, Kimendree. <i>"Analysis of Machine Learning Algorithms for Time Series Prediction."</i> ., ,Faculty of Science ,Department of Computer Science, 2021. http://hdl.handle.net/11427/36024 | en_ZA |
| dc.identifier.citation | Naidoo, K. 2021. Analysis of Machine Learning Algorithms for Time Series Prediction. . ,Faculty of Science ,Department of Computer Science. http://hdl.handle.net/11427/36024 | en_ZA |
| dc.identifier.ris | TY - Master Thesis AU - Naidoo, Kimendree AB - Due to the rapidly increasing prominence of Artificial Intelligence in the last decade and the advancements in technology such as processing power and data storage, there has been increased interest in applying machine learning algorithms to time series prediction problems. There are many machine learning algorithms that can be used for time series prediction problems but selecting an algorithm can be challenging due to algorithms not being suitable to all types of datasets. This research investigates and evaluates machine learning algorithms that can be used for time series prediction. Experiments were carried out using the Artificial Neural Network (ANN), Support Vector Regressor (SVR) and Long Short-Term Memory (LSTM) algorithms on eight datasets. An empirical analysis was carried out by applying each machine learning algorithm to the selected datasets. A critical comparison of the algorithm performance was carried out using the Mean Absolute Error (MAE), the Mean Squared Error (MSE), the Root Mean Squared Error (RMSE) and the Mean Absolute Scaled Error (MASE). The second experiment focused on evaluating the stability and robustness of the optimal models identified in the first experiment. The key dataset characteristics identified; were the dataset size, stationarity, trend and seasonality. It was found that the LSTM performed the best for majority of the datasets, due to the algorithm's ability to deal with sequential dependency. The performance of the ANN and SVR were similar for datasets with trend and seasonality, while the LSTM overall proved superior to the aforementioned algorithms. The LSTM outperformed the ANN and SVR due to its ability to handle temporal dependency. However, due to its stochastic nature, the LSTM and ANN algorithms can have poor stability and robustness. In this regard, the LSTM was found to be a more robust algorithm than the ANN and SVR. DA - 2021_ DB - OpenUCT DP - University of Cape Town KW - Time Series KW - Artificial Neural Network KW - Support Vector Machine KW - Long Short-Term Memory LK - https://open.uct.ac.za PY - 2021 T1 - Analysis of Machine Learning Algorithms for Time Series Prediction TI - Analysis of Machine Learning Algorithms for Time Series Prediction UR - http://hdl.handle.net/11427/36024 ER - | en_ZA |
| dc.identifier.uri | http://hdl.handle.net/11427/36024 | |
| dc.identifier.vancouvercitation | Naidoo K. Analysis of Machine Learning Algorithms for Time Series Prediction. []. ,Faculty of Science ,Department of Computer Science, 2021 [cited yyyy month dd]. Available from: http://hdl.handle.net/11427/36024 | en_ZA |
| dc.language.rfc3066 | eng | |
| dc.publisher.department | Department of Computer Science | |
| dc.publisher.faculty | Faculty of Science | |
| dc.subject | Time Series | |
| dc.subject | Artificial Neural Network | |
| dc.subject | Support Vector Machine | |
| dc.subject | Long Short-Term Memory | |
| dc.title | Analysis of Machine Learning Algorithms for Time Series Prediction | |
| dc.type | Master Thesis | |
| dc.type.qualificationlevel | Masters | |
| dc.type.qualificationlevel | MSc |