Hybrid Machine Learning Ensemble Techniques for Modeling Dissolved Oxygen Concentration

Abstract

The reliable prediction of dissolved oxygen concentration (DO) is significantly crucial for protecting the health of the aquatic ecosystem. The current research employed four different single AI-based models, namely long short-term memory neural network (LSTM), extreme learning machine (ELM), Hammerstein-Weiner (HW) and general regression neural network (GRNN) for modeling the DO concentration of Kinta River, Malaysia using available water quality (WQ) parameters. Afterwards, the first scenario used four different ensemble techniques (ET). Two linear, i.e. simple averaging ensemble (SAE) and weighted averaging ensemble (WAE) and two nonlinear namely; backpropagation neural network ensemble (BPNN-E) and HW ensemble (HW-E). The second scenario employed a hybrid random forest (RF) ensemble in order to enhance the prediction accuracy of the single models. The WQ parameters were subjected to a different pre-analysis test to ascertain their stability. The four-model combinations are generated using the nonlinear sensitivity input selection approach. The modeling performance was assessed using the statistical measures of Nash-Sutcliffe coefficient efficiency (NSE), Willmott's index of agreement (WI), root mean square error (RMSE), mean absolute error (MAE) and mean square error (MSE) and correlation coefficient (CC). The results of the single AI-based models demonstrated that HW (M3) served as the best model for predicting DO concentration. For ensemble results, BPNN-E (WI = 0.9764) was superior to the other three ET with average decreased of more than 2% with regards to MAE. Investigation on the hybrid RF ensemble demonstrated the reliable accuracy for all the hybrid models with better predictive skill shown by the HW-RF (CC = 0.981) ensemble. The overall results verified the promising impact of HW-M3, ET and hybrid RF ensemble for the prediction of the DO concentration in the Kinta River, Malaysia.

Keywords

• Dissolved oxygen
• artificial intelligence
• ensemble techniques
• hybrid random forest ensemble
• Kinta River