Reinforcement learning-based DSS for coagulant and disinfectant dosage selection on drinking water treatment plants

Abstract

The treatments to be applied for water purification must be dynamically adaptable to the raw water conditions. Currently, treatments are applied based on standards that are not optimized for the circumstances of each drinking water treatment plant (DWTP), neither for critical events. This paper presents a methodology for the creation of an Artificial Intelligence (AI) decision support system (DSS), encompassing the principal steps of the drinking water treatment processes (coagulation, sedimentation, filtration and disinfection), based on reinforcement learning techniques, that provides suggestions about the most efficient treatments (coagulant and chlorine dosages) for various raw water conditions, including critical events such as heavy rain and saline intrusions. Together with the model, a retraining strategy is included so the DSS adapts itself to the specific circumstances of each different DWTP. The model has been developed and validated in a DWTP replica. Furthermore, the model has been provided to a real DWTP to obtain feedback from experienced staff. The results and evaluation of the model are promising as a first approach on a DSS for drinking water treatments suggestion, although future versions might require more water quality parameters to characterize the raw water. HIGHLIGHTS AI decision support system (DSS) for the suggestion of the most efficient dosages (coagulant and chlorine) to be used in drinking water treatment plants (DWTP).; Multi-armed bandits applied on the whole process of most common DWTPs (coagulation/filtration/disinfection).; Combination of simulated data, data from a scaled-down replica DWTP, and a real DWTP.; Auto-optimization routine.; Outcomes validated by a real DWTP.;

Keywords

• ai
• decision support
• drinking water
• reinforcement learning
• treatments
• water quality