A decentralised federated learning scheme for heterogeneous devices in cognitive IoT

Abstract

Cognitive Internet of Things (IoT) technologies typically rely on substantial data collected from edge devices for data analysis and decision-making. However this reliance often leads to the inadvertent exposure of private data from smart edge devices. Federated learning (FL) is a distributed machine learning framework that protects user privacy by performing collaborative training without uploading private data. Nevertheless, applying classical FL to cognitive IoT systems to preserve privacy preservation faces significant challenges, such as central server failure and communication burden. Furthermore, when edge devices with heterogeneous data and systems participate in federated training, the learning process becomes slow and the performance of edge devices is compromised. To address these challenges, we propose a decentralised FL framework for cognitive IoT, termed DFL–MKF. In DFL– MKF, the centralised server is eliminated and each edge device is dynamically connected. We initialised models for edge devices based on computational and storage capabilities to accommodate system heterogeneity. Edge devices learned from the knowledge of multiple neighbours via knowledge transfer, and knowledge fusion was employed to aggregate the knowledge of multiple neighbours, thereby improving the performance of local models, and addressing data heterogeneity. Comprehensive experiments were performed on three image classification tasks. The results of these experiments demonstrate that the proposed method achieved superior performance compared to various baselines and improved communication efficiency.

Keywords

• Cognitive IoT
• Distributed machine learning
• Federated learning
• Heterogeneous devices
• Knowledge transfer