StreamK3s: A K3s-Based Data Stream Processing Platform for Simplifying Pipeline Creation, Deployment, and Scaling

Abstract

In today’s technology-driven era, applications focused on data stream processing are increasingly in need of user-friendly platforms, especially with the growing popularity of serverless computing solutions. Developers seek features such as straightforward pipeline definition, component reusability, throughput-based automatic scaling, and efficient resource utilization, highlighting the demand for such capabilities. This paper introduces a platform that addresses these requirements, leveraging technologies like K3s, RabbitMQ, and KEDA. In contrast to conventional platforms, the presented solution excels through its seamless integration of adaptability and user-friendliness, surpassing fundamental capabilities. The platform’s simple self-configuration streamlines the deployment of developer-created functions, improving efficiency and guaranteeing a seamless experience. This allows developers to focus on creating functions without the burden of managing complex configurations.

Keywords

• Cloud
• Edge
• FaaS platform
• K3s cluster