DEVELOPMENT OF A MODEL FOR THE DYNAMICS OF PROBABILITIES OF STATES OF SEMI-MARKOV SYSTEMS

Abstract

The subject is the study of the dynamics of probability distribution of the states of the semi-Markov system during the transition process before establishing a stationary distribution. The goal is to develop a technology for finding analytical relationships that describe the dynamics of the probabilities of states of a semi-Markov system. The task is to develop a mathematical model that adequately describes the dynamics of the probabilities of the states of the system. The initial data for solving the problem is a matrix of conditional distribution laws of the random duration of the system's stay in each of its possible states before the transition to some other state. Method. The traditional method for analyzing semi-Markov systems is limited to obtaining a stationary distribution of the probabilities of its states, which does not solve the problem. A well-known approach to solving this problem is based on the formation and solution of a system of integral equations. However, in the general case, for arbitrary laws of distribution of the durations of the stay of the system in its possible states, this approach is not realizable. The desired result can only be obtained numerically, which does not satisfy the needs of practice. To obtain the required analytical relationships, the Erlang approximation of the original distribution laws is used. This technique significantly increases the adequacy of the resulting mathematical models of the functioning of the system, since it allows one to move away from overly obligatory exponential descriptions of the original distribution laws. The formal basis of the proposed method for constructing a model of the dynamics of state probabilities is the Kolmogorov system of differential equations for the desired probabilities. The solution of the system of equations is achieved using the Laplace transform, which is easily performed for Erlang distributions of arbitrary order. Results. Analytical relations are obtained that specify the desired distribution of the probabilities of the states of the system at any moment of time. The method is based on the approximation of the distribution laws for the durations of the stay of the system in each of its possible states by Erlang distributions of the proper order. A fundamental motivating factor for choosing distributions of this type for approximation is the ease of their use to obtain adequate models of the functioning of probabilistic systems. Conclusions. A solution is given to the problem of analyzing a semi-Markov system for a specific particular case, when the initial distribution laws for the duration of its sojourn in possible states are approximated by second-order Erlang distributions. Analytical relations are obtained for calculating the probability distribution at any time.

Keywords

• Semi-Markov system
• model of dynamics of probabilities of states
• approximating Erlang distributions
• analytical calculation of probabilities of states