All issues

A cluster method of mathematical modeling of interval-stochastic thermal processes in complex electronic systems (ES), is developed. In the cluster method, the construction of a complex ES is represented in the form of a thermal model, which is a system of clusters, each of which contains a core that combines the heat-generating elements falling into a given cluster, the cluster shell and a medium flow through the cluster. The state of the thermal process in each cluster and every moment of time is characterized by three interval-stochastic state variables, namely, the temperatures of the core, shell, and medium flow. The elements of each cluster, namely, the core, shell, and medium flow, are in thermal interaction between themselves and elements of neighboring clusters. In contrast to existing methods, the cluster method allows you to simulate thermal processes in complex ESs, taking into account the uneven distribution of temperature in the medium flow pumped into the ES, the conjugate nature of heat exchange between the medium flow in the ES, core and shells of clusters, and the intervalstochastic nature of thermal processes in the ES, caused by statistical technological variation in the manufacture and installation of electronic elements in ES and random fluctuations in the thermal parameters of the environment. The mathematical model describing the state of thermal processes in a cluster thermal model is a system of interval-stochastic matrix-block equations with matrix and vector blocks corresponding to the clusters of the thermal model. The solution to the interval-stochastic equations are statistical measures of the state variables of thermal processes in clusters - mathematical expectations, covariances between state variables and variance. The methodology for applying the cluster method is shown on the example of a real ES.

The article deals with the problem of a distributed system operation reliability. The system core is an open integration platform that provides interaction of varied software for modeling gas transportation. Some of them provide an access through thin clients on the cloud technology “software as a service”. Mathematical models of operation, transmission and computing are to ensure the operation of an automated dispatching system for oil and gas transportation. The paper presents a system solution based on the theory of Markov random processes and considers the stable operation stage. The stationary operation mode of the Markov chain with continuous time and discrete states is described by a system of Chapman–Kolmogorov equations with respect to the average numbers (mathematical expectations) of the objects in certain states. The objects of research are both system elements that are present in a large number – thin clients and computing modules, and individual ones – a server, a network manager (message broker). Together, they are interacting Markov random processes. The interaction is determined by the fact that the transition probabilities in one group of elements depend on the average numbers of other elements groups.

The authors propose a multi-criteria dispersion model of risk assessment for such systems (both in the broad and narrow sense, in accordance with the IEC standard). The risk is the standard deviation of estimated object parameter from its average value. The dispersion risk model makes possible to define optimality criteria and whole system functioning risks. In particular, for a thin client, the following is calculated: the loss profit risk, the total risk of losses due to non-productive element states, and the total risk of all system states losses.

Finally the paper proposes compromise schemes for solving the multi-criteria problem of choosing the optimal operation strategy based on the selected set of compromise criteria.

In this work, we develop a model of the immune response to respiratory viral infections taking into account some particular properties of the SARS-CoV-2 infection. The model represents a system of ordinary differential equations for the concentrations of epithelial cells, immune cells, virus and inflammatory cytokines. Conventional analysis of the existence and stability of stationary points is completed by numerical simulations in order to study dynamics of solutions. Behavior of solutions is characterized by large peaks of virus concentration specific for acute respiratory viral infections.

At the first stage, we study the innate immune response based on the protective properties of interferon secreted by virus-infected cells. On the other hand, viral infection down-regulates interferon production. Their competition can lead to the bistability of the system with different regimes of infection progression with high or low intensity. In the case of infection outbreak, the incubation period and the maximal viral load depend on the initial viral load and the parameters of the immune response. In particular, increase of the initial viral load leads to shorter incubation period and higher maximal viral load.

In order to study the emergence and dynamics of cytokine storm, we consider proinflammatory cytokines produced by cells of the innate immune response. Depending on parameters of the model, the system can remain in the normal inflammatory state specific for viral infections or, due to positive feedback between inflammation and immune cells, pass to cytokine storm characterized by excessive production of proinflammatory cytokines. Furthermore, inflammatory cell death can stimulate transition to cytokine storm. However, it cannot sustain it by itself without the innate immune response. Assumptions of the model and obtained results are in qualitative agreement with the experimental and clinical data.

This article reviews both historical achievements and modern results in the field of Markov Decision Process (MDP) and convex optimization. This review is the first attempt to cover the field of reinforcement learning in Russian in the context of convex optimization. The fundamental Bellman equation and the criteria of optimality of policy — strategies based on it, which make decisions based on the known state of the environment at the moment, are considered. The main iterative algorithms of policy optimization based on the solution of the Bellman equations are also considered. An important section of this article was the consideration of an alternative to the $Q$-learning approach — the method of direct maximization of the agent’s average reward for the chosen strategy from interaction with the environment. Thus, the solution of this convex optimization problem can be represented as a linear programming problem. The paper demonstrates how the convex optimization apparatus is used to solve the problem of Reinforcement Learning (RL). In particular, it is shown how the concept of strong duality allows us to naturally modify the formulation of the RL problem, showing the equivalence between maximizing the agent’s reward and finding his optimal strategy. The paper also discusses the complexity of MDP optimization with respect to the number of state–action–reward triples obtained as a result of interaction with the environment. The optimal limits of the MDP solution complexity are presented in the case of an ergodic process with an infinite horizon, as well as in the case of a non-stationary process with a finite horizon, which can be restarted several times in a row or immediately run in parallel in several threads. The review also reviews the latest results on reducing the gap between the lower and upper estimates of the complexity of MDP optimization with average remuneration (Averaged MDP, AMDP). In conclusion, the real-valued parametrization of agent policy and a class of gradient optimization methods through maximizing the $Q$-function of value are considered. In particular, a special class of MDPs with restrictions on the value of policy (Constrained Markov Decision Process, CMDP) is presented, for which a general direct-dual approach to optimization with strong duality is proposed.

An approximate mathematical model of blood flow in an axisymmetric blood vessel is studied. Such a vessel is understood as an infinitely long circular cylinder, the walls of which consist of elastic rings. Blood is considered as an incompressible fluid flowing in this cylinder. Increased pressure causes radially symmetrical stretching of the elastic rings. Following J. Lamb, the rings are located close to each other so that liquid does not flow between them. To mentally realize this, it is enough to assume that the rings are covered with an impenetrable film that does not have elastic properties. Only rings have elasticity. The considered model of blood flow in a blood vessel consists of three equations: the continuity equation, the law of conservation of momentum and the equation of state. An approximate procedure for reducing the equations under consideration to the Korteweg – de Vries (KdV) equation is considered, which was not fully considered by J. Lamb, only to establish the dependence of the coefficients of the KdV equation on the physical parameters of the considered model of incompressible fluid flow in an axisymmetric vessel. From the KdV equation, by a standard transition to traveling waves, ODEs of the third, second and first orders are obtained, respectively. Depending on the different cases of arrangement of the three stationary solutions of the first-order ODE, a cnoidal wave and a soliton are standardly obtained. The main attention is paid to an unbounded periodic solution, which we call a degenerate cnoidal wave. Mathematically, cnoidal waves are described by elliptic integrals with parameters defining amplitudes and periods. Soliton and degenerate cnoidal wave are described by elementary functions. The hemodynamic meaning of these types of decisions is indicated. Due to the fact that the sets of solutions to first-, second- and third-order ODEs do not coincide, it has been established that the Cauchy problem for second- and third-order ODEs can be specified at all points, and for first-order ODEs only at points of growth or decrease. The Cauchy problem for a first-order ODE cannot be specified at extremum points due to the violation of the Lipschitz condition. The degeneration of the cnoidal wave into a degenerate cnoidal wave, which can lead to rupture of the vessel walls, is numerically illustrated. The table below describes two modes of approach of a cnoidal wave to a degenerate cnoidal wave.

The biological structure is considered as an open nonequilibrium system which properties can be described on the basis of kinetic equations. New problems with nonequilibrium boundary conditions are introduced. The nonequilibrium distribution tends gradually to an equilibrium state. The region of spatial inhomogeneity has a scale depending on the rate of mass transfer in the open system and the characteristic time of metabolism. In the proposed approximation, the internal energy of the motion of molecules is much less than the energy of translational motion. Or in other terms we can state that the kinetic energy of the average blood velocity is substantially higher than the energy of chaotic motion of the same particles. We state that the relaxation problem models a living system. The flow of entropy to the system decreases in downstream, this corresponds to Shrödinger’s general ideas that the living system “feeds on” negentropy. We introduce a quantity that determines the complexity of the biosystem, more precisely, this is the difference between the nonequilibrium kinetic entropy and the equilibrium entropy at each spatial point integrated over the entire spatial region. Solutions to the problems of spatial relaxation allow us to estimate the size of biosystems as regions of nonequilibrium. The results are compared with empirical data, in particular, for mammals we conclude that the larger the size of animals, the smaller the specific energy of metabolism. This feature is reproduced in our model since the span of the nonequilibrium region is larger in the system where the reaction rate is shorter, or in terms of the kinetic approach, the longer the relaxation time of the interaction between the molecules. The approach is also used for estimation of a part of a living system, namely a green leaf. The problems of aging as degradation of an open nonequilibrium system are considered. The analogy is related to the structure, namely, for a closed system, the equilibrium of the structure is attained for the same molecules while in the open system, a transition occurs to the equilibrium of different particles, which change due to metabolism. Two essentially different time scales are distinguished, the ratio of which is approximately constant for various animal species. Under the assumption of the existence of these two time scales the kinetic equation splits in two equations, describing the metabolic (stationary) and “degradative” (nonstationary) parts of the process.

In this work, we consider a special approximation of the general perturbation formula for the electromagnetic field by a set of electrically small inhomogeneities located in the domain of interest. The problem considered in this paper arises in many applications of technical electrodynamics, radar technologies and subsurface remote sensing. In the general case, it is formulated as follows: at some point in the perturbed domain, it is necessary to determine the amplitude of the electromagnetic field. The perturbation of electromagnetic waves is caused by a set of electrically small scatterers distributed in space. The source of electromagnetic waves is also located in perturbed domain. The problem is solved by introducing the far field approximation and through the formulation for the scatterer radar cross section value. This, in turn, allows one to significantly speed up the calculation process of the perturbed electromagnetic field by a set of a spherical inhomogeneities identical to each other with arbitrary electrophysical parameters. In this paper, we consider only the direct scattering problem; therefore, all parameters of the scatterers are known. In this context, it may be argued that the formulation corresponds to the well-posed problem and does not imply the solution of the integral equation in the generalized formula. One of the features of the proposed algorithm is the allocation of a characteristic plane at the domain boundary. All points of observation of the state of the system belong to this plane. Set of the scatterers is located inside the observation region, which is formed by this surface. The approximation is tested by comparing the results obtained with the solution of the general formula method for the perturbation of the electromagnetic field. This approach, among other things, allows one to remove a number of restrictions on the general perturbation formula for E-filed analysis.

There are conditions of uneven combustion for tubular powder elements of large elongation used in artillery propelling charges. Here it is necessary to consider in parallel the processes of combustion and movement of powder gases inside and outside the channels of the powder tubes. Without this, it is impossible to adequately formulate and solve the problems of ignition, erosive combustion and stress-strain state of tubular powder elements in the shot process. The paper presents a physical and mathematical formulation of the main problem of the internal ballistics of an artillery shot for a charge consisting of a set of powder tubes. Combustion and movement of a bundle of powder tubes along the barrel channel is modeled by an equivalent tubular charge of all-round combustion. The end and cross-sectional areas of the channel of such a charge (equivalent tube) are equal to the sum of the areas of the ends and cross-sections of the channels of the powder tubes, respectively. The combustion surface of the channel is equal to the sum of the inner surfaces of the tubes in the bundle. The outer combustion surface of the equivalent tube is equal to the sum of the outer surfaces of the tubes in the bundle. It is assumed that the equivalent tube moves along the axis of the bore. The speed of motion of an equivalent tubular charge and its current position are determined from Newton’s second law. To calculate the flow parameters, we used two-dimensional axisymmetric equations of gas dynamics, for the solution of which an axisymmetric orthogonalized difference mesh is constructed, which adapts to the flow conditions. When the tube moves and burns, the difference grid is rearranged taking into account the changing regions of integration. The control volume method is used for the numerical solution of the system of gas-dynamic equations. The gas parameters at the boundaries of the control volumes are determined using a self-similar solution to the Godunov problem of decay for an arbitrary discontinuity. The developed technique was used to calculate the internal ballistics parameters of an artillery shot. This approach is considered for the first time and allows a new approach to the design of tubular artillery charges, since it allows obtaining the necessary information in the form of fields of velocity and pressure of powder gases for calculating the process of gradual ignition, unsteady erosive combustion, stress-strain state and strength of powder elements during the shot. The time dependences of the parameters of the internal ballistics process and the distribution of the main parameters of the flow of combustion products at different times are presented.

The problem has been considered, to what extent the kinetic models of cellular metabolism fit the matter which they describe. Foundations of stoichiometry of the whole metabolism and its large regions have been stated. A bioenergetic representation of stoichiometry based on a universal unit of chemical compound reductivity, viz., redoxon, has been described. Equations of mass-energy balance (bioenergetic variant of stoichiometry) have been derived for metabolic flows including those of protons possessing high electrochemical potential μ_H⁺, and high-energy compounds. Interrelations have been obtained which determine the biomass yield, rate of uptake of energy source for cell growth and other important physiological quantities as functions of biochemical characteristics of cellular energetics. The maximum biomass energy yield values have been calculated for different energy sources utilized by cells. These values coincide with those measured experimentally.

Theoretical and experimental investigations of water vapor interaction with porous materials are carried out both at the macro level and at the micro level. At the macro level, the influence of the arrangement structure of individual pores on the processes of water vapor interaction with porous material as a continuous medium is studied. At the micro level, it is very interesting to investigate the dependence of the characteristics of the water vapor interaction with porous media on the geometry and dimensions of the individual pore.

In this paper, a study was carried out by means of mathematical modelling of the processes of water vapor interaction with suffering pore of the cylindrical type. The calculations were performed using a model of a hybrid type combining a molecular-dynamic and a macro-diffusion approach for describing water vapor interaction with an individual pore. The processes of evolution to the state of thermodynamic equilibrium of macroscopic characteristics of the system such as temperature, density, and pressure, depending on external conditions with respect to pore, were explored. The dependence of the evolution parameters on the distribution of the diffusion coefficient in the pore, obtained as a result of molecular dynamics modelling, is examined. The relevance of these studies is due to the fact that all methods and programs used for the modelling of the moisture and heat conductivity are based on the use of transport equations in a porous material as a continuous medium with known values of the transport coefficients, which are usually obtained experimentally.