All issues

Gradient-free optimization methods or zeroth-order methods are widely used in training neural networks, reinforcement learning, as well as in industrial tasks where only the values of a function at a point are available (working with non-analytical functions). In particular, the method of error back propagation in PyTorch works exactly on this principle. There is a well-known fact that computer calculations use heuristics of floating-point numbers, and because of this, the problem of finiteness of the mantissa arises.

In this paper, firstly, we reviewed the most popular methods of gradient approximation: Finite forward/central difference (FFD/FCD), Forward/Central wise component (FWC/CWC), Forward/Central randomization on $l_2$ sphere (FSSG2/CFFG2); secondly, we described current theoretical representations of the noise introduced by the inaccuracy of calculating the function at a point: adversarial noise, random noise; thirdly, we conducted a series of experiments on frequently encountered classes of problems, such as quadratic problem, logistic regression, SVM, to try to determine whether the real nature of machine noise corresponds to the existing theory. It turned out that in reality (at least for those classes of problems that were considered in this paper), machine noise turned out to be something between adversarial noise and random, and therefore the current theory about the influence of the mantissa limb on the search for the optimum in gradient-free optimization problems requires some adjustment.

A nonlinear oscillatory system described by ordinary differential equations with variable coefficients is considered, in which terms that are linearly dependent on coordinates, velocities and accelerations are explicitly distinguished; nonlinear terms are written as implicit functions of these variables. For the numerical solution of the initial problem described by such a system of differential equations, the one-step Galerkin method is used. At the integration step, unknown functions are represented as a sum of linear functions satisfying the initial conditions and several given correction functions in the form of polynomials of the second and higher degrees with unknown coefficients. The differential equations at the step are satisfied approximately by the Galerkin method on a system of corrective functions. Algebraic equations with nonlinear terms are obtained, which are solved by iteration at each step. From the solution at the end of each step, the initial conditions for the next step are determined.

The corrective functions are taken the same for all steps. In general, 4 or 5 correction functions are used for calculations over long time intervals: in the first set — basic power functions from the 2nd to the 4th or 5th degrees; in the second set — orthogonal power polynomials formed from basic functions; in the third set — special linear-independent polynomials with finite conditions that simplify the “docking” of solutions in the following steps.

Using two examples of calculating nonlinear oscillations of systems with one and two degrees of freedom, numerical studies of the accuracy of the numerical solution of initial problems at various time intervals using the Galerkin method using the specified sets of power-law correction functions are performed. The results obtained by the Galerkin method and the Adams and Runge –Kutta methods of the fourth order are compared. It is shown that the Galerkin method can obtain reliable results at significantly longer time intervals than the Adams and Runge – Kutta methods.

A numerical method is proposed that approximates the equations of the dynamics of a weakly compressible viscous flow in the presence of a polymer component of the flow. The behavior of the flow under the influence of a static external periodic force in a periodic square cell is investigated. The methodology is based on a hybrid approach. The hydrodynamics of the flow is described by a system of Navier – Stokes equations and is numerically approximated by the linearized Godunov method. The polymer field is described by a system of equations for the vector of stretching of polymer molecules $\bf R$, which is numerically approximated by the Kurganov – Tedmor method. The choice of model relationships in the development of a numerical methodology and the selection of modeling parameters made it possible to qualitatively model and study the regime of elastic turbulence at low Reynolds $Re \sim 10^{-1}$. The polymer solution flow dynamics equations differ from the Newtonian fluid dynamics equations by the presence on the right side of the terms describing the forces acting on the polymer component part. The proportionality coefficient $A$ for these terms characterizes the backward influence degree of the polymers number on the flow. The article examines in detail how the flow and its characteristics change depending on the given coefficient. It is shown that with its growth, the flow becomes more chaotic. The flow energy spectra and the spectra of the polymers stretching field are constructed for different values of $A$. In the spectra, an inertial sub-range of the energy cascade is traced for the flow velocity with an indicator $k \sim −4$, for the cascade of polymer molecules stretches with an indicator $−1.6$.

The semiclassical approximation method is applied for solution construction of the Fokker–Planck equation with quadratic nonlocal nonlinearity and various coefficients in models of asset returns estimation. Analitical expressions determining nonlinear evolution operator are obtained in semiclasical approximation.

We obtain asymptotic equalities for upper bounds of the deviations of the right-angled de la Vallee Poussin sums taken over classes of periodical functions of two variables of high smoothness. These equalities guarantee the solvability of the Kolmogorov–Nikol’skii problem for the right-angled de la Vallee Poussin sums on the specified classes of functions.

This paper covers deployable systems assembled from a set of trapezium plates. The middles lines of the plates represent a plane curve in the original position of the package. It is proved that when the package of thin plates is unwrapped, a surface approximating a shell of nearly any curvature is formed. Kinematics of the continual model is analyzed by the method of Cartan moving hedron, extending the results the authors published earlier. Various applications of rotating shells are shown. Experimental models of deployable latticed systems are demonstrated.

The solution of problems of heat conductivity by means of a method of continuous asynchronous cellular automats is considered in the article. Coordination of distribution of temperature in a sample at a given time between cellular automat model and the exact analytical solution of the equation of heattransfer is shown that speaks about expedient use of this method of modelling. Dependence between time of one cellular automatic interaction and dimension of a cellular automatic field is received.

We obtain asymptotic equalities for upper bounds of the deviations of the right-angled de la Vallee Poussin sums taken over classes of periodical functions of many variables of high smoothness. These equalities guarantee the solvability of the Kolmogorov–Nikol’skii problem for the right-angled de la Vallee Poussin sums on the specified classes of functions.

Stochastically forced discrete dynamical systems are considered. Using first approximation systems, we study dynamics of deviations of stochastic solutions from deterministic equilibria. Necessary and sufficient conditions of the existence of stable stationary solutions of equations for mean-square deviations are derived. Stationary values of these mean-square deviations are used for the estimations of the dispersion of random states nearby stable equilibria and analysis of noise-induced transitions. Constructive application of the suggested technique to the analysis of various stochastic regimes in Ricker population model with Allee effect is demonstrated.

In the context of problems of hydrogen and thermonuclear power engineering intensive research of the hydrogen isotopes properties is being conducted. Mathematical models help to specify physical-chemical ideas about the interaction of hydrogen isotopes with structural materials, to discover the limiting factors. Classical diffusion models are often insufficient. The paper is devoted to the models and numerical solution of the boundary-value problems of hydrogen thermodesorption and permeability taking into account nonlinear sorption-desorption dynamics on the surface and reversible capture of hydrogen atoms in the bulk. Algorithms based on difference approximations. The results of computer simulation of the hydrogen flux from a structural material sample are presented.