All issues
- 2024 Vol. 16
- 2023 Vol. 15
- 2022 Vol. 14
- 2021 Vol. 13
- 2020 Vol. 12
- 2019 Vol. 11
- 2018 Vol. 10
- 2017 Vol. 9
- 2016 Vol. 8
- 2015 Vol. 7
- 2014 Vol. 6
- 2013 Vol. 5
- 2012 Vol. 4
- 2011 Vol. 3
- 2010 Vol. 2
- 2009 Vol. 1
-
Ellipsoid method for convex stochastic optimization in small dimension
Computer Research and Modeling, 2021, v. 13, no. 6, pp. 1137-1147The article considers minimization of the expectation of convex function. Problems of this type often arise in machine learning and a variety of other applications. In practice, stochastic gradient descent (SGD) and similar procedures are usually used to solve such problems. We propose to use the ellipsoid method with mini-batching, which converges linearly and can be more efficient than SGD for a class of problems. This is verified by our experiments, which are publicly available. The algorithm does not require neither smoothness nor strong convexity of the objective to achieve linear convergence. Thus, its complexity does not depend on the conditional number of the problem. We prove that the method arrives at an approximate solution with given probability when using mini-batches of size proportional to the desired accuracy to the power −2. This enables efficient parallel execution of the algorithm, whereas possibilities for batch parallelization of SGD are rather limited. Despite fast convergence, ellipsoid method can result in a greater total number of calls to oracle than SGD, which works decently with small batches. Complexity is quadratic in dimension of the problem, hence the method is suitable for relatively small dimensionalities.
-
Influence of the mantissa finiteness on the accuracy of gradient-free optimization methods
Computer Research and Modeling, 2023, v. 15, no. 2, pp. 259-280Gradient-free optimization methods or zeroth-order methods are widely used in training neural networks, reinforcement learning, as well as in industrial tasks where only the values of a function at a point are available (working with non-analytical functions). In particular, the method of error back propagation in PyTorch works exactly on this principle. There is a well-known fact that computer calculations use heuristics of floating-point numbers, and because of this, the problem of finiteness of the mantissa arises.
In this paper, firstly, we reviewed the most popular methods of gradient approximation: Finite forward/central difference (FFD/FCD), Forward/Central wise component (FWC/CWC), Forward/Central randomization on $l_2$ sphere (FSSG2/CFFG2); secondly, we described current theoretical representations of the noise introduced by the inaccuracy of calculating the function at a point: adversarial noise, random noise; thirdly, we conducted a series of experiments on frequently encountered classes of problems, such as quadratic problem, logistic regression, SVM, to try to determine whether the real nature of machine noise corresponds to the existing theory. It turned out that in reality (at least for those classes of problems that were considered in this paper), machine noise turned out to be something between adversarial noise and random, and therefore the current theory about the influence of the mantissa limb on the search for the optimum in gradient-free optimization problems requires some adjustment.
-
Solution to a two-dimensional nonlinear heat equation using null field method
Computer Research and Modeling, 2023, v. 15, no. 6, pp. 1449-1467The paper deals with a heat wave motion problem for a degenerate second-order nonlinear parabolic equation with power nonlinearity. The considered boundary condition specifies in a plane the motion equation of the circular zero front of the heat wave. A new numerical-analytical algorithm for solving the problem is proposed. A solution is constructed stepby- step in time using difference time discretization. At each time step, a boundary value problem for the Poisson equation corresponding to the original equation at a fixed time is considered. This problem is, in fact, an inverse Cauchy problem in the domain whose initial boundary is free of boundary conditions and two boundary conditions (Neumann and Dirichlet) are specified on a current boundary (heat wave). A solution of this problem is constructed as the sum of a particular solution to the nonhomogeneous Poisson equation and a solution to the corresponding Laplace equation satisfying the boundary conditions. Since the inhomogeneity depends on the desired function and its derivatives, an iterative solution procedure is used. The particular solution is sought by the collocation method using inhomogeneity expansion in radial basis functions. The inverse Cauchy problem for the Laplace equation is solved by the null field method as applied to a circular domain with a circular hole. This method is used for the first time to solve such problem. The calculation algorithm is optimized by parallelizing the computations. The parallelization of the computations allows us to realize effectively the algorithm on high performance computing servers. The algorithm is implemented as a program, which is parallelized by using the OpenMP standard for the C++ language, suitable for calculations with parallel cycles. The effectiveness of the algorithm and the robustness of the program are tested by the comparison of the calculation results with the known exact solution as well as with the numerical solution obtained earlier by the authors with the use of the boundary element method. The implemented computational experiment shows good convergence of the iteration processes and higher calculation accuracy of the proposed new algorithm than of the previously developed one. The solution analysis allows us to select the radial basis functions which are most suitable for the proposed algorithm.
-
Detecting Braess paradox in the stable dynamic model
Computer Research and Modeling, 2024, v. 16, no. 1, pp. 35-51The work investigates the search for inefficient edges in the model of stable dynamics by Nestrov – de Palma (2003). For this purpose, we prove several general theorems about equilibrium properties, including the condition of equal costs for all used routes that can be extended to all paths involving edges from equilibrium routes. The study demonstrates that the standard problem formulation of finding edges whose removal reduces the cost of travel for all participants has no practical significance because the same edge can be both efficient and inefficient depending on the network’s load. In the work, we introduce the concept of an inefficient edge based on the sensitivity of total driver costs to the costs on the edge. The paper provides an algorithm for finding inefficient edges and presents the results of numerical experiments for the transportation network of the city of Anaheim.
Keywords: transportation modeling, Braess paradox. -
Localized nonlinear waves of the sine-Gordon equation in a model with three extended impurities
Computer Research and Modeling, 2024, v. 16, no. 4, pp. 855-868In this work, we use analytical and numerical methods to consider the problem of the structure and dynamics of coupled localized nonlinear waves in the sine-Gordon model with three identical attractive extended “impurities”, which are modeled by spatial inhomogeneity of the periodic potential. Two possible types of coupled nonlinear localized waves are found: breather and soliton. The influence of system parameters and initial conditions on the structure, amplitude, and frequency of localized waves was analyzed. Associated oscillations of localized waves of the breather type as in the case of point impurities, are the sum of three harmonic oscillations: in-phase, in-phase-antiphase and antiphase type. Frequency analysis of impurity-localized waves that were obtained during a numerical experiment was performed using discrete Fourier transform. To analyze localized breather-type waves, the numerical finite difference method was used. To carry out a qualitative analysis of the obtained numerical results, the problem was solved analytically for the case of small amplitudes of oscillations localized on impurities. It is shown that, for certain impurity parameters (depth and width), it is possible to obtain localized solitontype waves. The ranges of values of the system parameters in which localized waves of a certain type exist, as well as the region of transition from breather to soliton types of oscillations, have been found. The values of the depth and width of the impurity at which a transition from the breather to the soliton type of localized oscillations is observed were determined. Various scenarios of soliton-type oscillations with negative and positive amplitude values for all three impurities, as well as mixed cases, were obtained and considered. It is shown that in the case when the distance between impurities much less than one, there is no transition region where which the nascent breather, after losing energy through radiation, transforms into a soliton. It is shown that the considered model can be used, for example, to describe the dynamics of magnetization waves in multilayer magnets.
-
On an analytic-numerical method to simulate heat transfer process on $p$-dimensional complex geometry domains
Computer Research and Modeling, 2015, v. 7, no. 4, pp. 865-873Views (last year): 1.The article presents an analytical-numerical method to simulate $p$-dimentional heat transfer processes on complex geometry domains when conventional methods are not applicable. The model is converted by the proposed method so that conventional numerical analysis methods is applied to the numerical research. The results of numerical experiments are given to demonstrate the effectiveness of the proposed method. The obtained results, other authors’ numerical results and exact analytical solutions, known for a class of problems, is compared.
-
Development, calibration and verification of mathematical model for multilane urban road traffic flow. Part II
Computer Research and Modeling, 2015, v. 7, no. 6, pp. 1205-1219Views (last year): 3.The goal of this work is to generalize second order mathematical models for automotive flow using algorithm for building state equation — the dependency of pressure on traffic density — which is adequate with regard to real world data. The form of state equation, which closes the system of model equations, is obtained from experimental form of fundamental diagram — the dependency of traffic flow intensity on its density, and completely defines all properties of any phenomenological model. The proposed approach was verified using numerical experiments on typical traffic data, obtained from PeMS system (http://pems.dot.ca.gov/), using segment of I-507 highway in California, USA as model system.
-
Analysis of the possibility of investigation of hydrodynamic responses and landing dynamics of space module impacting water with FlowVision CFD software
Computer Research and Modeling, 2017, v. 9, no. 1, pp. 47-55Views (last year): 10.The results of verification carried out for investigations of hydrodynamic effect on reentry conicalsegmental space vehicle are presented in the paper. The program complex Flow Vision is used for this analysis. The purpose of the study is verification of using Flow Vision program complex for problem solving mentioned above on the base of comparison between calculated and experimental data, obtained on the Apollo landing models and new development reentry spacecraft of manned transporting spaceship designed by RSC Energia. The comparison was carried out through the data of pressure values on spacecraft model surfaces during its water landing and inertia center motion parameters.
The results of study show good agreement between experimental and calculated data of force effects on vehicle construction during water landing and its motion parameters in the water medium. Computer simulation sufficiently well reproduces influence of initial velocities & water entry angles variations on water landing process.
Using of computer simulation provides simultaneous acquisition of all data information needed for investigation of water landing peculiarities during construction design, notably, hydrodynamic effects for structural strength calculations, parameters and dynamics of center mass motion and vehicle revolution around center mass for estimation water landing conditions, as well as vehicle stability after landing.
Obtained results confirm suitability of using Flow Vision program complex for water landing vehicle investigations and investigations of influence of different landing regimes through wide initial condition change range, that permits considerably decrease extent of expensive experimental tests and realize landing conditions which are sufficiently complicated for realizing in model physical experiments.
-
Numerical investigation of the gas-condensate mixture flow in a porous medium
Computer Research and Modeling, 2018, v. 10, no. 2, pp. 209-219Views (last year): 18. Citations: 2 (RSCI).In the last decades, the development of methods for increasing the efficiency of hydrocarbon extraction in fields with unconventional reserves containing large amounts of gas condensate is of great importance. This makes important the development of methods of mathematical modeling that realistically describe physical processes in a gas-condensate mixture in a porous medium.
In the paper, a mathematical model which describes the dynamics of the pressure, velocity and concentration of the components of a two-component two-phase mixture entering a laboratory model of plast filled with a porous substance with known physicochemical properties is considered. The mathematical model is based on a system of nonlinear spatially one-dimensional partial differential equations with the corresponding initial and boundary conditions. Laboratory experiments show that during a finite time the system stabilizes, what gives a basis to proceed to the stationary formulation of the problem.
The numerical solution of the formulated system of ordinary differential equations is realized in the Maple environment on the basis of the Runge–Kutta procedure. It is shown that the physical parameters of the gascondensate mixture, which characterize the modeled system in the stabilization regime, obtained on this basis, are in good agreement with the available experimental data. This confirms the correctness of the chosen approach and the validity of its further application and development for computer modeling of physical processes in gas-condensate mixtures in a porous medium. The paper presents a mathematical formulation of the system of partial differential equations and of respective system stationary equations, describes the numerical approach, and discusses the numerical results obtained in comparison with experimental data.
-
Import model of flexible woven composites in ANSYS Mechanical APDL
Computer Research and Modeling, 2018, v. 10, no. 6, pp. 789-799Views (last year): 34.A variant of import into ANSYS Mechanical APDL system of the model of behavior of flexible woven composite materials with reinforcing weaving cloth of linen at static stretching along the reinforcement yarns is offered. The import was carried out using an integration module based on the use of an analytical model of deformation of the material under study. The model is presented in the articles published earlier and takes into account the changes in the geometric structure occurring in the reinforcing layer of the material during the deformation process, the formation of irreversible deformations and the interaction of cross-lying reinforcing fabric threads. In the introduction input characteristics of the plain weave of the reinforcing fabric and the analytical model imported into ANSYS are briefly described. The input parameters of the module are the mechanical characteristics of the materials that make up the composite (binder and material of reinforcement yarns), the geometric characteristics of the interlacing of the reinforcing fabric. The algorithm for importing the model is based on the calculation and transfer in ANSYS of the calculated points of the material stress-strain diagram for uniaxial stretching along the reinforcement direction and using the Multilinear Kinematich Hardening model material embedded in the ANSYS. The analytical model imported with the help of the presented module allows to model a composite material with reinforcing fabric without a detailed description of the geometry of the interlacing of threads during modeling of the material as a whole. The imported model was verified. For verification full-scale experimental studies and numerical simulation of the stretching of samples from flexible woven composites were carried out. The analysis of the obtained results showed good qualitative and quantitative agreement of calculations.
Indexed in Scopus
Full-text version of the journal is also available on the web site of the scientific electronic library eLIBRARY.RU
The journal is included in the Russian Science Citation Index
The journal is included in the RSCI
International Interdisciplinary Conference "Mathematics. Computing. Education"