All issues
- 2024 Vol. 16
- 2023 Vol. 15
- 2022 Vol. 14
- 2021 Vol. 13
- 2020 Vol. 12
- 2019 Vol. 11
- 2018 Vol. 10
- 2017 Vol. 9
- 2016 Vol. 8
- 2015 Vol. 7
- 2014 Vol. 6
- 2013 Vol. 5
- 2012 Vol. 4
- 2011 Vol. 3
- 2010 Vol. 2
- 2009 Vol. 1
-
Modern ways to overcome neural networks catastrophic forgetting and empirical investigations on their structural issues
Computer Research and Modeling, 2023, v. 15, no. 1, pp. 45-56This paper presents the results of experimental validation of some structural issues concerning the practical use of methods to overcome catastrophic forgetting of neural networks. A comparison of current effective methods like EWC (Elastic Weight Consolidation) and WVA (Weight Velocity Attenuation) is made and their advantages and disadvantages are considered. It is shown that EWC is better for tasks where full retention of learned skills is required on all the tasks in the training queue, while WVA is more suitable for sequential tasks with very limited computational resources, or when reuse of representations and acceleration of learning from task to task is required rather than exact retention of the skills. The attenuation of the WVA method must be applied to the optimization step, i. e. to the increments of neural network weights, rather than to the loss function gradient itself, and this is true for any gradient optimization method except the simplest stochastic gradient descent (SGD). The choice of the optimal weights attenuation function between the hyperbolic function and the exponent is considered. It is shown that hyperbolic attenuation is preferable because, despite comparable quality at optimal values of the hyperparameter of the WVA method, it is more robust to hyperparameter deviations from the optimal value (this hyperparameter in the WVA method provides a balance between preservation of old skills and learning a new skill). Empirical observations are presented that support the hypothesis that the optimal value of this hyperparameter does not depend on the number of tasks in the sequential learning queue. And, consequently, this hyperparameter can be picked up on a small number of tasks and used on longer sequences.
-
Application of discrete multicriteria optimization methods for the digital predistortion model design
Computer Research and Modeling, 2023, v. 15, no. 2, pp. 281-300In this paper, we investigate different alternative ideas for the design of digital predistortion models for radiofrequency power amplifiers. When compared to the greedy search algorithm, these algorithms allow a faster identification of the model parameters combination while still performing reasonably well. For the subsequent implementation, different metrics of model costs and score results in the process of optimization enable us to achieve sparse selections of the model, which balance the model accuracy and model resources (according to the complexity of implementation). The results achieved in the process of simulations show that combinations obtained with explored algorithms show the best performance after a lower number of simulations.
-
On the uniqueness of identification of reaction rate parameters in a combustion model
Computer Research and Modeling, 2023, v. 15, no. 6, pp. 1469-1476A model of combustion of premixed mixture of gases with one global chemical reaction is considered, the model includes equations of the second order for temperature of mixture and concentrations of fuel and oxidizer, and the right-hand sides of these equations contain the reaction rate function. This function depends on five unknown parameters of the global reaction and serves as approximation to multistep reaction mechanism. The model is reduced, after replacement of variables, to one equation of the second order for temperature of mixture that transforms to a first-order equation for temperature derivative depending on temperature that contains a parameter of flame propagation velocity. Thus, for computing the parameter of burning velocity, one has to solve Dirichlet problem for first-order equation, and after that a model dependence of burning velocity on mixture equivalence ratio at specified reaction rate parameters will be obtained. Given the experimental data of dependence of burning velocity on mixture equivalence ratio, the problem of optimal selection of reaction rate parameters is stated, based on minimization of the mean square deviation of model values of burning velocity on experimental ones. The aim of our study is analysis of uniqueness of this problem solution. To this end, we apply computational experiment during which the problem of global search of optima is solved using multistart of gradient descent. The computational experiment clarifies that the inverse problem in this statement is underdetermined, and every time, when running gradient descent from a selected starting point, it converges to a new limit point. The structure of the set of limit points in the five-dimensional space is analyzed, and it is shown that this set can be described with three linear equations. Therefore, it might be incorrect to tabulate all five parameters of reaction rate based on just one match criterion between model and experimental data of flame propagation velocity. The conclusion of our study is that in order to tabulate reaction rate parameters correctly, it is necessary to specify the values of two of them, based on additional optimality criteria.
-
Converting three-dimensional computer geometric models for optimization of simulated devices’ parameters
Computer Research and Modeling, 2015, v. 7, no. 1, pp. 81-91Views (last year): 1. Citations: 16 (RSCI).This work focuses on the application of a method of construction and conversion of three-dimensional computer models for optimization of geometric parameters of simulated devices. The method is used in design of complex technical devices for control system components of an exhaust gas recirculation vehicle – electric EGR valve with magnetic and electric motor. Three-dimensional geometric computer models were created in KOMPAS-3D environment and converted to Maxwell-2D. In Maxwell-2D environment transient electromagnetic processes for further optimization of parameters of therecirculation system devicewere calculated using a criterion of reducing power loss of the automobile engine.
-
Optimization of a hull form for decrease ship resistance to movement
Computer Research and Modeling, 2017, v. 9, no. 1, pp. 57-65Views (last year): 10. Citations: 1 (RSCI).Optimization of hull lines for the minimum resistance to movement is a problem of current interest in ship hydrodynamics. In practice, lines design is still to some extent an art. The usual approaches to decrease the ship resistance are based on the model experiment and/or CFD simulation, following the trial and error method. The paper presents a new method of in-detail hull form design based on the wave-based optimization approach. The method provides systematic variation of the hull geometrical form, which corresponds to alteration of longitudinal distribution of the hull volume, while its vertical volume distribution is fixed or highly controlled. It’s well known from the theoretical studies that the vertical distribution can't be optimized by condition of minimum wave resistance, thus it can be neglected for the optimization procedures. The method efficiency was investigated by application to the foreship of KCS, the well-known test object from the workshop Gothenburg-2000. The variations of the longitudinal distribution of the volume were set on the sectional area curve as finite volume increments and then transferred to the lines plan with the help of special frame transformation methods. The CFD towing simulations were carried out for the initial hull form and the six modified variants. According to the simulation results, examined modifications caused the resistance increments in the range 1.3–6.5 %. Optimization process was underpinned with the respective data analysis based on the new hypothesis, according to which, the resistance increments caused by separate longitudinal segments of hull form meet the principle of superposition. The achieved results, which are presented as the optimum distribution of volume present in the optimized designed hull form, which shows the interesting characteristics that its resistance has decrease by 8.9 % in respect to initial KCS hull form. Visualization of the wave patterns showed an attenuation of the transversal wave components, and the intensification of the diverging wave components.
-
Simulation of mixed convection of a variable viscosity fluid in a partially porous horizontal channel with a heat-generating source
Computer Research and Modeling, 2019, v. 11, no. 1, pp. 95-107Views (last year): 34.Numerical study of unsteady mixed convection in an open partially porous horizontal channel with a heatgenerating source was performed. The outer surfaces of horizontal walls of finite thickness were adiabatic. In the channel there was a Newtonian heat-conducting fluid with a temperature-dependent viscosity. The discrete heatconducting and heat-generating source is located inside the bottom wall. The temperature of the fluid phase was equal to the temperature of the porous medium, and calculations were performed using the local thermal equilibrium model. The porous insertion is isotropic, homogeneous and permeable to fluid. The Darcy–Brinkman model was used to simulate the transport process within the porous medium. Governing equations formulated in dimensionless variables “stream function – vorticity – temperature” using the Boussinesq approximation were solved numerically by the finite difference method. The vorticity dispersion equation and energy equation were solved using locally one-dimensional Samarskii scheme. The diffusive terms were approximated by central differences, while the convective terms were approximated using monotonic Samarskii scheme. The difference equations were solved by the Thomas algorithm. The approximated Poisson equation for the stream function was solved separately by successive over-relaxation method. Optimal value of the relaxation parameter was found on the basis of computational experiments. The developed computational code was tested using a set of uniform grids and verified by comparing the results obtained of other authors.
Numerical analysis of unsteady mixed convection of variable viscosity fluid in the horizontal channel with a heat-generating source was performed for the following parameters: $\mathrm{Pr} = 7.0$, $\varepsilon = 0.8$, $\mathrm{Gr} = 10^5$, $C = 0-1$, $10^{-5} < \mathrm{Da} < 10^{-1}$, $50 < \mathrm{Re} < 500$, $\delta = l/H = 0.6-3$. Distributions of the isolines of the stream function, temperature and the dependences of the average Nusselt number and the average temperature inside the heater were obtained in a steady-state regime, when the stationary picture of the flow and heat transfer is observed. As a result we showed that an addition of a porous insertion leads to an intensification of heat removal from the surface of the energy source. The increase in the porous insertion sizes and the use of working fluid with different thermal characteristics, lead to a decrease in temperature inside the source.
-
Investigation the material properties of a plate by laser ultrasound using the analysis of multiple waves
Computer Research and Modeling, 2019, v. 11, no. 4, pp. 653-673Views (last year): 3.Ultrasound examination of material properties is a precision method for determining their elastic and strength properties in connection with the small wavelength formed in the material after impact of a laser beam. In this paper, the wave processes arising during these measurements are considered in detail. It is shown that full-wave numerical modeling allows us to study in detail the types of waves, topological characteristics of their profile, speed of arrival of waves at various points, identification the types of waves whose measurements are most optimal for examining a sample made of a specific material of a particular shape, and to develop measurement procedures.
To carry out full-wave modeling, a grid-characteristic method on structured grids was used in this work and a hyperbolic system of equations that describes the propagation of elastic waves in the material of the thin plate under consideration on a specific example of a ratio of thickness to width of 1:10 was solved.
To simulate an elastic front that arose in the plate due to a laser beam, a model of the corresponding initial conditions was proposed. A comparison of the wave effects that arise during its use in the case of a point source and with the data of physical experiments on the propagation of laser ultrasound in metal plates was made.
A study was made on the basis of which the characteristic topological features of the wave processes under consideration were identified and revealed. The main types of elastic waves arising due to a laser beam are investigated, the possibility of their use for studying the properties of materials is analyzed. A method based on the analysis of multiple waves is proposed. The proposed method for studying the properties of a plate with the help of multiple waves on synthetic data was tested, and it showed good results.
It should be noted that most of the studies of multiple waves are aimed at developing methods for their suppression. Multiple waves are not used to process the results of ultrasound studies due to the complexity of their detection in the recorded data of a physical experiment.
Due to the use of full wave modeling and analysis of spatial dynamic wave processes, multiple waves are considered in detail in this work and it is proposed to divide materials into three classes, which allows using multiple waves to obtain information about the material of the plate.
The main results of the work are the developed problem statements for the numerical simulation of the study of plates of a finite thickness by laser ultrasound; the revealed features of the wave phenomena arising in plates of a finite thickness; the developed method for studying the properties of the plate on the basis of multiple waves; the developed classification of materials.
The results of the studies presented in this paper may be of interest not only for developments in the field of ultrasonic non-destructive testing, but also in the field of seismic exploration of the earth's interior, since the proposed approach can be extended to more complex cases of heterogeneous media and applied in geophysics.
-
On numerical solution of joint inverse geophysical problems with structural constraints
Computer Research and Modeling, 2020, v. 12, no. 2, pp. 329-343Inverse geophysical problems are difficult to solve due to their mathematically incorrect formulation and large computational complexity. Geophysical exploration in frontier areas is even more complicated due to the lack of reliable geological information. In this case, inversion methods that allow interpretation of several types of geophysical data together are recognized to be of major importance. This paper is dedicated to one of such inversion methods, which is based on minimization of the determinant of the Gram matrix for a set of model vectors. Within the framework of this approach, we minimize a nonlinear functional, which consists of squared norms of data residual of different types, the sum of stabilizing functionals and a term that measures the structural similarity between different model vectors. We apply this approach to seismic and electromagnetic synthetic data set. Specifically, we study joint inversion of acoustic pressure response together with controlled-source electrical field imposing structural constraints on resulting electrical conductivity and P-wave velocity distributions.
We start off this note with the problem formulation and present the numerical method for inverse problem. We implemented the conjugate-gradient algorithm for non-linear optimization. The efficiency of our approach is demonstrated in numerical experiments, in which the true 3D electrical conductivity model was assumed to be known, but the velocity model was constructed during inversion of seismic data. The true velocity model was based on a simplified geology structure of a marine prospect. Synthetic seismic data was used as an input for our minimization algorithm. The resulting velocity model not only fit to the data but also has structural similarity with the given conductivity model. Our tests have shown that optimally chosen weight of the Gramian term may improve resolution of the final models considerably.
-
Parallel implementation of numerical algorithm of solving coupled internal ballistics modelling problem for solid rocket motors
Computer Research and Modeling, 2021, v. 13, no. 1, pp. 47-65We present a physico-mathematical statement of coupled geometrical and gas dynamics problem of intrachamber processes simulation and calculation of main internal ballistics characteristics of solid rocket motors in axisymmetric approximation. Method and numerical algorithm of solving the problem are described in this paper. We track the propellant burning surface using the level set method. This method allows us to implicitly represent the surface on a fixed Cartesian grid as zero-level of some function. Two-dimensional gas-dynamics equations describe a flow of combustion products in a solid rocket motor. Due to inconsistency of domain boundaries and nodes of computational grid, presence of ghost points lying outside the computational domain is taken into account. For setting the values of flow parameters in ghost points, we use the inverse Lax – Wendroff procedure. We discretize spatial derivatives of level set and gas-dynamics equations with standard WENO schemes of fifth and third-order respectively and time derivatives using total variation diminishing Runge –Kutta methods. We parallelize the presented numerical algorithm using CUDA technology and further optimize it with regard to peculiarities of graphics processors architecture.
Created software package is used for calculating internal ballistics characteristics of nozzleless solid rocket motor during main firing phase. On the base of obtained numerical results, we discuss efficiency of parallelization using CUDA technology and applying considered optimizations. It has been shown that implemented parallelization technique leads to a significant acceleration in comparison with central processes. Distributions of key parameters of combustion products flow in different periods of time have been presented in this paper. We make a comparison of obtained results between quasione-dimensional approach and developed numerical technique.
-
Finding equilibrium in two-stage traffic assignment model
Computer Research and Modeling, 2021, v. 13, no. 2, pp. 365-379Authors describe a two-stage traffic assignment model. It contains of two blocks. The first block consists of a model for calculating a correspondence (demand) matrix, whereas the second block is a traffic assignment model. The first model calculates a matrix of correspondences using a matrix of transport costs (it characterizes the required volumes of movement from one area to another, it is time in this case). To solve this problem, authors propose to use one of the most popular methods of calculating the correspondence matrix in urban studies — the entropy model. The second model describes exactly how the needs for displacement specified by the correspondence matrix are distributed along the possible paths. Knowing the ways of the flows distribution along the paths, it is possible to calculate the cost matrix. Equilibrium in a two-stage model is a fixed point in the sequence of these two models. In practice the problem of finding a fixed point can be solved by the fixed-point iteration method. Unfortunately, at the moment the issue of convergence and estimations of the convergence rate for this method has not been studied quite thoroughly. In addition, the numerical implementation of the algorithm results in many problems. In particular, if the starting point is incorrect, situations may arise where the algorithm requires extremely large numbers to be computed and exceeds the available memory even on the most modern computers. Therefore the article proposes a method for reducing the problem of finding the equilibrium to the problem of the convex non-smooth optimization. Also a numerical method for solving the obtained optimization problem is proposed. Numerical experiments were carried out for both methods of solving the problem. The authors used data for Vladivostok (for this city information from various sources was processed and collected in a new dataset) and two smaller cities in the USA. It was not possible to achieve convergence by the method of fixed-point iteration, whereas the second model for the same dataset demonstrated convergence rate $k^{-1.67}$.
Indexed in Scopus
Full-text version of the journal is also available on the web site of the scientific electronic library eLIBRARY.RU
The journal is included in the Russian Science Citation Index
The journal is included in the RSCI
International Interdisciplinary Conference "Mathematics. Computing. Education"