All issues

Monte Carlo (MC) reinforcement learning suffers from high sample complexity, especially in environments with sparse rewards, large state spaces, and strongly correlated trajectories that reduce the statistical efficiency of return estimation. These well-known limitations often lead to slow convergence and unstable learning dynamics, particularly in settings where only a small fraction of collected trajectories is actually informative for policy improvement. A key challenge is therefore to identify a compact yet diverse subset of episodes that contributes most to the accuracy of value estimates while preserving sufficient exploration of the environment. To address this challenge, we reformulate episode selection as a Quadratic Unconstrained Binary Optimization (QUBO) problem and solve it using quantum-inspired sampling techniques. Our method, MC+ QUBO, inserts a combinatorial filtering step into the standard MC policy-evaluation pipeline: given a batch of trajectories, it selects a subset that maximizes cumulative reward and encourages broad state-space coverage. This selection procedure is expressed as a QUBO model, where linear terms favor high-return episodes, quadratic terms penalize redundancy between trajectories, and additional coupling terms can be used to enforce coverage-related constraints or promote structural diversity. Within this framework, we investigate two black-box QUBO solvers: Simulated Quantum Annealing (SQA), which emulates tunneling-based exploration of the search landscape, and Simulated Bifurcation (SB), a dynamical-systems-based iterative optimization method. Both solvers demonstrate the ability to efficiently navigate the combinatorial structure of the trajectory-selection problem and to handle batch sizes that are otherwise computationally expensive for exhaustive or deterministic search. Experiments in a finite-horizon GridWorld environment show that MC+QUBO consistently outperforms vanilla MC in convergence speed, stability of return estimates, and final policy quality. These results highlight the promise of quantum-inspired optimization as a practical decision-making subroutine within reinforcement-learning algorithms, offering a scalable way to improve sample efficiency without modifying the underlying learning paradigm.

This paper describes a method for generating a synthetic database of stenoses, consisting of 1620 entries. Each entry represents the results of a numerical experiment simulating the three-dimensional flow of a viscous incompressible fluid through a tube with a variable cross-section: pressure drop, mean flow rate, cross-sectionally averaged inlet blood flow velocity, maximum stenosis severity, stenosis length, stenosis asymmetry, tube radius, and Reynolds number. The database was validated by comparison with other models (with elastic walls) and bench experiments, showing a deviation in pressure drops of no more than 4%. The synthetic stenosis database was used to train a physics-informed neural network for the rapid estimation of pressure drop based on four key input parameters: Reynolds number, stenosis length, stenosis severity, and stenosis asymmetry coefficient. The physics-informed aspect was achieved by introducing penalties into the loss function for the absence of a positive pressure drop and for the lack of monotonicity of the pressure drop with respect to the input parameters. The physics-informed neural network demonstrated higher accuracy on hemodynamically significant stenoses when tested on a validation set and on new stenoses not represented in the database. The mean relative error for stenoses with a length of 8 healthy vessel radii was 6% for the physics-informed network and 13% for a classical neural network. The errors for short stenoses with a length of 4 radii were nearly identical: 9.5% for the physics-informed network and 10% for the classical neural network. The developed method for the functional assessment of the hemodynamic significance of stenoses can be used both as a standalone tool for clinical stenosis evaluation and as a component of network blood flow models. The approach becomes most relevant when modeling multi-vessel disease, which is predominant in clinical practice. The key advantage of the method lies in the physical correctness of the results and accuracy comparable to classical modeling, but with significantly lower computational costs.

Modeling of gas-particle suspensions with large pressure and density gradients is of practical interest in the study of volcanic phenomena, explosions at different altitudes, as well as in technogenic problems related to the operation of space technology and the formation of space debris. This work presents numerical and analytical investigations of the expansion of gas suspensions with a high ratio (up to six orders of magnitude) of pressures and densities. For numerical modeling, a high-resolution hybrid large-particle method was employed. Under the conditions considered, the accuracy of the method was confirmed by comparison with asymptotically exact solutions. The study examined the wave and structural characteristics of concentrated gas suspension expansion depending on particle volume fraction, particle size, and initial pressure ratio. It was found that the polytropic index and sound speed in the gas suspension depend not only on temperature but also on pressure and particle concentration. With increasing pressure, both the polytropic index and sound speed rise, while with increasing particle volume fraction they decrease. In the case of an arbitrary discontinuity decay, an unusual effect is observed compared with “pure” gas dynamics: the relative velocity of the mixture in the uniform flow region decreases as the initial pressure increases. This is explained by the nonlinear dependence of the sound speed in a gas-dispersed mixture on pressure. With increasing particle size (Stokes number), the mixture flow splits into gaseous and dispersed components. At the initial moment, the contact discontinuity separating the mixture from the rarefied gas region splits into two contact boundaries: gaseous and dispersed. A practical conclusion is that when the particle size changes by two orders of magnitude, the gas-dynamic parameters of the mixture in the rarefaction wave region and up to the medium interface remain close to each other. During spatial expansion, the initial cylindrical shape of the dispersed medium successively transforms into a cross-section resembling a hexagon. At the next stage of expansion, the particles redistribute to form a bilateral conical structure. Eventually, a dispersed formation close to a spherical shape emerges.

Solving the problem of stationary stream distribution for an arbitrary volume-free hydrosystem with a free level can be reduced to determining the extremes of a multi-variable function. Rayleigh function expressed in terms of the hydraulic characteristics of the parts of the system in question is used as such a function. The same function is Lyapunov function when analyzing the stability of the determined stationary operational modes of a hydrosystem using the direct Lyapunov method.

The article was retracted on May 3, 2022 at the request of the authors due to the fact that the data included in the article were published in the article by Nechipurenko Y.D., Golovkin M.V., Nechipurenko D.Yu., Ilyicheva I.A., Panchenko L. .A., Polozov R.V., Grokhovsky S.L. Kharakternye osobennosti rasshchepleniya DNK ul'trazvukom [Characteristic features of DNA cleavage by ultrasound]. Journal of Structural Chemistry, 2009, volume 50, number 5, pages 1045-1052 (in Russian).

The aim of research is to develop software system for solving gas dynamic problem in multiply connected integration domains of regular shape by high-performance computing system. Comparison of the various technologies of parallel computing has been done. The program complex is implemented using multithreaded parallel systems to organize both multi-core and massively parallel calculation. The comparison of numerical results with known model problems solutions has been done. Research of performance of different computing platforms has been done.

We consider the two-dimensional mathematical model of wildfire. Numerical solution algorithm based on the method of large particles was developed for this model.

In this paper the problem of searching for the design of the magnetic system for creation a magnetic field with the required characteristics in the given area is solved. On the basis of analysis of the mathematical model of the magnetic system rather a general approach is proposed to the solving of the inverse problem, which is written by the Fredgolm equation H(z) = ∫_SIJ(s)G(z, s)ds, z ∈ S _H, s ∈ S _I . It was necessary to define the current density distribution function J(s) and the existing winding geometry for creation of a required magnetic field H(z). In the paper a method of solving those by means of regularized iterative processes is proposed. On the base of the concrete magnetic system we perform the numerical study of influence of different factors on the character of the magnetic field being designed.

New key parameters, namely b₀ = tgθ₀, θ₀ — angle of throwing, R_a — top curvature radius and β₀ — dimensionless speed square on the top of low angular trajectory were suggested in classic problem of integrating nonlinear equations of point mass projectile motion with quadratic air drag. Very precise formulae were obtained in a new way for coordinates x(b), y(b) and fly time t(b), b = tgθ where θ is inclination angle. This method is based on Legendre transformation and its precision is automatically improved in wide range of the θ₀ values and drag force parameters α. The precision was monitored by Maple computing product.

The article deals with the local and double local estimation of the Monte Carlo method for solving the equation of global illumination. The local estimation allows calculating the illumination at any point at the approximation of diffuse reflection, whereas the double local estimation allows calculating directly the luminance at a given point in a given direction. The article presents the mathematical basis of local estimations and the basic stages of the software implementation. The representation of three-dimensional objects in the basis of spherical functions and the possibility of using them in the local estimations are also considered.