Результаты поиска по 'regularization':
Найдено статей: 83
  1. Dvinskikh D.M., Pirau V.V., Gasnikov A.V.
    On the relations of stochastic convex optimization problems with empirical risk minimization problems on $p$-norm balls
    Computer Research and Modeling, 2022, v. 14, no. 2, pp. 309-319

    In this paper, we consider convex stochastic optimization problems arising in machine learning applications (e. g., risk minimization) and mathematical statistics (e. g., maximum likelihood estimation). There are two main approaches to solve such kinds of problems, namely the Stochastic Approximation approach (online approach) and the Sample Average Approximation approach, also known as the Monte Carlo approach, (offline approach). In the offline approach, the problem is replaced by its empirical counterpart (the empirical risk minimization problem). The natural question is how to define the problem sample size, i. e., how many realizations should be sampled so that the quite accurate solution of the empirical problem be the solution of the original problem with the desired precision. This issue is one of the main issues in modern machine learning and optimization. In the last decade, a lot of significant advances were made in these areas to solve convex stochastic optimization problems on the Euclidean balls (or the whole space). In this work, we are based on these advances and study the case of arbitrary balls in the $p$-norms. We also explore the question of how the parameter $p$ affects the estimates of the required number of terms as a function of empirical risk.

    In this paper, both convex and saddle point optimization problems are considered. For strongly convex problems, the existing results on the same sample sizes in both approaches (online and offline) were generalized to arbitrary norms. Moreover, it was shown that the strong convexity condition can be weakened: the obtained results are valid for functions satisfying the quadratic growth condition. In the case when this condition is not met, it is proposed to use the regularization of the original problem in an arbitrary norm. In contradistinction to convex problems, saddle point problems are much less studied. For saddle point problems, the sample size was obtained under the condition of $\gamma$-growth of the objective function. When $\gamma = 1$, this condition is the condition of sharp minimum in convex problems. In this article, it was shown that the sample size in the case of a sharp minimum is almost independent of the desired accuracy of the solution of the original problem.

  2. Zhdanova O.L., Zhdanov V.S., Neverova G.P.
    Modeling the dynamics of plankton community considering phytoplankton toxicity
    Computer Research and Modeling, 2022, v. 14, no. 6, pp. 1301-1323

    We propose a three-component discrete-time model of the phytoplankton-zooplankton community, in which toxic and non-toxic species of phytoplankton compete for resources. The use of the Holling functional response of type II allows us to describe an interaction between zooplankton and phytoplankton. With the Ricker competition model, we describe the restriction of phytoplankton biomass growth by the availability of external resources (mineral nutrition, oxygen, light, etc.). Many phytoplankton species, including diatom algae, are known not to release toxins if they are not damaged. Zooplankton pressure on phytoplankton decreases in the presence of toxic substances. For example, Copepods are selective in their food choices and avoid consuming toxin-producing phytoplankton. Therefore, in our model, zooplankton (predator) consumes only non-toxic phytoplankton species being prey, and toxic species phytoplankton only competes with non-toxic for resources.

    We study analytically and numerically the proposed model. Dynamic mode maps allow us to investigate stability domains of fixed points, bifurcations, and the evolution of the community. Stability loss of fixed points is shown to occur only through a cascade of period-doubling bifurcations. The Neimark – Sacker scenario leading to the appearance of quasiperiodic oscillations is found to realize as well. Changes in intrapopulation parameters of phytoplankton or zooplankton can lead to abrupt transitions from regular to quasi-periodic dynamics (according to the Neimark – Sacker scenario) and further to cycles with a short period or even stationary dynamics. In the multistability areas, an initial condition variation with the unchanged values of all model parameters can shift the current dynamic mode or/and community composition.

    The proposed discrete-time model of community is quite simple and reveals dynamics of interacting species that coincide with features of experimental dynamics. In particular, the system shows behavior like in prey-predator models without evolution: the predator fluctuations lag behind those of prey by about a quarter of the period. Considering the phytoplankton genetic heterogeneity, in the simplest case of two genetically different forms: toxic and non-toxic ones, allows the model to demonstrate both long-period antiphase oscillations of predator and prey and cryptic cycles. During the cryptic cycle, the prey density remains almost constant with fluctuating predators, which corresponds to the influence of rapid evolution masking the trophic interaction.

  3. Pham C.T., Phan M.N., Tran T.T.
    Image classification based on deep learning with automatic relevance determination and structured Bayesian pruning
    Computer Research and Modeling, 2024, v. 16, no. 4, pp. 927-938

    Deep learning’s power stems from complex architectures; however, these can lead to overfitting, where models memorize training data and fail to generalize to unseen examples. This paper proposes a novel probabilistic approach to mitigate this issue. We introduce two key elements: Truncated Log-Uniform Prior and Truncated Log-Normal Variational Approximation, and Automatic Relevance Determination (ARD) with Bayesian Deep Neural Networks (BDNNs). Within the probabilistic framework, we employ a specially designed truncated log-uniform prior for noise. This prior acts as a regularizer, guiding the learning process towards simpler solutions and reducing overfitting. Additionally, a truncated log-normal variational approximation is used for efficient handling of the complex probability distributions inherent in deep learning models. ARD automatically identifies and removes irrelevant features or weights within a model. By integrating ARD with BDNNs, where weights have a probability distribution, we achieve a variational bound similar to the popular variational dropout technique. Dropout randomly drops neurons during training, encouraging the model not to rely heavily on any single feature. Our approach with ARD achieves similar benefits without the randomness of dropout, potentially leading to more stable training.

    To evaluate our approach, we have tested the model on two datasets: the Canadian Institute For Advanced Research (CIFAR-10) for image classification and a dataset of Macroscopic Images of Wood, which is compiled from multiple macroscopic images of wood datasets. Our method is applied to established architectures like Visual Geometry Group (VGG) and Residual Network (ResNet). The results demonstrate significant improvements. The model reduced overfitting while maintaining, or even improving, the accuracy of the network’s predictions on classification tasks. This validates the effectiveness of our approach in enhancing the performance and generalization capabilities of deep learning models.

  4. Brazhe A.R., Brazhe N.A., Sosnovtseva O.V., Pavlov A.N., Mosekilde E., Maksimov G.V.
    Wavelet-based analysis of cell dynamics measured by interference microscopy
    Computer Research and Modeling, 2009, v. 1, no. 1, pp. 77-83

    Laser interference microscopy was used to study morphology and intracellular dynamics of erythrocytes, neurons and mast cells. We have found that changes of the local refractive index (RI) of cells have regular components that relate to the cooperative processes in the cellular submembrane and centre regions. We have shown that characteristic frequencies of RI dynamics differ for various cell types and can be used as markers of specific cellular processes.

    Views (last year): 1. Citations: 5 (RSCI).
  5. Bratsun D.A., Buzmakov M.D.
    Repressilator with time-delayed gene expression. Part II. Stochastic description
    Computer Research and Modeling, 2021, v. 13, no. 3, pp. 587-609

    The repressilator is the first genetic regulatory network in synthetic biology, which was artificially constructed in 2000. It is a closed network of three genetic elements $lacI$, $\lambda cI$ and $tetR$, which have a natural origin, but are not found in nature in such a combination. The promoter of each of the three genes controls the next cistron via the negative feedback, suppressing the expression of the neighboring gene. In our previous paper [Bratsun et al., 2018], we proposed a mathematical model of a delayed repressillator and studied its properties within the framework of a deterministic description. We assume that delay can be both natural, i.e. arises during the transcription / translation of genes due to the multistage nature of these processes, and artificial, i.e. specially to be introduced into the work of the regulatory network using gene engineering technologies. In this work, we apply the stochastic description of dynamic processes in a delayed repressilator, which is an important addition to deterministic analysis due to the small number of molecules involved in gene regulation. The stochastic study is carried out numerically using the Gillespie algorithm, which is modified for time delay systems. We present the description of the algorithm, its software implementation, and the results of benchmark simulations for a onegene delayed autorepressor. When studying the behavior of a repressilator, we show that a stochastic description in a number of cases gives new information about the behavior of a system, which does not reduce to deterministic dynamics even when averaged over a large number of realizations. We show that in the subcritical range of parameters, where deterministic analysis predicts the absolute stability of the system, quasi-regular oscillations may be excited due to the nonlinear interaction of noise and delay. Earlier, we have discovered within the framework of the deterministic description, that there exists a long-lived transient regime, which is represented in the phase space by a slow manifold. This mode reflects the process of long-term synchronization of protein pulsations in the work of the repressilator genes. In this work, we show that the transition to the cooperative mode of gene operation occurs a two order of magnitude faster, when the effect of the intrinsic noise is taken into account. We have obtained the probability distribution of moment when the phase trajectory leaves the slow manifold and have determined the most probable time for such a transition. The influence of the intrinsic noise of chemical reactions on the dynamic properties of the repressilator is discussed.

  6. Bashkirtseva I.A., Perevalova T.V., Ryashko L.B.
    Stochastic sensitivity analysis of dynamic transformations in the “two prey – predator” model
    Computer Research and Modeling, 2022, v. 14, no. 6, pp. 1343-1356

    This work is devoted to the study of the problem of modeling and analyzing complex oscillatory modes, both regular and chaotic, in systems of interacting populations in the presence of random perturbations. As an initial conceptual deterministic model, a Volterra system of three differential equations is considered, which describes the dynamics of prey populations of two competing species and a predator. This model takes into account the following key biological factors: the natural increase in prey, their intraspecific and interspecific competition, the extinction of predators in the absence of prey, the rate of predation by predators, the growth of the predator population due to predation, and the intensity of intraspecific competition in the predator population. The growth rate of the second prey population is used as a bifurcation parameter. At a certain interval of variation of this parameter, the system demonstrates a wide variety of dynamic modes: equilibrium, oscillatory, and chaotic. An important feature of this model is multistability. In this paper, we focus on the study of the parametric zone of tristability, when a stable equilibrium and two limit cycles coexist in the system. Such birhythmicity in the presence of random perturbations generates new dynamic modes that have no analogues in the deterministic case. The aim of the paper is a detailed study of stochastic phenomena caused by random fluctuations in the growth rate of the second population of prey. As a mathematical model of such fluctuations, we consider white Gaussian noise. Using methods of direct numerical modeling of solutions of the corresponding system of stochastic differential equations, the following phenomena have been identified and described: unidirectional stochastic transitions from one cycle to another, trigger mode caused by transitions between cycles, noise-induced transitions from cycles to the equilibrium, corresponding to the extinction of the predator and the second prey population. The paper presents the results of the analysis of these phenomena using the Lyapunov exponents, and identifies the parametric conditions for transitions from order to chaos and from chaos to order. For the analytical study of such noise-induced multi-stage transitions, the technique of stochastic sensitivity functions and the method of confidence regions were applied. The paper shows how this mathematical apparatus allows predicting the intensity of noise, leading to qualitative transformations of the modes of stochastic population dynamics.

  7. Lopato A.I., Poroshyna Y.E., Utkin P.S.
    Numerical study of the mechanisms of propagation of pulsating gaseous detonation in a non-uniform medium
    Computer Research and Modeling, 2023, v. 15, no. 5, pp. 1263-1282

    In the last few years, significant progress has been observed in the field of rotating detonation engines for aircrafts. Scientific laboratories around the world conduct both fundamental researches related, for example, to the issues of effective mixing of fuel and oxidizer with the separate supply, and applied development of existing prototypes. The paper provides a brief overview of the main results of the most significant recent computational work on the study of propagation of a onedimensional pulsating gaseous detonation wave in a non-uniform medium. The general trends observed by the authors of these works are noted. In these works, it is shown that the presence of parameter perturbations in front of the wave front can lead to regularization and to resonant amplification of pulsations behind the detonation wave front. Thus, there is an appealing opportunity from a practical point of view to influence the stability of the detonation wave and control it. The aim of the present work is to create an instrument to study the gas-dynamic mechanisms of these effects.

    The mathematical model is based on one-dimensional Euler equations supplemented by a one-stage model of the kinetics of chemical reactions. The defining system of equations is written in the shock-attached frame that leads to the need to add a shock-change equations. A method for integrating this equation is proposed, taking into account the change in the density of the medium in front of the wave front. So, the numerical algorithm for the simulation of detonation wave propagation in a non-uniform medium is proposed.

    Using the developed algorithm, a numerical study of the propagation of stable detonation in a medium with variable density as carried out. A mode with a relatively small oscillation amplitude is investigated, in which the fluctuations of the parameters behind the detonation wave front occur with the frequency of fluctuations in the density of the medium. It is shown the relationship of the oscillation period with the passage time of the characteristics C+ and C0 over the region, which can be conditionally considered an induction zone. The phase shift between the oscillations of the velocity of the detonation wave and the density of the gas before the wave is estimated as the maximum time of passage of the characteristic C+ through the induction zone.

  8. Pirutin S.K., Shank M.A., Jia S., Konuhov I.V., Todorenko D.A., Chervitsov R.N., Fursova P.V., Kabashnikova L.F., Plusnina T.Yu., Khruschev S.S., Riznichenko G.Yu., Rubin A.B.
    Comprehensive analysis of copper ions effect on the primary processes of photosynthesis in Scenedesmus quadricauda based on chlorophyll a fluorescence measurements in suspension and on single cells
    Computer Research and Modeling, 2025, v. 17, no. 2, pp. 293-322

    The effect of copper ions on the primary processes of photosynthesis in freshwater microalgae Scenedesmus quadricauda was studied using a set of biophysical and mathematical methods. Chlorophyll a fluorescence transients were recorded both in cell suspensions and at the level of single cells after incubation at copper concentrations of 0.1–10 $\mu$M under light and dark conditions. It was found that copper has a dose-dependent effect on the photosynthetic apparatus of microalgae. At low copper concentration (0.1 $\mu$M), a stimulating effect on a number of studied parameters was observed, whereas significant disruption of Photosystem II activity was detected at 10 $\mu$M. The method of analyzing fluorescence of single cells proved to be more sensitive compared to traditional suspension measurements, allowing the detection of heterogeneous cellular responses to the toxicant. Analysis of chlorophyll a fast fluorescence kinetics showed that the JIP-test parameters $\delta_{Ro}$ and $\varphi_{Ro}$ were the most sensitive to copper exposure and were significantly different from the control when exposed not only to high but also to medium (1 $\mu$M) copper concentrations. The decrease in photochemical activity of cells during light incubation was less pronounced compared to dark conditions. The application of data normalization to optical density at $\lambda = 455$ nm significantly increased the sensitivity of the method and accuracy of result interpretation. The use of L1-regularization (LASSO) by the least angles method (LARS) for the spectral multi-exponential approximation of the fluorescence transients allowed us to reveal their temporal characteristics. Mathematical analysis of the obtained data suggested that copper exposure leads to increased non-photochemical quenching of fluorescence, which serves as a protective mechanism for dissipating excess excitation energy. The revealed heterogeneity of cellular responses to copper action may have important ecological significance, ensuring the survival of part of the population under stress conditions. The obtained data confirm the promise of using fluorescent analysis methods for early diagnosis of heavy metal stress effects on photosynthesizing organisms.

  9. Belyaev A.V.
    Stochastic transitions from order to chaos in a metapopulation model with migration
    Computer Research and Modeling, 2024, v. 16, no. 4, pp. 959-973

    This paper focuses on the problem of modeling and analyzing dynamic regimes, both regular and chaotic, in systems of coupled populations in the presence of random disturbances. The discrete Ricker model is used as the initial deterministic population model. The paper examines the dynamics of two populations coupled by migration. Migration is proportional to the difference between the densities of two populations with a coupling coefficient responsible for the strength of the migration flow. Isolated population subsystems, modeled by the Ricker map, exhibit various dynamic modes, including equilibrium, periodic, and chaotic ones. In this study, the coupling coefficient is treated as a bifurcation parameter and the parameters of natural population growth rate remain fixed. Under these conditions, one subsystem is in the equilibrium mode, while the other exhibits chaotic behavior. The coupling of two populations through migration creates new dynamic regimes, which were not observed in the isolated model. This article aims to analyze the dynamics of corporate systems with variations in the flow intensity between population subsystems. The article presents a bifurcation analysis of the attractors in a deterministic model of two coupled populations, identifies zones of monostability and bistability, and gives examples of regular and chaotic attractors. The main focus of the work is in comparing the stability of dynamic regimes against random disturbances in the migration intensity. Noise-induced transitions from a periodic attractor to a chaotic attractor are identified and described using direct numerical simulation methods. The Lyapunov exponents are used to analyze stochastic phenomena. It has been shown that in this model, there is a region of change in the bifurcation parameter in which, even with an increase in the intensity of random perturbations, there is no transition from order to chaos. For the analytical study of noise-induced transitions, the stochastic sensitivity function technique and the confidence domain method are used. The paper demonstrates how this mathematical tool can be employed to predict the critical noise intensity that causes a periodic regime to transform into a chaotic one.

  10. Aronov I.Z., Maksimova O.V., Zazhigalkin A.V.
    Investigation of time to reach consensus on the work of technical committees on standardization based on regular Markov chains
    Computer Research and Modeling, 2015, v. 7, no. 4, pp. 941-950

    In this paper construct the mathematical model for consensus in technical committees for standardization (TC), based on the consensus model proposed DeGroot. The basic problems of achieving consensus in the development of consensus standards in terms of the proposed model are discussed. The results of statistical modeling characterizing the dependence of time to reach consensus on the number of members of the TC and their authoritarianism are presented. It has been shown that increasing the number of TC experts and authoritarianism negative impact on the time to reach a consensus and increase fragmentation of the TC.

    Views (last year): 5. Citations: 8 (RSCI).
Pages: « first previous next last »

Indexed in Scopus

Full-text version of the journal is also available on the web site of the scientific electronic library eLIBRARY.RU

The journal is included in the Russian Science Citation Index

The journal is included in the RSCI

International Interdisciplinary Conference "Mathematics. Computing. Education"