Fractional-order stochastic gradient descent (FOSGD) leverages fractional exponents to capture long-memory effects in optimization. However, its utility is often limited by the difficulty of tuning and stabilizing these exponents. We propose 2SED Fractional-Order Stochastic Gradient Descent (2SEDFOSGD), which integrates the Two-Scale Effective Dimension (2SED) algorithm with FOSGD to adapt the fractional exponent in a data-driven manner. By tracking model sensitivity and effective dimensionality, 2SEDFOSGD dynamically modulates the exponent to mitigate oscillations and hasten convergence. Theoretically, this approach preserves the advantages of fractional memory without the sluggish or unstable behavior observed in na\"ive fractional SGD. Empirical evaluations in Gaussian and $\alpha$-stable noise scenarios using an autoregressive (AR) model,highlight faster convergence and more robust parameter estimates compared to baseline methods, underscoring the potential of dimension-aware fractional techniques for advanced modeling and estimation tasks.
| Mualliflar | Mohammad Partohaghighi, Roummel Marcia, YangQuan Chen |
|---|---|
| Jurnal | O‘zbekiston matematika jurnali |
| Nashr sanasi | 2025-09-05 |
| Jild | 69 |
| Son | 3 |
| Betlar | 142-152 |
| DOI | 10.29229/uzmj.2025-3-15 |
DOI: 10.29229/uzmj.2025-3-15 · Maqolaning asl sahifasi
Fractional Calculus, Stochastic Gradient Descent, Two Scale Effective Dimension, More Optimal Optimization
The mathematical model of the control system considered in this paper is presented in the form of a linear nonstationary differential inclusion. For this model of the control system, the problem of locally relative…
In this paper we study a global stability problem for polynomial stochastic operators associated with higher-order diagonally primitive doubly stochastic hyper-matrices.
In this paper, the inverse problem of determining convolution kernel in the time-fractional wave equation with the Caputo derivative is studied. To express the solution of the Cauchy problem, the fundamental solution of…
This paper constructs a discrete analogue of the second-order differential operator with variable coefficient. The construction is based on harrow-shaped functions and the application of direct and inverse Fourier…
This article studies the inverse problem of finding a multiplier on the right-hand side, depending on the spatial variable $x$. In the direct problem, an initial-boundary value problem for a fourth-order differential…
The well-known classical Dirichlet problem states that if $D\subset {\mathbb R}^{n}$ is a regular domain, then for any continuous function $\varphi (\xi )\in C(\partial D)$, there exists a unique harmonic function…
In this paper, hypergeometric function of Lauricella $F_{A}^{(n)}$ has been investigated. The new properties of which are established and applied to the solution of the Dirichlet problem for the three-dimensional…
In this paper we obtain the criterion of weak convergence of the sequence of the sum of the first $n$ terms of the linear process $\left\{X_{kn} ,\; k=1,2,...,n;\; n=1,2,...\right\}$ with random coefficients…
We study a differential game of two pursuers and one evader, whose dynamics are described by linear differential equations, in $\mathbb{R}^n$. The control functions of pursuers and evader are subjected to the Grönwall…
In this work, the complex Lie affgebra structures on three-dimensional solvable Lie algebras are completely determined