Stochastic Gradient Algorithm

14,000,000 Leading Edge Experts on the ideXlab platform

Scan Science and Technology

Contact Leading Edge Experts & Companies

Scan Science and Technology

Contact Leading Edge Experts & Companies

The Experts below are selected from a list of 16356 Experts worldwide ranked by ideXlab platform

Feng Ding - One of the best experts on this subject based on the ideXlab platform.

Tasawar Hayat - One of the best experts on this subject based on the ideXlab platform.

Ahmed Alsaedi - One of the best experts on this subject based on the ideXlab platform.

  • data filtering based recursive identification for an exponential autoregressive moving average model by using the multi innovation theory
    Iet Control Theory and Applications, 2020
    Co-Authors: Feng Ding, Ahmed Alsaedi, Tasawar Hayat
    Abstract:

    This study employs the data filtering technique to investigate the recursive identification problems for a non-linear exponential autoregressive model with moving average noise, i.e. the ExpARMA model. Whitening the ExpARMA model by a linear filter, the original identification model is divided into a filtered identification model and a coloured noise model, then a filtering-based extended Stochastic Gradient Algorithm is derived. In order to improve the parameter estimation accuracy, the multi-innovation identification theory is used to develop a filtering-based multi-innovation extended Stochastic Gradient Algorithm for the ExpARMA model. A simulation example is given to demonstrate the superiority of the proposed filtering-based multi-innovation Algorithm over the existing Algorithms.

  • data filtering based maximum likelihood Gradient estimation Algorithms for a multivariate equation error system with arma noise
    Journal of The Franklin Institute-engineering and Applied Mathematics, 2020
    Co-Authors: Lijuan Liu, Feng Ding, Haibo Liu, Ahmed Alsaedi
    Abstract:

    Abstract In this paper, we use the maximum likelihood principle and the data filtering technique to study the identification issue of the multivariate equation-error system whose outputs are contaminated by an ARMA noise process. The key is to break the system into several regressive identification subsystems based on the number of the outputs. Then a multivariate equation-error subsystem is transformed into a filtered model and a filtered noise model, and a filtering based maximum likelihood extended Stochastic Gradient Algorithm is derived to estimate the parameters of these two models. The filtering based maximum likelihood extended Stochastic Gradient Algorithm has higher parameter estimation accuracy than the maximum likelihood generalized extended Stochastic Gradient Algorithm and the maximum likelihood recursive generalized extended least squares Algorithm. The simulation examples indicate that the proposed methods work well.

  • fitting the exponential autoregressive model through recursive search
    Journal of The Franklin Institute-engineering and Applied Mathematics, 2019
    Co-Authors: Huan Xu, Feng Ding, Ahmed Alsaedi, Tasawar Hayat
    Abstract:

    Abstract This paper focuses on the recursive parameter estimation methods for the exponential autoregressive (ExpAR) model. Applying the negative Gradient search and introducing a forgetting factor, a Stochastic Gradient and a forgetting factor Stochastic Gradient Algorithms are presented. In order to improve the parameter estimation accuracy and the convergence rate, the multi-innovation identification theory is employed to derive a forgetting factor multi-innovation Stochastic Gradient Algorithm. A simulation example is provided to test the effectiveness of the proposed Algorithms.

  • a multi innovation state and parameter estimation Algorithm for a state space system with d step state delay
    Signal Processing, 2017
    Co-Authors: Feng Ding, Ahmed Alsaedi, Tasawar Hayat
    Abstract:

    Abstract This paper considers the state and parameter estimation problem of a state-delay system. On the basis of the Stochastic Gradient Algorithm (i.e., the Gradient based search estimation Algorithm), this work extends the scalar innovation into an innovation vector and presents a multi-innovation Gradient parameter estimation Algorithm for a state-space system with d-step state-delay by means of the multi-innovation identification theory. For thesystems whose states are unknown, we use the states of the state observer for the parameter estimation and use the estimated parameters for the state estimation. This forms a joint multi-innovation state and parameter estimation Algorithm for the state-delay systems with immeasurable states. The simulation results indicate that the proposed Algorithms can work well.

  • Gradient based recursive identification methods for input nonlinear equation error closed loop systems
    Circuits Systems and Signal Processing, 2017
    Co-Authors: Bingbing Shen, Feng Ding, Ahmed Alsaedi, Tasawar Hayat
    Abstract:

    The identification problem of closed-loop or feedback nonlinear systems is a hot topic. Based on the hierarchical identification principle, this paper presents a hierarchical Stochastic Gradient Algorithm and a hierarchical multi-innovation Stochastic Gradient Algorithm for feedback nonlinear systems. The simulation results show that the hierarchical multi-innovation Stochastic Gradient can more effectively estimate the parameters of the feedback nonlinear systems than the hierarchical Stochastic Gradient Algorithm.

Xuehai Wang - One of the best experts on this subject based on the ideXlab platform.

  • hierarchical Stochastic Gradient Algorithm and its performance analysis for a class of bilinear in parameter systems
    Circuits Systems and Signal Processing, 2017
    Co-Authors: Feng Ding, Xuehai Wang
    Abstract:

    This paper considers the parameter identification for a special class of nonlinear systems, i.e., bilinear-in-parameter systems. Based on the hierarchical identification principle, a hierarchical Stochastic Gradient (HSG) estimation Algorithm is presented. The basic idea is to decompose a bilinear-in-parameter system into two subsystems and to derive the HSG identification Algorithm for estimating the system parameters by replacing the unknown variables in the information vectors with their estimates obtained at the previous time. The convergence analysis of the proposed Algorithm indicates that the parameter estimation errors converge to zero under persistent excitation conditions. The simulation results show that the proposed Algorithm is effective.

  • recursive parameter and state estimation for an input nonlinear state space system using the hierarchical identification principle
    Signal Processing, 2015
    Co-Authors: Xuehai Wang, Feng Ding
    Abstract:

    This paper focuses on the identification problem of an input nonlinear state space system with colored noise. Based on the observability canonical form, an identification model is derived and a state observer is designed. By using the hierarchical identification principle, a state observer based hierarchical Stochastic Gradient Algorithm is presented for estimating the parameter vectors and states jointly. Furthermore, by using the multi-innovation identification theory, a state observer based hierarchical multi-innovation Stochastic Gradient Algorithm is proposed for improving the convergence rate. The analysis indicates that the parameter estimates given by the proposed Algorithms converge to the true values under persistent excitation conditions. Two numerical examples are offered to demonstrate the effectiveness of the proposed Algorithms. HighlightsThe identification problem for nonlinear state space systems is considered.A state observer based hierarchical multi-innovation Gradient Algorithm is presented.The proposed Algorithm can estimate the system states and parameters jointly.The convergence of the proposed Algorithm is studied.

  • convergence of the auxiliary model based multi innovation generalized extended Stochastic Gradient Algorithm for box jenkins systems
    Nonlinear Dynamics, 2015
    Co-Authors: Xuehai Wang, Feng Ding
    Abstract:

    This paper focuses on the parameter estimation problem of Box–Jenkins systems. Using the multi-innovation identification theory, an auxiliary model-based multi-innovation generalized extended Stochastic Gradient Algorithm is derived. The convergence of the proposed Algorithm is analyzed based on the Stochastic martingale theory. It is proved that the parameter estimation errors converge to zero under persistent excitation conditions. Two simulation examples are provided to confirm the convergence results.

  • performance analysis of the recursive parameter estimation Algorithms for multivariable box jenkins systems
    Journal of The Franklin Institute-engineering and Applied Mathematics, 2014
    Co-Authors: Xuehai Wang, Feng Ding
    Abstract:

    Abstract Two auxiliary model based recursive identification Algorithms, a generalized extended Stochastic Gradient Algorithm and a recursive generalized extended least squares Algorithm, are developed for multivariable Box–Jenkins systems. The basic idea is to use the auxiliary models to estimate the unknown noise-free outputs of the system and to replace the unmeasurable terms in the information vectors with their estimates. We prove that the estimation errors given by the proposed Algorithms converge to zero under the persistent excitation condition. Finally, an example is provided to show the effectiveness of the proposed Algorithms.

Jing Chen - One of the best experts on this subject based on the ideXlab platform.