Nonlinear Transformation

14,000,000 Leading Edge Experts on the ideXlab platform

Scan Science and Technology

Contact Leading Edge Experts & Companies

Scan Science and Technology

Contact Leading Edge Experts & Companies

The Experts below are selected from a list of 321 Experts worldwide ranked by ideXlab platform

John D. Joannopoulos - One of the best experts on this subject based on the ideXlab platform.

Heeyoul Choi - One of the best experts on this subject based on the ideXlab platform.

  • Persistent hidden states and Nonlinear Transformation for long short-term memory
    Neurocomputing, 2019
    Co-Authors: Heeyoul Choi
    Abstract:

    Recurrent neural networks (RNNs) have been drawing much attention with great success in many applications like speech recognition and neural machine translation. Long short-term memory (LSTM) is one of the most popular RNN units in deep learning applications. LSTM transforms the input and the previous hidden states to the next states with the affine Transformation, multiplication operations and a Nonlinear activation function, which makes a good data representation for a given task. The affine Transformation includes rotation and reflection, which change the semantic or syntactic information of dimensions in the hidden states. However, considering that a model interprets the output sequence of LSTM over the whole input sequence, the dimensions of the states need to keep the same type of semantic or syntactic information regardless of the location in the sequence. In this paper, we propose a simple variant of the LSTM unit, persistent recurrent unit (PRU), where each dimension of hidden states keeps persistent information across time, so that the space keeps the same meaning over the whole sequence. In addition, to improve the Nonlinear Transformation power, we add a feedforward layer in the PRU structure. In the experiment, we evaluate our proposed methods with three different tasks, and the results confirm that our methods have better performance than the conventional LSTM.

Y. Joly - One of the best experts on this subject based on the ideXlab platform.

  • A Speech Analysis/synthesis Software System For Hearing Research
    Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society Volume 13: 1991, 1991
    Co-Authors: Y. Joly
    Abstract:

    A software system is presented for performing complex, high-quality Transformations of the speech signal. It is based on a general analysis/synthesis method, and incorporates features such as formant extraction. A timevarying Nonlinear Transformation designed to aid speech reception by people with profound h.igh-frequency hearing loss demonstrates the potential usefulness of this software system in hearing research.

Katsunori Kawamura - One of the best experts on this subject based on the ideXlab platform.

  • Nonlinear Transformation Group of CAR Fermion Algebra
    Letters in Mathematical Physics, 2002
    Co-Authors: Mitsuo Abe, Katsunori Kawamura
    Abstract:

    Based on our previous work on the recursive fermion system in the Cuntz algebra, it is shown that a Nonlinear Transformation group of the CAR fermion algebra is induced from a U(2 p ) action on the Cuntz algebra \(\mathcal{O}\)2p with an arbitrary positive integer p. In general, these Nonlinear Transformations are expressed in terms of finite polynomials in generators. Some Bogoliubov Transformations are involved as special cases.

Cheng-wei Qiu - One of the best experts on this subject based on the ideXlab platform.