The Experts below are selected from a list of 1070190 Experts worldwide ranked by ideXlab platform
Emmanuel Vincent - One of the best experts on this subject based on the ideXlab platform.
-
Enforcing Harmonicity and Smoothness in Bayesian Non-Negative Matrix Factorization Applied to Polyphonic Music Transcription
IEEE Transactions on Audio Speech and Language Processing, 2010Co-Authors: Nancy Bertin, Roland Badeau, Emmanuel VincentAbstract:This paper presents theoretical and experimental results about constrained non-negative matrix factorization (NMF) in a Bayesian framework. A model of superimposed Gaussian components including Harmonicity is proposed, while temporal continuity is enforced through an inverse-Gamma Markov chain prior. We then exhibit a space-alternating generalized expectation-maximization (SAGE) algorithm to estimate the parameters. Computational time is reduced by initializing the system with an original variant of multiplicative harmonic NMF, which is described as well. The algorithm is then applied to perform polyphonic piano music transcription. It is compared to other state-of-the-art algorithms, especially NMF-based. Convergence issues are also discussed on a theoretical and experimental point of view. Bayesian NMF with Harmonicity and temporal continuity constraints is shown to outperform other standard NMF-based transcription systems, providing a meaningful mid-level representation of the data. However, temporal smoothness has its drawbacks, as far as transients are concerned in particular, and can be detrimental to transcription performance when it is the only constraint used. Possible improvements of the temporal prior are discussed.
-
WASPAA - Fast bayesian nmf algorithms enforcing Harmonicity and temporal continuity in polyphonic music transcription
2009 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2009Co-Authors: Nancy Bertin, Roland Badeau, Emmanuel VincentAbstract:This article presents theoretical and experimental results about constrained non-negative matrix factorization (NMF) in a Bayesian framework, enforcing both spectral Harmonicity and temporal continuity. We exhibit fast multiplicative update rules to perform the decomposition, which are then applied to perform polyphonic piano music transcription. This approach is shown to outperform other standard NMF-based transcription systems, providing a meaningful mid-level representation of the data.
-
Fast bayesian nmf algorithms enforcing Harmonicity and temporal continuity in polyphonic music transcription
2009 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2009Co-Authors: Nancy Bertin, Roland Badeau, Emmanuel VincentAbstract:This article presents theoretical and experimental results about constrained non-negative matrix factorization (NMF) in a Bayesian framework, enforcing both spectral Harmonicity and temporal continuity. We exhibit fast multiplicative update rules to perform the decomposition, which are then applied to perform polyphonic piano music transcription. This approach is shown to outperform other standard NMF-based transcription systems, providing a meaningful mid-level representation of the data.
-
Single-channel mixture decomposition using Bayesian harmonic models
2006Co-Authors: Emmanuel Vincent, Mark PlumbleyAbstract:We consider the source separation problem for single-channel music signals. After a brief review of existing methods, we focus on decomposing a mixture into components made of harmonic sinusoidal partials. We address this problem in the Bayesian framework by building a probabilistic model of the mixture combining generic priors for Harmonicity, spectral envelope, note duration and continuity. Experiments suggest that the derived blind decomposition method leads to better separation results than nonnegative matrix factorization for certain mixtures.
Josh H. Mcdermott - One of the best experts on this subject based on the ideXlab platform.
-
Harmonicity aids hearing in noise
bioRxiv, 2020Co-Authors: River C Grace, Malinda J Mcpherson, Josh H. McdermottAbstract:Abstract Hearing in noise is a core problem in audition, and a challenge for hearing-impaired listeners, yet the underlying mechanisms are poorly understood. We explored whether harmonic frequency relations, a signature property of many communication sounds, aid hearing in noise. We measured detection thresholds in noise for tones and speech synthesized to have harmonic or inharmonic spectra. Harmonic signals were consistently easier to detect than otherwise identical inharmonic signals. Harmonicity also improved discrimination of sounds in noise. In contrast to other documented effects of Harmonicity, harmonic detection advantages were comparable in musicians and non-musicians. The results show that Harmonicity is critical for hearing in noise, demonstrating a previously unappreciated aspect of auditory scene analysis. The consistency of the effect across synthetic and natural stimuli, as well as across musical expertise, suggests its importance in everyday hearing.
-
Inharmonic speech reveals the role of Harmonicity in the cocktail party problem
Nature Communications, 2018Co-Authors: Sara Popham, Dana Boebinger, Dan P. W. Ellis, Hideki Kawahara, Josh H. McdermottAbstract:Harmonicity is associated with a single sound source and may be a useful cue with which to segregate the speech of multiple talkers. Here the authors introduce a method for perturbing the constituent frequencies of speech and show that violating Harmonicity degrades intelligibility of speech mixtures. The “cocktail party problem” requires us to discern individual sound sources from mixtures of sources. The brain must use knowledge of natural sound regularities for this purpose. One much-discussed regularity is the tendency for frequencies to be harmonically related (integer multiples of a fundamental frequency). To test the role of Harmonicity in real-world sound segregation, we developed speech analysis/synthesis tools to perturb the carrier frequencies of speech, disrupting harmonic frequency relations while maintaining the spectrotemporal envelope that determines phonemic content. We find that violations of Harmonicity cause individual frequencies of speech to segregate from each other, impair the intelligibility of concurrent utterances despite leaving intelligibility of single utterances intact, and cause listeners to lose track of target talkers. However, additional segregation deficits result from replacing harmonic frequencies with noise (simulating whispering), suggesting additional grouping cues enabled by voiced speech excitation. Our results demonstrate acoustic grouping cues in real-world sound segregation.
-
inharmonic speech reveals the role of Harmonicity in the cocktail party problem
Nature Communications, 2018Co-Authors: Sara Popham, Dana Boebinger, Dan P. W. Ellis, Hideki Kawahara, Josh H. McdermottAbstract:The "cocktail party problem" requires us to discern individual sound sources from mixtures of sources. The brain must use knowledge of natural sound regularities for this purpose. One much-discussed regularity is the tendency for frequencies to be harmonically related (integer multiples of a fundamental frequency). To test the role of Harmonicity in real-world sound segregation, we developed speech analysis/synthesis tools to perturb the carrier frequencies of speech, disrupting harmonic frequency relations while maintaining the spectrotemporal envelope that determines phonemic content. We find that violations of Harmonicity cause individual frequencies of speech to segregate from each other, impair the intelligibility of concurrent utterances despite leaving intelligibility of single utterances intact, and cause listeners to lose track of target talkers. However, additional segregation deficits result from replacing harmonic frequencies with noise (simulating whispering), suggesting additional grouping cues enabled by voiced speech excitation. Our results demonstrate acoustic grouping cues in real-world sound segregation.
-
the role of harmonic spectral structure in the cocktail party problem
Journal of the Acoustical Society of America, 2016Co-Authors: Josh H. Mcdermott, Sara Popham, Dana BoebingerAbstract:Harmonicity is believed to provide an important acoustic grouping cue underlying sound segregation, though the mechanisms by which this occur, and its importance in real-world conditions, remain unclear. To test the role of Harmonicity in the segregation of speech, we used a modified version of the STRAIGHT methodology for speech resynthesis to manipulate the fine-grained spectral structure of otherwise natural-sounding speech tokens. We then measured the ability of human listeners on two tasks: speech comprehension—of individual speech tokens in isolation, of speech in noise, and of speech presented concurrently with other tokens—and detection of a mistuned harmonic. We tested the importance of Harmonicity in both tasks by jittering harmonic frequencies up or down by a small amount, rendering the speech inharmonic. We tested the importance of familiar spectral structure by deleting even-numbered harmonics. This latter manipulation left only the odd harmonics, a spectral pattern that, while harmonic, does...
Zhenqing Chen - One of the best experts on this subject based on the ideXlab platform.
-
on notions of Harmonicity
arXiv: Probability, 2008Co-Authors: Zhenqing ChenAbstract:In this paper, we address the equivalence of the analytic and probabilistic notions of Harmonicity in the context of general symmetric Hunt processes on locally compact separable metric spaces. Extensions to general symmetric right processes on Lusin spaces including infinite dimensional spaces are mentioned at the end of this paper.
-
Multidimensional symmetric stable processes
Korean Journal of Computational & Applied Mathematics, 1999Co-Authors: Zhenqing ChenAbstract:This paper surveys recent remarkable progress in the study of potential theory for symmetric stable processes. It also contains new results on the two-sided estimates for Green functions, Poisson kernels and Martin kernels of discontinuous symmetric α-stable process in bounded C ^1,1 open sets. The new results give explicit information on how the comparing constants depend on parameter α and consequently recover the Green function and Poisson kernel estimates for Brownian motion by passing α ↑ 2. In addition to these new estimates, this paper surveys recent progress in the study of notions of Harmonicity, integral representation of harmonic functions, boundary Harnack inequality, conditional gauge and intrinsic ultracontractivity for symmetric stable processes. Here is a table of contents. 1. Introduction 2. Green function and Poisson kernel estimates 2.1. Estimates on balls 2.2. Estimates on bounded C ^1,1 domains 2.3. Estimates on bounded C ^1,1 open sets 3. Harmonic functions and integral representation 3.1. Two notions of Harmonicity 3.2. Martin kernel and Martin boundary 3.3. Integral representation and uniqueness 3.4. Boundary Harnack principle 3.5. Conditional process and its limiting behavior 4. Conditional gauge and intrinsic ultracontractivity
-
Multidimensional symmetric stable processes
Korean Journal of Computational & Applied Mathematics, 1999Co-Authors: Zhenqing ChenAbstract:This paper surveys recent remarkable progress in the study of potential theory for symmetric stable processes. It also contains new results on the two-sided estimates for Green functions, Poisson kernels and Martin kernels of discontinuous symmetric α-stable process in bounded C ^1,1 open sets. The new results give explicit information on how the comparing constants depend on parameter α and consequently recover the Green function and Poisson kernel estimates for Brownian motion by passing α ↑ 2. In addition to these new estimates, this paper surveys recent progress in the study of notions of Harmonicity, integral representation of harmonic functions, boundary Harnack inequality, conditional gauge and intrinsic ultracontractivity for symmetric stable processes. Here is a table of contents. 1. Introduction 2. Green function and Poisson kernel estimates 2.1. Estimates on balls 2.2. Estimates on bounded C ^1,1 domains 2.3. Estimates on bounded C ^1,1 open sets 3. Harmonic functions and integral representation 3.1. Two notions of Harmonicity 3.2. Martin kernel and Martin boundary 3.3. Integral representation and uniqueness 3.4. Boundary Harnack principle 3.5. Conditional process and its limiting behavior 4. Conditional gauge and intrinsic ultracontractivity
Giovanni Calvaruso - One of the best experts on this subject based on the ideXlab platform.
-
Harmonicity of vector fields on four-dimensional generalized symmetric spaces
Central European Journal of Mathematics, 2012Co-Authors: Giovanni CalvarusoAbstract:Let ( M = G/H;g )denote a four-dimensional pseudo-Riemannian generalized symmetric space and g = m + h the corresponding decomposition of the Lie algebra g of G . We completely determine the Harmonicity properties of vector fields belonging to m. In some cases, all these vector fields are critical points for the energy functional restricted to vector fields. Vector fields defining harmonic maps are also classified, and the energy of these vector fields is explicitly calculated.
-
Harmonic morphisms and Riemannian geometry of tangent bundles
Annals of Global Analysis and Geometry, 2010Co-Authors: Giovanni Calvaruso, Domenico PerroneAbstract:Let (TM, G) and \({(T_1 M,\tilde G)}\) respectively denote the tangent bundle and the unit tangent sphere bundle of a Riemannian manifold (M, g), equipped with arbitrary Riemannian g-natural metrics. After studying the geometry of the canonical projections π : (TM, G) → (M, g) and \({\pi_1:(T_1 M,\tilde G) \rightarrow (M,g)}\), we give necessary and sufficient conditions for π and π 1 to be harmonic morphisms. Some relevant classes of Riemannian g-natural metrics will be characterized in terms of Harmonicity properties of the canonical projections. Moreover, we study the Harmonicity of the canonical projection \({\Phi:(TM-\{0\},G)\to (T_1 M,\tilde G)}\) with respect to Riemannian g-natural metrics \({G,\tilde G}\) of Kaluza–Klein type.
-
Harmonicity of unit vector fields with respect to riemannian g natural metrics
Differential Geometry and Its Applications, 2009Co-Authors: Mohamed Tahar Kadaoui Abbassi, Giovanni Calvaruso, Domenico PerroneAbstract:Abstract Let ( M , g ) be a compact Riemannian manifold and T 1 M its unit tangent sphere bundle. Unit vector fields defining harmonic maps from ( M , g ) to ( T 1 M , g ˜ s ) , g ˜ s being the Sasaki metric on T 1 M , have been extensively studied. The Sasaki metric, and other well known Riemannian metrics on T 1 M , are particular examples of g-natural metrics. We equip T 1 M with an arbitrary Riemannian g-natural metric G ˜ , and investigate the Harmonicity of a unit vector field V of M, thought as a map from ( M , g ) to ( T 1 M , G ˜ ) . We then apply this study to characterize unit Killing vector fields and to investigate Harmonicity properties of the Reeb vector field of a contact metric manifold.
Sara Popham - One of the best experts on this subject based on the ideXlab platform.
-
Inharmonic speech reveals the role of Harmonicity in the cocktail party problem
Nature Communications, 2018Co-Authors: Sara Popham, Dana Boebinger, Dan P. W. Ellis, Hideki Kawahara, Josh H. McdermottAbstract:Harmonicity is associated with a single sound source and may be a useful cue with which to segregate the speech of multiple talkers. Here the authors introduce a method for perturbing the constituent frequencies of speech and show that violating Harmonicity degrades intelligibility of speech mixtures. The “cocktail party problem” requires us to discern individual sound sources from mixtures of sources. The brain must use knowledge of natural sound regularities for this purpose. One much-discussed regularity is the tendency for frequencies to be harmonically related (integer multiples of a fundamental frequency). To test the role of Harmonicity in real-world sound segregation, we developed speech analysis/synthesis tools to perturb the carrier frequencies of speech, disrupting harmonic frequency relations while maintaining the spectrotemporal envelope that determines phonemic content. We find that violations of Harmonicity cause individual frequencies of speech to segregate from each other, impair the intelligibility of concurrent utterances despite leaving intelligibility of single utterances intact, and cause listeners to lose track of target talkers. However, additional segregation deficits result from replacing harmonic frequencies with noise (simulating whispering), suggesting additional grouping cues enabled by voiced speech excitation. Our results demonstrate acoustic grouping cues in real-world sound segregation.
-
inharmonic speech reveals the role of Harmonicity in the cocktail party problem
Nature Communications, 2018Co-Authors: Sara Popham, Dana Boebinger, Dan P. W. Ellis, Hideki Kawahara, Josh H. McdermottAbstract:The "cocktail party problem" requires us to discern individual sound sources from mixtures of sources. The brain must use knowledge of natural sound regularities for this purpose. One much-discussed regularity is the tendency for frequencies to be harmonically related (integer multiples of a fundamental frequency). To test the role of Harmonicity in real-world sound segregation, we developed speech analysis/synthesis tools to perturb the carrier frequencies of speech, disrupting harmonic frequency relations while maintaining the spectrotemporal envelope that determines phonemic content. We find that violations of Harmonicity cause individual frequencies of speech to segregate from each other, impair the intelligibility of concurrent utterances despite leaving intelligibility of single utterances intact, and cause listeners to lose track of target talkers. However, additional segregation deficits result from replacing harmonic frequencies with noise (simulating whispering), suggesting additional grouping cues enabled by voiced speech excitation. Our results demonstrate acoustic grouping cues in real-world sound segregation.
-
the role of harmonic spectral structure in the cocktail party problem
Journal of the Acoustical Society of America, 2016Co-Authors: Josh H. Mcdermott, Sara Popham, Dana BoebingerAbstract:Harmonicity is believed to provide an important acoustic grouping cue underlying sound segregation, though the mechanisms by which this occur, and its importance in real-world conditions, remain unclear. To test the role of Harmonicity in the segregation of speech, we used a modified version of the STRAIGHT methodology for speech resynthesis to manipulate the fine-grained spectral structure of otherwise natural-sounding speech tokens. We then measured the ability of human listeners on two tasks: speech comprehension—of individual speech tokens in isolation, of speech in noise, and of speech presented concurrently with other tokens—and detection of a mistuned harmonic. We tested the importance of Harmonicity in both tasks by jittering harmonic frequencies up or down by a small amount, rendering the speech inharmonic. We tested the importance of familiar spectral structure by deleting even-numbered harmonics. This latter manipulation left only the odd harmonics, a spectral pattern that, while harmonic, does...
