We previously wrote about our work on deep neural networks for speech enhancement. In late August, we presented our newest results as a paper and a poster at the speech technology conference Interspeech 2017 in Stockholm, Sweden.
News
MobileEars: An app-based hearing aid
A lot of people could use some help with their hearing, but getting a hearing aid has traditionally been a big, time-consuming, and expensive step. As we reported earlier, the Oslo-based company Listen have therefore been developing an app in collaboration with SINTEF that turns your iPhone into a hearing aid.
Their first app, MobileEars, was released this week, and is now available for free download from the App Store. You can see a promotional video for the app below the break.
Speech Enhancement with Deep Learning
Using deep learning to improve the intelligibility of noise-corrupted speech signals
Speech is key to our ability to communicate. We already use recorded speech to communicate remotely with other humans and we will get more and more used to machines that simply ‘listen’ to us. However, we want our phones, laptops, hearing aids, voice controlled and/or Internet of Things (IoT) devices to work in every environment — the majority of environments being noisy.
This creates the need for speech enhancement techniques that remove noise from recorded speech signals. Yet, as of today, there are no noise-filtering strategies that significantly help people understand single-channel noisy speech, and even state-of-the-art voice assistants fail miserably in noisy environments. Some recent publications on speech enhancement show that deep learning, a machine learning subfield based on deep neural networks (DNNs), will become a game-changer in the field of speech enhancement. See for example reference [1] below.
In this blog post we will go through a relatively simple implementation of Deep Learning to speech enhancement. Scroll down to the end of this post if you just want to know what the resulting enhanced samples can sound like.
Project: I Hear You! A new hearing service in Tanzania
Sharleen is an African girl, 9 years old, from a family of farmers. She is quite smart, but no longer goes to school.
Why?
Sharleen has a hearing impairment, and couldn’t understand what the teacher was saying. Her father thought he needed her at home to look after the goats. Unfortunately, Sharleen is just one among many children lacking help.
WHO has estimated that over 5% of the world population – 360 million people – has a hearing impairment (328 million adult and 32 million children), and the majority of children with hearing impairment live in low-income countries. In contrast, less than 2% of the hearing aids produced in 2005 went to low income countries.
Traditional hearing devices are advanced equipment; expensive, fragile and not developed for the Third World. Specialised personnel and complex infrastructure in the individual fitting process is needed, reducing the usefulness of such complex hearing aids to a minimum in low-income countries, where trained people and specialists are scarce.
With funding from Norwegian Research Council, SINTEF’s project “I Hear You”, starting early 2017, aims to help children like Sharleen by ensuring access to education for the hearing impaired.
Read more…Project: I Hear You! A new hearing service in Tanzania
Video: Take care of your hearing!
Noise-induced hearing loss is a result of exposure to loud sounds over a long time, or to one extremely loud impulse. In addition to permanent loss of hearing, tinnitus is a common symptom. While this is the most common permanent injury in the world, it is also preventable through hearing protection equipment and safe working practices.
We have acted as scientific consultants for a new five-minute information video from Honeywell on this topic. You can see the entire video here!
Truls Gjestland, Fellow of the Acoustical Society of America
Our very own Truls Gjestland has been elected a Fellow of the Acoustical Society of America, by action of their Executive Council. This honour was bestowed on Truls due to the contributions that he has made throughout his career to research and standards development on transportation noise effects on communities.
The formal announcement and Fellowship certificate presentation will be made at the ASA meeting in Honolulu, on 30 November 2016.
Horn simulation using mode-matching
Horns are used in many fields, including musical wind instruments and loudspeakers. The physics in the two cases is of course the same: sound propagation in a flaring duct open at one end. Therefore we can in principle use the same simulation methods for both cases. But what we want to obtain from the horn simulation can be very different.
A very important requirement for horn loudspeakers is directivity control. This entails directing sound into a specific region in front of the horn, giving the same frequency response inside that region and little sound outside it. Any simulation method for horn speakers must be capable of predicting directivity. Horn speakers should not be resonant, but should present a constant and smooth acoustic load to the driving unit, so this is also an important, but somewhat less critical, factor in the design.
For wind instruments, we are usually interested in the resonance frequencies. This is important for the tone, intonation and playability, and it is useful if we can predict this when designing the instrument. Any simulation method must therefore be able to predict these frequencies accurately. Or we may have an old valuable instrument and want to find the internal shape without cutting it into pieces. Then we can use an optimization algorithm to solve the inverse problem of finding the internal shape from measured resonance frequencies. For this, the simulation method must be fast.
Proceedings of the 39th Scandinavian Symposium on Physical Acoustics
The 39th Scandinavian Symposium on Physical Acoustics was held at Geilo, Norway from January 31 to February 3, 2016. It was organised by Ulf Kristiansen and Erlend Magnus Viggen, both part of the Acoustics Research Centre. This year we had 48 participants holding 31 presentations, and 9 papers were written for the proceedings, which have been published through arXiv.org.
This link takes you to the proceedings.
Thanks to Sverre Holm and Josephine Børvan for the photo
Program of the 39th Scandinavian Symposium on Physical Acoustics
The 39th Scandinavian Symposium on Physical Acoustics will be held at Geilo Hotel from January 31st to February 3rd, 2016, and is organised by Ulf Kristiansen and Erlend Magnus Viggen at ARC. This year, there are 50 registered participants who will be holding a total of 32 talks on various topics such as sound propagation, ultrasonics, sonar technology, acoustics in solids, petroleum-related acoustics, and more. You can find the entire conference program below, and a printable version can be downloaded here.
Read more…Program of the 39th Scandinavian Symposium on Physical Acoustics
Presenting the MAUS project on traffic auralisation
In the MAUS project, we have developed a prototype of a traffic auralisation tool. The idea is to realistically imitate the sound of traffic, to give an idea of how it will sound in cases that have not been realised yet, and to show the effects of various noise-reducing measures. We have previously given a simple description of how the tool works together with sound examples on this blog.
In early December, we presented a paper and a poster on the MAUS auralisation tool at the 18th International Conference on Digital Audio Effects (DAFx-15) here in Trondheim. This conference was organized by the Music Technology and Acoustics groups at NTNU.
Read more…Presenting the MAUS project on traffic auralisation