Take control of your hearing: Accessible methods to build a smart noise filter

Have you ever wanted more control over what you do or don't hear? This talk explores the potential of Python, deep learning, and open databases to bring you towards that goal, without needing expensive licenses or software.


We are all affected by sound waves, whether we hear them or not. Therefore, the potential is vast, what open resources can offer us to become masters of our own sound experience. People who are deaf could build apps to alarm them if cars honk, and from which direction; people with intact hearing could build a filter that lets them hear only birds sing, if they tire of human voices. Smart filters can potentially reduce hearing loss as well as stress for those living or working in noisy environments.

The problem potential developers and users of smart filtering techniques face is the large number of barriers standing in front of them. Often access to the relevant resources, such as hardware, software, and data (e.g. for training neural networks), either require a hefty fee, a good health insurance, an amazing employer, or a position at a successful academic or research institution. Furthermore, the mathematics behind that of sound, specifically digital signal processing, as well as deep learning algorithms can be quite intimidating and difficult to penetrate for outsiders.

In this talk, we share what we’ve learned building a low-computational smart noise filter for the purpose of speech enhancement via mobile device (e.g. smart phone). We will offer an overview of how we used Python to create not only a functional smart noise filter, but a potential learning tool to help others understand and interact with the math behind it. Important topics will include the gray area of ‘high performance’ in deep learning as well as acoustic filtering. We will also talk about the pros and cons of using open audio databases and how people can contribute to them to increase their already great value.


Python Skill Level:

basic

Domain Expertise:

none

Domains:

Artificial Intelligence, Algorithms, Computer Vision, Deep Learning, Data Science, Machine Learning, Science

Abstract as a tweet:

Control what you hear with deep learning and open audio databases. The developer and manager of \NoIze//, a project supported by Prototype Fund, share what’s helped them build an open source smart, low-computational noise filter in Python.

Public link to supporting material:

https://github.com/pgys/NoIze