Search by sound

This article needs additional citations for verification. Please help by adding citations to reliable sources. Unsourced material may be challenged and removed. Find sources:  –  ·  ·  · scholar · JSTOR (June 2020) (Learn how and when to remove this template message)

Search by sound is the retrieval of information based on audio input. There are a handful of applications, specifically for mobile devices that utilize search by sound. Shazam (service), Soundhound (previously Midomi), Axwave, ACRCloud and others have seen considerable success by using a simple algorithm to match an acoustic fingerprint to a song in a library. These applications take a sample clip of a song, or a user-generated melody and check a music library/music database to see where the clip matches with the song. From there, song information will queried and displayed to the user.

These kind of applications are mainly used for finding a song that the user does not already know. Searching by sound is not limited to just identifying songs, but also for identifying melodies, tunes or advertisements, and video files.

Acoustic fingerprinting[]

The way these apps search by sound is through generating an acoustic fingerprint; a digital summary of the sound. A microphone is used to pick up an audio sample, which is then broken down into a simple numeric signature, a code unique to each track. Using the same method of fingerprinting sounds, when Shazam picks up a sound clip, it will generate a signature for that clip. Then it’s simple pattern matching from there using an extensive audio music database.

The practice of using acoustic fingerprints is not limited to just music, however, but other areas of the entertainment business as well. Shazam also can identify television shows with the same technique of acoustic fingerprinting. Of course, this method of breaking down a sound sample into a unique signature is useless unless there is an extensive database of music with keys to match with the samples. Shazam has over 11 million songs in its database.^[1]

Other services such as Midomi and Soundhound allow users to add to that library of music in order to expand the chances to match a sound sample with its corresponding sound.

Query by humming[]

Midomi and Soundhound both offer query by humming. This is a branch off of acoustic fingerprints but is still a musical retrieval system. After receiving a user-generated hummed melody, which is the input query, the system returns a ranked list of songs that are closest to the user query.

See also[]

• AmpliFIND
• Automatic content recognition
• List of online music databases
• Music information retrieval
• Sound recognition

References[]