Interviews

On Wandering the Paths of a Spotify Analyst's Mad Music Map

Tristan Kneschke

Every Noise's curious constellation will fascinate even the casual listener, but its data madness is a puzzle.

Have you ever wondered how many music genres there are? Spotify data analyst Glenn McDonald has an answer to the question -- and he's built the map to illustrate it. Every Noise at Once catalogues over 1,500 genres ranging from the esoteric (modern uplift, deep discofox, power violence) to the outright bizarre (solipsynthm, terrorcore, and something called catstep). Clicking a style triggers its audio sample. A tiny arrow near the genre’s name leads to a smaller map collecting its artists. Bigger names are, well, bigger names. Choosing an artist leads to the corresponding Spotify artist page. Voilà! Instant music discovery. Search the main map by the genre or artist of your choice (who knew Radiohead were classified as melancholia?). Clicked genres feature a music note icon for remembering favorites.

The curious map arranges Patton Oswalt's acerbic comedy near the fizzling purity of the delta blues. Anime score's swirling strings are neighbors with freak folk and football anthems. Every Noise's curious constellation fascinates even the casual listener, but its data madness will also produce puzzled looks. According to McDonald, the map relies on 13 variables to cluster similar genres and artists. "The thirteen audio dimensions include tempo, loudness, energy, emotional valence and danceability," he says. "The vertical axis represents the spectrum from mechanistic to organic." Genres with rigid tempos and electronic instrumentation like tech house, minimal dub, and the peppy style of bubble trance are at the top of the page. "The bottom contains organic music, which combines acoustic instrumentation and variable human timing. They contain more of a human element." Classical piano, harp music, and expressive genres less concerned with metronomic timing live here.

The horizontal axis represents sonic density. On the left is the roaring crunch of cryptic black metal, but also classical organ, which is sonically dense but not as noisy. On the right, music is "bouncier", consisting of sharper noises and clear spaces between notes. Roots reggae, Turkish hip-hop, and less rhythmic, sparser styles like poetry reading fit the mold.

The microgenre explosion in the 21st century, aided by a combination of software advances, faster internet connections, and the globalized proliferation of music, has provided listeners with a comprehensive selection of styles, all of which are catalogued on Every Noise. McDonald prefers to think of genres as fuzzy, fluid. "I'm cheerfully unrigorous about what a genre can be. Some of them are musicological, some are historical, and others are regional themes. A genre can be any listening mode I think people might want." The map’s development was an experiment. "It all came about while I was looking for ways to crosscheck acoustic attributes. Aggregating them at the genre level helped determine whether they were working." McDonald realized some layouts were more visually interesting than others and settled on the scatter plot to represent the data. The color system also arose from a trial-and-error process to map three more of the 13 attributes using shades of red, green and blue. "The colors indicate dissimilar neighbors. For example, you can follow the blue-purple hues across the middle of the map to track a bunch of ambient, atmospheric genres that have different positions in the two-dimensional space, but share a timbral quality. The same organizational systems and colors are applied to the artist pages."

The map provides a new music excavating method, helping us find similar bands to Of Montreal (they're identified as "indie Christmas") based on their aggregation. Bands can pursue the scarce gaps in the topology to ensure they'll sound distinct from their peers.

The map goes deeper. When inside a genre, there are two inset maps under the main artist map. The first shows the genres closest to the one you're inside. Culturally-related genres share the same artists, as in Croatian pop and Croatian hip-hop. While not exactly filtering, it's a way to look at the data on a finer level and not get lost in the clutter of the main map.

The second inset map, in black, shows the styles furthest from the current genre. McDonald is eager to relate its creation. "This is a funny story. It was my goal to say, 'if you hate this style of music, then what's the farthest thing from it?' as presumably, you'd like that. But when I programmed it, I found the answer was always satanic black metal, esoteric tech house, classical piano or political speeches. Those four points were the extremes, and no matter where you were, one of those was the farthest away. That wasn't interesting. Months later it occurred to me to try to interpret the data in a different way to achieve a true inverse. So if your genre is slightly faster than average, the black map picks something slightly slower, with something that's equally conservative or extreme, but at the opposite polarity in each dimension. That turned out to be much more interesting." You can now spend hours marveling at how appropriate it is that trap's opposite is kraut rock.

A number of genres are designated "deep". Classical piano contains pianists most people are familiar with, while deep classical piano might collect artists who have won obscure piano competitions. Musically the genres could be virtually identical, as in classical, which relies on performing the canon. Deeper genres tend to correlate with different listeners and lesser plays. "In some cases, there are subtle but identifiable distinguishing characteristics. A particular flavor of tech house will actually tend to produce slightly different music. It will adhere more rigorously to some template. Its playlist will have a more consistent feel than one that's closer to the surface, where more influences and cross-genre stuff happens." Dive into the deep if you’re tired of the artists everybody knows about. Satisfy your inner hipster.

Genres are started, or "seeded", by identifying a set of artists. Creedence Clearwater Revival, The Who and Lynyrd Skynyrd would be a good seed for classic rock. The automation and data analysis that chooses other classic rock bands is a combination of how people listen, what the music sounds like, and what people say about it online. "We scrape millions of online sources a day, analyzing the text to figure out who it's about and what people are saying. The procedure figures out the words people use to describe a given artist." This isn't a perfect process, however. "Metal" might be associated with someone not currently in a metal band, but the terms describing most metal bands tend to be similar.

Even understanding Every Noise's functionality, the site has its limitations. For one, there's no way to sort the map, so it's not possible to see how many electronic genres have arisen since 2010, for example. However, there are some links to other data views at the bottom of the map. One of these, The Retromatic History of Music (or Love), maps genres across time. "It's a little mushy because the release dates we have are accurate generally, but subject to a lot of individual error." McDonald tried ranking the top songs of 1953, then realized 70 of the top 100 gathered were released in a different year. This is an intermittent problem with Spotify, which is where Every Noise gets its data. For example, industrial artist ohGr's 2001 debut Welt shows up as being released in 2003, coming ahead of 2003's Sunnypsyop, an inaccurate chronology. "In almost any year, you'll have individual errors. They don't invalidate the overall analysis, but they make it unsatisfying to make these types of playlists and charts."

The most common error is artist-name ambiguity. "If there were a global band-name registry, it would really help everybody. Absent that, we just have to fix stuff." A search for "Lee Jones" brings up the DJ and the singer-songwriter incorrectly combined into the same artist. "There's potential human involvement at almost any point, but we try to intervene in the least tedious ways. If a genre requires too much human oversight, we reconceive it as something to which the data lends itself more naturally."

Limitations aside, the map provides heaps of useful data, like which genres are the most popular. "Obviously hip-hop is huge and constantly evolving everywhere. Nearly every country has something interesting happening around hip-hop. Reggaeton-influenced versions are particularly hot in Latin America and southern Europe. Pop punk and second/third-generation emo are big with younger listeners now." Seems like teenage angst is universal, no matter the generation. The Every Noise list linked here analyzes youth demographics, the source of all music trends.

Though McDonald's day job at Spotify means intermittent work on Every Noise, the site's analysis is at the core of Spotify's analytics, determining how features appeal to different audiences. A recently implemented feature is the Daily Mix, functioning as a listener's personal genre. Some data techniques from Every Noise have been ported over to the popular listening app. "I'm centrally or peripherally involved in a lot of things. I meddle in stuff! 'The Sound of' playlists are entirely my end work on top of layers and layers of hundreds of other people. I also work on things feeding into the Related Artists. Every Noise is actually a fairly thin visualization layer over the categorization and similarity data, which gets used at different layers inside Spotify."

The mind behind the map

McDonald admits he hasn't added any new genres in a while, but will soon do another round. "Some of the underlying pieces got upgraded to better data sources and ideas. Every time we improve some part of the process, I identify things I hadn't before. Sometimes, it consolidates or splits things. It increases the resolution, if you will." Greater granularity will enable the data to identify new music scenes. "Ideally, I'd like to be able to distinguish between Lithuanian pop and Lithuanian hip-hop, but I can't because there just isn't enough of it. In some cases there's plenty of music but I don't have enough data to tease them apart. But each time we improve something, that becomes more possible." That possibility is what musical freedom is all about.

Tristan Kneschke has contributed to Hyperallergic, Decoder Magazine, The Wild Honey Pie, Echoes and Dust, No Film School, and others. He's the former Managing Editor for Subrewind and enjoys traveling to places his mother warns him about.

In the wake of Malcolm Young's passing, Jesse Fink, author of The Youngs: The Brothers Who Built AC/DC, offers up his top 10 AC/DC songs, each seasoned with a dash of backstory.

In the wake of Malcolm Young's passing, Jesse Fink, author of The Youngs: The Brothers Who Built AC/DC, offers up his top 10 AC/DC songs, each seasoned with a dash of backstory.

Keep reading... Show less

Pauline Black may be called the Queen of Ska by some, but she insists she's not the only one, as Two-Tone legends the Selecter celebrate another stellar album in a career full of them.

Being commonly hailed as the "Queen" of a genre of music is no mean feat, but for Pauline Black, singer/songwriter of Two-Tone legends the Selecter and universally recognised "Queen of Ska", it is something she seems to take in her stride. "People can call you whatever they like," she tells PopMatters, "so I suppose it's better that they call you something really good!"

Keep reading... Show less

Morrison's prose is so engaging and welcoming that it's easy to miss the irreconcilable ambiguities that are set forth in her prose as ineluctable convictions.

It's a common enough gambit in science fiction. Humans come across a race of aliens that appear to be entirely alike and yet one group of said aliens subordinates the other, visiting violence upon their persons, denigrating them openly and without social or legal consequence, humiliating them at every turn. The humans inquire why certain of the aliens are subjected to such degradation when there are no discernible differences among the entire race of aliens, at least from the human point of view. The aliens then explain that the subordinated group all share some minor trait (say the left nostril is oh-so-slightly larger than the right while the "superior" group all have slightly enlarged right nostrils)—something thatm from the human vantage pointm is utterly ridiculous. This minor difference not only explains but, for the alien understanding, justifies the inequitable treatment, even the enslavement of the subordinate group. And there you have the quandary of Otherness in a nutshell.

Keep reading... Show less
3

A 1996 classic, Shawn Colvin's album of mature pop is also one of best break-up albums, comparable lyrically and musically to Joni Mitchell's Hejira and Bob Dylan's Blood on the Tracks.

When pop-folksinger Shawn Colvin released A Few Small Repairs in 1996, the music world was ripe for an album of sharp, catchy songs by a female singer-songwriter. Lilith Fair, the tour for women in the music, would gross $16 million in 1997. Colvin would be a main stage artist in all three years of the tour, playing alongside Liz Phair, Suzanne Vega, Sheryl Crow, Sarah McLachlan, Meshell Ndegeocello, Joan Osborne, Lisa Loeb, Erykah Badu, and many others. Strong female artists were not only making great music (when were they not?) but also having bold success. Alanis Morissette's Jagged Little Pill preceded Colvin's fourth recording by just 16 months.

Keep reading... Show less
9

Frank Miller locates our tragedy and warps it into his own brutal beauty.

In terms of continuity, the so-called promotion of this entry as Miller's “third" in the series is deceptively cryptic. Miller's mid-'80s limited series The Dark Knight Returns (or DKR) is a “Top 5 All-Time" graphic novel, if not easily “Top 3". His intertextual and metatextual themes resonated then as they do now, a reason this source material was “go to" for Christopher Nolan when he resurrected the franchise for Warner Bros. in the mid-00s. The sheer iconicity of DKR posits a seminal work in the artist's canon, which shares company with the likes of Sin City, 300, and an influential run on Daredevil, to name a few.

Keep reading... Show less
8
Pop Ten
Mixed Media
PM Picks

© 1999-2017 Popmatters.com. All rights reserved.
Popmatters is wholly independently owned and operated.

rating-image