Scientists reconstruct Pink Floyd song from brain signals

Thanks to Pink Floyd, scientists have made a new breakthrough, adding “another brick in the wall of our understanding of music processing in the human brain.”

New research published Tuesday in the journal PLoS Biology showed that scientists can train a computer to recreate a song based solely on the brain activity of someone listening to music.

Scientists were able to reconstruct a passable cover of Pink Floyd’s 1979 song, “Another Brick in the Wall (Part 1).”

“It’s a wonderful result,” co-author Robert T. Knight, a neurologist and UC Berkeley professor of psychology at the Helen Wills Neuroscience Institute, said in a media release. “One of the things for me about music is it has prosody and emotional content.”

This is the first time a recognizable song has been interpreted from nothing but recordings of electrical brain activity, giving hope that the new understanding of how people comprehend sound could eventually help improve devices for those with speech difficulties.

Scientists were able to reconstruct a passable cover of Pink Floyd’s 1979 song, “Another Brick in the Wall (Part 1).”
Michael Ochs Archives/Getty Images

Neuroscientists at the University of California, Berkeley, analyzed recordings from electrodes of 29 patients undergoing surgery for epilepsy as they listened to the Pink Floyd song.

They were able to identify thoughts connected to the tone, rhythm, harmony and words of the song by looking at the electrical activity of brain regions and comparing the brain signals with the song.

Pink Floyd’s lyrics, “All in all it was just a brick in the wall,” is audible in the reconstructed version of the song, with the rhythm unscathed.


Scientists have reconstructed Pink Floydâs Another Brick in the Wall by eavesdropping on peopleâs brainwaves â the first time a recognisable song has been decoded from recordings of electrical brain activity.
Anatomical location of song-responsive electrodes.
PLOS

They used intracranial electroencephalography (iEEG) — when a surgeon records electrical activity from the brain by placing electrodes inside the skull, according to Johns Hopkins Medicine — which can only record from the surface of the brain, as close to the auditory centers as possible.

“Noninvasive techniques are just not accurate enough today. Let’s hope, for patients, that in the future we could, from just electrodes placed outside on the skull, read activity from deeper regions of the brain with a good signal quality. But we are far from there,” co-author Ludovic Bellier said.

A region called the superior temporal gyrus was able to process the rhythm of the guitar in the song, while signals from the right hemisphere of the brain were more critical for processing music than the left.


A young man holds up a placard with a quote from Pink Floyd's song "Another Brick in the Wall" as students, teachers and sympathizer block the traffic on Margit Bridge to protest against the government's education policy in Budapest, on October 5, 2022, the International Teachers' Day. - People took to the streets in the Hungarian capital on Wednesday to demand better living, working and financial conditions for teaching staff on the International Teachers' Day. (Photo by Attila KISBENEDEK / AFP) (Photo by ATTILA KISBENEDEK/AFP via Getty Images)
Pink Floyd’s lyrics “All in all it was just a brick in the wall” is audible in the reconstructed version of the song, with the rhythm unscathed.
ATTILA KISBENEDEK/AFP via Getty Images

These recordings from electrodes on the brain surface could be beneficial to reproducing the musicality of speech for people who have trouble communicating, whether from stroke or paralysis.

“As this whole field of brain machine interfaces progresses, this gives you a way to add musicality to future brain implants for people who need it, someone who’s got ALS or some other disabling neurological or developmental disorder compromising speech output,” Knight explained.

“It gives you an ability to decode not only the linguistic content, but some of the prosodic content of speech, some of the affect. I think that’s what we’ve really begun to crack the code on.”

Read the full article Here

Leave a Reply

Your email address will not be published. Required fields are marked *

DON’T MISS OUT!
Subscribe To Newsletter
Be the first to get latest updates and exclusive content straight to your email inbox.
Stay Updated
Give it a try, you can unsubscribe anytime.
close-link