News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
 
What sound does a singing body make?
 

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
 
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
 
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
 
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
 
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
 
Professor Macefield says the experiment aims to produce unique music.
 
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
 
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
 
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
 
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

Turkish Public Fears Jihadists More Than Kurds

Turkey facing twin threats of terrorism by Islamic State and PKK Kurdish separatists, says President Erdogan’s ruling AK Party More

Video One Year After Massacre, Iraq’s Yazidis a Broken People

Minority community still recovering from devastating assault by IS militants which spurred massive outrage More

‘Malvertisements’ Undermine Internet Trust

Hackers increasingly prey on users' trust of major websites to delivery malicious software More

This forum has been closed.
Comments
     
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
Iraqi Yazidis Fear Death of Their Communityi
X
Sharon Behn
August 03, 2015 2:23 PM
A year ago on August 3, Islamic State militants stormed the homelands of Iraq’s Yazidi minority, killing hundreds of men and enslaving thousands of women. The scenes of desperate Yazidi families crowding on the top of Sinjar mountain without food or water spurred Kurdish fighters into action, an emergency airlift and the start of the U.S. airstrike campaign against the Islamic State Sunni extremists. VOA's Sharon Benh reports from northern Iraq.
Video

Video Iraqi Yazidis Fear Death of Their Community

A year ago on August 3, Islamic State militants stormed the homelands of Iraq’s Yazidi minority, killing hundreds of men and enslaving thousands of women. The scenes of desperate Yazidi families crowding on the top of Sinjar mountain without food or water spurred Kurdish fighters into action, an emergency airlift and the start of the U.S. airstrike campaign against the Islamic State Sunni extremists. VOA's Sharon Benh reports from northern Iraq.
Video

Video Bangkok Warned It Soon Could Be Submerged

Italy's Venice and America's New Orleans are not the only cities gradually submerging. The nearly ten million residents of the Bangkok urban area now must confront warnings the city could become uninhabitable in a few decades. VOA Correspondent Steve Herman reports from the Thai capital.
Video

Video Inclusive Gym Gets People With Disabilities in Fitness Spirit

Individuals with special needs are 58 percent more likely to be obese than the general population. According to the U.S. Centers for Disease Control, they also have an increased likelihood of anxiety, depression and social isolation. But a sports club outside Washington wants to make a difference in these people's lives. With Carol Pearson narrating, VOA's June Soh reports.
Video

Video Astronauts Train Underwater for Deep Space Missions

Manned deep space missions are still a long way off, but space agencies are already testing procedures, equipment and human stamina for operations in extreme environment conditions. Small groups of astronauts take turns in spending days in an underwater lab, off Florida’s southern coast, simulating future missions to some remote world. VOA’s George Putic reports.
Video

Video Special Olympics Show Competitors' Skill, Determination

Special Olympics competitions will wrap up Saturday in Los Angeles, and the closing ceremony for athletes with intellectual disabilities will be held Sunday night. In a week of competition, athletes have shown what they can do through skill and determination. VOA's Mike O'Sullivan reports.
Video

Video Civil Rights Leaders Struggled to Achieve Voting Rights Act

Fifty years ago, lawmakers approved, and U.S. President Lyndon Johnson signed, the Voting Rights Act of 1965. The measure outlawed racial discrimination in voting, giving millions of blacks in many parts of the southern United States federal enforcement of the right to vote. Correspondent Chris Simkins introduces us to some civil rights leaders who were on the front lines in the struggle for voting rights.
Video

Video Shooter’s Grill: Serving Food with a Touch of the Second Amendment

Shooter's Grill, a restaurant in Rifle, Colorado, attracts visitors from all over the world as well as local patrons. The reason? Waitresses openly carry loaded firearms as they serve food, and customers are welcome to carry them, too. VOA's Enming Liu and Lin Yang paid a visit to Shooter's Grill, and heard different opinions about this unique establishment.
Video

Video Despite Controversy, Business Owner Continues Sale of Confederate Flags

At Cooter’s, a store in rural Sperryville, Virginia, about 120 kilometers west of Washington, D.C., Confederate flags are flying off the shelves. The red, white and blue battle flag, with 13 white stars representing the Confederate states, was carried by southern forces during the U.S. Civil War in the 1860s. The South had seceded from the Union over several key issues of disagreement, including slavery. VOA’s Deborah Block has the story.
Video

Video Booming London Property a ‘Haven for Dirty Money’

Billions of dollars of so-called ‘dirty money’ from the proceeds of crime - especially from Russia - are being laundered through the London property market, according to anti-corruption activists. As Henry Ridgwell reports from the British capital, the government has pledged to crack down on the practice.
Video

Video Hometown of Boy Scouts of America Founder Reacts to Gay Leader Decision

Ottawa, Illinois, is the hometown of W.D. Boyce, who founded the Boy Scouts of America in 1910. In Ottawa, where Scouting remains an important part of the legacy of the community, the end of the organization's ban on openly gay adult leaders was seen as inevitable. VOA's Kane Farabaugh reports.

VOA Blogs