News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
 
What sound does a singing body make?
 

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
 
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
 
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
 
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
 
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
 
Professor Macefield says the experiment aims to produce unique music.
 
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
 
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
 
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
 
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

EU Court Fines Poland for Hosting CIA 'Black Sites'

Ruling is first time a court has acknowledged suspects were held and tortured at the sites, under US program launched following the 9/11 terrorist attacks More

Migrant Issues Close to Home Spur Groups to Take Action

Groups placing water, food in the desert, or aiding detainees after release, have one common goal: no more deaths of migrants crossing illegally into the US More

Video At AIDS Conference, Prevention Pill Stirs Excitement

Truveda shows promise, spurring debate over access and other approaches More

This forum has been closed.
Comments
     
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
Israel Targets Gaza Supply Tunnelsi
X
July 24, 2014 4:42 AM
The Israeli military has launched a ground operation in Gaza to destroy the myriad tunnels that may have been used to smuggle weapons to Hamas. VOA's Zlatica Hoke reports that could mean more hardship for the people of Gaza, who obtain some of their essential supplies through these underground passages
Video

Video Israel Targets Gaza Supply Tunnels

The Israeli military has launched a ground operation in Gaza to destroy the myriad tunnels that may have been used to smuggle weapons to Hamas. VOA's Zlatica Hoke reports that could mean more hardship for the people of Gaza, who obtain some of their essential supplies through these underground passages
Video

Video MH17's 'Black Boxes' Could Reveal Crash Details

The government of Malaysia now has custody of the cockpit voice and flight data recorders from Malaysia Airlines Flight 17, which was hit by a missile over Ukraine before crashing last week. As VOA's Carolyn Presutti reports, the so-called black boxes may hold information about the final minutes of the flight.
Video

Video Living in the Shadows Panel Discussion

Following a screening of the new VOA documentary, "AIDS - Living in the Shadows," at the World AIDS conference in Melbourne, a panel discussed the film and how to combat the stigma associated with HIV/AIDS.
Video

Video IAEA: Iran Turns its Enriched Uranium Into Less Harmful Form

Iran has converted its stockpiles of enriched uranium into a less dangerous form that is more difficult to use for nuclear weapons, according to the United Nations’ Atomic Energy Agency. The move complies with an interim deal reached with Western powers on Iran's nuclear program last year, in exchange for easing of sanctions. Henry Ridgwell reports for VOA from London.
Video

Video Relic of Saint Draws Catholics Worried About Immigration Issue

A Roman Catholic saint who is a figure of devotion for those crossing the border into the United States is attracting believers concerned about the plight of undocumented immigrants. Mike O'Sullivan reports from Los Angeles, where a relic of Saint Toribio has drawn thousands to local churches.
Video

Video US Awards Medal of Honor for Heroics in Bloodiest of Afghan Battles

U.S. combat troops are withdrawing from Afghanistan, on pace to leave the country by the end of this year. But on Monday, U.S. President Barack Obama took time to honor a soldier whose actions while under fire in Afghanistan earned him the Medal of Honor. VOA's Jeff Seldin has more from the Pentagon.
Video

Video Ukraine Rebels Surrender MH17 Black Boxes

After days of negotiations, a senior separatist leader handed over two black boxes from an airliner downed over eastern Ukraine to Malaysian experts early Tuesday. While on Monday, the U.N. Security Council unanimously demanded that armed groups controlling the crash site allow safe and unrestricted access to the wreckage.
Video

Video In Cambodia, HIV Diagnosis Brings Deadly Shame

Although HIV/AIDS is now a treatable condition, a positive diagnosis is still a life altering experience. In Cambodia, people living with HIV are often disowned by friends, family and the community. This humiliation can be unbearable. We bring you one Cambodian woman’s struggle to overcome a life tragedy and her own HIV positive diagnosis.

AppleAndroid