News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
 
What sound does a singing body make?
 

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
 
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
 
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
 
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
 
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
 
Professor Macefield says the experiment aims to produce unique music.
 
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
 
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
 
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
 
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

Ukraine Purges Interior Ministry Leadership With Pro-Russian Ties

Interior Minister Avakov says 91 people 'in positions of leadership' have been fired, including 8 generals found to have links to past pro-Moscow governments More

US Airlines Point to Additional Problems of any Ebola Travel Ban

Airline officials note that even under travel ban, they may not be able to determine where passenger set out from, as there are no direct flights from Liberia, Guinea or Sierra Leone More

Nigerian President to Seek Another Term

Goodluck Jonathan has faced intense criticism for failing to stop Boko Haram militants More

This forum has been closed.
Comments
     
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
Talks to Resume on Winter Gas for Ukrainei
X
Al Pessin
October 25, 2014 4:21 PM
Ukrainian and Russian officials will meet again next week in an effort to settle their dispute over natural gas supplies that threatens to leave Ukraine short of heating fuel for the coming winter. VOA’s Al Pessin reports from London the dispute is complex, and has both economic and geopolitical dimensions.
Video

Video Talks to Resume on Winter Gas for Ukraine

Ukrainian and Russian officials will meet again next week in an effort to settle their dispute over natural gas supplies that threatens to leave Ukraine short of heating fuel for the coming winter. VOA’s Al Pessin reports from London the dispute is complex, and has both economic and geopolitical dimensions.
Video

Video Smugglers Offer Cheap Passage From Turkey to Syria

Smugglers in Turkey offer a relatively cheap passage across the border into Syria. Ankara has stepped up efforts to stem the flow of foreign fighters who want to join Islamic State militants fighting for control of the Syrian border city of Kobani. But porous borders and border guards who can be bribed make illegal border crossings quite easy. Zlatica Hoke has more.
Video

Video China Political Meeting Seeks to Improve Rule of Law

China’s communist leaders will host a top level political meeting this week, called the Fourth Plenum, and for the first time in the party’s history, rule of law will be a key item on the agenda. Analysts and Chinese media reports say the meetings could see the approval of long-awaited measures aimed at giving courts more independence and include steps to enhance an already aggressive and high-reaching anti-corruption drive. VOA’s Bill Ide has more from Beijing.
Video

Video After Decades of Pressure, Luxembourg Drops Bank Secrecy Rules

European Union finance ministers have reached a breakthrough agreement that will make it more difficult for tax cheats to hide their money. The new legislation, which had been blocked for years by countries with a reputation as tax havens, was approved last week after Luxembourg and Austria agreed to lift their vetoes. But as Mil Arcega reports, it doesn’t mean tax cheats have run out of places to keep their money hidden.
Video

Video Kobani Refugees Welcome, Turkey Criticizes, US Airdrop

Residents of Kobani in northern Syria have welcomed the airdrop of weapons, ammunition and medicine to Kurdish militia who are resisting the seizure of their city by Islamic State militants. The Turkish government, however, has criticized the operation. VOA’s Scott Bobb reports from southeastern Turkey, across the border from Kobani.
Video

Video US ‘Death Cafes’ Put Focus on the Finale

In contemporary America, death usually is a topic to be avoided. But the growing “death café” movement encourages people to discuss their fears and desires about their final moments. VOA’s Jerome Socolovsky reports.
Video

Video Ebola Orphanage Opens in Sierra Leone

Sierra Leone's first Ebola orphanage has opened in the Kailahun district. Hundreds of children orphaned since the beginning of the Ebola outbreak face stigma and rejection with nobody to care for them. Adam Bailes reports for VOA about a new interim care center that's aimed at helping the growing number of children affected by Ebola.

All About America

AppleAndroid