News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
 
What sound does a singing body make?
 

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
 
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
 
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
 
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
 
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
 
Professor Macefield says the experiment aims to produce unique music.
 
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
 
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
 
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
 
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

Uganda Court Annuls Anti-Gay Law

Court says law was passed in parliament without enough members present for a full quorum More

Multimedia Thailand Makes Efforts to Improve Conditions for Migrant Laborers

In Thailand, its not uncommon for parents to bring their children to work; one company, in-collaboration with other organizations, address safety concerns More

In Indonesia, Jihad Video Raises Concern

Video calls on Indonesians to join Islamic State of Iraq and the Levant, ISIL More

This forum has been closed.
Comments
     
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
In Thailand, Some Efforts to Improve Conditions For Migrant Laborersi
X
Steve Herman
August 01, 2014 6:22 PM
Thailand has been facing increasing international scrutiny as a hub of human trafficking and slave labor. Some of the kingdom’s companies are striving to improve working conditions, especially for the millions of migrant laborers from surrounding countries. VOA Correspondent Steve Herman in Bangkok takes a look at one initiative for children at construction sites
Video

Video In Thailand, Some Efforts to Improve Conditions For Migrant Laborers

Thailand has been facing increasing international scrutiny as a hub of human trafficking and slave labor. Some of the kingdom’s companies are striving to improve working conditions, especially for the millions of migrant laborers from surrounding countries. VOA Correspondent Steve Herman in Bangkok takes a look at one initiative for children at construction sites
Video

Video Public Raises its Voice on Power Plant Pollution

In the United States, proposed rules to cut pollution from the nation’s 600 coal-fired power plants are generating a heated debate. The U.S. Environmental Protection Agency, charged with writing and implementing the plan, has already received 300,000 written comments. As VOA’s Rosanne Skirble reports, another 1,600 people are lining up this week at EPA headquarters and at satellite offices around the country to give their testimony in person.
Video

Video Information War Rages Alongside Real One in Ukraine

The downing of the Malaysian airliner two weeks ago, and allegations that Russians are shelling Ukrainian troops across the border, have moved the information war swirling around the Ukrainian conflict to a new level. VOA's Al Pessin reports from Kyiv.
Video

Video When Fighting Eases, Gazans Line Up at Bakeries

When there is a lull in the conflict in Gaza, residents who have been hunkered down in their apartments rush out to stock up on food and other necessities. Probably the most important destination is the local bakery. VOA’s Scott Bobb reports from Gaza City.
Video

Video China Investigates Powerful Former Security Chief

The public in China is welcoming the Communist Party's decision to investigate one of the country's once most powerful politicians, former domestic security chief Zhou Yongkang. Analysts say the move by President Xi Jinping is not only an effort to win more support for the party, but an essential step to furthering much needed economic reforms and removing those who would stand in the way of change. VOA's Bill Ide has more from Beijing.
Video

Video US-Funded Program Offers Honduran Children Alternative to Illegal Immigration

President Obama and Central American leaders recently agreed to come up with a plan to address poverty and crime in the region that is fueling the surge of young migrants trying to illegally enter the United States. VOA’s Brian Padden looks at one such program in Honduras - funded in part by the United States - which gives street kids not only food and safety but a chance for a better life without, crossing the border.
Video

Video 'Fab Lab' Igniting Revolution in Kenya

The University of Nairobi’s Science and Technology Park is banking on 3-D prototyping to spark a manufacturing revolution in the country. Lenny Ruvaga has more for from Nairobi's so-called “FabLab” for VOA.
Video

Video Immigrant Influx on Texas Border Heats Up Political Debate

Immigrants from Central America continue to cross the U.S.-Mexico border in south Texas, seeking asylum in the United States, as officials grapple with ways to deal with the problem and provide shelter for thousands of minors among the illegal border crossers. As VOA's Greg Flakus reports from Houston, the issue is complicated by internal U.S. politics and U.S. relations with the troubled nations that immigrants are fleeing.

AppleAndroid