News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
 
What sound does a singing body make?
 

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
 
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
 
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
 
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
 
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
 
Professor Macefield says the experiment aims to produce unique music.
 
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
 
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
 
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
 
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

Video Miami Cubans Divided on New US Policy

While older, more conservative Cuban Americans have promoted anti-Castro political movement for years, younger generations say economically, it is time for change More

2014 Sees Dramatic Uptick in Boko Haram Abductions

Militants suspected in latest mass kidnapping of over 100 people in Gumsuri, Nigeria on Sunday More

Video Cuba Deal Is Major Victory for Pope

Role of Francis hailed throughout US, Latin America - though some Cuban-American Catholics have mixed feelings More

This forum has been closed.
Comments
     
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
Sudan School Becomes Target of Aerial Attacksi
X
December 19, 2014 12:45 AM
The school dropout rate is at an all-time high in Sudan's South Kordofan state because many schools have been destroyed during the three-year civil war between the government and SPLA-N rebel forces. Adam Bailes visited Sudan's Nuba Mountains' region and reports many children are simply too scared to go to school
Video

Video Sudan School Becomes Target of Aerial Attacks

The school dropout rate is at an all-time high in Sudan's South Kordofan state because many schools have been destroyed during the three-year civil war between the government and SPLA-N rebel forces. Adam Bailes visited Sudan's Nuba Mountains' region and reports many children are simply too scared to go to school
Video

Video VOA Reporter Tours Devastated Peshawar School

Islamist militants wearing military uniforms and strapped with explosives attacked a military run school Tuesday in the northwestern Pakistani city of Peshawar. At least 141 people were killed in the horrific attack, most of them young students. VOA reporter Ayaz Gul visited the devastated school and attended the funeral of the principal who courageously tried to save her students from the deadly attack.
Video

Video Nigerians Fleeing Boko Haram Languish in Camp Near Capital

In its five-year effort to impose Islamic law in northeastern Nigeria, the Boko Haram extremist group has killed thousands of people and forced hundreds of thousands to flee. Some of those who ran for their lives now live in squalor on the edges of the capital, Abuja. Chris Stein reports for VOA.
Video

Video Putin Says Russian Economy Will Emerge Stronger

Russian President Vladimir Putin has said his country's sinking economy will not only recover but also become stronger, despite falling oil prices and Western sanctions over Ukraine. VOA's Daniel Schearf reports.
Video

Video Detained Turkish Journalists Follow Teachings of US-Based Preacher

The Turkish government’s jailing of critical journalists has sparked international condemnation and is being seen as an effort to undermine the followers of an ailing Turkish preacher based in the United States. VOA religion reporter Jerome Socolovsky has more.
Video

Video ‘Anti-Islamization’ Marches Increase Tensions In Germany

Anti-immigrant rallies in Germany have been building in recent weeks, peaking Monday night in the city of Dresden where tens of thousands of people turned out to demonstrate against what they call the ‘Islamization’ of the West. Germany has offered asylum to more Syrian refugees than any other country, and this appears to have set off the protests. Henry Ridgwell reports from London.
Video

Video Aceh Rebuilt Decade After Tsunami, But Scars Remain

On December 26, 2004 there was an earthquake in the Indian Ocean so powerful it caused the Earth’s axis to wobble a few centimeters. Onshore on the island of Sumatra, the resulting tsunami was devastating. A decade later, VOA Correspondent Steve Herman reports from Banda Aceh, Indonesia, where although there is little remaining evidence of the physical devastation, the psychological scars among survivors remain.
Video

Video Refugees Living in Kenya Long for Peace in the Home Countries

Kenya is host to numerous refugees seeking safe haven from conflict. Immigrants from Somalia face challenges in their new lives in Kenya. Ahead of International Migrants Day (December 18) Lenny Ruvaga has more for VOA News from the Kenyan capital.

All About America

AppleAndroid