News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
 
What sound does a singing body make?
 

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
 
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
 
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
 
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
 
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
 
Professor Macefield says the experiment aims to produce unique music.
 
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
 
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
 
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
 
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

How to Safeguard Your Mobile Privacy

As the digital world becomes more mobile, so too do concerns about eroding privacy and increased hacking More

'Desert Dancer' Chronicles Iranian Underground Dance Troupe

Film by Richard Raymond is based on true story of Afshin Ghaffarian and his friends More

Researcher: Obesity Poses Complex Problem

Professor at Symposium on Obesity, Diabetes and Metabolic Syndrome says problem involves more than calorie intake, warns of worldwide health impact More

This forum has been closed.
Comments
     
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
Scientists Say Plankton More Important Than Previously Thoughti
X
George Putic
May 26, 2015 9:26 PM
Tiny ocean creatures called plankton are mostly thought of as food for whales and other large marine animals, but a four-year global study discovered, among other things, that plankton are a major source of oxygen on our planet. VOA’s George Putic reports.
Video

Video Scientists Say Plankton More Important Than Previously Thought

Tiny ocean creatures called plankton are mostly thought of as food for whales and other large marine animals, but a four-year global study discovered, among other things, that plankton are a major source of oxygen on our planet. VOA’s George Putic reports.
Video

Video Kenyans Lament Losing Sons to al-Shabab

There is agony, fear and lost hope in the Kenyan town of Isiolo, a key target of a new al-Shabab recruitment drive. VOA's Mohammed Yusuf visits Isiolo to speak with families and at least one man who says he was a recruiter.
Video

Video US-led Coalition Gives Some Weapons to Iraqi Troops

In a video released Tuesday from the Iraqi Ministry of Defense, Iraqi forces and U.S.-led coalition troops survey a cache of weapons supplied to help Iraq liberate Mosul from Islamic State group. According to a statement provided with the video, the ministry and the U.S.-led coaltion troops have started ''supplying the 16th army division with medium and light weapons in preparation to liberate Mosul and nearby areas from Da'esh (Arabic acronym for Islamic State group).''
Video

Video Amnesty International: 'Overwhelming Evidence' of War Crimes in Ukraine

Human rights group Amnesty International says there is overwhelming evidence of ongoing war crimes in Ukraine, despite a tentative cease-fire with pro-Russian rebels. Researchers interviewed more than 30 prisoners from both sides of the conflict and all but one said they were tortured. Henry Ridgwell reports for VOA from London.
Video

Video Washington Parade Honors Those Killed Serving in US Military

Every year, on the last Monday in the month of May, millions of Americans honor the memories of those killed while serving in the armed forces. Memorial Day is a tradition that dates back to the 19th Century. While many people celebrate the federal holiday with a barbecue and a day off from work, for those who’ve served in the military, it’s a special day to remember those who made the ultimate sacrifice. Arash Arabasadi reports for VOA from Washington.
Video

Video Kenya’s Capital Sees Rise in Shisha Parlors

In Kenya, the smoking of shisha, a type of flavored tobacco, is the latest craze. Patrons are flocking to shisha parlors to smoke and socialize. But the practice can be addictive and harmful, though many dabblers may not realize the dangers, according to a new review. Lenny Ruvaga has more on the story for VOA from Nairobi, Kenya.
Video

Video Rolling Thunder Run Reveals Changed Attitudes Towards Vietnam War

For many US war veterans, the Memorial Day holiday is an opportunity to look back at a divisive conflict in the nation’s history and to remember those who did not make it home.
Video

Video Female American Soldiers: Healing Through Filmmaking

According to the United States Defense Department, there are more than 200-thousand women serving in the U.S. Armed Forces.  Like their male counterparts, females have experiences that can be very traumatic.  VOA's Bernard Shusman tells us about a program that is helping some American women in the military heal through filmmaking.
Video

Video Iowa Family's Sacrifice Shaped US Military Service for Generations

Few places in America have experienced war like Waterloo. This small town in the Midwest state of Iowa became famous during World War II not for what it accomplished, but what it lost. As VOA’s Kane Farabaugh reports, the legacy of one family’s sacrifice is still a reminder today of the real cost of war for all families on the homefront.
Video

Video On Film: How Dance Defies Iran's Political Oppression

'Desert Dancer' by filmmaker Richard Raymond is based on the true story of a group of young Iranians, who form an underground dance troupe in the Islamic Republic of Iran. This is the latest in a genre of films that focus on dance as a form of freedom of expression against political oppression and social injustice. VOA’s Penelope Poulou has more.
Video

Video Turkey's Ruling Party Trying to Lure Voters in Opposition Stronghold

Turkey’s AK (Justice and Development) Party is seeking a fourth successive general election victory, with the goal of securing two-thirds of the seats in Parliament to rewrite the constitution and change the country's parliamentary system into a presidential one. To achieve that, the party will need to win seats in opposition strongholds like the western city of Izmir. Dorian Jones reports.
Video

Video Millions Flock to Ethiopia Polls

Millions of Ethiopians cast their votes Sunday in the first national election since the 2012 death of longtime leader Meles Zenawi. Mr. Meles' party, the Ethiopian People's Revolutionary Democratic Front, is almost certain of victory again. VOA's Anita Powell reports from Addis Ababa.

VOA Blogs