News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
 
What sound does a singing body make?
 

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
 
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
 
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
 
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
 
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
 
Professor Macefield says the experiment aims to produce unique music.
 
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
 
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
 
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
 
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

Video British Fighters on Frontline of Islamic State Information War

It’s estimated that several hundred British citizens are fighting for Islamic State alongside other foreign jihadists More

Pakistan's Political Turmoil Again Shines Spotlight on Military

Thousands of protesters calling for PM Sharif to step down continue protests in front of parliament, as critics fear political impasse could spur another military coup More

Photogallery Ebola Quarantines Spark Anxiety in Liberian Capital

Food prices rise sharply as residents attempting purchases clash with security forces, leaving one person dead More

This forum has been closed.
Comments
     
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
Native Bees May Help Save Cropsi
X
Deborah Block
August 22, 2014 12:23 AM
U.S. President Barack Obama has called for a federal strategy to promote the health of bees that have been declining. The honeybee has been waning due to parasites, disease and pesticides. Wild bees may be used to take over their role as crop pollinators. Scientists first need to learn a lot more about wild bees, says biologist Sam Droege, who is pioneering the first national inventory on native bees. VOA’s Deborah Block went to his research laboratory in Beltsville, Maryland, to bring you more.
Video

Video Native Bees May Help Save Crops

U.S. President Barack Obama has called for a federal strategy to promote the health of bees that have been declining. The honeybee has been waning due to parasites, disease and pesticides. Wild bees may be used to take over their role as crop pollinators. Scientists first need to learn a lot more about wild bees, says biologist Sam Droege, who is pioneering the first national inventory on native bees. VOA’s Deborah Block went to his research laboratory in Beltsville, Maryland, to bring you more.
Video

Video US Defense Officials Plan for Long-Term Strategy to Contain Islamic State

U.S. defense officials say American air strikes in Iraq have helped deter Islamic State militants for the time being, but that a broad international effort is needed to defeat the extremists permanently. Defense Secretary Chuck Hagel warned Thursday that the group formerly known as the Islamic State in Iraq and the Levant, or ISIL, is better organized, and financially and militarily stronger than any other known terrorist group. Zlatica Hoke has more.
Video

Video Drug-Resistant Malaria Spreads in Southeast Asia

On Thailand’s border with Myanmar, also known as Burma, a malaria research and treatment clinic is stepping up efforts to eliminate a drug-resistant form of the parasite - before it spreads abroad. Steve Sandford reports from Mae Sot, Thailand.
Video

Video Gaza Conflict, Hamas Popularity Challenge Abbas

The Palestinian unity government of Mahmoud Abbas has failed to convince Hamas to agree to Egyptian-negotiated terms with Israel on a Gaza cease-fire. VOA State Department Correspondent Scott Stearns reports on what the Gaza conflict means for President Abbas, with whom U.S. officials have worked for years on a two-state solution to the Israeli-Palestinian conflict.
Video

Video Nigeria's 'Nollywood' Movie Industry Rolls in High Gear

Twenty years after its birth in a video shop in Lagos, Nigeria's "Nollywood" is one of the most prolific film industries on earth. Despite low budgets and whirlwind production schedules, Nigerian films are wildly popular in Africa and industry professionals say they hope, in the future, their films will be as great in quality as they are in quantity. Heather Murdock has more for VOA from Lagos.
Video

Video UN Launches 'Biggest Aid Operation in 30 Years' in Iraq

The United Nations has launched what it describes as one of the biggest aid operations in 30 years in northern Iraq, as hundreds of thousands of refugees flee the extremist Sunni militant group calling itself the Islamic State. As Kurdish and Iraqi forces battle the Sunni insurgents, the fighting has forced more people to flee their homes. Kurdish authorities say the international community must act now to avert a humanitarian catastrophe. Henry Ridgwell reports for VOA from London.
Video

Video Cambodian American Hip Hop Artist Sings of Personal Struggles

A growing underground movement of Cambodian American hip hop artists is rapping about the struggles of living in urban America. Most, if not all of them, are refugees or children of refugees who came to the United States from Cambodia to escape the Khmer Rouge genocide of the 1970s. Through their music, the artists hope to give voice to immigrants who have been struggling quietly for years. Elizabeth Lee reports from Long Beach, California.
Video

Video African Media Tries to Educate Public About Ebola

While the Ebola epidemic continues to claim lives in West Africa, information technology specialists, together with radio and TV reporters, are battling misinformation and prejudice about the disease - using social media to educate the public about the deadly virus. VOA’s George Putic has more.

AppleAndroid