News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
What sound does a singing body make?

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
Professor Macefield says the experiment aims to produce unique music.
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

800-Pound Man Determined to Slim Down

Man says he was kicked out of hospital for ordering pizza; wants to be an actor More

Australia Prepares to Resettle 12,000 Syrian Refugees

Preference will be given to refugees from persecuted minorities, and the first group is expected to arrive before late December More

S. African Miners Seek Class Action Suit Against Gold Mines

The estimated 100,000 say say they contracted the lung diseases silicosis and tuberculosis in the mines More

This forum has been closed.
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
Amnesty Accuses Saudi Coalition of ‘War Crimes’ in Yemeni
Henry Ridgwell
October 12, 2015 4:03 PM
The human rights group Amnesty International has accused the Saudi-led coalition of war crimes in airstrikes against Houthi rebels in Yemen. Henry Ridgwell reports the group says hundreds of civilians have been killed in strikes on residential areas.

Video Amnesty Accuses Saudi Coalition of ‘War Crimes’ in Yemen

The human rights group Amnesty International has accused the Saudi-led coalition of war crimes in airstrikes against Houthi rebels in Yemen. Henry Ridgwell reports the group says hundreds of civilians have been killed in strikes on residential areas.

Video No Resolution in Sight to US House Speaker Drama

Uncertainty grips the U.S. Congress, where no consensus replacement has emerged to succeed Republican House Speaker John Boehner after his surprise resignation announcement. Half of Congress is effectively leaderless weeks before America risks defaulting on its national debt and enduring another partial government shutdown.

Video New Art Exhibit Focuses on Hope

Out of struggle and despair often comes hope. That idea is behind a new art exhibit at the American Visionary Art Museum in Baltimore, Maryland. "The Big Hope Show" features 25 artists, some of whom overcame trauma and loss. VOA’s Deborah Block reports.

Video Columbus Day Still Generates Controversy as US Holiday

The second Monday of October is Columbus Day in the United States, honoring explorer Christopher Columbus and his discovery of the Americas. The achievement is a source of pride for many, but for some the holiday is marked by controversy. Adrianna Zhang has more.

Video Anger Simmers as Turks Begin to Bury Blast Victims

The Turkish army carried out new air strikes on Kurdistan Workers Party (PKK) targets on Sunday, a day after the banned group announced a unilateral cease fire. The air raids apparently are in retaliation for the Saturday bombing in Turkey's capital Ankara that killed at least 95 people and wounded more than 200 others. But as Zlatica Hoke reports, there are suspicions that Islamic State is involved.

Video Bombings a Sign of Turkey’s Deep Troubles

Turkey has begun a three-day period of mourning following Saturday’s bomb attacks in the capital, Ankara, that killed nearly 100 people. With contentious parliamentary elections three weeks away, the attacks highlight the challenges Turkey is facing as it struggles with ethnic friction, an ongoing migrant crisis, and growing tensions with Russia. VOA Europe correspondent Luis Ramirez reports.

Video Afghanistan’s Progress Aided by US Academic Center

Recent combat in Afghanistan has shifted world attention back to the central Asian nation’s continuing civil war and economic challenges. But, while there are many vexing problems facing Afghanistan’s government and people, a group of academics in Omaha, Nebraska has kept a strong faith in the nation’s future through programs to improve education. VOA’s Greg Flakus has more from Omaha, Nebraska.

Video House Republicans in Chaos as Speaker Favorite Withdraws

The Republican widely expected to become the next speaker of the House of Representatives shocked his colleagues Thursday by announcing he was withdrawing his candidacy. The decision by Majority Leader Kevin McCarthy means the race to succeed retiring Speaker John Boehner is now wide open. VOA National Correspondent Jim Malone reports.

Video German, US Officials Investigate Volkswagen

German officials have taken steps to restore some of the reputation their car industry has lost after a recent Volkswagen diesel emissions scandal. Authorities have searched Volkswagen headquarters and other locations in an effort to identify the culprits in the creation of software that helps cheat on emission tests. Meanwhile, a group of lawmakers in Washington held a hearing to get to the bottom of the cheating strategy that was first discovered in the United States. Zlatica Hoke reports.

Video Why Are Gun Laws So Hard for Congress to Tackle?

Since taking office, President Barack Obama has spoken out or issued statements about 15 mass shootings. The most recent shooting, in which 10 people were killed at a community college, sparked outrage over the nation's gun laws. But changing those laws isn't as easy as many think. VOA's Carolyn Presutti reports.

Video In 'He Named Me Malala,' Guggenheim Finds Normal in Extraordinary

Davis Guggenheim’s documentary "He Named Me Malala" offers a probing look into the life of 18-year-old Malala Yousafsai, the Pakistani teenager who, in 2012, was shot in the head by the Taliban for standing up for her right to education in her hometown in Pakistan's Swat Valley. Guggenheim shows how, since then, Malala has become a symbol not as a victim of brutal violence, but as an advocate for girls’ education throughout the world. VOA’s Penelope Poulou has more.

Video Paintable Solar Cells May Someday Replace Silicon-Based Panels

Solar panels today are still factory-manufactured, with the use of some highly toxic substances such as cadmium chloride. But a researcher at St. Mary’s College, Maryland, says we are close to being able to create solar panels by painting them on a suitable surface, using nontoxic solutions. VOA’s George Putic reports.

VOA Blogs