News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
 
What sound does a singing body make?
 

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
 
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
 
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
 
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
 
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
 
Professor Macefield says the experiment aims to produce unique music.
 
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
 
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
 
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
 
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

Australia Knights Prince Philip, Sparking National Outrage

Abbott's surprise reintroduction of knights and dames in the country's honors system last year drew criticism that he was out of touch with national sentiment More

SAG Award Boosts 'Birdman' Oscar Hopes

Individual acting Oscars appear to be sewn up: SAG awards went to artists who won Golden Globes: Julianne Moore, Eddie Redmayne, Patricia Arquette, J.K. Simmons More

Katy Perry Lights Way for Super Bowl's Girl Power Moment

Pop star's selection to headline US football championship's halftime show extends NFL's trend of selecting artists who appeal to younger viewers More

This forum has been closed.
Comments
     
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
Zoo Animals Show Their Artistic Sidesi
X
June Soh
January 23, 2015 10:03 PM
The pursuit of happiness is so important, America's founding fathers put it in the Declaration of Independence. Any zookeeper will tell you animals need enrichment, just like humans do. So painting, and even music, are part of the Smithsonian National Zoo's program to keep the animals happy. VOA’s June Soh met some animal artists at the zoo in Washington. Faith Lapidus narrates.
Video

Video Zoo Animals Show Their Artistic Sides

The pursuit of happiness is so important, America's founding fathers put it in the Declaration of Independence. Any zookeeper will tell you animals need enrichment, just like humans do. So painting, and even music, are part of the Smithsonian National Zoo's program to keep the animals happy. VOA’s June Soh met some animal artists at the zoo in Washington. Faith Lapidus narrates.
Video

Video Progress, Some Areas of Disagreement in Cuba Talks

U.S. and Cuban officials are reporting progress from initial talks in Havana on re-establishing diplomatic ties. U.S. Assistant Secretary of State (for Western Hemisphere Affairs) Roberta Jacobson said while there was agreement on a broad range of issues, there also are some “profound disagreements” between Washington and Havana. VOA State Department correspondent Pam Dockins has the story.
Video

Video Worldwide Photo Workshops Empower Youth

Last September, 20 young adults from South Sudan took part in a National Geographic Photo Camp. They are among hundreds of students from around the world who have learned how to use a camera to tell the stories of the people in their communities through the powerful medium of photography. Three camp participants talked about their experiences recently on a visit to Washington. VOA’s Julie Taboh reports.
Video

Video US, Japan Offer Lessons as Eurozone Launches Huge Stimulus

The Euro currency has fallen sharply after the European Central Bank announced a bigger-than-expected $67 billion-a-month quantitative easing program Thursday - commonly seen as a form of printing new money. Henry Ridgwell reports for VOA from London on whether the move might rescue the eurozone economy -- and what lessons have been learned from similar programs around the world.
Video

Video Nigerian Elections Pose Concern of Potential Conflict in 'Middle Belt'

Nigeria’s north-central state of Kaduna has long been the site of fighting between Muslims and Christians as well as between people of different ethnic groups. As the February elections approach, community and religious leaders are making plans they hope will keep the streets calm after results are announced. Chris Stein reports from the state capital, Kaduna.
Video

Video As Viewership Drops, Obama Puts His Message on YouTube

Ratings reports show President Obama’s State of the Union address this week drew the lowest number of viewers for this annual speech in 15 years. White House officials anticipated this, and the president has decided to take a non-traditional approach to getting his message out. VOA White House correspondent Luis Ramirez reports.
Video

Video S. Korean Businesses Want to End Trade Restrictions With North

Business leaders in South Korea are calling for President Park Geun-hye to ease trade restrictions with North Korea that were put in place in 2010 after the sinking of a South Korean warship.Pro-business groups argue that expanding trade and investment is not only good for business, it is also good for long-term regional peace and security. VOA’s Brian Padden reports.
Video

Video US Marching Bands Grow Into a Show of Their Own

The 2014 Super Bowl halftime show was the most-watched in history - attracting an estimated 115 million viewers. That event featured pop star Bruno Mars. But the halftime show tradition started with marching bands, which still dominate the entertainment at U.S. high school and college American football games. But as Enming Liu reports in this story narrated by Adrianna Zhang, marching bands have grown into a show of their own.

Circumventing Censorship

An Internet Primer for Healthy Web Habits

As surveillance and censoring technologies advance, so, too, do new tools for your computer or mobile device that help protect your privacy and break through Internet censorship.
More

All About America

AppleAndroid