News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
 
What sound does a singing body make?
 

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
 
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
 
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
 
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
 
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
 
Professor Macefield says the experiment aims to produce unique music.
 
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
 
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
 
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
 
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

Obama: Alaskans Feel Signs of Climate Change

They're seeing bigger storm surges as sea ice melts, more wildfires, erosion of glaciers, shorelines More

Katrina Brought Enduring Changes to New Orleans

The city’s recovery is the result of the people and culture the city is famous for, as well as newcomers and start-up industries More

Magical Photo Slides Show Native Americans in Late 1800s

Walter McClintock spent 20 years photographing the Blackfoot Indians and their vanishing culture at the dawn of the modern age More

This forum has been closed.
Comments
     
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
Colombians Flee Venezuela as Border Crisis Escalatesi
X
August 27, 2015 2:08 AM
Hundreds of Colombians have fled Venezuela since last week, amid an escalating border crisis between the two countries. Last week, Venezuelan President Nicolas Maduro ordered the closure of a key border crossing after smugglers injured three Venezuelan soldiers and a civilian. The president also ordered the deportation of Colombians who are in Venezuela illegally. Zlatica Hoke reports.
Video

Video Colombians Flee Venezuela as Border Crisis Escalates

Hundreds of Colombians have fled Venezuela since last week, amid an escalating border crisis between the two countries. Last week, Venezuelan President Nicolas Maduro ordered the closure of a key border crossing after smugglers injured three Venezuelan soldiers and a civilian. The president also ordered the deportation of Colombians who are in Venezuela illegally. Zlatica Hoke reports.
Video

Video Is China's Economic Data Accurate?

Some investors say China's wild stock market gyrations have been made worse by worries about the reliability of that nation's economic data. And some critics say the reports can mislead investors by painting an unrealistically-strong picture of the economy. A key China scholar says Beijing is not fudging ((manipulating)) the numbers, but that the economy is evolving quickly from smoke-stack industries to services, and the ways of tracking new economic activity are falling behind the change. V
Video

Video Next to Iran, Climate at Forefront of Obama Agenda

President Barack Obama this week announced new initiatives aimed at making it easier for Americans to access renewable energy sources such as solar and wind. Obama is not slowing down when it comes to pushing through climate change measures, an issue he says is the greatest threat to the country’s national security. VOA correspondent Aru Pande has more from the White House.
Video

Video Shipping Containers Provide Experimental Housing

Housing prices around the San Francisco Bay area are out of reach for many people, so some young entrepreneurs, artists and tech industry workers are creating their own houses using converted shipping containers. But as VOA's Mike O’Sullivan reports from Oakland, the effort requires ingenuity and dealing with restrictive local laws.
Video

Video Arctic Draws International Competition for Oil

A new geopolitical “Great Game” is underway in earth’s northernmost region, the Arctic, where Russia has claimed a large area for resource development and President Barack Obama recently approved Shell Oil Company’s test-drilling project in an area under U.S. control. Greg Flakus reports.
Video

Video Philippine Maritime Police: Chinese Fishermen a Threat to Country’s Security

China and the Philippines both claim maritime rights in the South China Sea.  That includes the right to fish in those waters. Jason Strother reports on how the Philippines is catching Chinese nationals it says are illegal poachers. He has the story from Palawan province.
Video

Video Technique May Eliminate Drill-and-Fill Dental Care

Many people dread visiting dentists because they're afraid of drills. Now, however, a technology developed by a British firm promises to eliminate the need for mechanical cleaning of dental cavities by speeding a natural process of tooth repair. VOA’s George Putic reports.
Video

Video China's Spratly Island Building Said to Light Up the Night 'Like A City'

Southeast Asian countries claim China has illegally seized territory in the Spratly islands. It is especially a concern for a Philippine mayor who says Beijing is occupying parts of his municipality. Jason Strother reports from the capital of Palawan province, Puerto Princesa.
Video

Video Ages-old Ice Reveals Secrets of Climate Change

Ice caps don't just exist at the world's poles. There are also tropical ice caps, and the largest sits atop the Peruvian Andes - but it is melting, quickly, and may be gone within the next 20 years. George Putic reports scientists are now rushing to take samples to get at the valuable information about climate change locked in the ice.
Video

Video French Experiment in Integrating Roma Under Threat

Plans to destroy France’s oldest slum have sparked an outcry on the part of its Roma residents. As Lisa Bryant reports from the Paris suburb of La Courneuve, rights groups argue the community is a fledgling experiment on integrating Roma who are often outcasts in many parts of Europe.
Video

Video Kenyans Turn to Agriculture for Business

Each year Kenyan universities continue to churn out graduates for the job market despite the already existing high rate of unemployment among youth in the country. Some of these young men and women have realized that agriculture can be as rewarding as any other business or job, and they are resorting to agribusiness in large numbers as a way of tackling unemployment. Rael Ombuor reports for VOA.
Video

Video First Women Graduate Elite Army Ranger School

Two women are making history for the U.S. Army by proving they are among the toughest of the tough. VOA's Carla Babb reports from Fort Benning, Georgia as 94 men and those two women rise as graduates of the difficult Ranger school.

VOA Blogs