News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
 
What sound does a singing body make?
 

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
 
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
 
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
 
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
 
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
 
Professor Macefield says the experiment aims to produce unique music.
 
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
 
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
 
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
 
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

Jihadist Assassin says Goal of Tunisia Murders Was Chaos

Abu Muqatil at-Tunusi’s remarks in a propaganda interview also cast light on attack on Bardo Museum More

Russia Denies License to Tatar-Language TV Station in Crimea

OSCE official says denial shows 'politically selective censorship of free and independent voices in Crimea is continuing' More

Kenyan Startups Tackle Expensive Remittances Through Bitcoin

Some think services could give Western Union a run for its money, though others say it’s still got a long way to go More

This forum has been closed.
Comments
     
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
For Obama, It's More Business Than Friendships With World Leadersi
X
Aru Pande
April 01, 2015 9:09 PM
The rift between President Barack Obama and Israeli Prime Minister Benjamin Netanyahu has put a spotlight on the importance of the American leader’s personal relationships with other world leaders and what role such friendships play in foreign policy. VOA's Aru Pande reports.
Video

Video For Obama, It's More Business Than Friendships With World Leaders

The rift between President Barack Obama and Israeli Prime Minister Benjamin Netanyahu has put a spotlight on the importance of the American leader’s personal relationships with other world leaders and what role such friendships play in foreign policy. VOA's Aru Pande reports.
Video

Video Buhari: Nigeria Has ‘Embraced Democracy’

Nigeria woke up to a new president-elect Wednesday, Muhammadu Buhari. But people say democracy is the real winner as the country embarks on its first peaceful handover of power since the end of military rule in 1999. VOA’s Anne Look reports from Abuja.
Video

Video Tiny Camera Sees Inside Blood Vessels

Ahead of any surgical procedure, doctors try to learn as much as possible about the state of the organs they plan to operate on. A new camera developed in the Netherlands can now make that easier - giving surgeons an incredibly detailed look inside blood vessels, all the way to the patient’s heart. VOA’s George Putic has more.
Video

Video Latin American Groups Seek Fans at Texas Music Festival

Latin American music groups played all over Austin, Texas, during the recent South by Southwest festival, and some made fans out of locals as well as people from around the world who had come to hear music. Such exposure can boost such groups' image back home. VOA’s Greg Flakus reports.
Video

Video Stockton Community, Police, Work to Improve Relations

Relations are tense between minority communities and police departments around the United States following police shootings that have generated widely-publicized protests. VOA's Mike O’Sullivan reports from Stockton, California, where police and community groups are working toward solutions, with backing from Washington.
Video

Video Indiana Controversy Highlights Divergent Meanings of Religious Freedom

Indiana’s state government has triggered a nationwide controversy by approving a law that critics say is aimed at allowing discrimination against gays and lesbians. The controversy stems from divergent notions of religious freedom in America. VOA's Jerome Socolovsky reports.
Video

Video Report: State of Black America a 'Tale of Two Nations'

The National Urban League has described this year's "State of Black America" report as a "tale of two nations." The group's annual report, released earlier this month (March), found that under an equality index African Americans had only 72% parity compared to whites in areas such as education, economics, health, social justice and civic engagement. It’s a gap that educators and students at Brooklyn’s Medgar Evers College are looking to close. VOA's Daniela Schrier reports from the school.
Video

Video Film Tells Story of Musicians in Mali Threatened by Jihadists

At this year's annual South by Southwest film and music festival in Austin, Texas, some musicians from Mali were on hand to promote a film about how their lives were upturned by jihadists who destroyed ancient treasures in the city of Timbuktu and prohibited anyone from playing music under threat of death. As VOA’s Greg Flakus reports from Austin, some are afraid to return to their hometowns even though the jihadists are no longer in control there.
Video

Video Ebola Vaccine Trials Underway in West Africa

Ebola has claimed the lives of more than 10,000 people in West Africa. Since last summer, researchers have rushed to get anti-Ebola vaccines into clinical trials. While it's too early to say that any of the potential vaccines work, some scientists say they are seeing strong results from some of the studies. VOA's Carol Pearson reports.
Video

Video Philippines Wants Tourists Spending Money at New Casinos

Tourism is a multi-billion dollar industry in the Philippines. Close to five million foreign visitors traveled there last year, perhaps lured by the country’s tropical beaches. But Jason Strother reports from Manila that the country hopes to entice more travelers to stay indoors and spend money inside new casinos.
Video

Video Civilian Casualties Push Men to Join Rebels in Ukraine

The continued fighting in eastern Ukraine and the shelling of civilian neighborhoods seem to be pushing more men to join the separatist fighters. Many of the new recruits are residents of Ukraine made bitter by new grievances, as well as old. VOA's Patrick Wells reports.
Video

Video Cambodian Land Grabs Threaten Traditional Communities

Indigenous communities in Cambodia's Ratanakiri province say the government’s economic land concession policy is taking away their land and traditional way of life, making many fear that their identity will soon be lost. Local authorities, though, have denied this is the case. VOA's Say Mony went to investigate and filed this report, narrated by Colin Lovett.

VOA Blogs

Circumventing Censorship

An Internet Primer for Healthy Web Habits

As surveillance and censoring technologies advance, so, too, do new tools for your computer or mobile device that help protect your privacy and break through Internet censorship.
More