News / Asia

In Australia, Brain Power Fuels Emotion-Driven Music

Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
Phil Mercer
SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
What sound does a singing body make?

To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
"So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
“Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
Professor Macefield says the experiment aims to produce unique music.
“The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
“This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

"I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
 The end product is a mix of rhythms.

“Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

You May Like

Afghanistan, Pakistan Leaders to Hold Icebreaking Talks in Paris

Two sides are expected to discuss ways to ease bilateral tensions and jointly work for resumption of stalled peace talks between Afghan government and Taliban officials

Corruption Busting Is Her Game

South African activist is building 'international online community of thousands of corruption fighters'

Former SAF Businessman Gives Books, Love of Reading to Students

Steve Tsakaris now involved in nonprofit Read to Rise, which distributes books in Soweto, encourages lower-grade primary school students to read

This forum has been closed.
There are no comments in this forum. Be first and add one

Featured Videos

Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
Belgium-Germany Border Remains Porous, Even As Manhunt For Paris Attacker Continuesi
Ayesha Tanzeem
November 25, 2015 10:46 PM
One of the suspected gunmen in the Nov. 13 Paris attacks, Salah Abdeslam, evaded law enforcement, made his way to Belgium, and is now believed to have fled to Germany. VOA correspondent Ayesha Tanzeem makes the journey across the border from Belgium into Germany to see how porous the borders really are.

Video Belgium-Germany Border Remains Porous, Even As Manhunt For Paris Attacker Continues

One of the suspected gunmen in the Nov. 13 Paris attacks, Salah Abdeslam, evaded law enforcement, made his way to Belgium, and is now believed to have fled to Germany. VOA correspondent Ayesha Tanzeem makes the journey across the border from Belgium into Germany to see how porous the borders really are.

Video Islamic State Unfazed by Losses in Iraq, Syria

Progress in the U.S.-led effort to beat Islamic State on its home turf in Iraq and Syria has led some to speculate the terror group may be growing desperate. But counterterror officials say that is not the case, and warn the recent spate of terror attacks is merely part of the group’s evolution. VOA National Security correspondent Jeff Seldin has more.

Video Taiwan Looks for Role in South China Sea Dispute

The Taiwanese government is one of several that claims territory in the hotly contested South China Sea, but Taipei has long been sidelined in the dispute, overshadowed by China. Now, as the Philippines challenges Beijing’s claims in an international court at The Hague, Taipei is looking to publicly assert its claims. VOA’s Bill Ide has more from Beijing.

Video Syrian Refugees in US Express Concern for Those Left Behind

Syrian immigrants in the United States are concerned about the negative tide of public opinion and the politicians who want to block a U.S. plan to accept 10,000 Syrian refugees. Zlatica Hoke reports many Americans are fighting to dispel suspicions linking refugees to terrorists.

Video After Paris Attacks, France Steps Up Fight Against IS

The November 13 Paris attacks have drawn increased attention to Syria, where many of the suspected perpetrators are said to have received training. French President Francois Hollande is working to build a broad international coalition to defeat Islamic State in Syria and in Iraq. Zlatica Hoke reports.

Video US, Cambodian Navies Pair Up in Gulf of Thailand

The U.S. Navy has deployed one of its newest and most advanced ships to Cambodia to conduct joint training drills in the Gulf of Thailand. Riding hull-to-hull with Cambodian ships, the seamen of the USS Fort Worth are executing joint-training drills that will help build relations in Southeast Asia. David Boyle reports for VOA from Preah Sihanouk province.

Video Americans Sharpen Focus on Terrorism

Washington will be quieter than usual this week due to the Thanksgiving holiday, even as Americans across the nation register heightened concerns over possible terrorist threats. VOA’s Michael Bowman reports new polling data from ABC News and the Washington Post newspaper show an electorate increasingly focused on security issues after the deadly Islamic State attacks in Paris.

Video World Leaders Head to Paris for Climate Deal

Heads of state from nearly 80 countries are heading to Paris (November 30-December 11) to craft a global climate change agreement. The new accord will replace the Kyoto Protocol on Climate Change that expired in 2012.

Video Uncertain Future for Syrian Refugee Resettlement in Illinois

For the trickle of Syrian refugees finding new homes in the Midwest city of Chicago, the call to end resettlement in many U.S. states is adding another dimension to their long journey fleeing war. Organizations working to help them integrate say the backlash since the Paris attacks is both harming and helping their efforts to provide refugees sanctuary. VOA's Kane Farabaugh reports.

Video Creating Physical Virtual Reality With Tiny Drones

As many computer gamers know, virtual reality is a three-dimensional picture, projected inside special googles. It can fool your brain into thinking the computer world is the real world. But If you try to touch it, it’s not there. Now Canadian researchers say it may be possible to create a physical virtual reality using tiny drones. VOA’s George Putic reports.

Video New American Indian Village Takes Visitors Back in Time

There is precious little opportunity to experience what life was like in the United States before its colonization by European settlers. Now, an American Indian village built in a park outside Washington is taking visitors back in time to experience the way of life of America's indigenous people. Carol Pearson narrates this report from VOA's June Soh.

Video Even With Hometown Liberated, Yazidi Refugees Fear Return

While the northern Iraqi town of Sinjar has been liberated from Islamic State forces, it's not clear whether Yazidi residents who fled the militants will now return home. VOA’s Mahmut Bozarslan talked with Yazidis, a religious and ethnic minority, at a Turkish refugee camp in Diyarbakır. Robert Raffaele narrates his report.

Video Nairobi Tailors Make Pope Francis’ Vestments

To ensure the pope is properly attired during his visit, the Kenya Conference of Catholic Bishops asked the Dolly Craft Sewing Project in the Nairobi slum of Kangemi to make the pope's vestments, the garments he will wear during the various ceremonies. Jill Craig reports.

Video Cross-Border Terrorism Puts Europe’s Passport-Free Travel in Doubt

The fallout from the Islamic State terror attacks in Paris has put the future of Europe’s passport-free travel area, known as the "Schengen Zone," in doubt. Several of the perpetrators were known to intelligence agencies, but were not intercepted. Henry Ridgwell reports from London European ministers are to hold an emergency meeting Friday in Brussels to look at ways of improving security.

Video El Niño Brings Unexpected Fish From Mexico to California

Fish in an unexpected spectrum of sizes, shapes and colors are moving north, through El Niño's warm currents from Mexican waters to the Pacific Ocean off California’s coast. El Nino is the periodic warming of the eastern and central Pacific Ocean. As Faiza Elmasry tells us, this phenomenon thrills scientists and gives anglers the chance of a once-in-a-lifetime big catch. Faith Lapidus narrates.

Video Terrorism in Many Forms Continues to Plague Africa

While the world's attention is on Paris in the wake of Friday night's deadly attacks, terrorism from various sides remains a looming threat in many African countries. Nigerian cities have been targeted this week by attacks many believe were staged by the violent Islamist group Boko Haram. In addition, residents in many regions are forced to flee their homes as they are terrorized by armed militias. Zlatica Hoke reports.

Video Study: Underage Marriage Rate Higher for Females in Pakistan

While attitudes about the societal role of females in Pakistan are evolving, research by child advocacy group Plan International suggests that underage marriage of girls remains a particularly big issue in the country. VOA’s Ayesha Tanzeem reports how such marriages leads to further social problems.

VOA Blogs