News / Asia

    In Australia, Brain Power Fuels Emotion-Driven Music

    Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
    Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
    Phil Mercer
    SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
     
    What sound does a singing body make?
     

    To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
     
    They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
     
    "So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
     
    The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
     
    “Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
     
    Professor Macefield says the experiment aims to produce unique music.
     
    “The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
     
    The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
     
    “This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

    "I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
     
     The end product is a mix of rhythms.

    “Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
     
    The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

    You May Like

    Video As Refugees Perish, Greek Graveyards Fill

    Before burial at overflowing cemeteries, unidentified dead being swapped for DNA, in case some day relatives come to learn their fate

    Russian Opposition Leader Sues Putin for Conflict of Interest

    Alexei Navalny tells VOA in exclusive interview why transfer of $2 billion from country’s wealth fund to company with ties to President Putin’s son-in-law triggered lawsuit

    Clinton, Sanders Fight for African American Votes

    Some African American lawmakers lining up to support Clinton in face of perceived surge by Sanders in race for Democratic nomination in presidential campaign

    This forum has been closed.
    Comments
         
    There are no comments in this forum. Be first and add one

    Featured Videos

    Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
    As Refugees Perish, Greek Graveyards Filli
    X
    Hamada Elsaram
    February 11, 2016 8:01 PM
    Aid workers on the Greek island of Lesbos say they are struggling to bury the increasing number of bodies of refugees that have been recovered or washed up ashore in recent months.  The graveyards are all full, they say, yet as tens of thousands of people clamor to get out of Syria, it is clear refugees will still be coming in record numbers. For VOA, Hamada Elrasam reports from Lesbos, Greece.
    Video

    Video As Refugees Perish, Greek Graveyards Fill

    Aid workers on the Greek island of Lesbos say they are struggling to bury the increasing number of bodies of refugees that have been recovered or washed up ashore in recent months.  The graveyards are all full, they say, yet as tens of thousands of people clamor to get out of Syria, it is clear refugees will still be coming in record numbers. For VOA, Hamada Elrasam reports from Lesbos, Greece.
    Video

    Video To Fight Zika, Scientists Target Mosquitoes

    Mosquitoes strike again. The Zika virus outbreak is just the latest headline-grabbing epidemic carried by these biting pests, but researchers are fighting back with new ways to control them. VOA's Steve Baragona takes a look.
    Video

    Video Mosul Refugees Talk About Life Under IS

    A top U.S. intelligence official told Congress this week that a planned Iraqi-led operation to re-take the city of Mosul from Islamic State militants is unlikely to take place this year. IS took over the city in June 2014, and for the past year and a half, Mosul residents have been held captive under its rule. VOA's Zana Omar talked to some families who managed to escape. Bronwyn Benito narrates his report.
    Video

    Video Scientists Make Progress Toward Better Diabetes Treatment, Cure

    Scientists at two of the top U.S. universities say they have made significant advances in their quest to find a more efficient treatment for diabetes and eventually a cure. According to the International Diabetes Federation, the disease affects more than 370 million people worldwide. VOA’s George Putic reports.
    Video

    Video NATO to Target Migrant Smugglers

    NATO has announced plans to send warships to the Aegean Sea to target migrant smugglers in the alliance's most direct intervention so far since a wave of people began trying to reach European shores.
    Video

    Video Russia's Catholics, Orthodox Hopeful on Historic Pope-Patriarch Meeting

    Russia's Catholic minority has welcomed an historic first meeting Friday in Cuba between the Pope and the Patriarch of Russia's dominant Orthodox Church. The Orthodox Church split with Rome in 1054 and analysts say politics, both church and state, have been driving the relationship in the centuries since. VOA's Daniel Schearf reports from Moscow.
    Video

    Video Used Books Get a New Life on the Streets of Lagos

    Used booksellers are importing books from abroad and selling them on the streets of Africa's largest city. What‘s popular with readers may surprise you. Chris Stein reports from Lagos.
    Video

    Video After NH Primaries All Eyes on South Carolina

    After Tuesday's primary in New Hampshire, US presidential candidates swiftly turned to the next election coming up in South Carolina. The so-called “first-in-the-South” poll may help further narrow down the field of candidates. Zlatica Hoke reports.
    Video

    Video US Co-ed Selective Service Plan Stirs Controversy

    Young women may soon be required to register with the U.S. Selective Service System, the U.S. government agency charged with implementing a draft in a national emergency. Top Army and Marine Corps commanders told the Senate Armed Services Committee recently that women should register, and a bill has been introduced in Congress requiring eligible women to sign up for the military draft. The issue is stirring some controversy, as VOA’s Bernard Shusman reports from New York.
    Video

    Video Lessons Learned From Ebola Might Help Fight Zika

    Now that the Ebola epidemic has ended in West Africa, Zika has the world's focus. And, as Carol Pearson reports, health experts and governments are applying some of the lessons learned during the Ebola crisis in Africa to fight the Zika virus in Latin America and the Caribbean.
    Video

    Video Smartphone Helps Grow Vegetables

    One day, you may be using your smartphone to grow your vegetables. A Taipei-based company has developed a farm cube — a small, enclosed ecosystem designed to grow plants indoors. The environment inside is automatically adjusted by the cube, but it can also be controlled through an app. VOA's Deborah Block has more on the gardening system.
    Video

    Video Illinois Voters Have Mixed Emotions on Obama’s Return to Springfield

    On the ninth anniversary of the launch of his quest for national office, President Barack Obama returned to Springfield, Illinois, to speak to the Illinois General Assembly, where he once served as state senator. His visit was met with mixed emotions by those with a front-row seat on his journey to the White House. VOA's Kane Farabaugh reports.
    Video

    Video Exhibit Turns da Vinci’s Drawings Into Real Objects

    In addition to being a successful artist, Renaissance genius Leonardo da Vinci designed many practical machines, some of which are still in use today, although in different forms. But a number of his projects were never realized — until today. VOA’s George Putic reports.
    Video

    Video Heated Immigration Debate Limits Britain’s Refugee Response

    Compared to many other European states, Britain has agreed to accept a relatively small number of Syrian refugees. Just over a thousand have arrived so far -- and some are being resettled in remote corners of the country. Henry Ridgwell reports on why Britain’s response has lagged behind its neighbors.
    Video

    Video Russia's Car Sales Shrink Overall, But Luxury and Economy Models See Growth

    Car sales in Russia dropped by more than a third in 2015 because of the country's economic woes. But, at the extreme ends of the car market, luxury vehicles and some economy brands are actually experiencing growth. VOA's Daniel Schearf reports from Moscow.