News / Asia

    In Australia, Brain Power Fuels Emotion-Driven Music

    Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
    Neurophysiologist Vaughan Macefield works with volunteer Ben Schulz at the lab at the University of Western Sydney, Australia, 2012. (P. Mercer/VOA)
    Phil Mercer
    SYDNEY – A team of Australian researchers is tapping into the nerves and bodies of volunteers to create a raw musical performance driven purely by emotions.  In a world first, the data is fed into special software, which will create music that will be played by small robots.  The research team comprises a neurophysiologist, a roboticist and an artist. 
     
    What sound does a singing body make?
     

    To measure these inner feelings,  Sydney researchers are carefully mapping volunteers' blood pressure, breathing and sweat release.
     
    They are also inserting small needles into the nerves to listen into the electrical signals coming from the brain.
     
    "So amongst other things, I study the sympathetic nervous system, which is the branch of the nervous system involved in emotional expression," explains neurophysiologist Vaughan Macefield, professor of integrated physiology at the University of Western Sydney's School of Medicine. "And that is what we are looking at today.  So I have a needle inserted into Ben’s knee, the common peroneal nerve at the side of the knee, and as you can hear if I stroke Ben’s foot, we can hear this noise, which actually reflects the activity of sensory endings in the skin.”       
     
    The information is fed into a central computer, which decodes the data and translates it into music that fits the emotional state of volunteer, Ben Schulz.
     
    “Currently, I have got all sorts of wires coming in and out of me," Schulz says,  "so I have got something to measure my pulse and my blood pressure, and I have also got a small, little needle inserted into my leg, going into a nerve to actually sense the nerve endings in my feet.”
     
    Professor Macefield says the experiment aims to produce unique music.
     
    “The whole idea of this project is to tap into these nerve signals, and with Erin over there, [a] Montreal-based performance artist, we are wanting to use these signals, which are very sensitive markers of the state of emotion, to drive a performance,” he explains.  
     
    The experiments at a laboratory at the University of Western Sydney are the start of something far more spectacular.  The team aims to put their emotions-driven show on stage, where the inner feelings of two volunteers will generate live music performed by a fleet of small robots.
     
    “This project for me is all about a spirit of wonder and discovery," says Erin Gee, a Canadian sound and new media artist. " I anticipate that people could be as amazed as I am to hear these emotional rhythms.

    "I have a prototype software where I am experimenting with that right now" Gee adds  as she demonstrates how emotions are being portrayed and how they will sound when inserted into the robot. "I am translating this into glockenspiel instruments because to me I thought that something percussive, something glockenspiel, it reflects the nature of the data because the data is, you know, either on or it is off.   That is like a xylophone being hit.  Ding.”  
     
     The end product is a mix of rhythms.

    “Because you will definitely hear natural rhythms of the body being reflected in rhythms of xylophones being hit," Gee notes, "but every once in a while there will be an emotional fluctuation, so it will sound, kind of, like a gamelan orchestra of xylophone, bell sounds.”           
     
    The project is supported by the University of Western Sydney and the Concordia University in Montreal, Canada.

    You May Like

    Video Democrats Clinton, Kaine Offer 'Very Different Vision' Than Trump

    In a jab at Trump, Clinton says her team wants to 'build bridges, not walls'; Obama Hails Kaine's record; Trump calls Kaine a 'job-killer'

    Turkey Wants Pakistan to Close Down institutions, Businesses Linked to Gulen

    Thousands of Pakistani students are enrolled in Gulen's commercial network of around two dozen institutions operating in Pakistan for over two decades

    AU Passport A Work in Progress

    Who will get the passport and what the benefits are still need to be worked out

    This forum has been closed.
    Comments
         
    There are no comments in this forum. Be first and add one

    Featured Videos

    Your JavaScript is turned off or you have an old version of Adobe's Flash Player. Get the latest Flash player.
    In State of Emergency, Turkey’s Erdogan Focuses on Spiritual Movementi
    X
    July 22, 2016 11:49 AM
    The state of emergency that Turkish President Recep Tayyip Erdogan has declared is giving him even more power to expand a purge that has seen an estimated 60,000 people either arrested or suspended from their jobs. VOA Europe correspondent Luis Ramirez reports from Istanbul.
    Video

    Video In State of Emergency, Turkey’s Erdogan Focuses on Spiritual Movement

    The state of emergency that Turkish President Recep Tayyip Erdogan has declared is giving him even more power to expand a purge that has seen an estimated 60,000 people either arrested or suspended from their jobs. VOA Europe correspondent Luis Ramirez reports from Istanbul.
    Video

    Video Scientists in Poland Race to Save Honeybees

    Honeybees are in danger worldwide. Causes of what's known as colony collapse disorder range from pesticides and loss of habitat to infections. But scientists in Poland say they are on track to finding a cure for one of the diseases. VOA’s George Putic reports.
    Video

    Video Wall Already Runs Along Parts of US-Mexico Border

    The Republican Party’s presidential nominee, Donald Trump, gained the support of many voters by saying he would build a wall to keep undocumented immigrants and drugs from coming across the border from Mexico. Critics have called his idea impractical and offensive to Mexico, while supporters say such a bold approach is needed to control the border. VOA’s Greg Flakus has more from the border town of Nogales, Arizona.
    Video

    Video New HIV Tests Emphasize Rapid Results

    As the global fight against AIDS intensifies, activists have placed increasing importance on getting people to know their HIV status. Some companies are developing new HIV testing methods designed to be quick, easy and accurate. Thuso Khumalo looks at the latest methods, presented at the International AIDS conference in Durban, South Africa.
    Video

    Video African Youth with HIV Urge More Support

    HIV, the virus that causes AIDS, is the top killer of teens in sub-Saharan Africa. But many youths say their experience with the virus is unique and needs to be addressed differently than the adult epidemic. VOA South African Correspondent Anita Powell reports.
    Video

    Video Poor Residents in Cleveland Not Feeling High Hopes of Republican Convention

    With the Republican Party's National Convention underway in Cleveland, Ohio, delegates and visitors are gathered in the host city's downtown - waiting to hear from the party's presidential candidate, Donald Trump. But a few kilometers from the convention's venue, Cleveland's poorest residents are not convinced Trump or his policies will make a difference in their lives. VOA's Ramon Taylor spoke with some of these residents as well as some of the Republican delegates and filed this report.
    Video

    Video Pop-Up Art Comes to Your Living Room, Backyard and Elsewhere

    Around the world, independent artists and musicians wrestle with a common problem: where to exhibit or perform? Traditional spaces such as museums and galleries are reserved for bigger names, and renting a space is not feasible for many. Enter ArtsUp, which connects artists with venue owners. Whether it’s a living room, restaurant, office or even a boat, pop-up events are bringing music and art to unexpected places. Tina Trinh has more.
    Video

    Video With Yosemite as Backdrop, Obama Praises National Parks

    Last month, President Barack Obama and his family visited some of the most beautiful national parks in the U.S. Using the majestic backdrop of a towering waterfall in California's Yosemite National Park, Obama praised the national park system which celebrates its 100th anniversary this year. He talked about the importance of America’s “national treasures” and the need to protect them from climate change and other threats. VOA’s Julie Taboh reports.
    Video

    Video Counter-Islamic State Coalition Plots Next Steps

    As momentum shifts against Islamic State in Iraq, discussions are taking place about the next steps for driving the terrorist group from its final strongholds. Secretary of State John Kerry is hosting a counter-IS meeting at the State Department, a day after defense ministers from more than 30 countries reviewed and agreed upon a course of action. VOA Pentagon correspondent Carla Babb reports.
    Video

    Video Russia's Participation at Brazil Olympic Games Still In Question

    The International Olympic Committee has delayed a decision on whether to ban all Russian teams from competing in next month's Olympic Games in Brazil over allegations of an elaborate doping scheme. The World Anti-Doping Agency recently released an independent report alleging widespread doping by Russian athletes at the 2014 Winter Olympics in Sochi. So far, only Russian track and field athletes have been barred from the Summer Games in Brazil. VOA's Zlatica Hoke has more.
    Video

    Video Scotland’s Booming Whisky Industry Fears Brexit Hangover

    After Britain’s vote to leave the European Union, Scotland’s government wants to break away from the United Kingdom – fearing the nation’s exports are at risk. Among the biggest of these is whisky. Henry Ridgwell reports on a time of turmoil for those involved in the ancient art of distilling Scotland’s most famous product.
    Video

    Video Millennials Could Determine Who Wins Race to White House

    With only four months to go until Americans elect a new president, one group of voters is getting a lot more attention these days: those ages 18 to 35, a generation known as millennials. It’s a demographic that some analysts say could have the power to decide the 2016 election. But a lot depends on whether they actually turn out to vote. VOA’s Alexa Lamanna reports.

    Special Report

    Adrift The Invisible African Diaspora