October 21, 2016

Salk scientists adapt computer program to gauge eye spasm severity

Program also could be used in research and diagnosis of facial tics in disorders like Tourette syndrome, schizophrenia, and Parkinson’s disease

Salk News


Salk scientists adapt computer program to gauge eye spasm severity

Program also could be used in research and diagnosis of facial tics in disorders like Tourette Syndrome, schizophrenia, and Parkinson’s disease

LA JOLLA—If two clinicians observe the same patient with blepharospasm—uncontrollable muscle contractions around the eye—they’ll often come away with two different conclusions on the severity of the patient’s symptoms. That’s because the rating scales for blepharospasm are notoriously subjective and unreliable.

Now, in an attempt to provide a more objective scale for research and diagnosis, scientists at the Salk Institute have developed a computer program that takes over the job, analyzing videos of patients’ faces. The program could eventually be expanded to help study facial tics and twitches in other contexts, including Tourette syndrome, schizophrenia, and Parkinson’s disease. The research was described online on October 21, 2016 in Neurology, the medical journal of the American Academy of Neurology.

“The field of neurology has a long tradition of making clinical decisions based on careful observations. We hope to supplement that expertise by leveraging advances in computer vision and machine learning,” says Terrence Sejnowski, head of Salk’s Computational Neurobiology Laboratory and senior author of the new work.

David Peterson and Terrence Sejnowski
David Peterson and Terrence Sejnowski

Click here for a high-resolution image.

Credit: Salk Institute

Blepharospasm involves abnormal and involuntary twitching of the eyelid and surrounding muscles. Often, its cause is unknown, but the spasms can be triggered by fatigue or stress and are also associated with certain drugs, hormone changes and many other disorders, including multiple sclerosis. To help with research into the underlying causes, as well as trials of potential treatments, scientists have previously developed three different rating scales that can be used to put a number on blepharosplasm severity, but studies have shown that the ratings have a high level of variability.

“They’re inherently subjective because they’re based on human judgment,” says David Peterson, a project scientist at Salk and the University of California, San Diego and first author of the new paper. “And when these measures are used either to optimize treatment in clinical care or during studies of the condition, that variability introduces error.”

Sejnowski, Peterson and collaborators customized existing facial analysis software called Computer Expression Recognition Toolbox (CERT) to make the ratings objective. In the past, CERT has been used to analyze facial expressions as they relate to emotions. The team modified the program to quantify how often a patient’s eyes closed when they were instructed to keep them open. They tested the program using 49 existing videos of patients with blepharospasm who had already enrolled in a nationwide research program and been recorded while following a set of commands to open and close their eyes. The records included ratings of the blepharospasm that had been given by doctors who saw the patients. Additionally, Peterson’s coauthors in the study included a set of experienced clinicians who rated the severity of each patient’s eye spasms by watching the same video being analyzed by CERT.

The new program was able to find a patient’s face in 100 percent of the video frames for 46 of the 49 patients—in the 3 other cases, it identified the face in more than 93 percent of video frames. CERT’s measure of severity, given as a percentage of eye closure time, correlated with the ratings given by both live clinicians as well as those who watched the video. The correlations varied slightly, but that was expected because of the natural variation in the standard rating scales, the researchers say. “Next, we have some further software development that has to happen to make the program more automated, and it needs to be validated with larger cohorts,” says Peterson.

Once validated for use with blepharospasm, Peterson points out that CERT could be adapted to be used for other disorders that involve abnormal movements and muscle contractions in the face.

Other researchers on the study were Gwen C. Littlewort and Marian S. Bartlett of the University of California, San Diego, Antonella Macerollo of University College London, Joel S. Perlmutter of Washington University School of Medicine, H.A. Jinnah of Emory University, and Mark Hallett of the National Institute of Neurological Disorders and Stroke.

The work and the researchers involved were supported by grants from the Dystonia Coalition, the Office of Rare Diseases Research at the National Center for Advancing Translational Sciences and the National Institute of Neurological Disorders and Stroke, the Bachmann-Strauss Dystonia & Parkinson Foundation, the Benign Essential Blepharospasm Research Foundation, the Kavli Institute for Brain and Mind at UCSD, the National Institute of Mental Health, and the National Science Foundation.

PUBLICATION INFORMATION

JOURNAL

Neurology

TITLE

Objective, computerized video-based rating of blepharospasm severity

AUTHORS

David A. Peterson and Terrence J. Sejnowski of the Salk Institute, Gwen C. Littlewort and Marian S. Bartlett of the University of California, San Diego, Antonella Macerollo of University College London, Joel S. Perlmutter of Washington University School of Medicine, H.A. Jinnah of Emory University, and Mark Hallett of the National Institute of Neurological Disorders and Stroke.

For More Information

Office of Communications
Tel: (858) 453-4100
press@salk.edu

The Salk Institute For Biological Studies:

Unlocking the secrets of life itself is the driving force behind the Salk Institute. Our team of world-class, award-winning scientists pushes the boundaries of knowledge in areas such as neuroscience, cancer research, aging, immunobiology, plant biology, computational biology and more. Founded by Jonas Salk, developer of the first safe and effective polio vaccine, the Institute is an independent, nonprofit research organization and architectural landmark: small by choice, intimate by nature, and fearless in the face of any challenge.