Shake, Rattle, and Zoom
Space Science News home
A Shaky Proposition
The process to develop VISAR began over two years ago, following a request from the Southeast Bomb Task Force of the FBI. A video showing the bombing of the 1996 Olympic Games in Atlanta was of particularly poor quality, so the FBI task force asked if anyone at NASA's Marshall Space Flight Center could help improve the video's clarity.
Both Hathaway and Meyer had reason to believe they might be able to improve the crime scene video images. Meyer, a meteorologist and computer scientist working in Global Hydrology, processes weather satellite images. As a solar physicist, Hathaway uses video stabilization techniques to enhance pictures of the Sun.
Left: A handheld video camera can make for shaky footage. VISAR can smooth the jitters. This single frame shows some of the sharpening.to see the QuickTime movie (requires QuickTime 3.0 or later) which demonstrates both sharpening and stabilization. shows deblurring of the car.
"Telescopes are always shaky," states Hathaway. This jitter affects measurements of the Sun's position or features on the solar surface.
Sign up for our EXPRESS SCIENCE NEWS delivery
The two scientists began working on the FBI bombing video, a dark nighttime shot filmed with a shaky handheld camcorder. Luckily, the scientists had over 400 frames (more than 13 seconds) to work with. After a long process of trial and error, they were eventually able to stabilize, sharpen, and brighten the image.
Stabilizing the image is necessary to create a clear picture from a video sequence. Most image sharpening techniques, says Hathaway, are "crude and dirty." Current techniques usually just sharpen the edges of an image, without taking into account how the blurring occurred. Zooming in, for instance, makes an image larger and more spread out. And these techniques only work on one frame at a time, so the effects of video noise, or snow, cannot be accounted for. Such sharpening techniques can bring out the noise, distorting the image even further. Because VISAR allows you to combine several video images together, noise can be averaged out among the frames. The more images you can combine, the greater the corrective power of VISAR.
Right: Two pairs of video frames demonstrate how VISAR can stabilize a shaky image in this video of a recent Space Shuttle launch. The frames with a "V" are stabilized, as indicated by the blue lines showing two key features on the same level, and by the blank areas at bottom (No. 2) and top (No. 4). The original video frames are unmarked. Links to. Credit: NASA
Hathaway and Meyer's efforts in correcting the FBI video surpassed existing image-correction technology. The video correction methods currently in use could not compensate for the effects of zoom or tilt, as Hathaway and Meyer did. By steadying and reducing the noise in the images, they brought out a wealth of information, revealing new, previously obscured details.
Hathaway and Meyer decided to take everything they'd learned about image processing and create the new video stabilization product VISAR. They already knew their process was better than anything currently in use. They were further encouraged by scientific colleagues at the Los Alamos National Laboratory in New Mexico, who claimed that VISAR was better than anything they'd ever seen. VISAR is currently covered under a provisional patent, and will soon be available for licensing.
A Vision for the Future
Hathaway believes VISAR could be helpful to law enforcement. Police often use video to identify suspects, to investigate a crime scene, or to spot identifying characteristics. VISAR could be used to steady images of car chases shot from inside a moving police car, enabling police to focus on a license plate number, or even on an image of the driver's face reflected in the rear-view mirror. VISAR could also aid in identifying faces in a crowd. This would be especially useful at arson sites, for instance, because arsonists typically love to return to the scene to watch their handiwork. VISAR could be used to scrutinize onlookers at several different arson sites to identify repeat visitors.
Above: The single frame shows the recorded view in a low-light situation. Brightening adds both light and noise. VISAR, by adding the information from multiple frames, can actually show a person picking the lock. Fifty frames of video is a little under two seconds worth.to see more detail in QuickTime 3.0 format. Credit: NASA
VISAR could have applications in medical imaging as well. Ultrasounds, for instance, are infamous for their grainy, blurred quality. Puzzled moms and dads would no longer have to peer anxiously at obscure ultrasound images. More importantly, doctors could make better medical diagnoses based on steadier, clearer images. And as laproscopic surgery becomes more common, VISAR could steady images that would help not only during the surgery, but also in the training videos shown to students afterward.
Paul Meyer would like to see VISAR applied to meteorology, to track cloud formations and storms. VISAR could be used to determine if the images of a hurricane's eye have moved, rotated, or changed dimensions. VISAR would be especially useful for tornado videos, which are often shot on home video cameras by people unlucky enough to be caught in the path of the storm. If you could steady the image of the tornado, you could track objects whirling on the outside of the tornado. Tracking a whirling object, be it a tractor, truck or cow, would help determine the tornado's wind speed.
Left: Oops, wrong button! to see a QuickTime movie showing correction for a bad zoom. Credit: NASA
Hathaway believes the biggest potential market could be the home consumer, who would use VISAR to improve the quality of homemade movies. Homemade movies are notorious for their poor quality, since they are shot by amateurs who are often just learning how to use their cameras as they're shooting. Although many camcorder devices currently have built-in anti-jitter devices, there are currently no devices to fix problems having to do with zoom and tilt.
"If you've ever used a video camera, you've probably hit the wrong end of the zoom button," Hathaway states wryly. "VISAR can be used to correct these mistakes afterward."
VISAR would also allow people to give their homemade videos movie-style special effects.
"VISAR would be great for all those Steven Spielberg wanna-bees who want to make a video of their kids being chased by dinosaurs," Hathaway says. VISAR would allow you to determine precisely where someone is in the frame, which would then enable you to add a layer of special effects correlated to that position.
A Thousand (or more) Points of Light
A "pixel", derived from the phrase "picture element," is a tiny square of color that makes up an image. This technique is similar to Pointillism, the painting style that uses tiny dots of color to create a picture. On computer screens, a blend of red, green and blue determines the specific color of a pixel (in print, it's a blend of cyan, yellow, magneta, and black). The sharpness of an image depends on the density of pixels in an image, or pixels per inch (ppi). The standard ppi for computer monitors is 72 pixels per inch, although they can vary from 50 to 100 ppi. Most magazines print at 300 dpi (dots or pixels per inch); art books go to 1200 dpi.
VISAR's corrective power depends on how many video frames are available to be blended together, but generally VISAR can correct image jitter to about 1/10th of a pixel. It can correct magnification and zoom to 0.1 percent and angles to within 0.03 degrees.
The language of VISAR has become more accessible as well. Originally formatted on a difficult and obscure computer language, Interactive Data Language (IDL), VISAR was translated to the Windows version of C++. Changing the software increased the processing speed from 5 minutes to 15 seconds per video frame. Hathaway and Meyer think they can eventually reduce the processing time even further. Ultimately, they would like to develop "real-time" correction - to actually correct video as it's being filmed.
The development of VISAR relied on the teamwork between Hathaway and Meyer. Whenever one person was stuck on the problem, the other usually came up with a solution. Their very different educational backgrounds and fields of work gave them a broader base of knowledge from which to work.
Created through the efforts of a solar physicist and a meteorologist, VISAR is an example of how science that often seems distant or obscure ends up being used to solve familiar, everyday problems. Soon anyone will be able to use VISAR to turn out clearer, steadier videos. Thanks to VISAR, people subjected to watching someone's home movies may no longer have to wish they'd brought the Dramamine.
More Space Science Headlines - NASA research on the web
NASA's Office of Space Science press releases and other news related to NASA and astrophysics
return to Space Science News Home
|For more information, please contact:
Dr. John M. Horack , Director of Science Communications
|Author: Leslie Mullen
Curator: Linda Porter
NASA Official: Ron Koczor