New eyewear could help the visually impaired | Science News for Students

New eyewear could help the visually impaired

Ultrasound could spot obstacles in someone’s path, while other sensors could help identify colors
May 30, 2018 — 3:58 pm EST
ultrasound glasses

Axel Toro Vega, 15, from Puerto Rico, models the new electronic device he developed. This prototype (white band) uses ultrasound emissions to help visually impaired people detect obstacles in front of them.

Axel Toro Vega

PITTSBURGH, Pa. — About 253 million people — nearly one in every 30 worldwide — have some type of visual impairment. Roughly 36 million of them are totally blind. All of these people face daily challenges, from navigating safely to telling one color from another (which is important when your currency is color-coded). But two teen inventors have just unveiled new technologies to ease such problems. 

Axel Toro Vega, 15, is a 10th grader at Dr. Carlos González High School in Aguada, Puerto Rico. Jane Hantanto, 18, is a senior at Smak Penabur Gading Serpong school. It’s in Kabupaten Tangerang, Indonesia. These teens live half a world apart. But earlier this month, both arrived here to unveil their new adaptive technologies at the Intel International Science and Engineering Fair (ISEF).

They were among nearly 1,800 students from 81 nations, regions and territories who competed for about $5 million is prizes and scholarships. 

One of the biggest problems for people with visual impairments is safely getting from one place to another. To avoid bumping into or tripping over objects, many blind people use a cane. And in previous years, ISEF finalists have invented a number of “smart” canes to navigate around obstacles. Axel took a different route. His navigation band instead alerts wearers to objects in their path.

ultrasound glasses 2
A close-up of Axel’s electronic device (this version in black) shows the ultrasonic emitters and receivers (one pair of each on the left and the right), as well as the postage-stamp-sized computer (inside the band) that controls them and interprets data.
Axel Toro Vega

In effect, this device uses sound to help people see. Ultrasound, actually. It’s a range of high frequencies that people typically can’t hear. (Ultra is a Latin prefix that means “beyond” or “above.”) Few people can hear above frequencies of 20,000 hertz, or cycles per second. Axel’s new device broadcasts at 40,000 hertz. And there’s a good reason for that, the teen adds. He doesn’t want their use to audibly distract whomever wears them (or anyone nearby).

The teen mounted each of its two ultrasound emitters and two receivers in small holes on the device. Future versions, he notes, can be custom-printed to fit the dimensions of its wearer’s head.

Axel modeled a prototype device at Intel ISEF. He wore the narrow bar, which he 3-D printed, atop a regular pair of glasses at eyebrow level. But if he was totally blind, he could wear them in place of glasses at eye level, much like the adaptive eyewear worn by Lt. Cmdr. Geordi La Forge (LeVar Burton’s TV character on Star Trek: The Next Generation).

How it works

Key to the new device is a postage-stamp-sized computer chip. It controls the ultrasonic emitters (one over each eye). It directs these to regularly send out a brief pulse of sound. Each pulse lasts about 10 millionths of a second. The sound waves travel out, then bounce back to the system’s receivers (also positioned with one over each eye). The computer calculates how long it takes for an echo to return. The quicker that is, the closer is the object off of which it bounced.

The computer beeps a warning when it detects an object within 1.3 meters (4 feet) of the wearer. That warning can be heard through earphones, such as those used to listen to musical devices. If an object is closer than 50 centimeters (20 inches), the glasses actually vibrate.

Each emitter and receiver can detect objects located in a cone that is about 80 degrees wide. Together, both emitters and receivers, which are mounted side-by-side, can “see” objects in a swath about 140 degrees wide. That will include almost everything that’s in front of its wearer. But the system isn’t perfect, Axel admits. If a person is looking straight ahead and level, the system can only detect obstacles that are at least knee high. To see something lower than that, a wearer would need to periodically scan downward, too.

Six volunteers helped test Axel’s prototype. Most wore blindfolds during the trials. But one social worker at Axel’s school, who is blind, also took part in the tests, which included 16 obstacles. Axel’s system ended up spotting about 88 percent of them. 

Listening to color

Of all visual impairments, colorblindness is relatively benign. Still, it can pose serious challenges. People with the red-green form can’t distinguish red from green (which can make interpreting traffic light signaling difficult). They also have trouble identifying some shades of purple. Red-green colorblindness is the most common type. It afflicts more than one in every 20 males and fewer than one in 200 females. But Jane notes that this isn’t the only form of colorblindness. For instance, some people can’t tell blue from yellow.

In all its forms, colorblindness can interfere with education because many charts and graphs are color-coded. It can keep people from properly matching the colors of their clothes. It even can pose a problem to shoppers, Jane points out. That’s because many products come in different versions with labels that differ largely by color. And in Indonesia, Jane’s homeland, the paper currency also differs by color.

Jane Hantanto
Jane Hantanto invented a wearable system to help visually impaired people identify colors. It uses three sensors at the wearer’s fingertip (as seen in the prototype) and a cellphone-sized computer (inside orange bag).
Chris Ayers/Society for Science & the Public

Jane decided to invent a device to help discriminate between colors. It mounts on a pair of glasses. Like Axel’s, her system uses sensors and a computer. (Her computer is slightly larger and heftier, about the size of a cell phone.) Its computer easily can be worn in a small pouch on an armband.

A small gadget that can fit on a fingertip contains three sensors and a small white light-emitting diode (LED). When held against an object, the LED shines light on the object, which then reflects back to the sensors. One sensor detects red light and grades its intensity on a scale from 1 to 256. The other two sensors use the same scale to measure green and blue. Together, these scores represent the unique color of the object. (Any color can be represented in such a red-green-blue, or RGB, color system, Jane notes.)

Jane’s computer uses those three values to create a musical tone. The RGB scores modify, among other things, the tone’s frequency and volume. In general, lighter colors create a louder tone, says Jane. In theory, Jane’s RGB scores could represent more than 16.7 million colors. In practice, the teen notes, people can’t really tell the subtle differences between that many sounds.

Nevertheless, when she tested her system with blind volunteers, they quickly learned to identify a few colors. Some of her tests involved the light reflected off of fruit. In about one-third of those trials, volunteers were able to correctly match the “sound” of the fruit with the tone generated by a similar-colored sheet of origami paper.

In a different set of tests, Jane tested her classmates (who were blindfolded) to see if they could match a particular tone they heard with the one created by a specific color they had memorized earlier. In these trials, her classmates were, on average, able to learn seven different colors in about 5 minutes.

Many people with visual impairments might benefit from Jane’s system. Indeed, this system would work for people who are totally blind, she notes.

Society for Science & the Public created the ISEF competition and has been running it since 1950. (The Society also runs Science News for Students and this blog.) Intel sponsored this year’s event.

Power Words

(for more about Power Words, click here)

3-D printing     A means of producing physical items — including toys, foods and even body parts — using a machine that takes instructions from a computer program. That program tells the machine how and where to lay down successive layers of some raw material (the “ink”) to create a three-dimensional object.

average     (in science) A term for the arithmetic mean, which is the sum of a group of numbers that is then divided by the size of the group.

benign     Not harmful to one’s health. Malignant, in contrast, means harmful and generally refers to cancer.

broadcast     To cast — or send out — something over a relatively large distance. A farmer may broadcast seeds by flinging them by hand over a large area. A loudspeaker may send sounds out over a great distance. An electronic transmitter may emit electromagnetic signals over the air to a distant radio, television or other receiving device.

computer chip     (also integrated circuit) The computer component that processes and stores information.

currency     The money (coins, banknotes, etc.) that a country uses as a medium of exchange.

degree     (in geometry) A unit of measurement for angles. Each degree equals one three-hundred-and-sixtieth of the circumference of a circle.

diode     An electronic part that works like a one-way valve for electric current.

discriminate     (n. discrimination) The detection or recognition of a difference between two or more versions of something.

echo     To bounce back. For example, sound bouncing off walls of a tunnel, and returning to their source. Radio waves emitted above the surface can also bounce off the bedrock underneath an ice sheet — then return to the surface.

frequency     The number of times a specified periodic phenomenon occurs within a specified time interval. (In physics) The number of wavelengths that occurs over a particular interval of time.

hertz     The frequency with which something (such as a wavelength) occurs, measured in the number of times the cycle repeats during each second of time.

high school     A designation for grades nine through 12 in the U.S. system of compulsory public education. High-school graduates may apply to colleges for further, advanced education.

Intel International Science and Engineering Fair (Intel ISEF)     Initially launched in 1950, this competition is one of three created (and still run) by the Society for Science & the Public. Each year now, approximately 1,800 high school students from more than 80 countries, regions, and territories are awarded the opportunity to showcase their independent research at Intel ISEF and compete for an average of almost $5 million in prizes. 

LED     (short for light emitting diode) Electronic components that, as their name suggests, emit light when electricity flows through them. LEDs are very energy-efficient and often can be very bright. They have lately been replacing conventional lights for home and commercial lamps.

navigate     To find one’s way through a landscape using visual cues, sensory information (like scents), magnetic information (like an internal compass) or other techniques.

prototype     A first or early model of some device, system or product that still needs to be perfected.

range     The full extent or distribution of something. For instance, a plant or animal’s range is the area over which it naturally exists.

red-green-blue (RGB) One system for representing a color to be displayed on a computer or television screen. The overall color is described in terms of the value (intensity) of the individual components of red, blue and green. (These often are expressed as a percentage, from 0 to 100). By adding together the RGB values, it is possible to reproduce any color.

sensor     A device that picks up information on physical or chemical conditions — such as temperature, barometric pressure, salinity, humidity, pH, light intensity or radiation — and stores or broadcasts that information. Scientists and engineers often rely on sensors to inform them of conditions that may change over time or that exist far from where a researcher can measure them directly.

social work    A profession in which people are trained to help others who face some type of limitations or challenges. Those challenges may be mental, physical, financial or social (their ability to interact effectively with others). People who work in this field are known as social workers.

sound wave     A wave that transmits sound. Sound waves have alternating swaths of high and low pressure.

ultrasound     (adj. ultrasonic) Sounds at frequencies above the range that can be detected by the human ear. Also the name given to a medical procedure that uses ultrasound to “see” within the body.