People who have lived in the dark from birth have now found they don't need their eyes to see. A new device developed by Amir Amedi .. http://brain.huji.ac.il/default.asp .. from the Hebrew University of Jerusalem in Israel and colleagues is giving congenitally blind adults the ability to interpret visual information from sound.
In this video, you can watch people listen to sounds that illustrate an object or a facial expression, then describe what they are "seeing". The system can also be used to read by assigning sounds to letters.
A tiny camera is strapped to the user's head and connected to a computer or smartphone. An algorithm converts images to sound, providing a depiction of an object via headphones. Sound dips higher or lower to represent the surface of a shape, allowing the person to form a representation in their mind. It took about 70 hours of training for a blind person to learn to describe a range of images.
By monitoring the neural activity of blind people using the device, Amedi and his team found that even though the users weren't using their eyes, their visual cortex was activated by the soundscapes. This shows, for the first time, that specialised areas responsible for object recognition or reading can still be triggered later in life even if they have never been exposed to normal visual information.
The team now plans to enhance the experience by using music to represent colours, shapes and locations. Using the system is mentally demanding so more pleasant audio should help make it more relaxing.
Mindscapes: Stroke turned ex-con into rhyming painter
17:05 10 May 2013 by Helen Thomson For similar stories, visit the Mindscapes , Mental Health and The Human Brain Topic Guides
Mindscapes is our new column on brain science with a difference: we meet people who live with the world's most mysterious neurological conditions
Name: Tommy McHugh Disorder: Sudden artistic output following brain damage
"Canvases became too costly, so I started painting the ceilings and the wallpaper and the floor" (Image: Gianni Bianchini)
"I was sitting on the toilet. I suddenly felt an explosion in the left side of my head and ended up on the floor. I think the only thing that kept me conscious was that I didn't want to be found with my pants down. Then the other side of my head went bang! I woke up in hospital and looked out of the window to see the tree was sprouting numbers. 3, 6, 9. Then I started talking in rhyme…"
Ten days after having a subarachnoid haemorrhage – a stroke caused by bleeding in and around the brain – Tommy McHugh, an ex-con who'd been in his fair share of scraps, became a new man, with a personality that nobody recognised.
When he was a young man, Tommy did time in prison. But after his stroke at age 51, everything changed. "I could taste the femininity inside of myself," he said. "My head was full of rhymes and images and pictures."
Not only did he feel a sudden urge to write poetry, but he also began to paint and draw obsessively for up to 19 hours a day. He was never artistic before – in fact, he joked that he'd never even been in an art gallery "except to maybe steal something".
Flaherty says the haemorrhage sent blood squirting around the brain surface, affecting a lot of areas. It left Tommy unusually emotional and unable to hurt anyone, "like Zen monks sweeping steps before they walk," says Flaherty. "Everything strikes him as beautiful and cosmically meaningful."
Scanning Tommy's brain was impossible after an operation to treat the stroke damage left him with a piece of metal in his head. Instead, Lythgoe performed a neuropsychological evaluation. Tommy's IQ was in the normal range. However, he showed verbal disinhibition – he tended to talk a lot – and had difficulty with tests that required him to switch between different cognitive tasks. All of which suggested problems with the frontal lobes.
"That's what Tommy's mind does all the time," says Lythgoe. Everything he heard and saw triggered a stream of associations that he found difficult to stop. Tommy saw it as having a brain that shows him "endless, endless corridors". He said his paintings represented a snapshot of a millisecond in his brain.
"I'll paint three or six or nine pictures at a time. I see those numbers in my head all the time. Canvases became too costly, so I started painting the ceilings and the wallpaper and the floor. I can't stop painting and sculpting. Give me a mountain and I'll turn it into a profile. If you give me a bare tree I'll change it, so when spring come all the leaves will create the face, the mouth, the lips. Without hurting the tree."
Offering advice for others with brain damage, he said that people who have had strokes need to learn not to think of themselves as ill, with the dangers of depression that can bring. "Some repairs to the brain are constructive, some are negative. One has to learn to develop one's damaged brain, adapt and start to live again. You can either sit on your bum or look in the mirror and say 'I'm alive'."
He wouldn't even have wanted his old mind back: "The most wonderful thing that happened to Tommy McHugh," he laughed, "is having a stroke while doing a poo."
He wouldn't have changed a thing. "My two strokes have given me 11 years of a magnificent adventure that nobody could have expected."
Tommy McHugh passed away on 19 September 2012, having spoken to New Scientist several times that year. Samples of his artwork can be viewed on his website. http://www.tommymchugh.co.uk/