Tuesday, June 13, 2023

AI visual cortex


AI re-creates what people see by reading their brain scans

https://www.science.org/content/article/ai-re-creates-what-people-see-reading-their-brain-scans

Shinji Nishimoto, another systems neuroscientist at Osaka University who worked on the study, hopes that with further refinements the technology could be used to intercept imagined thoughts and dreams, or could allow scientists to understand how differently other animals perceive reality.

-

https://www.euronews.com/next/2023/05/10/a-new-ai-tool-that-can-decode-brain-signals-proves-95-accurate-on-mice

https://www.youtube.com/watch?v=bWZiPT8IhRY

Scientists used artificial intelligence (AI) to read a mouse’s brain while it watched a video clip - and then reconstruct what it saw.

Researchers scientists from the Swiss Federal Institute of Technology (EPFL) have developed a new machine-learning algorithm to translate brain signals into videos.

The algorithm, called CEBRA (and pronounced zebra), has the potential to reveal the hidden structure in data recorded from the brain and predict complex information.

In an experiment, researchers successfully reconstructed a film seen by a mouse using the novel technique.

"We asked the question: could we actually reconstruct what the animal was watching just purely from the neural data?" said Mackenzie Mathis, a neuroscientist at EPFL.

"We used our new algorithm CEBRA to build this latent representation of the embedding space. And then you can take this embedding space and essentially use that as the basis for a neural decoding algorithm and then predict exactly the sequence of frames the mouse was watching".