MIT CSAIL: Revealing hidden video just from its casting shadows

The team of researchers created a new AI algorithm that can help cameras "see" off-camera things using only moving shadows. They showed they can recover a video of motion taking place in a hidden scene by observing changes in illumination in a nearby visible region. They looked at the indirect effect on shadows and shading in an observed region. Their method can reconstruct a hidden video based on the shadows it casts. All in all, the researchers have taken an interesting path toward grasping information beyond line of sight.

Their paper discussing their work is called "Computational Mirrors: Blind Inverse Light Transport by Deep Matrix Factorization," and it is on arXiv.

Vid: https://www.youtube.com/watch?v=hhEJMpouMS8

No comments :