Topic: natural videos

Motion detection is a fundamental task for the visual system, with cells as early as the retina showing selectivity to specific directions of motion. These cells typically have localized connectivity and receptive fields. Why not pool information from locations that are far apart to improve motion sensing? Here we provide a normative model that relates the lack of distant connections in motion-sensitive cells to the statistics of natural videos, which exhibit localized patterns undergoing localized motion. These local motions largely conserve contrast in a visual scene, allowing us to treat t

To make sense of visual scenes, the brain must segment objects from background. This is thought to be facilitated by border ownership (BOS) neurons in the primate visual cortex. These neurons encode whether a local border in a visual scene is part of an object on one or the other side of the border. It is unclear how these signals emerge in neural networks without a teaching signal of what is foreground and what is background. Here we discovered that brain-like BOS units emerge in PredNet, a deep artificial neural network that is not trained to segment objects but simply to predict future fram