← Back

Self Supervised Training

Topic spotlight
TopicNeuro

Self Supervised Training

Discover seminars, jobs, and research tagged with Self Supervised Training across Neuro.
1 curated item1 Seminar
Updated about 3 years ago
1 items · Self Supervised Training

Latest

1 result
SeminarNeuroscienceRecording

From Machine Learning to Autonomous Intelligence

Yann Le Cun
Meta-FAIR & Meta AI
Oct 19, 2022

How could machines learn as efficiently as humans and animals? How could machines learn to reason and plan? How could machines learn representations of percepts and action plans at multiple levels of abstraction, enabling them to reason, predict, and plan at multiple time horizons? I will propose a possible path towards autonomous intelligent agents, based on a new modular cognitive architecture and a somewhat new self supervised training paradigm. The centerpiece of the proposed architecture is a configurable predictive world model that allows the agent to plan. Behavior and learning are driven by a set of differentiable intrinsic cost functions. The world model uses a new type of energy-based model architecture called H-JEPA (Hierarchical Joint Embedding Predictive Architecture). H-JEPA learns hierarchical abstract representations of the world that are simultaneously maximally informative and maximally predictable.

Self Supervised Training coverage

1 items

Seminar1
Domain spotlight

Explore how Self Supervised Training research is advancing inside Neuro.

Visit domain