Memorization

…are isolated exceptions requiring memorization. The framework studies when a learner can acquire the rule and retain those exceptions simultaneously. Its results emphasize how capacity is organized and deployed, rather than capacity alone. The talk examines how regularization and the geometry of kernels or learned feature maps can reserve resources for memorization without undermining rule learning. It connects the balance between abstraction and memory to architectural and algori

…information affect generation quality, memorization and exclusion constraints.

Understanding how humans form knowledge structures from a stream of information is a question with implications for both human cognition and artificial intelligence. Structural learning is affected by the training regime, which can be either blocked into trials of similar forms or interleaved into trials of different forms. Previous studies show mixed results with some showing that blocked regimes improve different types of learning [1, 2, 3], while others show advantages of blocked regimes [4, 5, 6]. Additionally, few studies investigated the effect of regime on structural learning specifical

…Bayesian reasoning, sampling, memorization, and logical inference. The resulting spiking neural network models capture various hippocampal cell types (grid, place, border, etc.), behavioural errors, and a variety of observed neural dyn

Our recent work presents a stochastic process model of the activations within an ANN and shows a promising indicator to distinguish memorizing from generalizing ANNs. The average λ, or mean firing rate (MFR), of a hidden layer, shows stable differences between memorizing and generalizing networks, comparatively independent of the underlying data used for evaluation. We first show the performance of this indicator during training on benchmark computer vision datasets such as MNIST and CIFAR-10. In a second step, we extend the work to the real-life use case of calibrating a pre-trained model to

Current models of behavioral performance are based on a cost/benefit analysis that ignores the impact of intrinsic motivation. Here we conceive intrinsic / extrinsic motivation as being driven by the value of the action itself (e.g., learning good stuff) / the value of the action outcome (e.g., getting a good mark). We propose that, unlike extrinsically motivated actions (for which the reward is delayed), intrinsically motivated actions (for which the reward is concomitant) may not require the exertion of effortful cognitive control.We developed a test where participants memorize and retrieve