Understanding learning in neural circuits requires answering a number of difficult questions: (1) What is the computation being performed and what is its behavioral significance? (2) What are the inputs required for the computation and how are they represented at the level of spikes? (3) What are the sites and rules governing plasticity, i.e. how do pre and post-synaptic activity patterns produce persistent changes in synaptic strength? (4) How does network connectivity and dynamics shape the computation being performed? I will discuss joint experimental and theoretical work addressing these questions in the context of the electrosensory lobe (ELL) of weakly electric mormyrid fish.