Learning entails self-modification of a system under closed-loop dynamics with its environment. Not only the system's components may change, but also the way they interact with one another - like synapses during learning in the brain, that modify interactions between neurons. Such processes, however, are not limited to the brain but can be found also in other areas of biology. I will describe a framework for a primitive form of learning that takes place within the single cell. This type of learning is composed of random modifications guided by global feedback. The capacity to utilize exploratory dynamics, improvisational in nature, provide cells with the plasticity required to overcome extreme challenges and to develop novel phenotypes.