Chapter 2: Learning and Adaptation
Summary
- Behaviors may be selected by evolution if they have survival value. Such behaviors are innate in the sense that they have no obvious original basis in learning.
- Evolution is a process that allows adaptation between generations; learning, on the other hand, is a process that allows adaptation within an animal’s lifetime.
- Through instrumental conditioning, animals learn to increase their contact with good S*s (S*s with positive survival value) and decrease their contact with bad S*s (S*s with negative survival value). The law of effect describes this state of affairs. Behaviors increase if they produce good S*s (reward learning) or prevent bad S*s (avoidance or escape learning). They decrease if they produce bad S*s (punishment) or prevent good S*s (omission). The term “reinforcement” means strengthening; it is used to describe either reward learning (positive reinforcement) or avoidance and escape learning (negative reinforcement).
- Shaping allows new behaviors to be added to an animal’s repertoire. In shaping, new behaviors emerge because successive approximations of the behavior are differentially reinforced. Shaping does not necessarily require a teacher, and it resembles natural selection in the sense that behavior is selected by its consequences.
- n classical conditioning, animals learn to respond to signals for S*. The response is adaptive because it helps the animal optimize its interaction with the upcoming S*. Signals for food evoke responses that help the animal digest the meal and identify good and bad food sources. Signals for rivals and for mates evoke responses that prepare the animal for a fight or a sexual encounter. Danger signals evoke a constellation of physiological and behavioral responses that allow the animal to defend itself against the impending aversive S*. Conditioning with drug S*s allows the learning of adaptive responses, like the compensatory conditioned response, that help an animal maintain equilibrium.
- Through classical conditioning, animals also learn to approach signals for good S*s as well as those that predict the absence of bad S*s; they also withdraw from signals that predict the presence of bad S*s or the absence of good S*s. This tendency is called sign tracking, and it complements the law of effect in helping animals to increase or decrease their contact with events that have either positive or negative survival value.
- Extinction occurs in both instrumental and classical conditioning. It is a decline in responding that occurs when S* no longer follows the signal or behavior that previously predicted it. Extinction allows the animal to continue to adapt as the environment changes. It is also useful in reducing unwanted behaviors in the clinic.
- Classical and instrumental conditioning are both sensitive to the timing and the magnitude of S*. Learning is best when S* follows the signal or the behavior quickly and when S* is large or intense.
- Evolution may prepare animals to associate some events more readily than others. Such “preparedness” is evident in both classical and instrumental conditioning. This phenomenon was discovered in aversion learning experiments: Taste is a good signal for illness but a bad one for an electric shock, while audiovisual cues are bad signals for illness but good cues for shock.

