
● Variable-Ratio (VR) Schedule: Reinforcement occurs after an unpredictable
number of responses.29 (e.g., gambling on a slot machine; a sales commission
for an unpredictable number of calls).30 This produces high and steady rates of
response, as the reinforcement is unpredictable and always a possibility.
● Fixed-Interval (FI) Schedule: Reinforcement occurs for the first response after a
fixed amount of time has passed.31 (e.g., waiting for a bus that comes every 15
minutes; studying more intensely as an exam date approaches). This produces a
scalloped pattern of response, with low rates immediately after reinforcement and
higher rates as the time for the next reinforcement approaches.32
● Variable-Interval (VI) Schedule: Reinforcement occurs for the first response
after an unpredictable amount of time has passed.33 (e.g., checking emails for a
reply; fishing for a bite). This produces a slow and steady rate of response
because the timing of reinforcement is unpredictable.
Shaping Complex Behaviors and Other Key Concepts
Skinner’s theory also introduced several other crucial concepts:
● Shaping: This is the process of reinforcing successive approximations of a
desired behavior. It's how complex behaviors are taught. For instance, to teach a
dog to fetch a specific item, you might first reward it for looking at the item, then
for moving towards it, then for picking it up, and finally for bringing it to you.
● Extinction: When a previously reinforced behavior is no longer reinforced, it
gradually decreases in frequency and eventually stops.34 For example, if a
child's tantrums are ignored (no longer reinforced by parental attention), the
tantrums will likely decrease.35
● Discrimination: The ability to differentiate between stimuli and respond only to
the stimuli that signal reinforcement.36 A dog learns to sit only when given the
command "sit," not "stay."
● Generalization: The tendency for a learned response to occur in the presence of
stimuli similar to the one that was originally reinforced. A child praised for sharing
toys with one friend might generalize this behavior to other friends.