Operant Conditioning: How Consequences Shape Behaviour
By the BrainSnail editorial team. How these articles are written and checked, and how to tell us when one is wrong.
Operant conditioning is a form of learning in which the consequences that follow a behaviour influence how likely that behaviour is to happen again. If an action is followed by a rewarding outcome, it may become more common. If it is followed by an unpleasant or costly outcome, it may become less common.
It starts with consequences
Psychologist B. F. Skinner developed influential work on operant learning, building on earlier research about how consequences shape behaviour. The basic unit is straightforward: an organism does something, a consequence follows, and future behaviour changes depending on that relationship.
Reinforcement increases the future likelihood of a behaviour. Positive reinforcement adds something valued after the behaviour, such as praise after careful work. Negative reinforcement removes something unpleasant, such as fastening a seat belt to stop an irritating warning sound. Both forms strengthen behaviour.
This vocabulary is central to operant conditioning because 'positive' and 'negative' do not mean good and bad. Positive means something is added, while negative means something is removed. Reinforcement tells you the behaviour becomes more likely.
Punishment aims to reduce behaviour
Punishment is defined by its effect of reducing a behaviour. Positive punishment adds a consequence, while negative punishment removes something valued. For example, an extra chore after breaking a rule could be positive punishment, while temporarily losing a privilege could be negative punishment.
In real life, consequences do not always work as intended. A response meant as punishment can accidentally provide attention that reinforces the behaviour. A reward can lose its value. Timing, consistency, individual preferences, and the surrounding situation all affect learning.
That is why operant conditioning is more useful when you observe what actually happens to behaviour rather than labelling a consequence by intention alone. If the behaviour increases, the consequence functioned as reinforcement. If it decreases, it may have functioned as punishment.
Shaping and reinforcement schedules
Operant learning can become more complex than one action followed by one result:
- •Shaping reinforces small steps that gradually get closer to a target behaviour.
- •Continuous reinforcement rewards every correct response and can help establish a new behaviour.
- •Partial reinforcement rewards only some responses and can make behaviour more persistent.
- •Fixed schedules use predictable counts or times, while variable schedules change when reinforcement arrives.
- •Extinction can occur when a previously reinforced behaviour stops producing the expected consequence.
Discriminative stimuli add another useful detail. A behaviour may be reinforced in one setting but not another, so cues in the environment can signal when a response is likely to produce a consequence. A student may raise a hand in class because that behaviour has been reinforced there, but not use the same response at home. Operant conditioning therefore involves relationships among behaviour, consequences, and context rather than consequences acting in isolation.
You can practise operant conditioning vocabulary by describing one behaviour at a time. Name the action, name the consequence, then ask whether the action becomes more or less frequent. Only after that should you decide whether the example is positive reinforcement, negative reinforcement, positive punishment, or negative punishment.
Clicker training, operant conditioning in action
Animal trainers use operant conditioning every day, and clicker training shows the principles clearly. Reinforcement works best when it follows a behaviour immediately, but a dog that sits cannot always be handed a treat in that same instant. So the trainer first pairs a distinct click with food until the sound itself predicts a reward. The click then marks the exact moment the right behaviour happened, bridging the delay before the treat arrives. Pairing the click with food is classical conditioning, while using the click to strengthen sitting is operant conditioning.
Clickers make shaping practical. To teach a dog to lie on a mat, a trainer might click for looking at the mat, then for stepping towards it, then for standing on it, and finally only for lying down. Skinner himself used similar methods with pigeons, training them to turn in circles and even to knock a ball back and forth in a kind of table tennis. During the Second World War he also worked on Project Pigeon, a plan to have trained pigeons guide missiles by pecking at a target on a screen, which was never put into use.
From Thorndike's cats to slot machines
Before Skinner, the American psychologist Edward Thorndike studied hungry cats in wooden puzzle boxes, publishing his results in 1898. A cat could escape and reach food only by pulling a loop or pressing a lever. At first it scratched and pushed at random until it hit the right movement by accident. Over repeated trials, escape times fell gradually rather than suddenly, which suggested the cat was not reasoning out a solution but having successful actions stamped in. Thorndike called this the law of effect: responses followed by satisfying results become more likely. Skinner later built his operant chamber to measure the same kind of learning more precisely.
Skinner's experiments showed that each reinforcement schedule produces its own pattern of behaviour. On a fixed-interval schedule, where a reward becomes available after a set time, responding tends to drop just after each reward and speed up as the next one approaches, much as some students study hardest just before a test. A variable-ratio schedule, which rewards after an unpredictable number of responses, produces fast, steady responding that is very resistant to extinction. Slot machines work this way, because any pull might pay out. Critics have argued that some app and game features, such as pull-to-refresh feeds and loot boxes, borrow the same unpredictable reward pattern.
The Premack principle: using one activity to reward another
Reinforcers do not have to be treats or praise. Around 1960 the psychologist David Premack argued that an activity a person or animal does often, when given free choice, can reinforce one they do less often. In one study, children who preferred playing a pinball machine to eating sweets ate more sweets when doing so earned them a turn on the machine, while children with the opposite preference played more pinball when it earned them sweets. What counts as a reward depends on the individual's own preferences, not on what an observer assumes.
You can apply this to your own routine. Notice what you do readily, perhaps messaging friends or playing a game, and make it follow something you tend to put off: twenty minutes of practice questions first, then the game. The order matters, because the preferred activity has to come after the target behaviour to strengthen it. Later researchers added a twist called response deprivation. Almost any activity can work as a reinforcer if access to it is restricted below the level a person would normally choose, which is why a rationed activity can motivate even when it is not someone's favourite.
The takeaway
Operant conditioning explains how consequences can shape future behaviour through reinforcement, punishment, shaping, and changing schedules. Keep two questions separate: was something added or removed, and did the behaviour become more or less likely? That simple grid prevents most terminology mix-ups. Then look at the real pattern over time, because the effect of a consequence matters more than what someone intended it to do.