How Dopamine Shapes Risky Reward Behaviors

Summary: Not all animals respond to reward cues the same way — some fixate on the cue itself, while others head straight for the reward. New research reveals that “sign trackers,” animals drawn to the cue, rely on dopamine in a specific brain region to form these associations, unlike “goal trackers,” who use a dopamine-independent mechanism.

Using optogenetics in rats, scientists showed that inhibiting dopamine at the moment of reward blocked sign-tracking behavior, while boosting dopamine had no lasting effect. This discovery sheds light on why certain individuals may be more prone to impulsivity and addiction-related behaviors.

Key Facts:

  • Sign tracking and goal tracking use fundamentally different brain mechanisms.
  • Dopamine is crucial for sign tracking but not for goal tracking.
  • Understanding these pathways may help explain risk factors for addiction and relapse.

Source: University of Pittsburgh

High school students learn that Pavlov’s dogs were conditioned to associate the sound of a bell with getting food. The association was so strong that the dogs would begin to salivate when they heard the bell, before there was even a whiff of food. When they were finally presented with the food, they ate it.

They did not lick the bell.

But that’s just what some animals will do when presented with a stimulus, or cue, that has been paired with a reward: interact with the cue.

Sometimes they’ll paw at it and even gnaw at it, said Sara Morrison, research assistant professor in the Department of Neuroscience at Pitt’s Kenneth P. Dietrich School of Arts and Sciences. Only once the reward has been delivered will they turn their attention to that tasty sugar pellet.

Animals who display this behavior are known as sign trackers. Alternatively, goal trackers head toward the area where they expect their reward to be delivered.

A study from Morrison’s lab, published in the Journal of Neuroscience on June 25, found that sign tracking is an altogether different learning process than goal tracking.

The research showed that in rats, sign trackers, learning to value a cue relies on the availability of the neurotransmitter dopamine in a particular brain region at the time they receive their reward.

Neither inhibiting nor increasing dopamine had any effect on goal trackers, Morrison said, a finding contrary to the way researchers have historically thought of cue-reward associations: as dopamine-dependent.

While that seems to be the case for sign trackers, Morrison’s research indicates goal tracking is reliant on a different, non-dopamine-dependent learning mechanism.

A better understanding of the neurological basis of sign tracking, and how to unlearn it, may help researchers better understand risk factors for related psychiatric disorders.

Sign tracking has been linked to risk-taking, impulsivity and substance abuse relapse. And it’s “sticky” — even after a reward is taken away, sign trackers are more likely to react to a cue than goal trackers.

Even if the reward is switched to something the animals aren’t interested in, sign trackers continue to react to the cue.

The research team, led by first author Ethan Herring (A&S ’23), used rats engineered with dopamine neurons that could be turned on and off using light, a method known as optogenetics, in the brain’s ventral tegmental area. The team could inhibit or increase the release of dopamine at will.

After giving rats the 8-second cue that they had been conditioned to associate with sugar pellets, the researchers turned off dopamine neurons at the time the reward was delivered.  

“Inhibiting dopamine prevented the rats from learning to sign track,” Morrison said. “When we stopped the inhibition, after a few days some went on to become sign trackers again.”

Adding additional dopamine when rats received the reward, however, did not help sign trackers learn the association any faster. And when the additional stimulation was taken away, the rats stopped developing sign-tracking abilities for a few days.

“This says something really cool,” Morris said. “The signal seemed to scale to the amount of dopamine provided. It was like we were giving a bigger reward, then took half of that away.”

The rats reacted as if the higher dopamine output was their baseline for a few days, after which they again began to improve as sign trackers.

That response makes sense, according to Morrison. “We all learn equally well from all different kinds of rewards. There must be some way our brain scales the rewards to the appropriate learning rate.”

About this neuroscience research news

Author: Brandie Jefferson
Source: University of Pittsburgh
Contact: Brandie Jefferson – University of Pittsburgh
Image: The image is credited to Neuroscience News

Original Research: Closed access.
“Modulation of Dopamine Neurons Alters Behavior and Event Encoding in the Nucleus Accumbens during Pavlovian Conditioning” by Sara Morrison et al. Journal of Neuroscience


Abstract

Modulation of Dopamine Neurons Alters Behavior and Event Encoding in the Nucleus Accumbens during Pavlovian Conditioning

When a cue is located away from its associated reward, some animals will learn to approach the site of reward (goal-tracking behavior) while others will approach the cue (sign-tracking behavior).

The acquisition of sign tracking, but not goal tracking, is dependent on dopamine in the nucleus accumbens (NAc), and we have previously demonstrated that reward-evoked activity in the NAc core may reflect different patterns of dopamine release in sign tracker versus goal tracker individuals.

However, a causal relationship among dopamine release, NAc activity, and sign tracking has not been established.

Using male and female TH::Cre rats, we expressed inhibitory or excitatory opsins in dopamine neurons of the ventral tegmental area (VTA) and examined the impact of optical manipulation of dopamine neurons on behavior and concurrent NAc neuronal activity.

We found that inhibition of VTA dopamine neurons at the time of reward suppressed the acquisition of sign-tracking, but not goal-tracking, behavior.

On the other hand, stimulation of dopamine neurons did not alter the acquisition of sign tracking; however, cessation of stimulation impeded further acquisition of sign tracking.

Finally, both inhibition and stimulation of VTA dopamine neurons rapidly modulated activity in a subset of NAc neurons and led to changes in cue- and reward-related activity across sessions.

Overall, these findings support the ideas that sign tracking and goal tracking are the products of two different learning processes—one dopamine-dependent and one not—and that the impact of VTA dopamine on sign tracking may be mediated by activity in the NAc core.

Continue Reading