ADHD shows a different reaction to expected rewards and to rewards received.
1. Neurophysiological correlates of reward expectation¶
The dopaminergic projections from the VTA to the ventral striatum (the nucleus accumbens) influence reward and motivation, while dopaminergic projections from the substantia nigra to the dorsal striatum influence voluntary movements and habit learning.
Six components of reward processing were identified:
- Association
- Differentiation
- Preference/rating
- Effort
- Expectation
- Reaction
Selected evidence suggests that these develop in the first 6 months of life after birth
1.1. Striatum and reward expectation: underactivated in ADHD and stress¶
ADHD could be due to altered reward sensitivity. fMRI studies found that ADHD
- For references to (monetary and affiliate) incentives
- Hypoactivation in the bilateral ventral and dorsal striatum
- For food rewards, on the other hand, there was no difference between those with ADHD and those without.
Affiliate reactions are behaviors that signal a desire to make contact.
1.1.1. Ventral striatum for reward anticipation: underactivated in ADHD¶
In rats that performed actions required to obtain a reward, dopamine levels continued to rise as the reward approached, peaking when the reward was received. Afterwards, when they consumed the reward, it quickly dropped again.
ADHD correlates with reduced activity in response to anticipated rewards in the brain regions of the reward center (including the nucleus accumbens). Motivation triggered by (correspondingly high) personally interesting rewards reduces ADHD symptoms.
Adult males with ADHD-HI were found to have decreased activation of the ventral striatum during gain anticipation and increased activation of the orbitofrontal cortex in response to a gain. The lower the activation of the ventral striatum during gain anticipation, the higher the hyperactivity and impulsivity. Children with ADHD-HI showed a significantly reduced volume of the ventral striatum bilaterally and a correlation of the reduction of the right ventral striatum with hyperactivity / impulsivity.
Brain activity on reward anticipation and reward maintenance appears to be subtype-specific. ADHD-I showed bilateral underactivation of the ventral striatum during reward anticipation compared to ADHD-C and healthy controls. In contrast, ADHD-C showed underactivation of the OFC in response to reward compared to ADHD-I and controls.
One study found underactivation of the striatum during reward anticipation in ADHD-C only in adults, but not in children.
Another study found in ADHD-HI that hyperactivity/impulsivity correlated with (relatively) decreased ventral striatal activity during reward anticipation and increased ventral striatal activity as a reward response. In contrast, non-affected individuals showed increased activity of the ventral striatum during reward anticipation.
ADHD symptoms in children correlated with reduced activation of the striatum during reward anticipation, regardless of the severity of ADHD symptoms.
Dihydro-β-erythroidine (DHβE) is a plant-derived competitive antagonist of nicotinic receptors. It is an inhibitor of nicotinic acetylcholine receptors containing β2 units (β2* NAChRs; β2 nicotinic receptors). DHβE reduces the phasic release of dopamine in the dorsolateral striatum
It follows that reward anticipation, which is controlled by phasic dopamine in the striatum and even more so in the nucleus accumbens, is also increased by β2 nicotinic receptor agonists - such as nicotine - .
1.1.2. Striatum for reward expectation and stress¶
1.1.2.1. Striatum with reward expectation: increased activation during acute stress¶
Acute stress also increases dopamine, including in the nucleus accumbens, which triggers motivational expectancy. The increased expectation of motivation appears to be mediated by CRH release in the nucleus accumbens. A CRH1 antagonist blocks this reinforcing effect of acute stress on reward motivation. High chronic stress abolishes - up to 90 days after the cessation of the stressor - the ability of CRH to increase dopamine in the nucleus accumbens and at the same time causes a switch from appetitive to aversive motivation, as is also observed in major depressive disorder MDD.
1.1.2.2. Striatum for reward expectation: underactivated in chronic stress¶
Chronic stress reduces the dopaminergic activity of the striatum in the long term. Institutional neglect, early childhood stress or maltreatment inhibit the striatal reward function, which is dopaminergically mediated.
More on this at ⇒ Changes in the dopaminergic system due to chronic stress
1.1.2.3. Striatum with reward expectation: underactivated after early childhood stress¶
Early childhood stress (e.g. postnatal deprivation, maternal separation) led to reduced mesolimbic dopamine levels in the striatum and reduced motivation to pursue rewards in adult rats and monkeys. Monkeys with early childhood stress experience showed reduced interest in rewards. However, reward consumption remained unchanged. Increased noradrenaline degradation substances were found in the urine.
In humans, early childhood stress is also associated with reduced reward-related activity in the ventral striatum, which is associated with increased symptoms of anhedonia, although the data did not differentiate between reward expectation and reward receipt. It is conceivable that reduced reactivity to rewards received in particular correlates with anhedonia or depression.
Adolescents who were maltreated as children showed reduced dopaminergic activation of the pallidum (part of the striatum) during reward anticipation with simultaneously stronger symptoms of depression.
Further studies confirm that early childhood stress (without a direct link to depression) correlates with reduced activation of the striatum during reward anticipation, but not during reward maintenance. This is consistent with the changes in ADHD with respect to both reward anticipation and reward maintenance.
More on this at ⇒ Early childhood stress permanently alters the dopaminergic system
1.2. ACC, PFC, cerebellum in reward anticipation: overactivated in ADHD¶
A larger study found increased responses during reward anticipation in adolescents and young adults with ADHD in the
-
Anterior cingulate cortex (ACC)
-
PFC
-
Cerebellum
The results for the unaffected siblings were identical, with the exception of the cerebellum.
1.3. Ventral anterior thalamus in reward anticipation: underactivated in ADHD¶
In the control group, cues that predicted a reward caused greater activation in the ventral anterior thalamus than cues that did not predict a reward, whereas in ADHD, cues that predicted a reward caused less activation than cues that did not predict a reward.
1.4. OFC activity in reward anticipation: increased in ADHD¶
An fMRI study found a significant signal increase in the OFC to large compared to small expected rewards in all test subjects. In ADHD, the responses were significantly stronger and also correlated with hyperactivity / impulsivity. High cognitive abilities normalized the OFC responses.
1.5. Further changes during reward and loss expectation in early childhood stress¶
A study that re-examined children with high and low early childhood stress after 10 years found:
Early childhood stress correlated with
- With expectation of loss
- Reduced activation of the putamen
- Reduced activation of the insula
- When suffering losses
- Increased activation of the left lower frontal gyrus
- With reward expectation
- Reduced activation of the posterior cingulate cortex
- Reduced activation of the precuneus
- Reduced activation of the middle temporal gyrus
- Reduced activation of the upper occipital cortex
1.6. Stress, anhedonia and the VTA-BLA-NAc pathway¶
A signaling pathway between the ventral tegmentum, basolateral amygdala and nucleus accumbens appears to be activated by (sexual) reward. Blockade of this pathway caused anhedonic behavior. Chronic stress (by movement restriction in rats) inhibited the responsiveness of VTA dopaminergic neurons to sexual reward. Reactivation of ventral tegmental area cells associated with sexual reward experience acutely counteracted stress-induced impairment of reward-seeking behavior (anhedonia).
(Severe) one-off stress can cause long-lasting neuroadaptive changes in VTA dopamine neurons. Thus, even a single acute stress can alter the responsiveness of VTA dopamine neurons to future stressors or rewards.
2. Neurophysiological correlates of reward reception¶
2.1. OFC for reward maintenance: overactivation in ADHD¶
A larger study found increased reactions in adolescents and young adults with ADHD during the receipt of rewards in the
-
OFC
-
Occipital lobe
-
Ventral striatum
In the unaffected siblings, the results were identical, with the exception of the ventral striatum.
ADHD-HI symptom severity predicted higher orbitofrontal activity in response to an immediate reward.
2.2. Caudate nucleus and frontal eye field in reward maintenance in ADHD¶
In the control group, feedback that no reward was given caused stronger activation in the left caudate nucleus and in the frontal eye field than feedback about rewards received, while in the ADHD-HI group, feedback that no reward was given caused weaker activation in the left caudate nucleus and in the frontal eye field than feedback about rewards received.
2.3. Nucleus accumbens and reward response¶
Mice in which dopamine was chemically reduced in the nucleus accumbens showed a reduced response to offered rewards. The nucleus accumbens appears to dopaminergically moderate the response to rewards and aversive stimuli. Motivational control by the nucleus accumbens appears to be stimulated by the mPFC via noradrenaline. Noradrenaline deficiency in the mPFC leads to dopamine deficiency in the nucleus accumbens with the resulting changes in motivational control.
2.4. Connectivity of the ventral striatum during reward reception: increased in ADHD¶
ADHD sufferers show increased activity in the ventral striatum and superior frontal gyrus and increased connectivity between the ventral striatum and motor control regions when receiving rewards.
Increased activation in the ventral striatum was also shown in ADHD when receiving affiliative rewards.
For food rewards, on the other hand, there was no difference between those with ADHD and those without.
3. Control of motivation through dopamine¶
Motivation is controlled by increased dopamine in the ventral striatum (nucleus accumbens).
The increase in dopamine levels can be triggered by various mechanisms.
3.1. Phasic impulses from dopaminergic cells of the VTA¶
The mesolimbic dopamine projection from the VTA to the nucleus accumbens is a central element for reward-driven learning and for the motivation to be active for more reward.
The dorsolateral striatum, the nucleus accumbens core and the nucleus accumbens shell responded in vitro with different dopamine releases to electrical stimulation of different numbers (single pulse (tonic), 5 pulses, 20 pulses (phasic) each at 20 Hz and 0.5 to 1 ms in length):
- Single pulse (tonic signal)
-
Dorsolateral striatum: high dopaminergic response
-
Nucleus accumbens core: intermediate dopaminergic response
-
Nucleus accumbens shell: low dopaminergic response
- 5 Impulses
-
Dorsolateral striatum: high dopaminergic response
-
Nucleus accumbens core: intermediate dopaminergic response
-
Nucleus accumbens shell: intermediate dopaminergic response
- 20 pulses (phasic signal)
-
Dorsolateral striatum: smallest increase in dopaminergic response
-
Nucleus accumbens core: mean increase in dopaminergic response
-
Nucleus accumbens shell: largest increase in dopaminergic response
The dorsolateral striatum responded to tonic stimuli with an amplification of the dopaminergic signal and to phasic stimuli with an attenuation, while the nucleus accumbens shell responded to tonic stimulation with a weak dopamine signal and to phasic stimulation with a strong dopamine signal.
With a very slow tonic stimulation at 0.2 Hz, followed by a 5-pulse burst at 20 Hz, the dopamine amplitude in the dorsolateral striatum is higher than in the nucleus accumbens shell, and the dopamine release to the phasic stimulus is higher in both regions than to the preceding tonic stimulation. In the nucleus accumbens shell, the increase in dopamine release from the tonic to the phasic stimulus is higher than in the dl striatum.
The usual tonic firing frequency of dopaminergic neurons is around 4 Hz
- Continuous single pulses of 3.3 Hz (tonic signal)
-
Dopamine response began to blur
- Static dopaminergic background level
- 5 pulses at 20 Hz
-
Dorsolateral striatum: only slightly increased dopaminergic response
-
Nucleus accumbens core: significantly increased dopaminergic response
-
Nucleus accumbens shell: very clearly increased dopaminergic response
A strong phasic dopamine response is a respresentative of an unexpected positive perception that is better than the expectation, e.g. for a surprising reward. Expected rewards do not correlate with phasic dopamine bursts in the striatum.
3.2. Increase in tonic extracellular dopamine due to varicosities?
There is evidence that motivational dopamine dynamics do not result from the firing of VTA dopamine cells, but may reflect local influences on forebrain dopamine varicosities:
The mesolimbic dopamine projection sent from the VTA to the nucleus accumbens encodes reward prediction errors. These are important as learning signals for behavioral adaptation.
However, the actual release of dopamine in the nucleus accumbens corresponds more to the value of reward anticipation, a motivational signal that promotes approach behavior.
This discrepancy could be due to changes in the tonic firing of the dopamine neurons, or to a fundamental separation between firing and release.
Dopamine release in the nucleus accumbens core and the ventral prelimbic cortex correlates with reward anticipation.
In contrast, the firing rate of dopamine neurons in the VTA does not correlate with reward expectancy, but with transient, error-like responses to unexpected cues, thus encoding reward prediction errors.
