Neural substrates underlying the expectation of rewards resulting from effortful exertion

Using fMRI and an incentivized grip-force paradigm, this study demonstrates that reward expectations act as neural reference points in the ventral striatum that recalibrate the subjective value of effort, thereby governing whether individuals persist in or abandon effortful tasks.

The Gist

Imagine you are a rideshare driver. You've been driving for a few hours, and you're wondering: "Should I keep going for another hour, or should I call it a day?"

Usually, we think the answer is simple: "Is the money I'm making right now worth the tiredness in my legs?" But this new study suggests that's not the whole story. It turns out, your brain doesn't just look at the current money; it looks at what you expected to make.

Here is the breakdown of this fascinating research, explained with some everyday analogies.

The Big Question: Why Do We Keep Pushing?

The researchers wanted to know: Why do people keep working hard when they are tired?

Economic theory has long suggested that we have an "internal target." If you expect to make $100 today, and you've only made $50, you might drive an extra hour to hit that target. But if you've already made $150, you might pack it in early. This is called Reference Dependence. It means we judge our effort not by the absolute amount of money, but by how it compares to our expectations.

The big mystery was: Where in the brain does this "expectation math" happen?

The Experiment: The "Grip Strength" Game

To find out, the scientists put people in an MRI machine (a giant camera for the brain) and gave them a simple task: Squeeze a handgrip.

1. The Training: First, they taught the participants that squeezing harder earns more money. Squeeze a little? You get a little cash. Squeeze as hard as you can? You get $4.
2. The Twist: Then, they introduced a "mystery" choice. On any given turn, the participant could get paid based on how hard they squeezed (the "Wage Rate"), OR they could get a Fixed Payment (a guaranteed amount, like $2), regardless of how hard they squeezed.
3. The Catch: The participant didn't know which payment method would be chosen until after they squeezed.

The "Thermostat" Analogy

Here is the clever part. The researchers used the Fixed Payment as a way to set the participant's "expectation thermostat."

• Scenario A: The Fixed Payment is low ($0.50). The participant thinks, "Even if I get the fixed pay, it's nothing. But if I get the wage rate, I can make a lot!" So, they squeeze hard.
• Scenario B: The Fixed Payment is high ($3.50). The participant thinks, "Wow, even if I get the fixed pay, that's a great amount. I don't need to squeeze my heart out to get a decent payout." So, they might squeeze less.

The Result: The participants' effort changed based on that "Fixed Payment" number. They weren't just reacting to the money they could make; they were reacting to the money they expected to make. If their expectation was high, they were willing to work harder to "beat" that expectation. If their expectation was low, they relaxed.

The Brain's "Scoreboard": The Ventral Striatum

While the participants squeezed, the MRI camera was watching their brains. They found a specific area called the Ventral Striatum (let's call it the brain's "Scoreboard").

This Scoreboard did two amazing things:

1. It tracked the Expectation: When the "Fixed Payment" number was shown, the Scoreboard lit up. It was saying, "Okay, the target is set at $3.50."
2. It tracked the Surprise: When the money was actually awarded, the Scoreboard lit up again based on the difference between what they got and what they expected.
   • If they got more than expected? Big cheer! (The brain lights up).
   • If they got less than expected? Disappointment. (The brain reacts differently).

The "Coach" Metaphor

Think of the Ventral Striatum as a sports coach standing on the sidelines.

• The coach sets a goal for the player: "You need to score 10 points to win."
• As the player runs, the coach watches the scoreboard.
• If the player is at 9 points, the coach screams, "Go! You're so close!" (This motivates the player to push harder).
• If the player is at 11 points, the coach says, "Relax, you've already won." (The player slows down).

The study found that this "Coach" in our brains is constantly recalibrating how much effort we are willing to give based on what we thought we were going to achieve.

Why Does This Matter?

This study changes how we understand motivation.

• Old View: We work hard because the reward is big.
• New View: We work hard because we are trying to match or exceed our expectations.

This explains why a salesperson might work overtime to hit a monthly quota they set for themselves, or why a student might study all night because they expected to get an A, even if the test was easy.

The Takeaway:
Your brain has a built-in "reference point." It's not just about the reward you get; it's about the gap between what you hoped for and what you got. If you want to stay motivated, you have to manage your expectations. If you set the bar too high, you might burn out trying to reach it. If you set it just right, your brain's "Scoreboard" will keep cheering you on.

Technical Summary

1. Problem Statement

While economic theories and field observations suggest that human effort is reference-dependent (i.e., individuals evaluate effort relative to expected earnings rather than absolute incentives), the causal mechanisms and neural substrates underlying this phenomenon remain poorly understood.

• The Gap: Existing literature establishes that labor supply responds to deviations from expected earnings (e.g., taxi drivers working fewer hours when daily income targets are met early), but it is unclear how the brain encodes these expectations during effort-based decision-making.
• The Hypothesis: The authors hypothesize that reward expectations serve as a reference point that modulates effort exertion. Specifically, they propose that the Ventral Striatum (VS) encodes both prospective reward expectations and the deviation between realized and expected outcomes (reward prediction errors), thereby driving reference-dependent effort.

2. Methodology

The study employed an incentivized grip-force paradigm combined with functional magnetic resonance imaging (fMRI) to isolate the effects of expectations on effort.

• Participants & Task Design:

  • Participants performed a physical effort task using hand grip force, normalized to their Maximum Voluntary Contraction (MVC).
  • Training Phase: Participants learned the association between effort levels and monetary rewards (up to $4 for maximum exertion).
  • Recall Phase: Participants demonstrated they could accurately exert specific effort levels to achieve target earnings.
  • Effort Provision Phase (Main Experiment): Participants faced a choice between two probabilistic outcomes (50/50 chance):
    1. Wage Rate Payment: Earnings proportional to the effort exerted.
    2. Fixed Payment: A set monetary amount regardless of effort.
  • Experimental Manipulation: The "Fixed Payment" amount was varied across trials to serve as an exogenous reference point. Participants had to decide how much effort to exert before knowing which payment scheme would be realized.

• Neuroimaging Analysis:

  • A General Linear Model (GLM) was used to analyze fMRI data.
  • Condition 1 (Incentive Presentation): Parametric modulation by the magnitude of the Fixed Payment (representing the reference point/expectation).
  • Condition 2 (Outcome Presentation): Parametric modulation by the Reward Prediction Error (RPE), calculated as the deviation between actual earnings and the expected value (0.5 × Fixed Payment + 0.5 × Wage Rate Payment).
  • Behavioral-Neural Correlation: Individual differences in reference-dependent effort (sensitivity to the fixed payment) were regressed against whole-brain neural activity.

3. Key Results

Behavioral Findings

• Reference-Dependent Effort: Participants systematically adjusted their effort based on the Fixed Payment. As the Fixed Payment (reference point) increased, participants exerted more effort.
• Mechanism: This suggests participants were motivated to "close the gap" between their potential wage earnings and the fixed payment. If the fixed payment was high, they exerted more effort to ensure their wage earnings matched or exceeded it.
• Variability: There was significant inter-individual variability in how strongly the fixed payment influenced effort, with most participants showing a positive intercept (exerting effort even when the fixed payment was low).

Neural Findings

• Prospective Expectation Encoding: During the incentive presentation, activity in the Ventral Striatum (VS) increased linearly with the magnitude of the Fixed Payment. This indicates the VS encodes the prospective reward value acting as a reference point.
• Outcome Evaluation (RPE): During outcome presentation, bilateral VS activity scaled positively with the deviation between actual earnings and expected earnings. This confirms the VS processes reward prediction errors in the context of effort.
• Individual Differences: The degree to which an individual's effort was influenced by the fixed payment (behavioral reference dependence) was positively correlated with left VS activity modulated by the expected value at the time of outcome presentation. Stronger VS signals predicted greater sensitivity to reference points.

4. Key Contributions

1. Causal Evidence of Reference Dependence: The study provides experimental proof that reward expectations act as a causal determinant of effort, distinct from the actual cost of effort or absolute reward magnitude.
2. Neural Mechanism Identification: It identifies the Ventral Striatum as the critical neural substrate that integrates exogenous expectations (reference points) with effort valuation.
3. Bridging Economics and Neuroscience: The findings validate economic theories of reference-dependent labor supply (e.g., the "target income" hypothesis) by mapping them to specific neural computations (expectation encoding and prediction errors).
4. Generalizability: The results suggest that reference dependence is not limited to market transactions but is a fundamental principle governing motivated physical exertion.

5. Significance and Implications

• Theoretical Impact: The paper challenges the traditional view of effort as a simple trade-off between absolute reward and cost. Instead, it posits that effort is evaluated relative to a dynamic reference point established by expectations.
• Clinical and Practical Applications: Understanding the neural basis of reference-dependent motivation offers insights into:
  • Motivational Deficits: Conditions like depression or fatigue where the "reference point" may be dysregulated, leading to reduced effort even when rewards are available.
  • Performance Optimization: Strategies for managing persistence in physical or cognitive tasks by manipulating expectation frameworks.
• Cost Structure Nuance: The authors note a divergence from some prior studies where effort decreased once marginal costs exceeded returns. They attribute this to the transient nature of physical effort in their task versus the irreversible temporal costs in previous studies, suggesting that the recoverability of effort costs modulates reference dependence.

In summary, this research demonstrates that the brain does not evaluate effort in a vacuum; rather, the Ventral Striatum continuously recalibrates the value of exertion based on what is expected, making expectations a fundamental driver of human motivation and persistence.