A delivery gap in electricity grid expansion

Technical Summary: A Delivery Gap in Electricity Grid Expansion

Problem Statement
Expanding transmission grids is a prerequisite for meeting global climate and energy targets, yet the deployment process is characterized by significant delays and high failure rates. While a political consensus acknowledges that current deployment rates are insufficient for the energy transition, empirical evidence quantifying the magnitude of these delays and the attrition of investment pipelines has been scarce. Existing literature often relies on single-project case studies or country-specific qualitative analyses, which lack the scale necessary for generalizability. Furthermore, official planning frameworks, such as the European Ten-Year Network Development Plan (TYNDP), often rely on forward-looking projections that suffer from optimism bias, failing to account for the structural realities of infrastructure delivery. The paper posits that promoters treat development rights as "options" rather than firm commitments, leading to an inflated investment pipeline that overstates deliverable grid capacity.

Methodology
To address these gaps, the authors constructed a novel, granular longitudinal dataset covering over 900 distinct European transmission investments (N = 965) across a 16-year timeframe (2010–2026). The data was harmonized from biennial ENTSO-E TYNDP reports, Monitoring Updates, and Draft Project Portfolios.

• Data Harmonization: The authors mapped disparate reporting cycles and nomenclature into a unified schema using "Investment IDs" as the primary unit of analysis to avoid double-counting aggregated projects. They employed regular expressions and manual validation to standardize geographic coordinates, project statuses, and expected commissioning dates.
• Lifecycle Modeling: The investment lifecycle was disaggregated into five sequential phases: (1) Consideration, (2) Planning, (3) Design and Permitting, (4) Construction, and (5) Commissioning, with a sixth absorbing state for Cancellation.
• Statistical Analysis:
  • Absorbing Markov Chain: To correct for left-truncation (omission of early-stage projects) and right-censoring (ongoing projects with optimistic deadlines), the authors modeled the lifecycle as an absorbing Markov chain. This allowed for the calculation of the Conditional Mean First Passage Time (MFPT) to commissioning, accounting for the probability of cancellation at each stage.
  • Multi-state Cox Proportional Hazards: A semi-Markov Cox model was used to estimate transition intensities between phases. This model treated project cancellation as a competing risk against successful phase transitions. It incorporated covariates for jurisdiction (EU vs. Extra-EU), investment type (upgrade vs. greenfield), technology (AC vs. DC), and temporal shocks (EU reforms, COVID-19).
  • Delay and Cancellation Drivers: The authors utilized Natural Language Processing (NLP), combining TF-IDF clustering, HDBSCAN, and LLMs (Llama 3.2) to classify textual justifications for rescheduling and cancellations into thematic categories.
  • Systemic Impact: The empirical failure rates and delays were integrated with ENTSO-E Cost-Benefit Analysis (CBA) data to estimate macroeconomic welfare losses, renewable energy curtailment, and additional greenhouse gas emissions.

Key Results

• Extended Timelines: The expected duration for a transmission investment to reach commissioning is 14.1 years (95% CI [13.1, 15.2]), significantly exceeding the official 10-year baseline. Physical construction accounts for only 3.8 years (27%) of this timeline; the remaining 73% is consumed by administrative and planning phases, particularly permitting.
• High Attrition and Delays:
  • 55% of tracked investments fail to meet their initial commissioning targets, accumulating an average delay of 4.7 years.
  • 46% of announced investments are ultimately cancelled or withdrawn. An investment entering the "Consideration" phase faces an 87% probability of cancellation, which decreases to 14% only upon entering the "Construction" phase.
• Drivers of Delay:
  • Jurisdiction: EU Member projects advance 159% faster through the "Consideration" phase than Extra-EU projects. Cross-border status provides an 80% acceleration in early stages.
  • Phase-Specific Bottlenecks: Early-stage rescheduling is driven primarily by strategic interdependencies (28.4%) and technical scope (22.4%). Late-stage delays are dominated by regulatory and permitting frameworks (42.6%).
  • Policy Impact: Recent EU reforms (e.g., revised EIA Directive) accelerated permitting speeds by over 400%, while the COVID-19 pandemic reduced transition intensity in the "Design and Permitting" phase by 90%.
• Option-Holding Behavior: The data suggests promoters treat the pipeline as a portfolio of non-binding options. Cancellations are increasingly driven by failure to meet compliance frameworks (28%) rather than pure financial unviability, indicating that projects are held to resolve uncertainty before committing capital.

Key Contributions

1. Empirical Quantification: This study provides the first large-scale, continental assessment of transmission deployment timelines, moving beyond case studies to establish a robust empirical baseline for grid expansion.
2. Methodological Innovation: By applying absorbing Markov chains and multi-state survival models to infrastructure planning data, the authors successfully isolate the "success path" from cancellations, correcting for statistical biases inherent in standard planning reports.
3. Identification of the "Delivery Gap": The paper quantifies the discrepancy between the "announced" investment pipeline and "deliverable" capacity, demonstrating that official plans significantly overstate future grid capacity.
4. Causal Analysis of Attrition: Through NLP analysis of promoter justifications, the study identifies the shifting drivers of project failure, highlighting the role of regulatory compliance and strategic obsolescence over pure market viability.

Significance and Claims
The paper argues that the current "option-holding" behavior of grid promoters creates a market failure where an inflated pipeline signals uncertainty to renewable energy developers, leading to a feedback loop of mutual waiting that raises the cost of the energy transition.

• Economic and Environmental Costs: If historical failure rates persist, the authors estimate that between 2030 and 2040, grid bottlenecks will result in a cumulative welfare loss of €158 billion, renewable energy curtailment of 2,826 TWh (equivalent to the EU's 2025 electricity consumption), and additional emissions of 488 MtCO2e.
• Post-2040 Deficit: The study claims that achieving the optimal 2040 grid topology requires 28 GW of capacity that has not yet entered the planning phase. Given the 14.1-year lead time, this capacity cannot physically be delivered by 2040, creating a permanent infrastructure gap with an estimated annual penalty of €18 billion in lost welfare.
• Regulatory Implications: The authors propose a three-tiered regulatory approach to close the information gap: (1) anchoring reporting to initial commitments and publishing historical cancellation probabilities; (2) enforcing stricter, binding commitments as projects advance through phases; and (3) including anticipatory investments in network tariffs to de-risk first movers.

The paper concludes that climate and energy assessments must treat the investment pipeline as a measure of prepared capacity rather than a forecast of future capacity, as the gap between planned and delivered transmission is larger than official scenarios suggest.