💻 computer science

Beyond Citations: Comparing Scholarly, Policy, and Patent Impact Across the FT50 Journals

This study challenges the assumption that the Financial Times 50 (FT50) journal list represents a homogeneous tier of excellence by demonstrating that journals exhibit significant heterogeneity across scholarly, policy, and patent impact dimensions, revealing that reliance on citation-only metrics overlooks substantial variations in real-world research influence.

Original authors: Arash Hajikhani, Yi Zhang, Mengjia Wu

Published 2026-06-17

📖 5 min read🧠 Deep dive

CC BY 4.0

Original authors: Arash Hajikhani, Yi Zhang, Mengjia Wu

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). ✨ This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine the FT50 as a prestigious "Hall of Fame" for business and management research. For decades, university deans and hiring committees have treated this list like a simple "Yes/No" switch: if a journal is on the list, it's "excellent." If it's not, it's not.

This paper argues that treating the list as a single, uniform block of excellence is like judging a sports team by saying, "Everyone on the roster is an athlete," without realizing that some are Olympic sprinters, some are chess grandmasters, and some are just really good at stretching.

Here is the breakdown of what the researchers found, using simple analogies:

1. The Three Different "Sports"

The researchers realized that "impact" isn't just one thing. They looked at the 53 journals on the list through three different lenses, or "sports":

The Academic Sport (Citations): This is the traditional measure. It counts how many other scholars read and reference a paper. Think of this as popularity among peers.
The Policy Sport (Government Reach): This counts how often government reports, NGO briefs, or policy documents cite the research. Think of this as influence on the rules of society.
The Patent Sport (Industry Reach): This counts how often the research is cited in patents (new inventions or business processes). Think of this as influence on the marketplace and technology.

2. The "Specialization" Shock

The biggest surprise was that these three "sports" don't overlap much. A journal that is a superstar in one area is often average or even invisible in the others.

The Policy Giants: The top Economics journals are like heavyweights in the "Policy Sport." They are cited by governments constantly. But they don't necessarily show up in patent citations.
The Tech & Marketing Giants: The top Information Systems and Marketing journals are the champions of the "Patent Sport." Their ideas are frequently used to build new products and business strategies.
The Pure Academics: Many Management and Accounting journals are incredibly popular among other scholars (high citations), but they rarely make it into government reports or patent filings. They are like a local celebrity who is famous in their neighborhood but unknown to the rest of the world.

The "Empty Corner": The researchers found a "missing zone." No single journal on the list is a superstar at both influencing government policy and driving industry patents at the same time. You have to pick a lane.

3. The "One-Size-Fits-All" Problem

Because the FT50 list treats all these journals as equal, it hides a massive difference in quality.

The Analogy: Imagine a school report card that gives every student an "A" simply because they are in the "Advanced Class." But if you look closer, one student is solving calculus problems, another is writing poetry, and a third is just memorizing the alphabet.
The Reality: The researchers found that the top journals in the "Policy Sport" are cited by governments 250 times more often (per paper) than the journals at the bottom of the list. Yet, under the current system, they are all just "FT50 members."

4. The "Quality Map"

The authors created a map to show where each journal actually sits:

Top Right (The Superstars): A small group of journals (mostly Economics, Finance, and some Management) that are strong in both academic citations and real-world impact.
Top Left: Journals that are great at influencing industry (patents) but less dominant in pure academic citations.
Bottom Right: Journals that are famous among scholars but have almost no reach outside the university walls.
Bottom Left: Journals that struggle to make an impact in any of the three areas.

5. The 2026 List Update

The Financial Times recently updated their list, removing three journals and adding three new ones. The researchers checked this change against their "Quality Map."

The Result: The update actually made sense! The journals they removed were sitting in the "Bottom Left" (low impact across the board). The journals they added were strong in specific areas (one was a citation powerhouse, one was strong in policy, one in patents).
The Takeaway: The list is slowly becoming more aware of these different "sports," but it still treats them as a single group.

The Bottom Line

The paper concludes that the FT50 list is not a lie, but it is incomplete. It acts like a binary switch (On/Off), but the reality is a spectrum.

If you are a university trying to hire the best researchers, or a government trying to find the best advice, you can't just ask, "Is it on the FT50?" You have to ask, "What kind of impact does it have?" Because a journal that is great at teaching other professors might be terrible at helping a government write a law, and vice versa. The list needs to stop pretending all its members are the same.

Technical Summary: Beyond Citations: Comparing Scholarly, Policy, and Patent Impact Across the FT50 Journals

Problem Statement
The Financial Times 50 (FT50) journal list serves as a primary metric for hiring, promotion, and accreditation in business schools globally. However, the list is frequently treated as a homogeneous tier of excellence, implying that all included journals possess comparable quality and impact. The authors challenge this assumption, noting that existing evaluations often rely on a single dimension (citation counts) or focus on specific disciplinary slices. This approach fails to capture the potential heterogeneity in impact channels, such as policy uptake and technological reach, and overlooks the "Goodhart-style decay" and volume-driven dilution affecting citation-based metrics. The central research question is whether the FT50 identifies a uniform tier of high-quality outlets or if it bundles incommensurable types of scholarship with vastly different impact profiles.

Methodology
The study employs a comparative cross-journal analysis using a panel of 53 journals (the 50 journals on the FT50 prior to the 2026 update, plus the three journals added in 2026, while retaining the three removed journals for comparative purposes).

Data Sources: The analysis utilizes a coupled dataset from three sources:
- Scopus/SciVal: For bibliographic data and citation metrics.
- Overton: For public policy document citations.
- Patent Offices: Data from five major offices (EPO, USPTO, UK IPO, JPO, WIPO) for patent citations.
Time Window: The headline analysis covers publications from 2005 to 2019. This window was selected to ensure sufficient time for citation, policy, and patent accrual, particularly given the lags inherent in patent examination and policy indexing. Sensitivity analyses were conducted using alternative windows (2005–2014, 2010–2019, and 2015–2019).
Indicators: Seven per-publication indicators were computed to normalize for volume and field:
1. Scholarly Impact (3): Field-Weighted Citation Impact (FWCI), Top-10% rate, and Field-Weighted Views Impact.
2. Policy Reach (2): Policy citations per published paper and the share of papers cited by at least one policy document.
3. Technological Reach (2): Patent citations per published paper and the share of papers cited by at least one patent.
Analytical Approach: Journals were ranked on each indicator, and a composite rank was derived from the mean of these seven ranks. A "FT50 quality map" was constructed using z-scores to visualize journals on a two-dimensional plane defined by citation impact (x-axis) and societal impact (policy + patent) (y-axis). Stability was assessed using Kendall's $\tau$ correlation across different time windows.

Key Results

Striking Heterogeneity: Even after per-publication normalization, the FT50 journals exhibit massive disparities in impact. For instance, the Quarterly Journal of Economics records roughly 250 times more policy citations per paper than Contemporary Accounting Research. Similarly, MIS Quarterly has significant patent citations, while Academy of Management Review has essentially none.
Channel Orthogonality: Citation, policy, and patent impacts behave as largely independent dimensions. The correlation between FWCI and policy citations is weak (0.27), and between FWCI and patent citations is negative (-0.12). No journal achieves above-median per-paper reach in both policy and patent channels simultaneously (the upper-right quadrant of the quality map is empty).
Disciplinary Specialization:
- Policy Impact: Dominated by elite economics journals (e.g., American Economic Review, Journal of Political Economy), which account for 65% of the policy-citation footprint.
- Patent Impact: Dominated by Information Systems, Marketing, and Operations Research journals.
- Citation Impact: Management journals dominate raw citation counts and views but contribute less than 8% to societal channels.
Composite Ranking Shifts: When policy and patent indicators are incorporated into a composite ranking, nearly half of the journals (25 out of 53) change quartile positions compared to a citation-only ranking. Elite economics and finance journals generally rise in the composite ranking, while many management journals with high citation counts but low societal reach fall.
Stability: The identification of top and bottom tiers is stable across different publication-year windows, with Kendall's $\tau$ values ranging from 0.69 to 0.89 between rankings derived from different windows.
2026 List Update: The 2026 revision (removing three management journals and adding Academy of Management Annals, American Sociological Review, and Psychological Science) aligns closely with the study's findings. The removed journals were in the bottom quartile of the composite ranking, while the additions occupy higher tiers, though none fill the "high policy + high patent" gap.

Significance and Claims
The paper does not claim to determine the "correct" list of journals but aims to characterize the within-list quality spectrum. Its primary contribution is descriptive, revealing that the binary "in-or-out" FT50 label obscures a substantial spectrum of impact.

Independence of Impact Dimensions: The study demonstrates that citation-based metrics are poor proxies for policy or technological impact. Relying solely on citations overlooks important dimensions of research influence.
Limitations of Current Evaluation: The results suggest that assessments based solely on scholarly citations are insufficient for capturing the full scope of a journal's influence.
Recommendation for Presentation: The authors propose that a "channel-aware" or multi-tier presentation of the FT50 list would better communicate the heterogeneity of the journals to deans and accreditation bodies without altering the list's fundamental role in research evaluation.
Modest Scope: The authors explicitly note that the analysis is within-FT50 and does not compare these journals against a control set of non-FT50 elite journals. Furthermore, the trajectory analysis is presented as a naive linear extrapolation to flag direction rather than a precise forecast of future performance.

In summary, the paper argues that the FT50 is not a monolithic tier of excellence but a collection of journals with distinct, often orthogonal, impact profiles. The 2026 update appears to refine the list's existing impact profile rather than fundamentally broadening its definition of quality.