Has ACL Lost Its Crown? A Decade-Long Quantitative Analysis of Scale and Impact Across Leading AI Conferences
This ten-year quantitative study of seven leading AI conferences reveals that while conference expansion has not yielded proportional growth in scholarly impact, the ACL conference continues to maintain its leadership position in citation metrics and milestone contributions.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine a massive, bustling city of ideas called Artificial Intelligence, where scientists build digital brains that can read, write, and chat just like humans. In this city, the most important way to share a new discovery is by presenting it at a "conference"—think of these as the city's biggest annual music festivals or science fairs. For a long time, there was one festival that everyone agreed was the absolute best, the "crown jewel" of the bunch. But recently, the city has exploded with growth. More people are building digital brains, more papers are being written, and the festivals have gotten huge. With this boom, some people started whispering in the streets: "Is the quality getting worse? Is the top festival losing its magic? Are we just accepting too many things just to keep the party going?" This paper steps in to answer those questions, not by listening to rumors or reading angry comments on social media, but by crunching ten years of hard numbers to see what really happened.
The researchers decided to play detective, looking at data from 2014 to 2024 across seven of the biggest AI festivals. They built a special measuring tool they call "Quality-Quantity Elasticity" (QQE). You can think of this like a rubber band. If you stretch a rubber band (add more accepted papers), does it snap back with a huge pop of new value (citations from other scientists)? Or does it just get loose and floppy? They also looked at how famous the papers were, how spread out the attention was, and how much the festivals influenced each other.
Here is what they found: The rubber band is definitely getting looser. Even though the festivals have grown massively in size, the amount of new scholarly impact hasn't kept up. In other words, just because a conference accepts more papers doesn't mean those papers are getting cited more often; the growth in "popularity" is lagging behind the growth in "volume." However, the big surprise is that the "crown" hasn't fallen off. Despite the chaos and the complaints, the top conference, known as ACL, is still the king of the hill. When you look at the median number of citations, the most important milestone papers, and how widely the work is read, ACL is still outperforming its rivals. So, while the party has gotten crowded and the quality of every single new entry might be stretching thin, the main stage is still holding its title as the most influential spot in the neighborhood. The authors provide this decade-long evidence to show that while the landscape has changed, the hierarchy of influence remains surprisingly stable.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.