Researchers advance by standing on the shoulders of giants, to paraphrase Isaac Newton. So, which research giants are still getting cited frequently today?
One way of answering that is to determine which articles appear most often in the reference lists of today’s research papers. Nature asked three bibliometricians who study patterns of references in scientific publications to dig into the data. They churned through tens of millions of references cited in all the papers published in 2023, the most complete year available in research repositories at the time.
The researchers found that popular twenty-first-century papers on topics such as artificial intelligence (AI), scientific software and methods to improve the quality of research dominate today’s reference lists. But some studies published before 2000 are still heavily acknowledged even now (see ‘Which articles are referenced the most?’).
Studying the cited references of a large collection of papers provides a foundation for finding the intellectual roots of a field, says Robin Haunschild, a scientometrician at the Max Planck Institute for Solid State Research in Stuttgart, Germany.
“This reveals the really important papers for a community,” adds Lutz Bornmann, a sociologist of science at the Max Planck Society in Munich, Germany. Bornmann and Haunschild, together with Andreas Thor, a computer scientist at the Leipzig University of Applied Sciences, Germany, conducted the technically challenging analysis for Nature. They relied on a modified version of software that Bornmann and Thor, with others, introduced in 2016 to help researchers to explore cited references1.
To compile a list of the most-cited references in publications today, Nature took the median rankings across three databases (see the scientometricians’ methodology2 and Supplementary information).
AI influencers
The analysis reveals that work on AI published in the past decade was referenced the most. Nature found a similar pattern in a related exploration of the most-cited papers published in the twenty-first century.
The most-cited papers of the twenty-first century
But some older AI studies were still citation magnets in 2023. One paper3 published in 1997 — which describes an early neural-network architecture for modelling languages called long short-term memory (LSTM) — was the tenth most cited in 2023. Because of their efficiency, LSTMs remain popular for processing some data. Jürgen Schmidhuber, a pioneer of AI and one of the authors of the 1997 paper, who is now at King Abdullah University of Science and Technology, Thuwal, Saudi Arabia, says that not all old AI papers get the same recognition, in part because those articles put forward ideas before they were feasible.
“Sadly, the field of AI and machine learning is rife with plagiarism,” he says, “and some of the most famous papers actually failed to cite the original work published when compute was millions of times more expensive than today.”
Materials high
Remarkably, another research paper4 written nearly three decades ago was the fourth most referenced work in papers published in 2023. In 1996, three researchers at Tulane University in New Orleans, Louisiana, published a clever, fast approximation that could be used in software to help researchers to calculate the interactions of electrons in materials, as a way to understand the materials’ properties.
“The citations just grew and grew and grew,” says physicist Kieron Burke, who co-authored the article with physicists John Perdew and Matthias Ernzerhof. In fact, one-quarter of the paper’s total citations were garnered in the past two years, according to the Dimensions research database, and it is also the fourth most-cited paper of all time (see ‘These are the most-cited research papers of all time’).
