Ignoring population structure in hominin evolutionary models can lead to the inference of spurious admixture events

Abstract

Genomic and ancient DNA data have revolutionized palaeoanthropology and our vision of human evolution, with indisputable landmarks like the sequencing of Neanderthal and Denisovan genomes. Yet, using genetic data to identify, date and quantify evolutionary events—such as ancient bottlenecks or admixture—is not straightforward, as inferences may depend on model assumptions. In the last two decades, the idea that Neanderthals and members of the Homo sapiens lineage interbred has gained momentum. From the status of unlikely theory, it has reached consensus among human evolutionary biologists. This theory is mainly supported by statistical approaches that depend on demographic models minimizing or ignoring population structure, despite its widespread occurrence and the fact that, when ignored, population structure can lead to the inference of spurious demographic events. We simulated genomic data under a structured and admixture-free model of human evolution, and found that all the tested admixture approaches identified long Neanderthal fragments in our simulated genomes and an admixture event that never took place. We also observed that several published admixture models failed to predict important empirical diversity or admixture statistics, and that we could identify several scenarios from our structured model that better predicted these statistics jointly. Using a simulated time series of ancient DNA, the structured scenarios could also predict the trajectory of the empirical D statistics. Our results suggest that models accounting for population structure are fundamental to improve our understanding of human evolution, and that admixture between Neanderthals and H. sapiens needs to be re-evaluated in the light of structured models. Beyond the Neanderthal case, we argue that ancient hybridization events, which are increasingly documented in many species, including with other hominins, may also benefit from such re-evaluation.