Originally published as Genetics Published Articles Ahead of Print on July 29, 2007.
Genetics, Vol. 177, 427-434, September 2007, Copyright © 2007
doi:10.1534/genetics.107.072538
On the Choice of Genetic Distance in Spatial-Genetic Studies
Paul Fearnhead1
Department of Mathematics and Statistics, Lancaster University, Lancaster LA1 4YF, United Kingdom
1 Address for correspondence: Department of Mathematics and Statistics, Lancaster Unversity, Lancaster LA1 4YF, United Kingdom.
E-mail: p.fearnhead{at}lancaster.ac.uk
We look at how to choose genetic distance so as to maximize the power of detecting spatial structure. We answer this question through analyzing two population genetic models that allow for a spatially structured population in a continuous habitat. These models, like most that incorporate spatial structure, can be characterized by a separation of timescales: the history of the sample can be split into a scattering and a collecting phase, and it is only during the scattering phase that the spatial locations of the sample affect the coalescence times. Our results suggest that the optimal choice of genetic distance is based upon splitting a DNA sequence into segments and counting the number of segments at which two sequences differ. The size of these segments depends on the length of the scattering phase for the population genetic model.
Copyright © 2007 by the Genetics Society of America.