Empirical Bayes Procedure for Estimating Genetic Distance Between Populations and Effective Population Size

Corresponding author: Shuichi Kitada, Tokyo University of Fisheries, 4-5-7 Konan, Minato, Tokyo 108-8477, Japan., kitada{at}tokyo-u-fish.ac.jp (E-mail)

Communicating editor: Z-B. ZENG

We developed an empirical Bayes procedure to estimate genetic distances between populations using allele frequencies. This procedure makes it possible to describe the skewness of the genetic distance while taking full account of the uncertainty of the sample allele frequencies. Dirichlet priors of the allele frequencies are specified, and the posterior distributions of the various composite parameters are obtained by Monte Carlo simulation. To avoid overdependence on subjective priors, we adopt a hierarchical model and estimate hyperparameters by maximizing the joint marginal-likelihood function. Taking advantage of the empirical Bayesian procedure, we extend the method to estimate the effective population size using temporal changes in allele frequencies. The method is applied to data sets on red sea bream, herring, northern pike, and ayu broodstock. It is shown that overdispersion overestimates the genetic distance and underestimates the effective population size, if it is not taken into account during the analysis. The joint marginal-likelihood function also estimates the rate of gene flow into island populations.

This article has been cited by other articles:

				S. Kitada, T. Kitakado, and H. Kishino Empirical Bayes Inference of Pairwise FST and Its Distribution in the Genome Genetics, October 1, 2007; 177(2): 861 - 873. [Abstract] [Full Text] [PDF]

				T. Kitakado, S. Kitada, H. Kishino, and H. J. Skaug An Integrated-Likelihood Method for Estimating Genetic Differentiation Between Populations Genetics, August 1, 2006; 173(4): 2073 - 2082. [Abstract] [Full Text] [PDF]

				S. Kitada and H. Kishino Simultaneous Detection of Linkage Disequilibrium and Genetic Differentiation of Subdivided Populations Genetics, August 1, 2004; 167(4): 2003 - 2013. [Abstract] [Full Text] [PDF]

				G. Laval, M. SanCristobal, and C. Chevalet Maximum-Likelihood and Markov Chain Monte Carlo Approaches to Estimate Inbreeding and Effective Size From Allele Frequency Changes Genetics, July 1, 2003; 164(3): 1189 - 1204. [Abstract] [Full Text] [PDF]

				J. Corander, P. Waldmann, and M. J. Sillanpaa Bayesian Analysis of Genetic Differentiation Between Populations Genetics, January 1, 2003; 163(1): 367 - 374. [Abstract] [Full Text] [PDF]