- THIS ARTICLE
-
Abstract
- Full Text (PDF)
-
All Versions of this Article:
genetics.109.103952v1
183/1/347 most recent - Alert me when this article is cited
- Alert me if a correction is posted
- SERVICES
- Email this article to a friend
- Similar articles in this journal
- Similar articles in PubMed
- Alert me to new issues of the journal
- Download to citation manager
- Reprints & Permissions
- CITING ARTICLES
- Citing Articles via HighWire
- Citing Articles via Google Scholar
- GOOGLE SCHOLAR
- Articles by Gianola, D.
- Articles by Fernando, R.
- Search for Related Content
- PUBMED
- PubMed Citation
- Articles by Gianola, D.
- Articles by Fernando, R.
Originally published as Genetics Published Articles Ahead of Print on July 20, 2009.
Genetics, Vol. 183, 347-363, September 2009, Copyright © 2009
doi:10.1534/genetics.109.103952
Additive Genetic Variability and the Bayesian Alphabet
Daniel Gianola*,
,
,1,
Gustavo de los Campos*,
William G. Hill
,
Eduardo Manfredi
and
Rohan Fernando**
* Department of Animal Sciences, University of Wisconsin, Madison, Wisconsin 53706,
Department of Animal and Aquacultural Sciences, Norwegian University of Life Sciences, N-1432 Ås, Norway,
Institut National de la Recherche Agronomique, UR631 Station d'Amélioration Génétique des Animaux, BP 52627, 32326 Castanet-Tolosan, France,
Institute of Evolutionary Biology, School of Biological Sciences, University of Edinburgh, Edinburgh EH9 3JT, United Kingdom and ** Department of Animal Science, Iowa State University, Ames, Iowa 50011
1 Corresponding author: Department of Animal Sciences, 1675 Observatory Dr., Madison, WI 53706.
E-mail: gianola{at}ansci.wisc.edu
>ABSTRACT
RELATIONSHIP BETWEEN THE...
RESEMBLANCE BETWEEN RELATIVES
CONNECTION WITH THE...
THE BAYESIAN ALPHABET
DISCUSSION
APPENDIX
ACKNOWLEDGEMENTS
LITERATURE CITED
The use of all available molecular markers in statistical models for prediction of quantitative traits has led to what could be termed a genomic-assisted selection paradigm in animal and plant breeding. This article provides a critical review of some theoretical and statistical concepts in the context of genomic-assisted genetic evaluation of animals and crops. First, relationships between the (Bayesian) variance of marker effects in some regression models and additive genetic variance are examined under standard assumptions. Second, the connection between marker genotypes and resemblance between relatives is explored, and linkages between a marker-based model and the infinitesimal model are reviewed. Third, issues associated with the use of Bayesian models for marker-assisted selection, with a focus on the role of the priors, are examined from a theoretical angle. The sensitivity of a Bayesian specification that has been proposed (called "Bayes A") with respect to priors is illustrated with a simulation. Methods that can solve potential shortcomings of some of these Bayesian regression procedures are discussed briefly.
IN an influential article on animal breeding, MEUWISSEN et al. (2001) suggested using all available molecular markers as covariates in linear regression models for prediction of genetic value for quantitative traits. This has led to a genome-enabled selection paradigm. For example, major dairy cattle breeding countries are now genotyping elite animals and genetic evaluations based on SNPs (single nucleotide polymorphisms) are becoming routine (HAYES et al. 2009; VAN RADEN et al. 2009). A similar trend is taking place in poultry (e.g., LONG et al. 2007; GONZÁLEZ-RECIO et al. 2008, 2009), beef cattle (D. J. GARRICK, personal communication), and plants (HEFFNER et al. 2009).
The extraordinary speed with which events are taking place hampers the process of relating new developments to extant theory, as well as the understanding of some of the statistical methods proposed so far. These span from Bayes hierarchical models (e.g., MEUWISSEN et al. 2001) and the Bayesian Lasso (e.g., DE LOS CAMPOS et al. 2009b) to ad hoc procedures (e.g., VAN RADEN 2008). Another issue is how parameters of models for dense markers relate to those of classical models of quantitative genetics.
Many statistical models and approaches have been proposed for marker-assisted selection. These include multiple regression on marker genotypes (LANDE and THOMPSON 1990), best linear unbiased prediction (BLUP) including effects of a single-marker locus (FERNANDO and GROSSMAN 1989), ridge regression (WHITTAKER et al. 2000), Bayesian procedures (MEUWISSEN et al. 2001; GIANOLA et al. 2003; XU 2003; DE LOS CAMPOS et al. 2009b), and semiparametric specifications (GIANOLA et al. 2006a; GIANOLA and DE LOS CAMPOS 2008). In particular, the methods proposed by MEUWISSEN et al. (2001) have captured enormous attention in animal breeding, because of several reasons. First, the procedures cope well with data structures in which the number of markers amply exceeds the number of observations, the so-called "small n, large p" situation. Second, the methods in MEUWISSEN et al. (2001) constitute a logical progression from the standard BLUP widely used in animal breeding to richer specifications, where marker-specific variances are allowed to vary at random over many loci. Third, Bayesian methods have a natural way of taking into account uncertainty about all unknowns in a model (e.g., GIANOLA and FERNANDO 1986) and, when coupled with the power and flexibility of Markov chain Monte Carlo, can be applied to almost any parametric statistical model. In MEUWISSEN et al. (2001) normality assumptions are used together with conjugate prior distributions for variance parameters; this leads to computational representations that are well known and have been widely used in animal breeding (e.g., WANG et al. 1993, 1994). An important question is that of the impact of the prior assumptions made in these Bayesian models on estimates of marker effects and, more importantly, on prediction of future outcomes, which is central in animal and plant breeding.
A second aspect mentioned above is how parameters from these marker-based models relate to those of standard quantitative genetics theory, with either a finite or an infinite number (the infinitesimal model) of loci assumed. The relationships depend on the hypotheses made at the genetic level and some of the formulas presented, e.g., in MEUWISSEN et al. (2001), use linkage equilibrium; however, the reality is that marker-assisted selection relies on the existence of linkage disequilibrium. While a general treatment of linkage disequilibrium is very difficult in the context of models for predicting complex phenotypic traits, it is important to be aware of its potential impact. Another question is the definition of additive genetic variance, according to whether marker effects are assumed fixed or random, with the latter corresponding to the situation in which such effects are viewed as sampled randomly from some hypothetical distribution. MEUWISSEN et al. (2001) employ formulas for eliciting the variance of marker effects, given some knowledge of the additive genetic variance in the population. Their developments begin with the assumption that marker effects are fixed, but these eventually become random without a clear elaboration of why this is so. Since their formulas are used in practice for eliciting priors in the Bayesian treatment (e.g., HAYES et al. 2009), it is essential to understand their ontogeny, especially considering that priors may have an impact on prediction of outcomes.
The objective of this article is to provide a critical review of some of these aspects in the context of genomic-assisted evaluation of quantitative traits. First, relationships between the (Bayesian) variance of marker effects in some regression models and additive genetic variance are examined. Second, connections between marker genotypes and resemblance between relatives are explored. Third, the liaisons between a marker-based model and the infinitesimal model are reviewed. Fourth, and in the context of the quantitative genetics theory discussed in the preceding sections, some statistical issues associated with the use of Bayesian models for (massive) marker-assisted selection are examined, with the main focus on the role of the priors. The sensitivity of some of these methods with respect to priors is illustrated with a simulation.
ABSTRACT
>RELATIONSHIP BETWEEN THE...
RESEMBLANCE BETWEEN RELATIVES
CONNECTION WITH THE...
THE BAYESIAN ALPHABET
DISCUSSION
APPENDIX
ACKNOWLEDGEMENTS
LITERATURE CITED
Additive genetic variance:
A simple specification serves to set the stage. The phenotypic value (y) for a quantitative trait is described by the linear model
![]() | (1) |
, where VE is the environmental or residual variance, provided gene action is additive. Under Hardy–Weinberg (HW) equilibrium, the frequencies of the three possible genotypes are
, and
, where
and
. Code arbitrarily the states of w such that
![]() | (2) |
![]() | (3) |
![]() | (4) |
![]() | (5) |
A standard treatment (e.g., FALCONER and MACKAY 1996) regards the additive effect a as a fixed parameter. The conditional distribution of phenotypes, given a (but unconditionally with respect to w, since genotypes vary at random according to HW frequencies), has mean
![]() | (6) |
![]() | (7) |
Uncertainty about the additive effect:
Assume now that
, where
is the mean of the distribution. In the Appendix of MEUWISSEN et al. (2001), a suddenly mutates from fixed to random without explanation. How does the variance of a arise? Parameter
can be assigned at least two interpretations. The first one is as the variance between a effects in a conceptual sampling scheme in which such effects are drawn at random from a population of loci. In the second (Bayesian),
represents uncertainty about the true but unknown value of the additive effect of the specific locus, but without invoking a scheme of random sampling over a population of loci. For example,
= 0 means in a Bayesian sense that a =
with complete certainty, but not necessarily that the locus does not have an effect, since
may (may not) be distinct from 0; this cannot be overemphasized. With a single locus the Bayesian interpretation is more intuitive, since it is hard to envisage a reference population of loci in this case.
Irrespective of the interpretation assigned to
, the assumption
induces another conditional distribution (given w) with mean and variance
![]() | (8) |
![]() | (9) |
![]() | (10) |
![]() | (11) |
. The term
stems from randomness (uncertainty) about a, and it dissipates from (11) only if
= 0. Note that there is additive genetic variance even if
= 0, and it is equal to 2pq
2. Further, if the standard assumption
= 0 is adopted, the variance of the marginal distribution of phenotypes becomes
![]() | (12) |
may not be zero, since one poses that a locus has no effect (on average) but there is some uncertainty or variation among loci effects, as represented by
.
In a nutshell, the additive genetic variance at the locus, VA = 2pqa2, does not appear in (11), because a has been integrated out; actually, it is replaced by 2pq
2 in (11). The term
does not arise in the standard (fixed) model, where additive genetic variance in stricto sensu is VA. When a is known with certainty, then
= 0 and yet the locus generates additive genetic variance, as measured by VA = 2pq
2. If
= 0 and
= 0, then the variance is purely environmental. In short, the connection between the uncertainty variance
and the additive variance VA (which involves the effect of the locus) is elusive when both genotypes and effects are random variables.
Several loci:
Consider now K loci with additive effect ak at locus k, without dominance or epistasis. The phenotype is expressible as
![]() | (13) |
under HW equilibrium. If all markers were quantitative trait loci (QTL), this would be a "finite number of QTL" model; it is assumed that these loci are markers hereinafter unless stated otherwise. Under this specification
![]() | (14) |
Linkage equilibrium (LE) and HW frequencies are assumed to make the problem tractable. Some expressions are available to accommodate linkage disequilibrium, but parameters are not generally available to evaluate them (see the APPENDIX). When there is selection, genetic drift, or introgression and many loci are considered jointly, some of which will be even physically linked, the LE assumption is unrealistic. Hence, as in the case of many other authors, e.g., BARTON and DE VLADAR (2009) in a study of evolution of traits using statistical mechanics, LE–HW assumptions are used here.
If there is LE, the distributions of genotypes at the K loci are mutually independent, so that
![]() | (15) |
.
Suppose now that all effects ak
are drawn from the same random process with some distribution function
, mean
, and variance
. Using the same reasoning as before, the variance of the marginal distribution of the phenotypes is
![]() | (16) |
![]() | (17) |
What is the relationship between the multilocus additive genetic variance
and
? Let
be the mean variance, obtained by averaging VA over the distribution of the a's. This operation yields
![]() |
= 0 (additive effects expressed as a deviation from their mean), then
![]() | (18) |
and the marked average additive genetic variance
would then be
![]() | (19) |
gives only the part of the additive genetic variance captured by markers, and this may be a tiny fraction only (MAHER 2008). This makes the connection between additive genetic variance for a trait and marked variance even more elusive. Corresponding formulas under linkage disequilibrium are in the APPENDIX.
Heterogeneity of variance:
Suppose now that locus effects are independently (but not identically) distributed as
. The mean of the marginal distribution of phenotypes is
, and the variance becomes
![]() |
= 0 (complete Bayesian certainty about all marker effects ak), there would still be genetic variance, as measured by the second term in
. Apart from the difficulty of inferring a given
with any reasonable precision, there is the question of possible "commonality" between locus effects. For instance, some loci may have correlated effects, and alternative forms for the prior distribution of the a's have been suggested by GIANOLA et al. (2003). Also, some of these effects are expected to be identically equal to 0, especially if ak represents a marker effect, as opposed to being the result of a QTL [if the marker is in linkage disequilibrium (LD) with the QTL, its effect would be expected to be nonnull]. In such a case, a more flexible prior distribution might be useful, such as a mixture of normals, a double exponential, or a Dirichlet process.
If a frequentist interpretation is adopted for the assumption
, it is difficult to envisage the conceptual population from which ak is sampled, unless the variances are also random draws from some population. Posing a locus-specific variance is equivalent to assuming that each sire in a sample of Holsteins is drawn from a different conceptual population with sire-specific variance. There would be as many variances as there are sires!
Variation in allelic frequencies:
In addition to assuming random variation of a effects over loci, a distribution of gene frequencies may be posed as well. WRIGHT (1937) found that a beta distribution arose from a diffusion equation that was used to study changes in allele frequencies in finite populations, so this is well grounded in population genetics. In a Bayesian context, on the other hand, assigning a beta distribution to gene frequencies would be a (mathematically convenient) representation of uncertainty.
Suppose that allelic frequencies pk (k = 1, 2,..., K) vary over loci according to the same beta
process, where
a,
b are parameters determining the form of the distribution; WRIGHT (1937) expressed these parameters as functions of effective population size and mutation rates. Standard results yield
![]() | (20) |
![]() | (21) |
![]() | (22) |
![]() | (23) |
There are now four sources of variation: (1) due to random sampling of genotypes over individuals in the population, (2) due to uncertainty about additive effects (equivalently, variability due to sampling additive effects over loci), (3) due to spread of gene frequencies over loci or about some equilibrium distribution, and (4) environmental variability. The third source contributes to variance under conceptual repeated sampling, since gene frequencies would fluctuate around the equilibrium distribution or over loci.
Consider now additive genetic variance when dispersion in allelic frequencies is taken into account, assuming LE. Let
and
. Using previous results, (22) and (23),
![]() | (24) |
![]() | (25) |
![]() | (26) |
![]() |
![]() | (27) |
![]() | (28) |
![]() | (29) |
The variance of the marginal distribution of the phenotypes has, thus, three components. The one involving
relates to uncertainty about or random variation of marker effects. The second,
![]() |
is known with complete certainty, and the third component is the environmental variance VE. If
= 0 and the first term of (29) is interpreted as additive genetic variance (
), it turns out that
![]() | (30) |
a +
b is large enough, and K is very large, such that
![]() |
is the beta density representing variation of allelic frequencies. ABSTRACT
RELATIONSHIP BETWEEN THE...
>RESEMBLANCE BETWEEN RELATIVES
CONNECTION WITH THE...
THE BAYESIAN ALPHABET
DISCUSSION
APPENDIX
ACKNOWLEDGEMENTS
LITERATURE CITED
Standard results:
QTL are most often unknown, so their effects and their relationships to those of markers are difficult to model explicitly. An alternative is to focus on effects of markers, whose genotypes are presumably in linkage disequilibrium with one or several QTL, so can be thought of as proxies. Using a slightly different notation, the marker-based linear model suggested by MEUWISSEN et al. (2001) for genomic-assisted prediction of genetic values is
![]() | (31) |
is a K x 1 vector of additive effects of markers, and
is a known incidence matrix containing codes for marker genotypes, e.g., –1, 0, and 1 for mm, Mm, and MM, respectively. Let the ith row of W be
and assume that
is a vector of microenvironmental residual effects.
If genotypes are sampled at random from the population, this induces a probability distribution with mean vector
![]() | (32) |
![]() |
is the same and equal to
, a constant that can be absorbed into the intercept element of β. Hence, and without loss of generality,
.
The covariance matrix (regarding β and marker effects am as fixed parameters) is
![]() |
![]() |
for all i. If the population is in HW–LE,
is a diagonal matrix. Further, if individuals are genetically related, off-diagonal terms
are not null, because of covariances due to genotypic similarity.
To illustrate, let i be a randomly chosen male mated to a random female, and let j be a randomly chosen descendant. Under HW–LE, genotypes at different marker loci are mutually independent, within and between individuals, so it suffices to consider a single locus. It turns out that
![]() |
of the variance between genotypes at the locus in question. This generalizes readily to any type of additive relationships in the population.
Letting rij be the additive relationship between i and j,
![]() | (33) |
![]() | (34) |
is the matrix of additive relationships between individuals; D is diagonal in this case. The variance–covariance matrix (33) involves the fixed marker effects am, but these get absorbed into VA.
The implication is that a model with the conditional (given marker effects and gene frequencies) expectation function
![]() | (35) |
] and conditional covariance matrix
![]() | (36) |
![]() | (37) |
distributed as
![]() | (38) |
Formulas under LD are given in the second section of the APPENDIX.
Estimating the pedigree-based relationship matrix and expected heterozygosity using markers:
Consider model (37):
![]() |
![]() |
, and the sum is over markers. If all individuals belong to the same genotypic distribution, as argued above,
![]() | (39) |
, then
so
. Under this idealized assumption
provides an unbiased estimator of the pedigree-based additive relationship matrix, but only if HW–LE holds. Note that under a beta distribution of gene frequencies
![]() |
![]() |
![]() |
is the expected heterozygosity. Since the relationship holds for any combination i, j and there are n(n + 1)/2 distinct elements in WW' and in Ar, one can form an estimator of mean heterozygosity as
![]() |
and
are averages over all distinct elements in WW' and Ar. The estimator is simple, but no claim is made about its properties. ABSTRACT
RELATIONSHIP BETWEEN THE...
RESEMBLANCE BETWEEN RELATIVES
>CONNECTION WITH THE...
THE BAYESIAN ALPHABET
DISCUSSION
APPENDIX
ACKNOWLEDGEMENTS
LITERATURE CITED
The vector of additive genetic effects (or marked breeding value) of all individuals is
. Next, assume that effects a1, a2, ... , aK are independently and identically distributed as
, but this does not need to be so. Again,
is not the additive genetic variance, which is given by (34) above.
Assuming
implies that a* = Wam must be normal (given W). However, the elements of W (indicators of genotypes, discrete) are also random so the finite sample distribution of a* is not normal; however, as K goes to infinity, the distribution approaches normality, as discussed later in this section. If am and W are independently distributed, the mean vector and covariance matrix of the distribution of marked breeding values are
![]() | (40) |
![]() | (41) |
and (33), then under LE assumptions
![]() |
, it follows that
![]() | (42) |
, and by the level of heterozygosity. In the special case where allelic frequencies are equal to
at each of the loci, the first term vanishes and one gets
, where
. This can be construed as the counterpart of the polygenic additive variance of the standard infinitesimal model, but in a special situation. Again, this illustrates that
a2 relates to additive genetic variance in a more subtle manner than would appear at first sight.
What is the distribution of marked breeding values
when both wik and ak vary at random? Because ak is normal, the conditional distribution
| wi is normal, with mean 0 and variance
. Thus, one can write the density of the marginal distribution of
as
![]() |
is the probability of observing the K-dimensional marker genotype wi in individual i. If the population is in HW–LE at all K marker loci, the joint distribution of genotypes of an individual over the K loci is the product of the marginal distributions at each of the marker loci; that is,
![]() |
is a mixture of 3K normal distributions each with a null mean, but distribution-specific variance
. As
, the mixing probabilities
become infinitesimally small, so that
![]() |
must necessarily converge toward a Gaussian one, because
is the sum of a large (now infinite) number of independent random variates (note that under LE wikak is independent of any other wik'ak' because genotypes at different loci are mutually independent), so the central limit theorem holds; it holds even under weaker assumptions. Then
![]() |
![]() |
When the joint distribution of additive genetic values a* of a set of individuals is considered, it is reasonable to conjecture that it should be multivariate normal, especially under LE. Its mean vector is
, as shown in (40), and the covariance matrix of the limiting process can be deduced from (42). The first term becomes null, because allelic frequencies became infinitesimally small as
, so the covariance matrix tends to
![]() |
As shown by HABIER et al. (2007), markers may act as a proxy for a pedigree. Hence, unless the pedigree is introduced into the model in some explicit form, markers may be capturing relationships among individuals, as opposed to representing flags for QTL regions. At any rate, it is essential to keep in mind that markers are not genes.
ABSTRACT
RELATIONSHIP BETWEEN THE...
RESEMBLANCE BETWEEN RELATIVES
CONNECTION WITH THE...
>THE BAYESIAN ALPHABET
DISCUSSION
APPENDIX
ACKNOWLEDGEMENTS
LITERATURE CITED
Bayes A:
MEUWISSEN et al. (2001) suggested using model (31) for marker-enabled prediction of additive genetic effects and proposed two Bayesian hierarchical structures, termed "Bayes A" and "Bayes B." A brief review of these two methods follows, assuming that k denotes a SNP locus.
In Bayes A (using notation employed here), the prior distribution of a marker effect ak, given some marker-specific uncertainty variance
, is assumed to be normal with null mean and dispersion
. In turn, the variance associated with the effect of each marker k = 1, 2,..., K is assigned the same scaled inverse chi-square prior distribution
, where
and S2 are known degrees of freedom and scale parameters, respectively. This hierarchy is represented as
![]() |
, yielding
![]() | (43) |
, which is the de facto prior in MEUWISSEN et al. (2001) assigned to a marker effect. Again,
, S2 are assumed known and given arbitrary values by the user; this is a crucial issue.
Bayes B:
In Bayes B, MEUWISSEN et al. (2001) proposed
![]() |
![]() |
, given an arbitrary probability parameter
, is
![]() |
, this implies that ak is known with certainty), taken by MEUWISSEN et al. (2001) to be equal to 0, even though it does not need to be 0. Marginally, after integrating
out, the prior takes the form
![]() |
= 0.
A critique:
Neither Bayes A nor Bayes B (or any variations thereof that assume marker-specific variances) allow Bayesian learning on these variances to proceed far away from the prior. This means that the hyperparameters of the prior assigned to these variances (according to assumptions based on quantitative genetics theory) will always have influence on the extent of shrinkage produced on marker effects. A user can arbitrarily control the extent of shrinkage simply by varying
and S2. It suffices to illustrate this problem with Bayes A, since the problem propagates to Bayes B.
It is straightforward to show that the fully conditional (i.e., given all other parameters and the data, a situation denoted as ELSE hereinafter) posterior distribution of
is the scaled inverse chi-square process
, so Bayesian learning "moves" only a single degree of freedom away from the prior distribution
, even though its scale parameter is modified from S2 into
(most markers are expected to have nearly null effects). Now, since ak is unknown, and inferring it consumes information contained in the data, this implies that, unconditionally (that is, a posteriori), inferences about
are even more strongly affected by the information encoded by its prior distribution than in the conditional posterior process. For instance, if
= 5, say, this means that the posterior degree of belief about
has an upper bound at 6, irrespective of whether data on millions of markers or of individuals become available.
For parameter
of a model, Bayesian learning should be such that the posterior coefficient of variation, that is,
, tends to 0 asymptotically as DATA accrue. This does not happen in Bayes A or Bayes B for
. In Bayes A, the coefficients of variation of the prior and of the fully conditional posterior distribution are
![]() |
![]() |
. This ratio goes to 1 rapidly as the degrees of freedom of the prior increase (meaning that the prior "dominates" inference), as illustrated in Figure 1. For example, if
= 4.1,
= 5.1, and
= 6.1, the ratio between the coefficients of variation of the conditional posterior distribution of
and that of its prior is
0.30, 0.72, and 0.82, so that the prior is influential even at mild values of the degrees of freedom. Given a large
, the conditional posterior essentially copies the prior, with the contribution of DATA being essentially nil. As mentioned, since marginal posterior inferences about
require deconditioning over ak (thus consuming information contained in the data), the impact of the prior will be even more marked at the margins. This is questionable, at least from an inference perspective.
|
Another way of illustrating the same problem is based on computing information gain, i.e., the difference in entropy before and after observing data. Since the posterior distribution of
is unknown, we consider the entropy of the fully conditional posterior distribution of
, instead of that of the marginal process. This provides an upper bound for the information gain. The entropy of the prior is
![]() | (44) |
,
,
is replaced by
+ 1 and
S2 by
(it is expected that
S2 for most markers). The relative information gain (fraction of entropy reduced by knowledge encoded in ELSE) is then
![]() | (45) |
= 4, RIG = 0.125; for ak = 0, S = 1, and
= 10, then RIG = 6.51 x 10–2; and for ak = 0, S = 1, and
= 100, RIG = 9.60 x 10–3. Even at mild values of the prior degrees of freedom
, the extent of uncertainty reduction due to observing data is negligible. Metaphorically, the prior is totalitarian in Bayes A, at least for each one of the
parameters.
A third gauge is the Kullback–Leibler distance (KL) between the prior and conditional posterior distributions. The KL metric (KULLBACK 1968) is the expected logarithmic divergence between two parametric distributions, one taken as reference or point of departure. Using the prior as reference distribution, the expected distance is
![]() |
![]() |
, and p is the number of markers that are assigned the same variance, so that p = 1 and am = ak in Bayes A; however, p could be much larger if, say, all p markers on the same chromosome were assigned the same variance.
The impact of the degrees of freedom of the prior on the random quantity L(.) of the integrand in KL was examined by assuming that the conditional posterior distribution of
had ak = 0 (again, most marker effects are expected to be tiny, if not null) and that the scale parameter of the prior of the marker-specific variances was S = 1. Figure 2 displays three scaled inverse chi-square densities, all with the same parameter S = 1 and degrees of freedom 4, 10, or 100, as well as values of the random quantity
with p = 1 and ak = 0 in the KL gauge. Also shown in Figure 2 (in open circles) are values of
for p = 10, meaning that, instead of having marker-specific variances, 10 markers would share the same variance. While the three priors are different, and reflect distinct states of prior uncertainty about
via their distinct degrees of freedom, the
values are essentially the same irrespective of
and flat for any values of
appearing with appreciable density in the priors. On the other hand, if it is assumed that
, where
is now a variance assigned to a group of markers (even assuming that their effects are nil),
is steep with respect to
, taking negative values for
<0.55 (roughly). In fact, the KL distances (evaluated with numerical integration) between the prior and conditional posterior distributions are (1) 7.33 x 10–2 for
= 4, S = 1, p = 1 and ak = 0; (2) 2.64 x 10–2 for
= 10, S = 1, p = 1 and ak = 0; and (3) 2.52 x 10–3 for
= 100, S = 1, p = 1, and ak = 0, so that the conditional posterior is very close to the prior even at small values of the degrees of freedom parameter. However, when the number of markers sharing the same variance increases to p = 10 (assuming all
's = 0, as stated), KL = 4.47, so that considerable Bayesian learning about
takes place in this situation. Relative to scenario 1 above, the KL distance increases by
61 times.
|
A pertinent question is whether or not the learned marker effect (i.e., a draw from its conditional posterior distribution) has an important impact on KL via modification of the scale parameter from S2 into
. Let
be the realized value of the marker effect in units of the "prior standard deviation" S, with c = 0, 0.01, 0.5, 1, and 2; the last two cases would be representative of markers with huge effects. The density of the conditional posterior distribution of
is then
![]() |
= 4, are (1)
, (2) KL
, (3) KL
, (4) KL
, and (5) KL
. Even though marker effects are drastically different, the conditional posteriors are not too different (in the KL sense) from each other, meaning that the extent of shrinkage in Bayes A (or B) continues to be dominated by the prior. This is illustrated in Figure 3: even when c = 2, the conditional posterior does not differ appreciably from the prior.
|
In short, neither Bayes A nor Bayes B, as formulated by MEUWISSEN et al. (2001), allows for any appreciable Bayesian learning about marker-specific variances so that, essentially, the extent of shrinkage of effects will always be dictated strongly by the prior, which negates the objective of introducing marker-specific variances into the model. The magnitudes of the estimates of marker effects can be made smaller or larger at will via changes of the degrees of freedom and scale parameters of the prior distribution.
Arguably, Bayes B is not well formulated in a Bayesian context. MEUWISSEN et al. (2001) interpret that assigning a priori a value
with probability
means that the specific SNP does not have an effect on the trait. As mentioned earlier in this article, stating that a parameter has 0 variance a priori does not necessarily mean that the parameter takes value 0: it could have any value, but known with certainty. Thus, assuming
implies determinism about such an effect. It turns out, however, that their sampler sets ak = 0 when the state
is drawn! A more reasonable specification is to place the mixture with a 0 state at the level of the effects, but not at the level of the variances.
Impact on predictions:
A counterargument to the preceding critique could be articulated as follows: Even though the prior affects inferences about marker-specific variances, this is practically irrelevant, because one can "kill" the influence of the prior on estimates of marker effects simply by increasing sample size. Superficially, it seems valid, because the fully conditional posterior distribution of ak (assuming a model with a single location parameter µ) is
![]() |
tends to
so the influence of
vanishes asymptotically, given some fixed values of
, S. This indicates that, in Bayes A, even though Bayesian learning about the
parameters is limited, the influence of the prior on the posterior distributions of marker effects and of the genetic values
dissipates in large samples. However, in marker-assisted prediction of genetic values n < < p, so the prior may be influential. The sensitivity of Bayes A with respect to the prior in a finite sample was examined by simulation.
Simulation:
Bayes A was fitted under different prior specifications to a simple data structure. Records for 300 individuals were generated under the additive model
![]() |
Two LD scenarios regarding the distribution of the 280 markers were generated. In scenario X0, markers were in weak LD, with almost no correlation between genotypes of adjacent markers (Table 1). In scenario X1, LD was relatively high: the correlation between markers dropped from 0.772 for adjacent markers to 0.354 for markers separated by three positions (Table 1). Effects of allele substitutions were kept constant across simulations and were set to zero for all markers except for 10, as shown in Figure 4. The locations of markers with nonnull effects were chosen such that different situations were represented. For example (Figure 4), in chromosome 3 there were two adjacent markers with opposite effects, while chromosome 4 had two adjacent markers with equal effects.
|
|
A Monte Carlo study with 100 replicates was run for each of the two LD scenarios. For each replicate and LD scenario, nine variations of Bayes A were fitted, each defined by a combination of prior values of hyperparameters. In all cases, a scale inverted chi-square distribution with 1 d.f. and scale parameter equal to 1 were assigned to the residual variance. The nine priors considered are in Table 2. Hyperparameter values were chosen such that the prior had, at most, the same contribution to the degrees of freedom of the fully conditional distribution as the information coming from the remaining components of the model (i.e., 1). Values of S2 were chosen following similar considerations. Note that if the samples of marker effects are equal to their true value,
0.22 (see Figure 4). Priors 1–3 are improper, and the other six priors are proper but do not possess finite means and variances. Therefore, scenarios with S2 = 10–5 correspond to cases of relatively small influence of the prior on the scale parameter of the fully conditional distribution, while S2 = 5 x 102 represents a case where the fully conditional distribution has a strong dependency on the prior specification.
|
For each of these models and Monte Carlo replicates 35,000 iterations of the Gibbs Sampler were run, and the first 5000 iterations were discarded as burn-in. Inspection of trace plots and other diagnostics (effective sample size, MC standard error) computed using Coda (PLUMMER et al. 2008) indicated that this was adequate to infer quantities of interest.
Table 3 shows the average (across 100 MC replicates) of posterior means of the residual variance and of the correlation between the true and the estimated quantity of several features. This provides an assessment of goodness of fit, of how well the model estimates genomic values, and of the extent to which the model can uncover relevant marker effects. As expected, Bayes A was sensitive with respect to prior specification for all items monitored. Scenarios 4 and 7 produced overfitting (low estimate of residual variance, whose true value was 1, and high correlation between data and fitted values). It also had a low ability to recover signal (i.e., to estimate marker effects and genomic values), as indicated by the corresponding correlations. Other priors (e.g., 6) produced a model with a better ability to estimate genomic values and marker effects. These results were similar in both scenarios of LD. The results in Table 3 also indicate that it is much more difficult to uncover marker effects than to predict genomic values.
|
To have a measure of the ability of each model to locate genomic regions affecting the trait, an index was created as follows. For each marker having a nonnull effect and for each replicate, a dummy variable was created indicating whether or not the marker, or any of its 4 flanking markers, ranked among the top 20 on the basis of the absolute value of the posterior mean of the marker's effect. Averaging across markers and replicates led to an index of "retrieved regions" (Table 4). Results suggest that the ability of Bayes A to uncover relevant genomic regions is also affected by the choice of hyperparameters. For example, in scenarios 1, 4, and 7 only one of five regions was retrieved by Bayes A. On the other hand, the fraction of retrieved regions was twice as large when using other priors (scenarios 2, 3, and 6). The ability to uncover genomic regions affecting a trait was usually worse with high LD, due to redundancy between markers.
|
ABSTRACT
RELATIONSHIP BETWEEN THE...
RESEMBLANCE BETWEEN RELATIVES
CONNECTION WITH THE...
THE BAYESIAN ALPHABET
>DISCUSSION
APPENDIX
ACKNOWLEDGEMENTS
LITERATURE CITED
The second aspect addressed in this study was a critique of methods Bayes A and B as proposed by MEUWISSEN et al. (2001). These methods require specifying hyperparameters that are elicited using formulas related to those mentioned in the paragraph above; however, the authors did not state the assumptions needed precisely. It was shown here that these hyperparameters can be influential.
The influence of the prior on inferences and predictions via Bayes A can be mitigated in several ways. One way consists of forming clusters of markers such that their effects share the same variance. Thus, shrinkage would be specific to the set of markers entering into the cluster. The clusters could be formed either on the basis of biological information (e.g., according to coding or noncoding regions specific to a given chromosome) or perhaps statistically, using some form of supervised or unsupervised clustering procedure. If clusters of size p were formed, the conditional posterior distribution of the variances of the markers would have p +
d.f., instead of 1 +
in Bayes A. A second way of mitigating the impact of hyperparameters is to assign a noninformative prior to the scale and degrees of freedom parameters of Bayes A. This has been done in quantitative genetics, as demonstrated by STRANDÉN and GIANOLA (1998) and ROSA et al. (2003, 2004) and discussed in SORENSEN and GIANOLA (2002). For example, STRANDÉN and GIANOLA (1998) used models with t-distributions for the residuals (the implementation would be similar in Bayes A, with the t-distribution assigned to marker effects instead), with unknown degrees of freedom and unknown parameters. In STRANDÉN and GIANOLA (1998) a scaled inverted chi-square distribution was assigned to the scale parameter of the t-distribution, and equal prior probabilities were assigned to a set of mutually exclusive and exhaustive values of the degrees of freedom. On the other hand, ROSA et al. (2003, 2004) presented a more general treatment, in which the degrees of freedom were sampled with a Metropolis–Hastings algorithm. A third modification of Bayes A would consist of combining the two preceding options, i.e., assign a common variance to a cluster of marker effects and then use noninformative priors, as in ROSA et al. (2003, 2004), for the parameters of the t-distribution. Applications of thick-tailed priors, such as the t or the double exponential distribution, to models with marker effects are presented in YI and XU (2008) and DE LOS CAMPOS et al. (2009a).
Bayes B requires a reformulation (and a new letter, to avoid confusion!), e.g., the mixture with a zero state posed at the level of effects and not at that of the variances, as discussed earlier. For example, one could assume that the marker effect is 0 with probability
or that it follows a normal distribution with common variance otherwise. Further, the mixing probability
could be assigned a prior distribution, e.g., a beta process, as opposed to specifying an arbitrary value for
. Mixture models in genetics are discussed, for example, by GIANOLA et al. (2006b) and some new, yet unpublished, normal mixtures for marker-assisted selection are being developed by R. L. Fernando (R. L. FERNANDO, unpublished data) (http://dysci.wisc.edu.edu/sglpe/pdf/Fernando.pdf).
A more general solution is to use a nonparametric method, as suggested by GIANOLA et al. (2006a), GIANOLA and VAN KAAM (2008), GIANOLA and DE LOS CAMPOS (2008) and casted more generally by DE LOS CAMPOS et al. (2009a). These methods do not make hypotheses about mode of inheritance, contrary to the parametric methods discussed above, where additive action is assumed. Evidence is beginning to emerge that nonparametric methods may have better predictive ability when applied to real data (GONZÁLEZ-RECIO et al. 2008, 2009; N. LONG, D. GIANOLA, G. J. M. ROSA and K. A. WEIGEL, unpublished results.).
In conclusion, this article discussed connections between marker-based additive models and standard models of quantitative genetics. It was argued that the relationship between the variance of marker effects and the additive genetic variance is not as simple as has been reported, becoming especially cryptic if the assumption of linkage equilibrium is violated, which is manifestly the case with dense whole-genome markers. Also, a critique of earlier models for genomic-assisted evaluation in animal breeding was advanced, from a Bayesian perspective, and some possible remedies of such models were suggested.
ABSTRACT
RELATIONSHIP BETWEEN THE...
RESEMBLANCE BETWEEN RELATIVES
CONNECTION WITH THE...
THE BAYESIAN ALPHABET
DISCUSSION
>APPENDIX
ACKNOWLEDGEMENTS
LITERATURE CITED
Linkage disequilibrium:
The expression
results from jointly sampling genotypes (but not their effects) at K loci in linkage equilibrium. This is a needed assumption for arriving at (19). On the other hand, if there is LD, the additive genetic variance (under HW equilibrium at each locus) is
![]() | (A1) |
pB,l is the usual LD statistic involving the two loci in question. The first term in (A1) is the additive genetic variance under LE; the second term is a contribution to variance from LD, and it may be negative or positive. It can be shown that the average correlation between genotypes at a pair of loci is (approximately) <K–1.
The average (over a effects) variance under LD depends on the distribution of the a's. If these are independently and identically distributed with mean
and variance
, one has
![]() | (A2) |
= 0, then
(D) =
, in which case linkage disequilibrium would not affect relationship (19).
There is no mechanistic basis for expecting that all loci have the same effects and for these being mutually independent. There may be some genomic regions without any effect at all, or some regions may induce similarity (or dissimilarity) of effects; for example, if two genes are responsible for producing a fixed amount of transcript, their effects would be negatively correlated, irrespective of whether or not genotypes are in linkage equilibrium. A more general assumption may be warranted, i.e., that effects follow some multivariate distribution
, where
is just a dispersion parameter. Here, with w being the vector of genotypes for the K loci, one can write the average variance under LD,
![]() |
![]() |
![]() |
is the trace of the matrix in question. The counterpart of (19) is
![]() | (A3) |
= 0. It follows that (19), appearing often in the literature, holds only under strong simplifying assumptions. In short, the connection between additive genetic variance and the variance of marker effects depends on the unknown means of the distributions of marker effects, their possible covariances (induced by unknown molecular and chromosomal process), their gene frequencies, and all pairwise linkage disequilibrium parameters, which are a function of the
's. It is not obvious what the effects of using (19) as an approximation are, but the assumptions surrounding it are undoubtedly strong.
Covariance between relatives and linkage disequilibrium:
Linkage disequilibrium complicates matters, as noted earlier. The covariance between marked genetic values of individuals i and j, instead of being
, takes the form
![]() |
![]() |
![]() |
ABSTRACT
RELATIONSHIP BETWEEN THE...
RESEMBLANCE BETWEEN RELATIVES
CONNECTION WITH THE...
THE BAYESIAN ALPHABET
DISCUSSION
APPENDIX
>ACKNOWLEDGEMENTS
LITERATURE CITED
ABSTRACT
RELATIONSHIP BETWEEN THE...
RESEMBLANCE BETWEEN RELATIVES
CONNECTION WITH THE...
THE BAYESIAN ALPHABET
DISCUSSION
APPENDIX
ACKNOWLEDGEMENTS
>LITERATURE CITED
BARTON, N. H., and H. P. DE VLADAR, 2009 Statistical mechanics and the evolution of polygenic quantitative traits. Genetics 181: 997–1011.
BOX, G. E. P., and G. C. TIAO, 1973 Bayesian Inference in Statistical Analysis. Addison-Wesley, Reading, MA.
DE LOS CAMPOS, G., D. GIANOLA and G. J. M. ROSA, 2009a Reproducing kernel Hilbert spaces regression: a general framework for genetic evaluation. J. Anim. Sci. 87: 1883–1887.
DE LOS CAMPOS, G., H. NAYA, D. GIANOLA, J. CROSSA, A. LEGARRA et al., 2009b Predicting quantitative traits with regression models for dense molecular markers and pedigrees. Genetics 182: 375–385.
FALCONER, D. S., and T. F. C. MACKAY, 1996 Introduction to Quantitative Genetics, Ed. 4. Longmans Green, Harlow, Essex, UK.
FERNANDO, R. L., and M. GROSSMAN, 1989 Marker-assisted selection using best linear unbiased prediction. Genet. Sel. Evol. 33: 209–229.[CrossRef]
GIANOLA, D., and G. DE LOS CAMPOS, 2008 Inferring genetic values for quantitative traits non-parametrically. Genet. Res. 90: 525–540.[CrossRef][Medline]
GIANOLA, D., and R. L. FERNANDO, 1986 Bayesian methods in animal breeding. J. Anim. Sci. 63: 217–244.
GIANOLA, D., M. PÉREZ-ENCISO and M. A. TORO, 2003 On marker-assisted prediction of genetic value: beyond the ridge. Genetics 163: 347–365.
GIANOLA, D., R. L. FERNANDO and A. STELLA, 2006a Genomic assisted prediction of genetic value with semi-parametric procedures. Genetics 173: 1761–1776.
GIANOLA, D., B. HERINGSTAD and J. ØDEGÅRD, 2006b On the quantitative genetics of mixture characters. Genetics 173: 2247–2255.
GIANOLA, D., and J. B. C. H. M. VAN KAAM, 2008 Reproducing kernel Hilbert spaces methods for genomic assisted prediction of quantitative traits. Genetics 178: 2289–2303.
GONZÁLEZ-RECIO, O., D. GIANOLA, N. LONG, K. A. WEIGEL, G. J. M. ROSA et al., 2008 Nonparametric methods for incorporating genomic information into genetic evaluations: an application to mortality in broilers. Genetics 178: 2305–2313.
GONZÁLEZ-RECIO, O., D. GIANOLA, G. J. M. ROSA, K. A. WEIGEL and A. KRANIS, 2009 Genome-assisted prediction of a quantitative trait in parents and progeny: application to food conversion rate in chickens. Genet. Sel. Evol. 41: 3–13.[CrossRef][Medline]
HABIER, D., R. L. FERNANDO and J. C. M. DEKKERS, 2007 The impact of genetic relationship information on genome-assisted breeding values. Genetics 177: 2389–2397.
HAYES, B. J., P. J. BOWMAN, A. J. CHAMBERLAIN and M. E. GODDARD, 2009 Invited review: genomic selection in dairy cattle: progress and challenges. J. Dairy Sci. 92: 433–443.[CrossRef][Medline]
HEFFNER, E. L., M. E. SORRELL and J. L. JANNINK, 2009 Genomic selection for crop improvement. Crop Sci. 49: 1–12.[CrossRef]
KULLBACK, S., 1968 Information Theory and Statistics, Ed. 2. Dover, New York.
LANDE, R., and R. THOMPSON, 1990 Efficiency of marker-assisted selection in the improvement of quantitative traits. Genetics 124: 743–756.[Abstract]
LONG, N., D. GIANOLA, G. J. M. ROSA, K. A. WEIGEL and S. AVENDAÑO, 2007 Machine learning classification procedure for selecting SNPs in genomic selection: application to early mortality in broilers. J. Anim. Breed. Genet. 124: 377–389.[Medline]
MAHER, B., 2008 The case of the missing heritability. Nature 456: 18–21.[Medline]
MEUWISSEN, T. H., B. J. HAYES and M. E. GODDARD, 2001 Prediction of total genetic value using genome-wide dense marker maps. Genetics 157: 1819–1829.
PLUMMER, M., N. BEST, K. COWLES and K. VINES, 2008 Coda: output analysis and diagnostics for MCMC. http://cran.r-project.org/web/packages/coda/index.html.
ROSA, G. J. M., C. R. PADOVANI and D. GIANOLA, 2003 Robust linear mixed models with normal/independent distributions and Bayesian MCMC implementation. Biom. J. 45: 573–590.[CrossRef]
ROSA, G. J. M., D. GIANOLA and C. R. PADOVANI, 2004 Bayesian longitudinal data analysis with mixed models and thick-tailed distributions using MCMC. J. Appl. Stat. 31: 855–873.[CrossRef]
SORENSEN, D., and D. GIANOLA, 2002 Likelihood, Bayesian, and MCMC Methods in Quantitative Genetics. Springer, New York.
STRANDÉN, I., and D. GIANOLA, 1998 Attenuating effects of preferential treatment with Student-t mixed linear models: a simulation study. Genet. Sel. Evol. 30: 565–583.[CrossRef]
TURELLI, M., 1985 Effects of pleiotropy on predictions concerning mutation selection balance for polygenic traits. Genetics 111: 165–195.
VAN RADEN, P. M., 2008 Efficient methods to compute genomic predictions. J. Dairy Sci. 91: 4414–4423.[CrossRef][Medline]
VAN RADEN, P. M., C. P. VAN TASSELL, G. R. WIGGANS, T. S. SONSTEGARD, R. D. SCHNABEL et al., 2009 Reliability of genomic predictions for North American Holstein bulls. J. Dairy Sci. 92: 16–24.[CrossRef][Medline]
WANG, C. S., J. J. RUTLEDGE and D. GIANOLA, 1993 Marginal inferences about variance components in a mixed linear model using Gibbs sampling. Genet. Sel. Evol. 25: 41–62.[CrossRef]
WANG, C. S., J. J. RUTLEDGE and D. GIANOLA, 1994 Bayesian analysis of mixed linear models via Gibbs sampling with an application to litter size in Iberian pigs. Genet. Sel. Evol. 26: 91–115.[CrossRef]
WHITTAKER, J. C., R. THOMPSON and M. C. DENHAM, 2000 Marker-assisted selection using ridge regression. Genet. Res. 75: 249–252.[CrossRef][Medline]
WRIGHT, S., 1937 The distribution of gene frequencies in populations. Proc. Natl. Acad. Sci. USA 23: 307–320.
YI, N., and S. XU, 2008 Bayesian Lasso for quantitative trait loci mapping. Genetics 179: 1045–1055.
XU, S., 2003 Estimating polygenic effects using markers of the entire genome. Genetics 163: 789–801.
ZHANG, X. S., and W. G. HILL, 2005 Predictions of patterns of response to artificial selection in lines derived from natural populations. Genetics 169: 411–425.
Communicating editor: E. ARJAS
This article has been cited by other articles:
![]() |
H. D. Daetwyler, R. Pong-Wong, B. Villanueva, and J. A. Woolliams The Impact of Genetic Architecture on Genome-Wide Evaluation Methods Genetics, July 1, 2010; 185(3): 1021 - 1031. [Abstract] [Full Text] [PDF] |
||||
- THIS ARTICLE
-
Abstract
- Full Text (PDF)
-
All Versions of this Article:
genetics.109.103952v1
183/1/347 most recent - Alert me when this article is cited
- Alert me if a correction is posted
- SERVICES
- Email this article to a friend
- Similar articles in this journal
- Similar articles in PubMed
- Alert me to new issues of the journal
- Download to citation manager
- Reprints & Permissions
- CITING ARTICLES
- Citing Articles via HighWire
- Citing Articles via Google Scholar
- GOOGLE SCHOLAR
- Articles by Gianola, D.
- Articles by Fernando, R.
- Search for Related Content
- PUBMED
- PubMed Citation
- Articles by Gianola, D.
- Articles by Fernando, R.









































































of the conditional posterior and prior distributions of the variance of the marker effect, as a function of the degrees of freedom 




in the Kullback–Leibler distance, for each of the three priors, shown as solid lines. The integrands are essentially indistinguishable from each other for all values of
.




; true marker effects, am; estimated marker effects,








