Originally published as Genetics Published Articles Ahead of Print on May 27, 2008.

Genetics, Vol. 179, 1045-1055, June 2008, Copyright © 2008
doi:10.1534/genetics.107.085589

Bayesian LASSO for Quantitative Trait Loci Mapping

* Department of Biostatistics, Section on Statistical Genetics, University of Alabama, Birmingham, Alabama 35294 and {dagger} Department of Botany and Plant Sciences, University of California, Riverside, California 92521

1 Corresponding author: Department of Biostatistics, University of Alabama, Birmingham, AL 35294-0022.
E-mail: nyi{at}ms.soph.uab.edu

Manuscript received December 10, 2007. Accepted for publication March 14, 2008.

ABSTRACT

The mapping of quantitative trait loci (QTL) is to identify molecular markers or genomic loci that influence the variation of complex traits. The problem is complicated by the facts that QTL data usually contain a large number of markers across the entire genome and most of them have little or no effect on the phenotype. In this article, we propose several Bayesian hierarchical models for mapping multiple QTL that simultaneously fit and estimate all possible genetic effects associated with all markers. The proposed models use prior distributions for the genetic effects that are scale mixtures of normal distributions with mean zero and variances distributed to give each effect a high probability of being near zero. We consider two types of priors for the variances, exponential and scaled inverse-{chi}2 distributions, which result in a Bayesian version of the popular least absolute shrinkage and selection operator (LASSO) model and the well-known Student's t model, respectively. Unlike most applications where fixed values are preset for hyperparameters in the priors, we treat all hyperparameters as unknowns and estimate them along with other parameters. Markov chain Monte Carlo (MCMC) algorithms are developed to simulate the parameters from the posteriors. The methods are illustrated using well-known barley data.


QUANTITATIVE traits are controlled by multiple quantitative trait loci (QTL). The genetic effects of QTL and the phenotypic value of a quantitative trait are usually described by a linear model. Since the locations of QTL are not known a priori, we often use markers to represent QTL. Some markers may be closely linked to one or more QTL, and thus they may show strong association with the trait. Most markers, however, may not be directly linked to QTL, and thus no association will be expected between these markers and the trait. Interval mapping or the equivalent single-marker analysis does not provide accurate estimates of QTL effects because the single-QTL model used by the method is seldom the correct model. The multiple-QTL model is the reasonable choice for mapping quantitative traits (KAO et al. 1999).

When all markers are included in the QTL analysis, the model may be oversaturated. Variable selection may be conducted to include and exclude markers in the model (SILLANPÄÄ and ARJAS 1998; YI et al. 2003, 2005; YI 2004; YI and SHRINER 2008). An alternative approach is a shrinkage method that includes all variables in the model and uses informative prior distributions to shrink trivial effects toward zero. Ridge regression (HOERL and KENNARD 1970) is a shrinkage procedure and can be obtained using independent and identical normal priors centered at zero, with the degree of shrinkage controlled by the prior variance. The least absolute shrinkage and selection operator (LASSO) is another shrinkage method that has been widely used in regression analysis for large models (TIBSHIRANI 1996). It minimizes the residual sum of squares constraining the sum of absolute values of the regression coefficients, Formula for Formula, if the response and the predictors are standardized. This special constraint allows some estimated regression coefficients to be exactly zero. This selective or individualized shrinkage allows LASSO to handle extremely large models. Mathematically, the LASSO estimates of regression coefficients can be achieved by

Formula
where Formula is a Lagrange multiplier, which relates implicitly to the bound t and controls the degree of shrinkage. The LASSO estimates of coefficients can be efficiently computed via the LARS algorithm of EFRON et al. (2004). The LASSO procedure can be interpreted as a Bayesian posterior mode estimate when assigning an independent double-exponential prior to each Formula (e.g., TIBSHIRANI 1996; YUAN and LIN 2005; PARK and CASELLA 2007). Recently, XU (2007) successfully applied the LASSO method to estimate the epistatic effects of QTL. However, the LASSO provides no estimate for the residual error variance and no interval estimate for a regression coefficient and needs to predetermine the parameter Formula (TIBSHIRANI 1996; EFRON et al. 2004).

There are some other shrinkage methods that have been applied to mapping multiple QTL. The method of XU (2003) simultaneously fits maker effects of the entire genome in a regression model and assigns each effect a normal prior with mean 0 and an effect-specific variance (also see WANG et al. 2005; HOTI and SILLANPÄÄ 2006; HUANG et al. 2007). The variance parameters are further assigned the noninformative Jeffrey's prior, which in turn induces improper priors on the coefficients. MEUWISSEN et al. (2001) and XU (2007) used scaled inverse-Formula distributions with predetermined hyperparameters as priors for the effect-specific variance parameters. Rather than presetting the hyperparameters in the priors that control the degree of shrinkage, it would be appealing to treat the hyperparameters as unknowns and estimate them from the data so that the model can shrink the coefficients as much as can be justified by the data. PARK and CASELLA (2007) set up a hyperprior for the hyperparameter in the LASSO model and developed a Gibbs sampler to fit the hierarchical model. R. B. O'HARA and M. J. SILLANPÄÄ (unpublished results) conducted a comparison with several Bayesian model selection and shrinkage methods, including Bayesian LASSO and the method of XU (2003).

In this article, we propose several Bayesian hierarchical models for mapping multiple QTL that simultaneously fit and estimate all possible genetic effects associated with all markers across the entire genome. We use prior distributions for the genetic effects that are scale mixtures of normal distributions with mean zero and unknown effect-specific variances. We consider two types of priors for the variances, exponential and scaled inverse-Formula distributions, which result in a Bayesian version of the LASSO model and the well-known Student's t model, respectively. We treat all hyperparameters as unknowns and estimate them along with other parameters. We fit the models in a fully Bayesian approach, employing the Markov chain Monte Carlo (MCMC) simulation to generate posterior samples from the joint posterior distribution. Our methods give not only point estimates but also interval estimates of all parameters and provide natural means of assessing model uncertainty.


MULTIPLE-QTL MODEL
We describe our method primarily for a mapping population with only two segregating genotypes, e.g., a backcross, double-haploid (DH), or recombinant inbred line (RIL). The method can be extended to other types of population. Assume that we observe many markers across the genome. The aim of QTL mapping is to identify which markers are tightly linked to genes with detectable effects and to estimate the magnitudes of the effects. For a continuously distributed trait, the observed phenotypic value yi of individual i can be described by the linear regression model

Formula 1(1)
where p is the number of markers, Formula 1 is the overall mean, Formula 1 denotes the genotype of marker j for individual i and is defined as –0.5 and 0.5 for the two genotypes in the mapping population, the coefficient Formula 1 represents the main effect of marker j, Formula 1 is the residual error assumed to follow a Formula 1 distribution, Formula 1, and Formula 1.

In practice, some marker genotypes may be missing. There are two commonly used methods to deal with missing marker data. The first approach takes the uncertainty in missing genotypes into account by treating the missing genotypes as unknowns and sampling them in the MCMC update procedure. The second approach is similar to the regression model of HALEY and KNOTT (1992) and replaces all missing genotypes by their expected values conditioning on the observed marker data, using the multipoint method (JIANG and ZENG 1997). Although the second method ignores the uncertainty of the estimated marker genotypes, it has a big computational advantage over the first method. Both approaches can be incorporated into our Bayesian method. For simplicity and computational convenience, this study considers only the second method.


PRIOR DISTRIBUTIONS
Data are usually sufficient to estimate the overall mean Formula 1 and the residual variance Formula 1. Thus, we can use any reasonable noninformative prior distributions for these parameters. For example, we can use an independent, flat prior for Formula 1, i.e., Formula 1, and a noninformative scale-invariant prior 1/Formula 1 for Formula 1.

QTL data typically contain a large number of markers, leading to many coefficients in model (1). However, most of the coefficients are expected to have no or only weak effects on the phenotype. Only a few coefficients may have notable effects (see, e.g., XU 2003). To incorporate this prior knowledge into our analysis, therefore, we set up a prior distribution that gives each coefficient Formula 1 a high probability of being near zero and in the meantime gives each coefficient a chance to take a large effect.

A commonly used prior that has the above properties is the double exponential (also called Laplace) distribution

Formula 2(2)
(TIBSHIRANI 1996; PARK and CASELLA 2007), where Formula 2 is a hyperparameter. With the double-exponential prior, the posterior mode estimate of the coefficients Formula 2 is the LASSO estimate (TIBSHIRANI 1996; PARK and CASELLA 2007). Another wide-tailed distribution is the well-known Student's t distribution,

Formula 3(3)
where the hyperparameters Formula 3, Formula 3, and Formula 3 are the degrees of freedom, the location, and the scale parameters, respectively (see, e.g., SORENSEN and GIANOLA 2002; GELMAN et al. 2003; VARONA et al. 2005).

Both the double-exponential distribution and Student's t distribution can be presented as a two-level hierarchical model (see, e.g., ANDREWS and MALLOWS 1974; GRIFFIN and BROWN 2006). Compared with their original forms, the two-level hierarchical models are easier to deal with both analytically and computationally. In the two-level hierarchical models, the first level assumes that the coefficients Formula 3 follow independent normal distributions with mean zero and unknown variances Formula 3,

Formula 4(4)
where Formula 4. At the second level, we assume that the variances Formula 4 follow some specified independent prior distributions

Formula 5(5)
where Formula 5 includes all the hyperparameters. The above two-level priors result in a scale mixture of normal distributions for the coefficients Formula 5,

Formula 6(6)
where Formula 6 is referred to as the mixing distribution. From this, we see that two-level hierarchical models introduce different variance parameters for different coefficients and hence induce different amounts of shrinkage in the estimates of different coefficients. The variance components are not the parameters of interest, but they are useful intermediate quantities to facilitate better inferences for the individual regression coefficients (e.g., GELMAN 2005).

The double-exponential distribution (2) can be presented as a mixture of normal distributions (4) with the mixing distribution Formula 6 being an exponential distribution Expon(Formula 6) or equivalently a gamma distribution Gamma(1, Formula 6),

Formula 7(7)
where Formula 7 is the inverse scale that needs to be carefully preset or estimated from the data.

For any values of Formula 7, the mode of the exponential distribution Expon(Formula 7) = 0, meaning that the "most likely" values of Formula 7 and thus Formula 7 are zero. However, the variance of Formula 7 is Formula 7, strongly depending on the value of Formula 7. Instead of presetting a value for Formula 7, it is appealing to assign a prior distribution to Formula 7 also so that Formula 7 can be estimated along with other parameters. This procedure obviates the choice of Formula 7 and automatically accounts for the uncertainty in its selection that affects the estimates of regression coefficients (PARK and CASELLA 2007). For convenience, we regard Formula 7, instead of Formula 7, as the parameter of interest. Following PARK and CASELLA (2007), we assign a conjugate gamma prior Gamma(a, b), a > 0, b > 0, to the parameter Formula 7. Assigning a prior distribution to Formula 7 provides a way to estimate Formula 7. We set a and b as small values (e.g., a = 0.1 and b = 0.1) so that the prior for Formula 7 is essentially noninformative.

Student's t distribution (3) can be expressed as a mixture of normal distributions (4) with the mixing distribution Formula 7 being a conjugate scaled inverse-Formula 7 distribution Formula 7 or equivalently an inverse gamma distribution Inv-gamma(Formula 7, Formula 7),

Formula 8(8)
where the hyperparameters Formula 8 and Formula 8 represent the degrees of freedom and the scale of the distribution, respectively.

The amount of shrinkage in the prior (8) depends on the values of the hyperparameters Formula 8 and Formula 8. The improper distribution Formula 8, which is equivalent to the uniform distribution on Formula 8, has the form of the inverse-Formula 8 density with Formula 8 and Formula 8 and can be taken as a limit of the proper inverse-Formula 8 or inverse-gamma densities. This improper prior in turn induces an improper prior for Formula 8 of the form Formula 8 (GRIFFIN and BROWN 2006). In the class of inverse-Formula 8 densities, Formula 8 has the constant degree of shrinkage in the coefficient estimates. XU (2003) actually used this improper prior Formula 8 in his shrinkage QTL mapping.

We here treat Formula 8 and Formula 8 as unknown parameters, obviating the choice of (Formula 8, Formula 8) and automatically accounting for the uncertainty in its selection that affects the estimates of the regression coefficients. We assign a uniform density on 1/Formula 8 for the range (0, 1] and a uniform distribution on Formula 8 for the range (0, A] with A being a large number (see GELMAN et al. 2003).

The prior (4) on the coefficients Formula 8 is independent of the residual variance and has been commonly used in the literature. PARK and CASELLA (2007) recently proposed an alternative version of the prior on Formula 8 that is dependent on the residual variance Formula 8,

Formula 9(9)
where Formula 9. At the second level, the prior distributions on Formula 9 take the same form as (7) or (8). This conditional prior may have some advantages; for example, it results in that Formula 9 is unitless and posteriors induced from (9) generally do not have more than one mode (PARK and CASELLA 2007).

We now have introduced two different priors for Formula 9 and two different priors for Formula 9. The two priors for Formula 9 are Formula 9 and Formula 9, respectively. The two priors for Formula 9 are Formula 9 and Formula 9, respectively. This yields four possible combinations and thus four different models. These four models are called model I with prior Formula 9, model II with prior Formula 9, model III with prior Formula 9, and model IV with prior Formula 9.


POSTERIOR COMPUTATION
We fit the models using the MCMC algorithm, applied to the joint posterior distribution of all the parameters Formula 9. The joint posterior distribution can be expressed as

Formula 10(10)
where Formula 10, Formula 10, Formula 10, Formula 10 represents Formula 10 for models I and II and (Formula 10) for models III and IV, Formula 10 is the normal density function Formula 10, and other terms in the right-hand side are the priors defined in the last section. For notational convenience, we suppress the dependence on X here and afterward.

With the two-level hierarchical models as set up in the last section, the joint posterior distribution Formula 10 can be simulated using the MCMC algorithm, alternately updating Formula 10 from the normal distribution Formula 10, updating each Formula 10 from the normal distribution Formula 10, where Formula 10 represents all elements of Formula 10 except Formula 10, updating Formula 10 from the inverse-Formula 10 distribution Formula 10, updating each Formula 10 from the inverse Gaussian (for models I and II) or inverse-Formula 10 distribution (for models III and IV), and updating Formula 10 from the gamma distribution Formula 10 (for models I and II), or updating Formula 10 from the gamma distribution Formula 10 and updating Formula 10 from Formula 10, using a Metropolis step (for models III and IV).

The two-level hierarchical modeling allows us to easily derive the above conditional posterior distributions (see APPENDIX A). For all the four proposed models, however, the above MCMC algorithms can be performed directly using the Bayesian software WinBUGS14 (SPIEGELHALTER et al. 2002), and thus we actually do not need to derive the conditional posteriors. However, the expressions of the conditional posteriors allow us to develop faster, purpose-built programs. The WinBUGS code implementing these four hierarchical models can be obtained by request from the first author.

The MCMC algorithm proceeds to draw each unknown from its fully conditional posterior distribution, given the current values of all other unknowns and the observed data. Each iteration of the MCMC algorithm cycles through all elements of Formula 10. This process continues for a large number of iterations to obtain random samples from the joint posterior distribution. We run multiple parallel chains with overdispersed starting points and use the potential scale reduction factor Formula 10 that compares the between- and within-sequence variances for any scalar estimands, to monitor convergence (GELMAN et al. 2003). We use the condition of Formula 10 < 1.1 for all scalar estimands of interest as the criteria of convergence. Once our simulations have converged, we continue to draw thousands of simulations and treat them as a sample from the joint posterior distribution. We thin the sequences by keeping every kth simulation draw from each sequence and discarding the rest (e.g., k = 100).


POSTERIOR SUMMARY AND INTERPRETATION
The proposed Bayesian hierarchical models can provide various graphical and tabular summaries that assess the contribution of individual loci while adjusting for effects of all other possible loci. One of such summaries is the estimate of the genetic effects Formula 10 associated with each marker. Furthermore, using the posterior samples of Formula 10 and the observed values Formula 10, we can also calculate the proportion of the phenotypic variance explained by each effect (i.e., heritability), Formula 10, where Vy is the phenotypic variance and Formula 10 is the sample variance of Formula 10. The heritability Formula 10 is independent of the scale of the phenotype, while the effect size Formula 10 depends on it. The fully Bayesian analysis usually uses the posterior median or mean to estimate Formula 10 and Formula 10 and also can provide the posterior interval for the estimate.

The Bayesian hierarchical models shrink the "insignificant" coefficients to zero, and hence the posterior estimates of Formula 10 and Formula 10 can guide variable selection. However, these posterior summaries do not automatically provide a criterion to declare that an effect is "in" the model. HOTI and SILLANPÄÄ (2006) suggest setting a threshold value, c, such that the standardized effect Formula 10 is included if Formula 10. Note that the summary statistic, heritability, is essentially the same as the standardized effects in HOTI and SILLANPÄÄ (2006). YANG and XU (2007) proposed using a Wald test statistic.

We here construct an alternative measurement that is similar to the widely used LOD score in the traditional QTL mapping approach if the phenotype is affected by a single QTL (LANDER and BOTSTEIN 1989), following the idea of YANDELL et al. (2007) (also see the vignette in the package R/qtlbim). We call this statistic the approximate Bayesian LOD score. The approximate Bayesian LOD score can be conveniently compared with the LOD curve obtained from the traditional interval-mapping approach. Our Bayesian LOD score considers the contribution of a given locus to the LOD after adjusting effects for all other possible loci. For marker j, the Bayesian LOD score (BLOD) is calculated as

Formula 11(11)
where the values of Formula 11, Formula 11, and Formula 11 are the simulated draws in a certain iteration, and Formula 11, the mean of the conditional posterior Formula 11. Note that although we adjust for the residual error variance, we use the simulated draws under the full model (including Formula 11) to calculate the likelihood function for the reduced model (without Formula 11).


REAL DATA ANALYSIS
The well-known barley data set from the North American Barley Genome Mapping Project (TINKER et al. 1996) was analyzed using the four proposed Bayesian hierarchical models. This data set has been extensively analyzed using different methods (TINKER et al. 1996; XU 2003, 2007; YI et al. 2003, 2005; ZHANG et al. 2005; XU and JIA 2007). The data were collected from a doubled-haploid population that contained n = 145 lines; each was grown in 25 different environments. The phenotype analyzed was the average value of kernel weight across environments. A total of p = 127 mapped markers covering a genome of 1500 cM (seven chromosomes) were used in the analysis. Observed marker genotypes were coded as –0.5 for one genotype and +0.5 for the other genotype. The data contain ~5% missing marker genotypes. The missing marker genotypes were replaced by their expected values conditioning on the observed marker data using the multipoint method. We simultaneously modeled all 127 marker effects in the linear regression (1).

For all four proposed models, the MCMC simulations were performed in the Bayesian software WinBUGS14 (SPIEGELHALTER et al. 2002), linked from the R statistical computing software (STURTZ et al. 2005; R DEVELOPMENT CORE TEAM 2006), which we can use to conveniently plot the results. For each analysis, we ran three parallel simulation sequences with starting points randomly generated from the prior distributions. The models with the dependent prior (9) (models III and IV) were found to converge slightly quicker than those with the independent prior (4) (models I and II). For all four models, the potential scale reduction factor Formula 11 values fell below 1.1 for all parameters after ~5000 iterations, indicating that the chains converged adequately (data not shown). For each of the three parallel sequences, therefore, we ran a total of 20,000 iterations and discarded the first halves to allow adequate convergence. The remaining 10,000 posterior samples of each sequence were thinned to 1000 for estimating the posterior distribution of quantities of interest by keeping every 10th simulation draw from each sequence and discarding the rest. On a dual processor 2.4-GHz machine, each analysis took ~4.5 hr.

To investigate whether or not posterior inferences are affected by the values of the shape a and the inverse scale b in the gamma prior Gamma(a, b), we analyzed models I and II with four different values of (a, b), a = b = 0.01, 0.1, 0.5, 1. Under the four analyses, the posterior estimates of the parameters Formula 11 were identical, but the inverse scale Formula 11 differed slightly.

Figure 1 shows the posterior medians and the 95% posterior intervals for the marker effects Formula 11 and the proportion of the phenotypic variance explained by each effect (i.e., heritability) Formula 11. Models I and II produced almost identical results, both being able to identify markers with large effects. The analyses showed four chromosomes (7, 1, 3, and 2) with strong evidence of QTL. The QTL on chromosome 3 was found to have an opposite effect on the phenotype to the other detected QTL and was missed in the analysis of XU (2003), who used the improper prior Formula 11. The difference may also be caused by the different ways of treating missing marker genotypes for the two methods. As can be seen in Figure 1, the plots of the heritability can provide a clearer picture than those of the effect.


Figure 1
View larger version (35K):
In this window
In a new window
Download PPT slide
 
FIGURE 1.—

Posterior medians (points) and 95% intervals (shaded lines) for genetic effects and the proportion of the phenotypic variance explained by each effect (i.e., heritability). (Top) Plots drawn from model I; (bottom) plots for model II. Inner tick marks on the x-axis represent the marker positions.

 
Figure 2 shows the histograms of the inverse scale Formula 11 for the analyses of models I and II with a = b = 0.1. We can see that the hyperparameter Formula 11 can be estimated with quite high precision. For model I, the inverse scale parameter was estimated at 32.0, with a 95% posterior interval of [20.6, 50.5]. However, model II provided a much smaller estimate, with a posterior median of 5.1 and a 95% posterior interval of [2.8, 9.8]. We know that in the exponential distribution a larger inverse scale forces stronger shrinkage. Figure 1 shows that models I and II perform at the same level of shrinkage in the coefficient estimates. This can also be shown by looking at the estimated Formula 11, which was 0.3, <1.


Figure 2
View larger version (13K):
In this window
In a new window
Download PPT slide
 
FIGURE 2.—

Histogram of the posterior samples for the inverse scale of the exponential prior on the variances. The dotted lines represent the posterior 5, 50, and 95% quantiles. The left and right plots show inferences for models I and II, respectively.

 
Figure 3 depicts the posterior medians and the 95% posterior intervals for marker effect Formula 11 and the heritability Formula 11 from the analyses of models III and IV. Models III and IV produced identical results, similar to those from models I and II. However, the Inv-Formula 11 prior distributions on Formula 11 produced slightly larger posterior medians and wider posterior intervals for Formula 11 and Formula 11. The degrees of freedom and scale parameters can be estimated from the data. Figure 4 shows the histograms of these two hyperparameters for the analyses of models III and IV. The two models produced similar estimates for the degrees of freedom, with the posterior median at 2.1 and the 95% posterior interval of [1.2, 5.3]. However, the estimate of the scale parameter for model IV was three times as large as that for model III.


Figure 3
View larger version (31K):
In this window
In a new window
Download PPT slide
 
FIGURE 3.—

Posterior medians (points) and 95% intervals (shaded lines) for genetic effects and the proportion of the phenotypic variance explained by each effect (i.e., heritability). (Top) Plots drawn from model III; (bottom) plots for model IV. Inner tick marks on the x-axis represent the marker positions.

 

Figure 4
View larger version (16K):
In this window
In a new window
Download PPT slide
 
FIGURE 4.—

Histogram of the posterior samples for the degrees of freedom and scale of the Inv-Formula 11 prior on variances. The dotted lines represent the posterior 5, 50, and 95% quantiles. The top and bottom plots show inferences for models III and IV, respectively.

 
Figure 5 (top) shows the posterior medians and the 95% posterior intervals for the Bayesian LOD score for model I. The other three models produced similar estimates (data not shown). For comparison, Figure 5 (bottom) also shows the LOD score curve calculated by the traditional interval mapping based on a single-QTL model. If we use the standard threshold value of 3.2, the interval mapping identified only two regions (on chromosomes 7 and 1, respectively), which have larger effects in our analyses. Our Bayesian models produced much higher estimates of LOD score and detected more significant QTL.


Figure 5
View larger version (19K):
In this window
In a new window
Download PPT slide
 
FIGURE 5.—

The top plot shows posterior medians (points) and 95% intervals (shaded lines) for the approximate Bayesian LOD score from model I, and the bottom plot shows the LOD score curve from traditional interval mapping. The dotted lines represent the standard threshold value of 3.2. Inner tick marks on the x-axis represent the marker positions.

 
In the proposed two-level hierarchical models, the amount of shrinkage in the coefficient estimates is largely determined by the hyperparameters in the priors. It is expected that optimal values of the hyperparameters depend on the data and the number of variables included, which makes it difficult to preset their values. To illustrate this, we analyzed the data with only markers on chromosomes 1, 3, and 7 included in the model. Figure 6 displays the plots of marker effects, showing that we were still able to detect the same QTL as in our previous analyses. As shown in Figure 7, however, the posterior estimates of the hyperparameters were different from those in the previous analyses.


Figure 6
View larger version (31K):
In this window
In a new window
Download PPT slide
 
FIGURE 6.—

Posterior medians (points) and 95% intervals (shaded lines) for genetic effects from all four models using markers on chromosomes 1, 3, and 7. Inner tick marks on the x-axis represent the marker positions.

 

Figure 7
View larger version (15K):
In this window
In a new window
Download PPT slide
 
FIGURE 7.—

Histogram of the posterior samples for the hyperparameters of priors on variances. The dotted lines represent the posterior 5, 50, and 95% quantiles. The top plots show inferences for models I and II, respectively, the middle plots show inferences from model III, and the bottom plots show inferences from model IV.

 


DISCUSSION
We have presented four Bayesian hierarchical models that can be used to simultaneously fit and estimate all possible genetic effects associated with all molecular markers across the entire genome. We found that these four methods perform equally well. It is known a priori that most markers have no or little effect on the phenotype, but if a marker has an effect, it could be large. To incorporate this prior knowledge into our analysis, we set up a continuous form of prior distribution for genetic effects that gives each effect a high probability of being near zero and also enables us to accommodate large effects. We have considered two such priors—double exponential distribution and Student's t distribution—that can be expressed as scale mixtures of normal distributions with mean zero and unknown variances distributed as exponential and scaled inverse-Formula 11 distributions, respectively. The former prior results in a Bayesian LASSO model (TIBSHIRANI 1996; YUAN and LIN 2005; PARK and CASELLA 2007), and the latter includes Jeffrey's noninformative prior as a special case (GELMAN 2006).

Both the exponential and the scaled inverse-Formula 11 distributions include hyperparameters that determine the degrees of shrinkage in the estimates of the variances and thus the genetic effects. A common practice is to preset values for the hyperparameters using methods like cross validation (TIBSHIRANI 1996; MEUWISSEN et al. 2001; XU 2003; BAO and MALLICK 2004; XU 2007). However, optimal values depend on the data and thus may be difficult to choose. A novel aspect of our approach is to treat all hyperparameters as unknowns and estimate them along with other parameters. This procedure allows us to control the amount of shrinkage by taking advantage of the characteristics of the data. In contrast, Jeffrey's prior includes no hyperparameter but always forces a constant degree of shrinkage. XU (2003) showed that Jeffrey's prior yields good performance, but we observed that it converges more slowly than our proposed methods.

We fit the models in a fully Bayesian approach, employing the MCMC simulation to generate posterior samples from the joint posterior distribution, which can be used to make various posterior inferences. Although computationally intensive, it is easy to implement and provides not only point estimates but also interval estimates of all parameters. We have proposed graphical tools to summarize the posterior samples, notably the approximate Bayesian LOD score that can be easily compared with the results from traditional interval mapping. However, we realize that these tools still are informal and descriptive, due to the lack of formal threshold value to select markers. A formal choice of threshold value will be a topic of future research.

The fully Bayesian approach enables us to obtain much richer inferences about the models than most non-Bayesian analyses. In practice, however, it is desirable to have a quicker calculation that merely looks for posterior modes rather than fully investigating the posterior distribution. The original LASSO estimates for linear regression coefficients are equivalent to Bayesian posterior mode estimates when the coefficients have independent and identical double-exponential priors (TIBSHIRANI 1996). The two-level hierarchical formulation enables us to find posterior modes using various algorithms, e.g., conditional maximization (ZHANG and XU 2005), the EM algorithm, and its extensions (FIGUEIREDO 2003; FOSTER et al. 2007; XU 2007). However, these methods have been developed on the basis of preset hyperparameters. Further investigation is necessary to extend the mode-searching algorithms to the proposed hierarchical models.

The proposed models have been used to fit all markers and estimate their effects. The methods can be easily extended to detect QTL within marker intervals. The idea is to insert loci within each marker interval as possible positions of QTL and put a reasonable number of loci on each chromosome with positions treated as parameters (WANG et al. 2005). An additional Metropolis step is then used to update the positions. Future research also will consider epistatic effects and extensions to complicated experimental crosses. Computationally efficient algorithms are an essential feature for the practical analysis of these more complicated cases. We are in the process of developing purpose-specific computer programs that would significantly reduce the computing time. Our hierarchical models assign marker effects independent priors with a single prior mean. However, it is desirable to develop hierarchical priors to allow shrinkage of coefficients toward multiple prior means with the locations of these means unknown and to accommodate the spatial covariance structure along markers (GIANOLA et al. 2003).


APPENDIX A: CONDITIONAL POSTERIOR DISTRIBUTIONS
The two-level hierarchical models presented in this study have explicit forms of conditional posterior distributions for parameters and hyperparameters. These conditional posterior distributions are required to perform the MCMC algorithm. The posterior distributions are presented in this section.

Conditional on the parameters Formula 11, the models are the standard weighted linear regressions, and thus the conditional posterior distributions of Formula 11 are

Formula A1(A1)

Formula A2(A2)

Formula A3(A3)
where Formula A3 represents all elements of Formula A3 except Formula A3, and Formula A3 for models I and III or Formula A3 for models II and IV.

For models I and II, the conditional posterior distribution of Formula A3 is inverse Gaussian,

Formula A4(A4)
A relatively simple algorithm is available for simulating from the inverse Gaussian distribution (CHHIKARA and FOLKS 1989). With the conjugate prior Gamma(a, b), the conditional posterior distribution of the hyperparameter Formula A4 in the prior (7) is gamma

Formula A5(A5)
For models III and IV, the conditional posterior distribution of Formula A5 is inverse-Formula A5,

Formula A6(A6)
The conditional posterior distribution of the scale parameter Formula A6 in the prior (8) is gamma

Formula A7(A7)
The conditional posterior of the degrees of freedom Formula A7 has no standard form. Therefore, a Metropolis step is required to update Formula A7 in each iteration.


ACKNOWLEDGEMENTS
This work was supported by the National Institutes of Health (NIH) grants R01 GM069430, HL080812, and GM077490 to N.Y. and by the National Science Foundation grant DBI-0345205 and the National Research Initiative Plant Genome of the U.S. Department of Agriculture Cooperative State Research, Education, and Extension Service no. 2007-02784 to S.X.


LITERATURE CITED

ANDREWS, D. F., and C. L. MALLOWS, 1974 Scale mixtures of normal distributions. J. R. Stat. Soc. Ser. B 36: 99–102.

BAO, K., and B. K. MALLICK, 2004 Gene selection using a two-level hierarchical Bayesian model. Bioinformatics 20: 3423–3430.[Abstract/Free Full Text]

CHHIKARA, R. S., and L. FOLKS, 1989 The Inverse Gaussian Distribution: Theory, Methodology, and Applications. Marcel Dekker, New York.

EFRON, B., T. HASTIE, I. JOHNSTONE and R. TIBSHIRANI, 2004 Least angle regression. Ann. Stat. 32: 407–499.[CrossRef]

FIGUEIREDO, M. A. T., 2003 Adaptive sparseness for supervised learning. IEEE Trans. Patt. Anal. Machine Intell. 25: 1150–1159.[CrossRef]

FOSTER, S. D., A. P. VERBYLA and W. S. PITCHFORD, 2007 Incorporating LASSO effects into a mixed model for QTL detection. J. Agric. Biol. Environ. Stat. 12(2): 300–314.[CrossRef]

GELMAN, A., 2005 Analysis of variance: why it is more important than ever (with discussion). Ann. Stat. 33: 1–53.[CrossRef]

GELMAN, A., 2006 Prior distributions for variance parameters in hierarchical models. Bayesian Anal. 1: 515–533.[CrossRef]

GELMAN, A., J. CARLIN, H. STERN and D. RUBIN, 2003 Bayesian Data Analysis. Chapman & Hall, London.

GIANOLA, D., M. PEREZ-ENCISO and M. A. TORO, 2003 On marker-assisted prediction of genetic value: beyond of the ridge. Genetics 163: 347–365.[Abstract/Free Full Text]

GRIFFIN, J. E., and P. J. BROWN, 2006 Alternative prior distributions for variable selection with very many more variables than observations. Technical report. University of Warwick, Coventry, UK.

HALEY, C. S., and S. A. KNOTT, 1992 A simple regression method for mapping quantitative trait loci in line crosses using flanking markers. Heredity 69: 315–324.[Medline]

HOERL, A. E., and R. W. KENNARD, 1970 Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12: 55–67.[CrossRef]

HOTI, F., and M. J. SILLANPÄÄ, 2006 Bayesian mapping of genotype x expression interactions in quantitative and qualitative traits. Heredity 97: 4–18.[CrossRef][Medline]

HUANG, H., C. D. EVERSLEY, D. W. THREADGILL and F. ZOU, 2007 Bayesian multiple quantitative trait loci mapping for complex traits using markers of the entire genome. Genetics 176: 2529–2540.[Abstract/Free Full Text]

JIANG, C., and Z.-B. ZENG, 1997 Mapping quantitative trait loci with dominant and missing markers in various crosses from two inbred lines. Genetica 101: 47–58.[CrossRef][Medline]

KAO, C. H., Z.-B. ZENG and R. D. TEASDALE, 1999 Multiple interval mapping for quantitative trait loci. Genetics 152: 1203–1216.[Abstract/Free Full Text]

LANDER, E. S., and D. BOTSTEIN, 1989 Mapping Mendelian factors underlying quantitative traits using RFLP linkage maps. Genetics 121: 185–199.[Abstract/Free Full Text]

MEUWISSEN, T. H. E., B. J. HAYES and M. E. GODDARD, 2001 Prediction of total genetic value using genome-wide dense marker maps. Genetics 157: 1819–1829.[Abstract/Free Full Text]

PARK, T., and G. CASELLA, 2007 The Bayesian Lasso. Technical report. University of Florida, Gainesville, FL.

R DEVELOPMENT CORE TEAM, 2006 R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna. http://www.R-project.org.

SILLANPÄÄ, M. J., and E. ARJAS, 1998 Bayesian mapping of multiple quantitative trait loci from incomplete inbred line cross data. Genetics 148: 1373–1388.[Abstract/Free Full Text]

SORENSEN, D., and D. GIANOLA, 2002 Likelihood, Bayesian and MCMC Methods in Quantitative Genetics. Springer, New York.

SPIEGELHALTER, D., A. THOMAS, N. BEST and D. LUNN, 2002 BUGS: Bayesian Inference Using Gibbs Sampling, Version 1.4. MRC Biostatistics Unit, Cambridge, UK. www.mrc-bsu.cam.ac.uk/bugs/.

STURTZ, S., U. LIGGES and A. GELMAN, 2005 R2WinBUGS: a package for running WinBUGS from R. J. Stat. Software 12: 1–16.

TIBSHIRANI, R., 1996 Regression shrinkage and selection via the Lasso. J. R. Stat. Soc. Ser. B 58: 267–288.

TINKER, N. A., D. E. MATHER, B. G. ROSSNAGEL, K. J. KASHA and A. KLEINHOFS, 1996 Regions of the genome that affect agronomic performance in two-row barley. Crop Sci. 36: 1053–1062.[Abstract/Free Full Text]

VARONA, L., W. MEKKAWY, D. GIANOLA and A. BLASCO, 2005 A whole genome analysis using robust asymmetric distributions. Genet. Res. 88: 143–151.[CrossRef]

WANG, H., Y. M. ZHANG, X. LI, G. L. MASINDE, S. MOHAN et al., 2005 Bayesian shrinkage estimation of quantitative trait loci parameters. Genetics 170: 465–480.[Abstract/Free Full Text]

XU, S., 2003 Estimating polygenic effects using markers of the entire genome. Genetics 163: 789–801.[Abstract/Free Full Text]

XU, S., 2007 An empirical Bayes method for estimating epistatic effects of quantitative trait loci. Biometrics 63: 513–521.[CrossRef][Medline]

XU, S., and Z. JIA, 2007 Genome-wide analysis of epistatic effects for quantitative traits in barley. Genetics 175: 1955–1963.[Abstract/Free Full Text]

YANDELL, B. S., T. MEHTA, S. BANERJEE, D. SHRINER, R. VENKATARAMAN et al., 2007 R/qtlbim: QTL with Bayesian interval mapping in experimental crosses. Bioinformatics 23: 641–643.[Abstract/Free Full Text]

YANG, R., and S. XU, 2007 Bayesian shrinkage analysis of quantitative trait loci for dynamic traits. Genetics 176: 1169–1185.[Abstract/Free Full Text]

YI, N., 2004 A unified Markov chain Monte Carlo framework for mapping multiple quantitative trait loci. Genetics 167: 967–975.[Abstract/Free Full Text]

YI, N., and D. SHRINER, 2008 Advances in Bayesian multiple QTL mapping in experimental designs. Heredity 100: 240–252.[CrossRef][Medline]

YI, N., V. GEORGE and D. B. ALLISON, 2003 Stochastic search variable selection for identifying quantitative trait loci. Genetics 164: 1129–1138.[Abstract/Free Full Text]

YI, N., B. S. YANDELL, G. A. CHURCHILL, D. B. ALLISON, E. J. EISEN et al., 2005 Bayesian model selection for genome-wide epistatic QTL analysis. Genetics 170: 1333–1344.[Abstract/Free Full Text]

YUAN, M., and Y. LIN, 2005 Efficient empirical Bayes variable selection and estimation in linear models. J. Am. Stat. Assoc. 100: 1215–1225.[CrossRef]

ZHANG, Y.-M., and S. XU, 2005 A penalized maximum likelihood method for estimating epistatic effects of QTL. Heredity 95: 96–104.[CrossRef][Medline]

ZHANG, M., K. L. MONTOOTH, M. T. WELLS, A. G. CLARK and D. ZHANG, 2005 Mapping multiple quantitative trait loci by Bayesian classification. Genetics 169: 2305–2318.[Abstract/Free Full Text]

Communicating editor: J. B. WALSH




This article has been cited by other articles:


Home page
GeneticsHome page
G. de los Campos, H. Naya, D. Gianola, J. Crossa, A. Legarra, E. Manfredi, K. Weigel, and J. M. Cotes
Predicting Quantitative Traits With Regression Models for Dense Molecular Markers and Pedigree
Genetics, May 1, 2009; 182(1): 375 - 385.
[Abstract] [Full Text] [PDF]


Home page
GeneticsHome page
N. Yi and S. Banerjee
Hierarchical Generalized Linear Models for Multiple Quantitative Trait Locus Mapping
Genetics, March 1, 2009; 181(3): 1101 - 1113.
[Abstract] [Full Text] [PDF]