- THIS ARTICLE
-
Abstract
- Full Text (PDF)
- Alert me when this article is cited
- Alert me if a correction is posted
- SERVICES
- Similar articles in this journal
- Similar articles in PubMed
- Alert me to new issues of the journal
- Download to citation manager
- Reprints & Permissions
- CITING ARTICLES
- Citing Articles via HighWire
- Citing Articles via Google Scholar
- GOOGLE SCHOLAR
- Articles by Lee, H.
- Articles by Rothschild, M. F.
- Search for Related Content
- PUBMED
- PubMed Citation
- Articles by Lee, H.
- Articles by Rothschild, M. F.
Application of the False Discovery Rate to Quantitative Trait Loci Interval Mapping With Multiple Traits
Hakkyo Leea, Jack C. M. Dekkersb, M. Sollerc, Massoud Malekb, Rohan L. Fernandob, and Max F. Rothschildba Hankyong National University, Ansung-si, Kyonggi, 456-749, Korea,
b Department of Animal Science, Iowa State University, Ames, Iowa 50011
c Department of Genetics, Hebrew University of Jerusalem, Jerusalem, 91904 Israel
Corresponding author: Jack C. M. Dekkers, Iowa State University, 225C Kildee Hall, Ames, IA 50011., jdekkers{at}iastate.edu (E-mail)
Communicating editor: J. A. M. VAN ARENDONK
| ABSTRACT |
|---|
Controlling the false discovery rate (FDR) has been proposed as an alternative to controlling the genome-wise error rate (GWER) for detecting quantitative trait loci (QTL) in genome scans. The objective here was to implement FDR in the context of regression interval mapping for multiple traits. Data on five traits from an F2 swine breed cross were used. FDR was implemented using tests at every 1 cM (FDR1) and using tests with the highest test statistic for each marker interval (FDRm). For the latter, a method was developed to predict comparison-wise error rates. At low error rates, FDR1 behaved erratically; FDRm was more stable but gave similar significance thresholds and number of QTL detected. At the same error rate, methods to control FDR gave less stringent significance thresholds and more QTL detected than methods to control GWER. Although testing across traits had limited impact on FDR, single-trait testing was recommended because there is no theoretical reason to pool tests across traits for FDR. FDR based on FDRm was recommended for QTL detection in interval mapping because it provides significance tests that are meaningful, yet not overly stringent, such that a more complete picture of QTL is revealed.
DUE to availability of large numbers of polymorphic markers, it is now possible to scan a complete genome for loci affecting quantitative traits of interest, so-called quantitative trait loci (QTL). Because of the large number and correlated statistical tests conducted and associated concerns about a flood of false-positive claims for QTL if comparison-wise type I error rates (CWER) are not properly controlled, methods to set CWER thresholds for declaring the presence of a QTL have received much attention over the past decade. The most common approach is to set CWER so as to control the genome-wise type I error rate (GWER). To achieve this, ![]()
![]()
![]()
More recently, ![]()
![]()
![]()
Interval mapping based on least squares (![]()
![]()
![]()
![]()
The methods for hypothesis testing described above have generally been applied to single traits. Yet, QTL mapping experiments typically involve several to many traits and this must be taken into account when setting significance thresholds. Technically, this can be readily achieved in the CD and FDR approaches by grouping tests across traits, as though they were generated by a single analysis; for the LK approach single-trait thresholds can be adjusted by a Bonferroni correction (![]()
![]()
The objective of this study was to implement the FDR approach for least-squares regression interval mapping of single and multiple traits. A secondary objective was to compare CWER thresholds and power for QTL detection using FDR to those from the CD and LK approaches. Data from an F2 cross of outbred lines in pigs were used to address these objectives but methods and results have a more general application.
| MATERIALS AND METHODS |
|---|
Data and QTL analyses:
Data used were from a complete genome scan based on 125 microsatellite markers in 525 F2 progeny from a cross between two breeds of swine, Berkshire and Yorkshire. Full details are in ![]()
![]()
The least-squares regression interval mapping procedure and program of ![]()

where ba,k and bd,k are regression coefficients that estimate the additive and dominance effects for the putative QTL at position k, and ca,k and cd,k are the additive and dominance "breed-origin" coefficients at that position. Breed-origin coefficients were based on breed-origin probabilities for alleles at the putative position. Breed-origin probabilities were derived using all available marker data following ![]()
![]()
False discovery rate (FDR):
CWER thresholds to control FDR to a level
F, as suggested by ![]()
, where N is the total number of tests and CWERi is the CWER for the ith ranked test. Note that N x CWERi is the expected number of tests declared significant if no QTL were present and the CWER threshold was set at
, while i is the number of tests that are actually declared significant at that level in the current experiment. Significance thresholds to control FDR at a level
F were then determined as the CWER corresponding to the largest i for which FDRi was below the desired level
F. For multiple-trait thresholds, tests were ranked across traits.
Initially, FDR were derived on the basis of all tests conducted, i.e., at every 1-cM position, referred to as FDR1. The CWER for individual tests were obtained from the standard F-distribution. FDR1 included 2050 tests per trait and 10,250 tests across the five traits. In a second approach, referred to as FDRm, only the highest F-statistic within each marker interval was included, as suggested in ![]()
The IWER for a given marker interval was determined by the distribution of the maximum F-statistic in that interval under the null hypothesis, which can be derived by data permutation. Because densities are required for low values of IWER (<0.001), this would require a very large number of permutations to be conducted for every marker interval. To provide an alternative requiring much less computation, a prediction equation was derived that allowed prediction of IWER on the basis of the CWER for the observed maximum F-value in the interval and the degree of dependence of tests conducted in that interval. The dependence of tests at two positions k and l on the chromosome can be quantified by the correlations of the breed-origin coefficients at these positions, i.e., the correlation of ca,k with ca,l and the correlation of cd,k with cd,l. Correlations between breed-origin coefficients at the flanking markers were computed across the F2 individuals for each interval, separately for additive and dominance coefficients. The average of the two correlations was used to quantify the dependence of tests conducted within the interval. The rationale for using correlations between flanking markers is that all information to map a QTL in an interval is present at the markers that flank the interval (![]()
![]()
Data from 13 marker intervals (6 on chromosome 1 and 7 on chromosome 2) were used to derive the prediction equation for IWER. For each interval, the distribution of the maximum F-statistic under the null hypothesis of no QTL was derived by data permutation (10,000). Threshold F-values were obtained for a range of IWER and used to derive the relationship of IWER with CWER and the average correlation between breed-origin coefficients at the flanking markers. The resulting prediction equation was used to derive IWER for all tests included in FDRm.
Approaches to control GWER:
The CD and LK methods were used to derive CWER thresholds that controlled GWER at 0.10, 0.05, and 0.01. The CD method was implemented as in ![]()
![]()
![]()
= 1.5, and d = 2 d.f. for each test. For controlling GWER across the five traits, a Bonferroni adjustment was made, on the realistic assumption that the traits are independent (Table 1). The single-trait GWER (GWERST) required to control the multiple trait GWER at GWERMT was then derived from
.
|
| RESULTS |
|---|
Population parameters for the five traits that were included in the analyses are in Table 1. Traits were chosen because of their independence and range of heritabilities. Traits were approximately independent, as indicated by close to zero phenotypic correlations.
Prediction of IWER:
Table 2 shows characteristics of the 13 marker intervals that were used to develop the prediction equation for IWER. They represented a range of marker distances and information contents. Correlations between breed-origin coefficients were lower for intervals that were longer and that had higher information content. Correlations between dominance coefficients were consistently lower than correlations between additive coefficients. Data on all of the 106 marker intervals showed a high correlation (0.97) between the two correlation coefficients.
|
Thresholds of the F-statistic for IWER were obtained by data permutation for each of the 13 intervals of Table 2 and plotted against their corresponding CWER. Fig 1 illustrates the relationship between IWER and CWER for intervals with a low and a high correlation between QTL coefficients (intervals 2 and 4 on chromosome 2). For these intervals, 50,000 permutations were run, such that thresholds for IWER as low as 0.0005 could be derived.
|
The IWER and CWER were linearly related on the logarithmic scale for IWER < 0.4 (Fig 1), which is the IWER region of interest. For the interval with the high correlation, the relationship between IWER and CWER was close to equality (IWER = CWER), which is equivalent to conducting a single test across the interval. For the interval with the low correlation, IWER was substantially greater than CWER, except for CWER close to 1. Thus, the CWER required for a given IWER decreased with magnitude of the correlation.
The following prediction equation was derived on the basis of CWER data points corresponding to IWER equal to 0.01, 0.05, 0.1, 0.2, 0.3, and 0.4 for the 13 intervals,

where IWERj and CWERj are the IWER and corresponding CWER for interval j, and
j is the average of the correlations for the additive and dominance breed-origin coefficients at the flanking markers (Table 2). The model R square was 0.998, which indicates a very good fit. For IWER = 0.01, the average absolute error was 0.0007 or 7% and the maximum absolute error was 25%. Data for IWER < 0.01 were not used to develop the prediction equation because the number of permutations was limited to 10,000. Results displayed in Fig 1, which are based on 50,000 replicates, however, show that the linear prediction can readily be extended to IWER < 0.01.
False discovery rate (FDR):
An example of the calculation of FDRm is in Table 3. For each interval, the IWER corresponding to the maximum F value was derived on the basis of the prediction equation. Tests were ranked by IWER and the 20 lowest tests are shown in Table 3. Although FDR generally increased with IWER, a step-like pattern was occasionally seen, where FDR decreased with error rate. This behavior is caused by disproportionate changes in the numerator and denominator of FDR when ranked tests differ little in IWER. When this occurs, the numerator of the expression for FDR, N x IWERi, remains the same, while the denominator, i, increases, leading to a reduction in FDR. For example, in going from rank 4 to 5 (Table 3), IWER increased from 0.00143 to 0.00150, while FDR decreased from 0.038 to 0.032.
|
The stepwise behavior of FDR is very apparent in Fig 2 and Fig 3, which show FDR1 and FDRm, respectively, for last rib back fat and across the five traits. Steps were more pronounced for FDR1. For low CWER values, FDR1 increased dramatically with decreasing CWER. For example, FDR1 was 0.05 for CWER = 0.00012 and 0.19 for CWER = 0.00009 (Fig 2). This behavior is caused by the large number of tests included, combined with the small differences in CWER among the top ranking tests, which tend to originate from the same marker interval.
|
|
For a given CWER or IWER, FDR tended to be higher when based on all traits than on tests for last rib back fat alone (Fig 2 and Fig 3). Single-trait results for marbling, loin eye area, and carcass weight (data not shown) were similar to those for back fat. For cholesterol content, both FDR1 and FDRm behaved erratically and never reached FDR levels <0.8.
Comparison of significance testing methods: Single-trait analyses:
The CWER thresholds required to control GWER or FDR at the 0.10, 0.05, and 0.01 levels for different approaches are in Table 4. For FDRm, both IWER thresholds and the CWER for the associated tests are shown for completeness.
|
By definition, LK thresholds were the same for all traits (Table 4). Thresholds based on CD differed slightly by trait due to differences in phenotypic distributions and sampling, the latter in particular for the 0.01 GWER level. Thresholds for FDR varied considerably by trait and could not be found for all significance levels for some traits. This variability is caused by the specific CWER values obtained for the set of tests included in the analysis. Part of this variability may be due to the number of segregating QTL. Inability to obtain the target FDR level for a particular trait indicates that none of the tests were significant at that level.
The LK approach required the most stringent CWER thresholds, followed by CD and FDR (Table 4). The CWER thresholds for FDR1 and FDRm were generally similar but varied relative to each other. This variability is caused by the specific tests included in the analyses and by the dependence of CWER thresholds for FDRm on interval characteristics.
The CWER thresholds decreased with decreasing GWER or FDR levels for all methods (Table 4). Decreases in thresholds were relatively small in going from GWER = 0.10 to GWER = 0.05 and greater in going from GWER = 0.05 to GWER = 0.01. Thresholds for FDR decreased markedly in going from FDR = 0.05 to FDR = 0.01, coming close to those for CD. However, at this level of FDR, only two traits had tests that met the target FDR level.
Multiple-trait analyses:
Testing for multiple traits decreased CWER thresholds five- to sixfold for both LK and CD (Table 4). Multiple-trait thresholds were also reduced for FDR1 and FDRm, when compared to the average CWER or IWER of single-trait thresholds, but less than for LK or CD. At the 0.10 level, multiple-trait thresholds were reduced only by a factor of 2.3 for FDRm and FDR1, compared to the fivefold reductions observed for LK and CD. At the 0.05 level, multiple-trait thresholds were reduced by a factor of 4 for FDRm and 10 for FDR1. The 0.01 level was not reached for the FDR approaches.
Number of QTL detected:
The number of QTL declared significant on the basis of the various thresholds reported in Table 4 are listed in Table 5. Graphs of the test statistic are shown in ![]()
![]()
|
As anticipated, the number of detected QTL tended to be in proportion to the required CWER threshold. At the very stringent thresholds required by LK, only 3 QTL were uncovered with the single-trait analyses at the 0.10 GWER level, and 1 and 0 at the 0.05 and 0.01 levels, respectively. The CD approach allowed more QTL to be detected than did LK. Both FDRm and FDR1 performed distinctly better than either LK or CD. The FDRm uncovered a total of 17, 9, and 2 QTL at the 0.10, 0.05, and 0.01 FDR levels, respectively, for the single-trait analyses. FDR1 resulted in very similar numbers of QTL detected as FDRm.
When computed across traits, both LK and CD lost much of their power to detect QTL (Table 5). The FDR method maintained relatively high power at an FDR of 0.10 but not at the 0.05 and 0.01 levels. For FDR1 for marbling at the 0.10 level, more QTL were detected by the multiple-trait test (1) than on the basis of the single-trait test (0).
| DISCUSSION |
|---|
Implementation of FDR for interval mapping:
With interval mapping, a test for presence of a QTL is typically conducted at each 1-cM position on the genome. This results in a large number of tests with very high correlations among tests at adjacent positions. Although FDR does not require independence of tests (![]()
![]()
Despite their somewhat different behaviors, FDRm and FDR1 resulted in very similar CWER thresholds and numbers of QTL detected. This similarity is consistent with the theoretical argument that the proportion of false positives is independent of the number of tests included, provided prior probabilities of a true test and statistical power are unaffected (![]()
![]()
Implementation of FDRm requires adjustment of the CWER for the multiple tests that are conducted within that interval. The IWER was introduced for these purposes. As demonstrated here, IWER can be derived with high accuracy from (i) a linear relationship between the logarithms of CWER and IWER for IWER < 0.4 and (ii) the dependence of the parameters of this linear relationship on the correlation between breed-origin coefficients at the flanking markers. Further work is needed to confirm these relationships for other designs.
Further development of FDR also requires accommodating the concerns of ![]()
![]()
0.1 (Table 5). ![]()
Because FDR has not yet been used widely for hypotheses testing, there is no consensus as to the appropriate levels of declaring significance of QTL. A limited number of studies have examined the impact of type I and type II errors on the efficiency of marker-assisted selection (![]()
![]()
Comparison of significance testing approaches:
The main conclusion to be drawn from the results presented with regard to comparison of significance testing methods is that CWER significance thresholds at the same GWER or FDR levels differ substantially between methods (Table 4), leading to different numbers of QTL detected (Table 5). Specifically, FDR resulted in less stringent significance thresholds (Table 4) and in more QTL detected (Table 5), as compared to the GWER controlling methods. Compared to LK, the CD method resulted in less stringent thresholds (Table 4) and in more QTL detected (Table 5). Although these results may depend on the specific data set used, they illustrate several conceptual differences between approaches, as is discussed below.
Conceptual differences:
Controlling type I error rate on the basis of a null hypothesis of zero effect is a well-accepted principle in statistical testing of scientific hypotheses. The GWER controlling methods of CD and LK attempt to extend this principle to multiple testing in a QTL scan by taking the null hypothesis of no QTL as valid for all tests conducted across the genome. This null hypothesis is, however, by definition false for traits that have been shown by prior biometrical analyses to have nonzero heritabilities. Instead, the statistical problem is to identify regions that harbor QTL vs. those that do not. The FDR approach deals directly and quantitatively with this challenge by controlling the proportion of false positives among all significant results. The GWER approaches deal with this only qualitatively, by controlling the probability that significant results include no more than one false positive.
The CD and LK approaches differ conceptually in the use of only tests based on the set of markers being analyzed in the given experiment for CD and consideration of all tests that would be conducted in a high-density marker map in the LK approach. This results in more stringent thresholds and fewer QTL detected for LK, as illustrated in Table 4 and Table 5. The implications of this conceptual difference have been discussed previously (![]()
![]()
![]()
Multiple-trait testing:
Consideration of multiple traits leads to even more stringent significance thresholds based on GWER and further reduces the power to detect QTL, as demonstrated in Table 4 and Table 5 for CD and LK. This is not necessarily the case for the FDR approach, provided the proportion of false positives among significant results is not affected by the number of tests. This relies on the condition that adding tests does not affect the prior probability of a true test or the average statistical power across tests (![]()
![]()
In principle, GWER controlling methods require pooling of traits in a single analysis, since they all share the same null hypothesis of zero QTL. This is not the case for FDR, since there is no prior assumption that traits have the same number of QTL. Furthermore, there is no advantage to losing power for a trait with many QTL from including tests for a trait with few QTL. Thus, for maximum power, FDR should be implemented for each trait separately.
![]()
| CONCLUSIONS |
|---|
Our general conclusion is that FDR allows detection of more QTL and provides a more appropriate strategy for setting significance thresholds for QTL mapping than controlling GWER because it allows a means for controlling the proportion of true results among all those declared significant. From a conceptual point of view, this appears to be the most crucial error rate for follow-up studies or application, although further work is needed to clarify the impact of different types of errors and to address the concerns of ![]()
| ACKNOWLEDGMENTS |
|---|
The authors are grateful to Daniel Nettleton, Dirk-Jan De Koning, and an anonymous reviewer for their input and critical review. This work was supported in part by a consortium of the National Pork Producers Council, Iowa Pork Producers Association, Iowa Purebred Swine Council, Babcock Swine, Danbred USA, DEKALB, PIC, Seghersgenetics USA, and Shamrock Swine Breeders. Additional support was from the Cooperative State Research, Education, and Extension Service, U.S. Department of Agriculture, under Agreement no. 00-52100-9610; the Iowa Agriculture and Home Economics Experimental Station, Ames, paper no. J-19082, project no. 3600; as well as Hatch and State of Iowa funds. Part of this work was completed while Dr. Soller was on leave at Iowa State University, supported by a visiting scientist fellowship provided by Cotswold Inc.
Manuscript received February 6, 2001; Accepted for publication March 13, 2002.
| LITERATURE CITED |
|---|
BENJAMINI, Y. and Y. HOCHBERG, 1995 Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. B 57:289-300.
CHURCHILL, G. A. and R. W. DOERGE, 1994 Empirical threshold values for quantitative trait mapping. Genetics 138:963-971[Abstract].
GOODWIN, R., and S. BURROUGHS, 1995 Genetic evaluation terminal line program results. National Pork Producers Council, Des Moines, IA.
HALEY, C. S. and S. A. KNOTT, 1992 A simple regression method for mapping quantitative trait loci in line crosses using flanking markers. Heredity 69:315-324[Medline].
HALEY, C. S., S. A. KNOTT, and J. M. ELSEN, 1994 Mapping quantitative trait loci in crosses between outbred lines using least squares. Genetics 136:1195-1207[Abstract].
KADARMIDEEN, H. N. and J. C. M. DEKKERS, 1999 Regression on markers with uncertain allele transmission for QTL mapping in half-sib designs. Genet. Sel. Evol. 31:437-455.
KASHI, Y., E. HALLERMAN, and M. SOLLER, 1990 Marker-assisted selection of candidate bulls for progeny testing programmes. Anim. Prod. 51:63-74.
LANDER, E. S. and D. BOTSTEIN, 1989 Mapping Mendelian factors underlying quantitative traits using RFLP linkage maps. Genetics 121:185-190
LANDER, E. S. and L. KRUGLYAK, 1995 Genetic dissection of complex traits: guidelines for interpreting and reporting linkage result. Nat. Genet. 11:241-247[Medline].
LANDER, E. S. and L. KRUGLYAK, 1996 Genetic dissection of complex traitscorrespondence. Nat. Genet. 11:241-247.
LANDER, E. S. and N. S. SCHORK, 1994 Genetic dissection of complex traits. Science 265:2037-2048
MALEK, M., J. C. M. DEKKERS, H. K. LEE, T. J. BAAS, and M. F. ROTHSCHILD, 2001a A molecular genome scan analysis to identify chromosomal regions influencing economic traits in the pig. I. Growth and body composition. Mamm. Genome 12:630-636[Medline].
MALEK, M., J. C. M. DEKKERS, H. K. LEE, T. J. BAAS, and M. F. ROTHSCHILD, 2001b A molecular genome scan analysis to identify chromosomal regions influencing economic traits in the pig. II. Meat and muscle composition. Mamm. Genome 12:637-645[Medline].
MOREAU, L., A. CHARCOSSET, F. HOSPITAL, and A. GALLAIS, 1997 Marker-assisted selection efficiency in populations of finite size. Genetics 148:1353-1365
MOSIG, M. O., E. LIPKIN, G. KHUTORESKAYA, E. TCHOURYZNA, and E. EZRA et al., 2001 A whole genome scan for quantitative trait loci affecting milk protein percentage in Israeli-Holstein cattle, by means of selective milk DNA pooling in a daughter design, using an adjusted false discovery rate criterion. Genetics 157:1683-1698
SOUTHEY, B., and R. L. FERNANDO, 1998 Controlling the proportion of false positives among significant results in QTL detection. Proceedings of the 6th World Congress on Genetics Applied to Livestock Production, Armidale, Australia, Vol. 26, pp. 221224.
SPELMAN, R. J., 1998 Detection and utilisation of quantitative trait loci in dairy cattle. Ph.D. Thesis, Wageningen Agricultural University, Wageningen, The Netherlands.
SPELMAN, R. J., W. COPPIETERS, L. KARIM, J. A. M. VAN ARENDONK, and H. BOVENHUIS, 1996 Quantitative trait loci analysis for five milk production traits on chromosome six in the Holstein-Friesian population. Genetics 144:1799-1808[Abstract].
WELLER, J. I., 2000 Using the false discovery rate approach in the genetic dissection of complex traits: a response to Zaykin et al. Genetics 154: 1919.
WELLER, J. I., J. Z. SONG, D. W. HEYEN, H. A. LEWIN, and M. RON, 1998 A new approach to the problem of multiple comparisons in the genetic dissection of complex traits. Genetics 150:1699-1706
WHITTAKER, J. R., R. THOMPSON, and P. M. VISSCHER, 1996 On the mapping of QTL by regression of phenotype on marker-type. Heredity 77:23-32.
WITTE, J. S., R. C. ELSTON, and N. J. SCHORK, 1996 Genetic dissection of complex traitscorrespondence. Nat. Genet. 12:365-366.
ZAYKIN, D. V., S. S. YOUNG, and P. H. WESTFALL, 2000 Using the false discovery rate approach in the genetic dissection of complex traits: a response to Weller et al.. Genetics 154:1917-1918
This article has been cited by other articles:
![]() |
E. M. Heifetz, J. E. Fulton, N. P. O'Sullivan, J. A. Arthur, J. Wang, J. C. M. Dekkers, and M. Soller Mapping Quantitative Trait Loci Affecting Susceptibility to Marek's Disease Virus in a Backcross Population of Layer Chickens Genetics, December 1, 2007; 177(4): 2417 - 2431. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Benjamini and D. Yekutieli Quantitative Trait Loci Analysis Using the False Discovery Rate Genetics, October 1, 2005; 171(2): 783 - 790. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Bennewitz, N. Reinsch, V. Guiard, S. Fritz, H. Thomsen, C. Looft, C. Kuhn, M. Schwerin, C. Weimann, G. Erhardt, et al. Multiple Quantitative Trait Loci Mapping With Cofactors and Application of Alternative Variants of the False Discovery Rate in an Enlarged Granddaughter Design Genetics, October 1, 2004; 168(2): 1019 - 1027. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Varga, G. Muller, G. Szabo, O. Pinke, E. Korom, B. Kovacs, L. Patthy, and M. Soller Mapping Modifiers Affecting Muscularity of the Myostatin Mutant (MstnCmpt-dl1Abc) Compact Mouse Genetics, September 1, 2003; 165(1): 257 - 267. [Abstract] [Full Text] [PDF] |
||||
- THIS ARTICLE
-
Abstract
- Full Text (PDF)
- Alert me when this article is cited
- Alert me if a correction is posted
- SERVICES
- Similar articles in this journal
- Similar articles in PubMed
- Alert me to new issues of the journal
- Download to citation manager
- Reprints & Permissions
- CITING ARTICLES
- Citing Articles via HighWire
- Citing Articles via Google Scholar
- GOOGLE SCHOLAR
- Articles by Lee, H.
- Articles by Rothschild, M. F.
- Search for Related Content
- PUBMED
- PubMed Citation
- Articles by Lee, H.
- Articles by Rothschild, M. F.



