- THIS ARTICLE
-
Abstract
- Full Text (PDF)
- Alert me when this article is cited
- Alert me if a correction is posted
- SERVICES
- Similar articles in this journal
- Similar articles in PubMed
- Alert me to new issues of the journal
- Download to citation manager
- Reprints & Permissions
- CITING ARTICLES
- Citing Articles via HighWire
- Citing Articles via Google Scholar
- GOOGLE SCHOLAR
- Articles by Noor, M. A. F.
- Articles by Larkin, J. C.
- Search for Related Content
- PUBMED
- PubMed Citation
- Articles by Noor, M. A. F.
- Articles by Larkin, J. C.
Consequences of Recombination Rate Variation on Quantitative Trait Locus Mapping Studies: Simulations Based on the Drosophila melanogaster Genome
Mohamed A. F. Noora, Aimee L. Cunninghama, and John C. Larkinaa Department of Biological Sciences, Louisiana State University, Baton Rouge, Louisiana 70803
Corresponding author: Mohamed A. F. Noor, Department of Biological Sciences, Life Sciences Bldg., Louisiana State University, Baton Rouge, LA 70803., mnoor{at}lsu.edu (E-mail)
Communicating editor: Z-B. ZENG
| ABSTRACT |
|---|
We examine the effect of variation in gene density per centimorgan on quantitative trait locus (QTL) mapping studies using data from the Drosophila melanogaster genome project and documented regional rates of recombination. There is tremendous variation in gene density per centimorgan across this genome, and we observe that this variation can cause systematic biases in QTL mapping studies. Specifically, in our simulated mapping experiments of 50 equal-effect QTL distributed randomly across the physical genome, very strong QTL are consistently detected near the centromeres of the two major autosomes, and few or no QTL are often detected on the X chromosome. This pattern persisted with varying heritability, marker density, QTL effect sizes, and transgressive segregation. Our results are consistent with empirical data collected from QTL mapping studies of this species and its close relatives, and they explain the "small X-effect" that has been documented in genetic studies of sexual isolation in the D. melanogaster group. Because of the biases resulting from recombination rate variation, results of QTL mapping studies should be taken as hypotheses to be tested by additional genetic methods, particularly in species for which detailed genetic and physical genome maps are not available.
QUANTITATIVE trait locus (QTL) mapping has recently become a standard tool for unraveling the genetic basis of phenotypic variation in natural populations, tests of adaptation, and directing marker-assisted selection of agronomically important traits. Coupling sophisticated statistical analyses with molecular genetic data, many QTL mapping studies have identified precise genomic regions contributing to differences between strains or species. The results of these studies have also provided minimum estimates of the number of genes contributing to observed phenotypic differences. These estimates are necessarily minimum because loci contributing subtle effects have a lower probability of being detected (![]()
Low recombination rates may cause multiple independent genetic factors contributing to a trait to resemble a single QTL of large effect. Regional differences in relative rates of recombination have been documented in numerous taxa (![]()
![]()
![]()
![]()
![]()
![]()
![]()
![]()
Here, we use simulation results to demonstrate that variance in recombination rate across a genome can cause systematic biases in the interpretation of mapping studies. The recent completion of the Drosophila melanogaster genome project (![]()
![]()
| MATERIALS AND METHODS |
|---|
We obtained the number of predicted mRNA coding sequences on the basis of the genome annotation (also referred to as "genes") in each of the 100 D. melanogaster cytological bands and the recombination rates within each of these bands from published sources (![]()
![]()
14,000 mRNA coding sequences were contained in the database: 2415 on the X chromosome, 5301 on chromosome 2, and 6293 on chromosome 3. Using these numbers, we manually estimated the number of coding sequences per centimorgan across the three major D. melanogaster chromosomes, whose lengths are
73 cM (the X chromosome), 110 cM (chromosome 2), and 110 cM (chromosome 3). This conversion was performed by counting the number of coding sequences and recombination fractions simultaneously until a complete centimorgan was reached. If a cytological band was >1 cM, we inferred that the proportion of a centimorgan contained within the band was equal to the proportion of the total number of genes within the band present in that centimorgan. Because the dot chromosome encodes <100 transcripts, it was excluded from this study.
Following this procedure, we designed two computer programs (available upon request) to randomly assign 50 QTL affecting a hypothetical trait difference. One program assigned QTL at random with respect to the 14,000 coding sequences [random-by-coding (RC)], and the other assigned QTL at random with respect to recombinational position [random-by-recombination (RR)]. RR QTL assignments are typical of the procedure used by most simulated QTL mapping studies (e.g., ![]()
The output of these programs was used as input for the QTL Cartographer suite of programs (![]()
![]()
Throughout this article we use the word QTL in two contexts. We refer to "true QTL" as those that were assigned by our RC and RR programs. Unless otherwise specified, there were exactly 50 true QTL in all of our simulations. We refer to "predicted QTL" as those loci that QTL Cartographer subsequently detected to have a significant association with the phenotypic variance. With an infinite number of markers and an infinite sample size, QTL Cartographer should have identified 50 predicted QTL in most of our simulations.
| RESULTS |
|---|
Gene density per centimorgan:
The distribution of coding sequences per centimorgan in the D. melanogaster genome is highly skewed, as can be seen for the three main chromosomes in Fig 1. Although there were typically fewer coding sequences close to the centromeres, the suppression in recombination extended beyond the centromeres far enough to create high gene densities per centimorgan in the centromeric region. Indeed, along chromosome 3, there was a 20-fold difference in gene density per centimorgan between some points along the chromosome. For example, 1990 genes were within 5 cM of the centromere of chromosome 3, resulting in >14% of the total number of genes occupying <3.5% of the recombinational genome. Further, the mean coding sequence density per centimorgan was also higher along the two autosomes (chromosome 2, 48.0 genes/centimorgan; chromosome 3, 58.5 genes/centimorgan) than along the X chromosome (32.2 genes/centimorgan, Mann-Whitney U-test, P < 0.0001 in both comparisons). This difference was still statistically significant if the 5 cM surrounding the centromeres of the two autosomes was excluded.
|
Basic simulation results:
To examine the consequences of a skewed distribution of coding sequences relative to the recombinational map on the detection of true QTL, we took a simulation approach. In all experiments, 50 true QTL loci were distributed randomly across the genome, using two different models to control placement of the QTL. In one set of simulations, true QTL were distributed randomly on the basis of the recombinational map (RR simulations). This set of simulations represents the assumptions inherent in most current simulated QTL mapping studies (e.g., ![]()
![]()
The results of these simulated mapping experiments were unambiguous. Almost identical results were obtained for both single marker linear regression analyses and composite interval mapping (CIM), so we focus here on the latter. First, in RC simulations, the strongest predicted QTL detected across the genome were within 5 cM of the centromere of chromosomes 2 or 3 (usually 3) in 46 of 100 simulated data sets (Table 1 and Fig 2). This is almost three times more frequent than the 14 of 100 RR simulations in which the strongest predicted QTL was associated with these two centromeric regions (chi-square, P < 0.0001). The reason for this difference is that, in RC simulations, many true QTL (sometimes up to 7 out of 50) were placed within 1 cM of each autosomal centromere because of the much higher gene density per centimorgan in these regions. This clustering was interpreted by the mapping algorithms as a single strong predicted QTL in these regions. In both simulations, no noticeable clustering of predicted QTL was observed on the X chromosome, consistent with its more homogeneous distribution of genes per centimorgan. The LOD score of the strongest predicted QTL was between 10.0 and 55.7 in RC simulations and between 10.8 and 37.3 in RR simulations (Mann-Whitney U-test, P < 0.0001).
|
|
CIM estimated 528 predicted QTL (mean 14.7) contributing to the RC-simulated phenotype and 1126 QTL (mean 17.9) in RR simulations (Mann-Whitney U-test, P < 0.0001). While this difference may not appear dramatic, 20% of RC simulations estimated 10 or fewer predicted QTLfewer than observed in any of the RR simulations. This difference came from the relative absence of predicted QTL on the X chromosome and chromosome 2 in RC simulations vs. RR simulations (see Table 1; Mann-Whitney U-test, P < 0.0001). Similarly, CIM did not identify any X chromosomal QTL in 10% of RC simulations, but all of the analyses of RR simulations identified at least one X chromosomal QTL (Fisher's exact test, P = 0.0015).
Varying QTL effect sizes, heritability, and marker density:
To explore the robustness of this pattern, we allowed the true QTL to have effect sizes drawn from an exponential distribution rather than all having equal effects, as in the simulations described above. This effect size distribution may be expected for alleles fixed during the process of adaptation (![]()
![]()
We also simulated a phenotype having a heritability of 0.7 rather than 0.3. This higher heritability allowed for the detection of a significantly greater number of predicted QTL on all chromosomes together or individually in both RC and RR simulations as compared with the simulated phenotype with a heritability of 0.3 (Mann-Whitney U-test, P < 0.0001). RC and RR simulations still differed significantly in overall number of QTL detected (Mann-Whitney U-test, P = 0.0003), although this difference was proportionately much smaller (Table 1). Nonetheless, the autosomes were still consistently more likely to have predicted QTL associated with greater effects than the X chromosome in RC simulations. It was very rare that the strongest predicted QTL would be associated with the X chromosome in RC simulations (see Table 1). In 13 of the RR and 53 of the RC simulations, the strongest QTL detected were again situated within 5 cM of the centromere of chromosomes 2 or 3 (chi-square, P < 0.0001).
We also varied the marker density from every 5 cM in the basic simulation to every 1 cM. This change had an almost identical effect to increasing the heritability of the phenotype. The results of these simulations are also presented in Table 1.
In all of these simulation variants, predicted QTL on the X chromosome are typically still less abundant and weaker in RC simulations than in RR simulations. Correspondingly, the strongest predicted QTL in RC simulations are typically within 5 cM of the centromere of one of the two major autosomes, while those of RR simulations are more randomly distributed.
X chromosomal vs. autosomal QTL:
In the simulations above, we observed fewer predicted QTL on the X chromosome in RC simulations relative to RR simulations. This difference is consistent with the proportion of coding sequences on the X chromosome: 17.2% of QTL should be on the X chromosome according to gene density, while RC simulations estimated 18.4% (2.7/14.7, from Table 1) of predicted QTL to be on the X chromosome. Similarly, RR simulations predicted that 22.9% (4.1/17.9) of predicted QTL would be on the X chromosome, while 24.9% of the recombinational length of the genome is along the X chromosome. These observations may suggest a more severe bias in the inferred effects of QTL due to clustering in centromeric regions rather than on which chromosome a QTL is likely to be detected.
However, we expanded our simulations to evaluate the likelihood of detecting strong true QTL on the X chromosome vs. autosomes in the RC and RR models. We again randomly placed 50 true "background" QTL with small effects (37 having additive effects of 1 and 13 having additive effects of 2) along with three "larger-effect" QTL with effect sizes twice as large as the largest of the background QTL (all having additive effects of 4). A total of 172 RC simulations and 188 RR simulations were executed, the results were analyzed using composite interval mapping (![]()
Transgressive segregation:
Several mapping studies have identified predicted QTL with effects opposite in direction to the difference observed between the strains being tested. To evaluate the effects of transgressive segregation on the difference between RC and RR simulations, we simulated three additional types of situations: true QTL having a 50% probability of having effects in either direction, true QTL having a 66% probability of being in one direction, and true QTL having an 83% probability of being in one direction. These were then compared with our basic simulation in which 100% of true QTL had effects in one direction.
The results of these simulations are presented in Table 2. Generally, as more true QTL had effects in opposite directions, fewer predicted QTL were detected. Interestingly, the difference between the X chromosome and autosomes in RC vs. RR simulations decayed with increasing transgressive segregation. However, even in the simulations where only one-half of the true QTL had effects in one direction, the largest predicted QTL were typically near the autosomal centromeres in RC simulations, significantly more often than in RR simulations (Table 2; Fisher's exact test, P = 0.0002).
|
All genes are QTL:
As a final approach, we assigned each of the
14,000 mRNA coding sequences from the genome of D. melanogaster to contribute equally to the simulated phenotype of interest. The result is presented in Fig 3. Composite interval mapping predicted two distinct predicted QTL peaks on the third chromosome, each associated with
10% of the phenotypic variance; two smaller peaks on the second chromosome; and one region on the X chromosome significantly associated with the phenotypic variance. Single marker linear regressions detected strong associations between markers and phenotype across both of the autosomes, but again detected only two regions of the X chromosome as being significantly associated with the phenotypic variance.
|
| DISCUSSION |
|---|
QTL mapping studies necessarily provide minimum numbers of genes that contribute to differences between strains, and all of our simulations corroborate that fact. More significantly, two general patterns emerged from our simulation studies of the effect of recombination rate variation on QTL mapping studies in D. melanogaster: biases in inferred effect sizes of QTL and biases on which chromosomes QTL are likely to be detected. First, regions of low recombination (in this study, primarily centromeric regions) are likely to harbor the strongest apparent QTL. Given that all true QTL effects were equal in our simulations, the reason for this tendency is that multiple independent true QTL were often clustered in these regions, whereas in regions of high recombination, single true QTL were more isolated from others. This tendency does not result from the properties of QTL mapping algorithms but is instead an artifact of variation in gene density per centimorgan itself. Second, we found a tendency for regions of the X chromosome to harbor weaker apparent QTL (or none at all) than autosomal regions. This tendency results in part at least from the lower overall number of genes per centimorgan across the X chromosome, and it was amplified by the particularly high density of genes per centimorgan in the centromeric regions of the two autosomes.
Our observation that regions of low recombination should often have strong predicted QTL is intuitive but should not be trivialized. The assumption of homogeneity in gene density is explicit in virtually all simulation studies of QTL mapping, explained simply as "true QTL were randomly assigned to genomic locations," and referring to assignments identical to our RR simulations. The assumption is also implicit in empirical QTL mapping studies, as the observation of a single QTL associated with much of the genetic variance is often interpreted as a single or small number of genes associated with a disproportionate effect, rather than as the location of a region of low recombination. Our simulations under a perhaps unrealistic model, that of 50 small-but-equal-effect true QTL, often predicted single QTL of large effect in centromeric regions. Without explicit knowledge of gene density per centimorgan, no claims can be made as to whether characters are "polygenic" or "oligogenic" on the basis of QTL mapping results. If a genome has been sequenced and regional recombination rates have been estimated, then perhaps one can design a mapping protocol that would "correct" for variation in gene density per centimorgan and yield more accurate estimates of QTL numbers and effect sizes.
Many investigators interpret the "infinitesimal" model of ![]()
![]()
Recent empirical results comparing mapping studies that used recombinational linkage to molecular markers vs. physical mapping methodologies (e.g., deficiency mapping) are consistent with the predictions of our study. For example, ![]()
![]()
![]()
![]()
![]()
![]()
Our second observation, that the X chromosome of D. melanogaster will typically have smaller effects associated with it than the autosomes because of variation in gene density per centimorgan, has not previously been suggested. However, this finding corresponds with the "small X-effect" suggested by several investigators in smaller-scale genetic studies. The X chromosome was not significantly associated with female sexual isolation in studies of the species of this group, although strong autosomal associations were frequently identified (![]()
![]()
![]()
![]()
![]()
The biases presented here may represent something of a worst-case scenario: D. melanogaster has a very small number of chromosomes. Increasing the number of chromosomes necessarily increases the overall amount of recombination in the genome through independent assortment. Hence, if the number of chromosomes increases without a corresponding increase in the number of genes [as, for example, noted in the similar number of transcripts between D. melanogaster and Homo sapiens (![]()
Finally, the biases that we observed were most strikingly different between our RC and RR simulations in cases where most QTL had effects in the same direction. This tendency would be particularly common in genetic studies of adaptive traits (![]()
![]()
![]()
QTL mapping can lead to identification of individual genes contributing to a trait (e.g., ![]()
![]()
![]()
| ACKNOWLEDGMENTS |
|---|
This research was supported by National Institutes of Health grant GM-58060 to M.A.F.N. (subcontracted through J. Hey at Rutgers University), National Science Foundation (NSF) grant DEB9980797 to M.A.F.N., NSF grant IBN9728047 to J.C.L., and a Howard Hughes Medical Institute summer undergraduate research fellowship to A.L.C.
Manuscript received January 15, 2001; Accepted for publication July 5, 2001.
| LITERATURE CITED |
|---|
ADAMS, M. D., S. E. CELNICKER, R. A. HOLT, C. A. EVANS, and J. D. GOCAYNE et al., 2000 The genome sequence of Drosophila melanogaster. Science 287:2185-2195
BASTEN, C. J., B. S. WEIR and Z-B. ZENG, 1999 QTL Cartographer: A Reference Manual and Tutorial for QTL Mapping. North Carolina State University, Raleigh, NC (http://statgen.ncsu.edu).
BEGUN, D. J. and C. F. AQUADRO, 1992 Levels of naturally occurring DNA polymorphism correlate with recombination rates in D. melanogaster. Nature 356:519-520[Medline].
BRADSHAW, H. D., K. G. OTTO, B. E. FREWEN, J. K. MCKAY, and D. W. SCHEMSKE, 1998 Quantitative trait loci affecting differences in floral morphology between two species of monkeyflower (Mimulus). Genetics 149:367-382
COPENHAVER, G. P., W. E. BROWNE, and D. PREUSS, 1998 Assaying genome-wide recombination and centromere functions with Arabidopsis tetrads. Proc. Natl. Acad. Sci. USA 95:247-252
COYNE, J. A., 1989 Genetics of sexual isolation between two sibling species, Drosophila simulans and Drosophila mauritiana. Proc. Natl. Acad. Sci. USA 86:5464-5468
COYNE, J. A., 1992 Genetics of sexual isolation in females of the Drosophila simulans species complex. Genet. Res. Camb. 60:25-31[Medline].
DOEBLEY, J., A. STEC, and C. GUSTUS, 1995 teosinte branched1 and the origin of maize: evidence for epistasis and the evolution of dominance. Genetics 141:333-346[Abstract].
FISHER, R. A., 1958 The Genetical Theory of Natural Selection. Dover, New York.
FRARY, A., T. C. NESBITT, S. GRANDILLO, E. KNAAP, and B. CONG et al., 2000 fw2.2: a quantitative trait locus key to the evolution of tomato fruit size. Science 289:85-88
HAMBLIN, M. T. and C. F. AQUADRO, 1999 DNA sequence variation and the recombinational landscape in Drosophila pseudoobscura: a study of the second chromosome. Genetics 153:859-869
HOLLOCHER, H., C. T. TING, M. L. WU, and C.-I. WU, 1997 Incipient speciation by sexual isolation in Drosophila melanogaster: extensive genetic divergence without reinforcement. Genetics 147:1191-1201[Abstract].
JONES, C., 1998 The genetic basis of Drosophila sechellia's resistance to a host plant toxin. Genetics 149:1899-1908
KINDAHL, E. C., 1994 Recombination and DNA polymorphism on the third chromosome of Drosophila melanogaster, Ph.D. Thesis, Cornell University, Ithaca, NY.
LANDER, E. S., L. M. LINTON, B. BIRREN, C. NUSBAUM, and M. C. ZODY et al., 2001 Initial sequencing and analysis of the human genome. Nature 409:860-921[Medline].
LARKIN, J. C. and J. L. WOOLFORD, 1983 Molecular cloning and analysis of the CRY1 gene: a yeast ribosomal gene. Nucleic Acids Res. 11:403-420
LONG, A. D., R. F. LYMAN, C. H. LANGLEY, and T. F. C. MACKAY, 1998 Two sites in the Delta gene region contribute to naturally occurring variation in bristle number in Drosophila melanogaster. Genetics 149:999-1017
MACDONALD, S. J. and D. B. GOLDSTEIN, 1999 A quantitative genetic analysis of male sexual traits distinguishing the sibling species Drosophila simulans and D. sechellia. Genetics 153:1683-1699
NACHMAN, M. W. and G. A. CHURCHILL, 1996 Heterogeneity in rates of recombination across the mouse genome. Genetics 142:537-548[Abstract].
NACHMAN, M. W., V. L. BAUER, S. L. CROWELL, and C. F. AQUADRO, 1998 DNA variability and recombination rates at X-linked loci in humans. Genetics 150:1133-1141
NOOR, M. A. F., K. L. GRAMS, L. A. BERTUCCI, Y. ALMENDAREZ, and J. REILAND et al., 2001 The genetics of reproductive isolation and the potential for gene exchange between Drosophila pseudoobscura and D. persimilis via backcross hybrid males. Evolution 55:512-521[Medline].
NUZHDIN, S. V., E. G. PASYUKOVA, C. L. DILDA, Z-B. ZENG, and T. F. C. MACKAY, 1997 Sex-specific quantitative trait loci affecting longevity. Proc. Natl. Acad. Sci. USA 94:9734-9739
ORR, H. A., 1998a The population genetics of adaptation: the distribution of factors fixed during adaptive evolution. Evolution 52:935-949.
ORR, H. A., 1998b Testing natural selection vs. genetic drift in phenotypic evolution using quantitative trait locus data. Genetics 149:2099-2104
ORR, H. A., 1999 The evolutionary genetics of adaptation: a simulation study. Genet. Res. Camb. 74:207-214[Medline].
OTTO, S. P. and C. D. JONES, 2000 Detecting the undetected: estimating the total number of loci underlying a trait in QTL analyses. Genetics 156:2093-2107
PASYUKOVA, E. G., C. VIEIRA, and T. F. C. MACKAY, 2000 Deficiency mapping of quantitative trait loci affecting longevity in Drosophila melanogaster. Genetics 156:1129-1146
STEPHAN, W. and C. H. LANGLEY, 1998 DNA polymorphism in Lycopersicon and crossing-over per physical length. Genetics 150:1585-1603
TANKSLEY, S. D., M. W. GANAL, J. P. PRINCE, M. C. DEVICENTE, and M. W. BONIERBALE et al., 1992 High density molecular linkage maps of the tomato and potato genomes. Genetics 132:1141-1160[Abstract].
TRUE, J. R., J. LIU, L. F. STAM, Z-B. ZENG, and C. C. LAURIE, 1997 Quantitative genetic analysis of divergence in male secondary sexual traits between Drosophila simulans and Drosophila mauritiana. Evolution 51:816-832.
WILLIAMS, M. A., A. G. BLOUIN, and M. A. F. NOOR, 2001 Courtship songs of Drosophila pseudoobscura and D. persimilis. II. Genetics of species differences. Heredity 86:68-77[Medline].
ZENG, Z-B., 1994 Precision mapping of quantitative trait loci. Genetics 136:1457-1468[Abstract].
This article has been cited by other articles:
![]() |
K. Bullaughey, M. Przeworski, and G. Coop No effect of recombination on the efficacy of natural selection in primates Genome Res., April 1, 2008; 18(4): 544 - 554. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Lee Selection Bias in Quantitative Trait Loci Mapping J. Hered., July 1, 2005; 96(4): 363 - 367. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. G. Mezey, D. Houle, and S. V. Nuzhdin Naturally Segregating Quantitative Trait Loci Affecting Wing Shape of Drosophila melanogaster Genetics, April 1, 2005; 169(4): 2101 - 2113. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. J. Betancourt, Y. Kim, and H. A. Orr A Pseudohitchhiking Model of X vs. Autosomal Diversity Genetics, December 1, 2004; 168(4): 2261 - 2269. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Slotman, A. della Torre, and J. R. Powell The Genetics of Inviability and Male Sterility in Hybrids Between Anopheles gambiae and An. arabiensis Genetics, May 1, 2004; 167(1): 275 - 287. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. I. Jensen-Seaman, T. S. Furey, B. A. Payseur, Y. Lu, K. M. Roskin, C.-F. Chen, M. A. Thomas, D. Haussler, and H. J. Jacob Comparative Recombination Rates in the Rat, Mouse, and Human Genomes Genome Res., April 1, 2004; 14(4): 528 - 538. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. K. Griswold and M. C. Whitlock The Genetics of Adaptation: The Roles of Pleiotropy, Stabilizing Selection and Drift in Shaping the Distribution of Bidirectional Fixed Mutational Effects Genetics, December 1, 2003; 165(4): 2181 - 2192. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. L. Montooth, J. H. Marden, and A. G. Clark Mapping Determinants of Variation in Energy Metabolism, Respiration and Flight in Drosophila Genetics, October 1, 2003; 165(2): 623 - 635. [Abstract] [Full Text] [PDF] |
||||
- THIS ARTICLE
-
Abstract
- Full Text (PDF)
- Alert me when this article is cited
- Alert me if a correction is posted
- SERVICES
- Similar articles in this journal
- Similar articles in PubMed
- Alert me to new issues of the journal
- Download to citation manager
- Reprints & Permissions
- CITING ARTICLES
- Citing Articles via HighWire
- Citing Articles via Google Scholar
- GOOGLE SCHOLAR
- Articles by Noor, M. A. F.
- Articles by Larkin, J. C.
- Search for Related Content
- PUBMED
- PubMed Citation
- Articles by Noor, M. A. F.
- Articles by Larkin, J. C.









