DNA fingerprinting data and the analysis of population genetic structure by comparing band-sharing patterns

• Published in: Molecular ecology Vol. 8; no. 11; pp. 1851 - 1866
• Main Authors: Bertorelle, G., Bucchini, L., Pilastro, A., Matessi, C.
• Format: Journal Article
• Language: English
• Published: Oxford, UK Blackwell Science Ltd 01.11.1999
• Subjects: band-sharing coefficients; Data Interpretation, Statistical; DNA Fingerprinting; genetic distance; Genetics, Population; Models, Genetic; Monte Carlo Method; Monte-Carlo simulation; parametric tests; permutation tests; population subdivision; statistical power; Statistics as Topic
• ISSN: 0962-1083; 1365-294X
• DOI: 10.1046/j.1365-294x.1999.00775.x

Genetic isolation among populations can be effectively investigated by multilocus DNA fingerprinting. If populations have diverged, it is expected that the mean proportion of bands shared by individuals from the same population, Bw, exceeds the corresponding mean, Bb, calculated from pairs of individuals from distinct populations. A problem arises in deciding whether any difference between Bw and Bb is statistically significant. In fact, any two band‐sharing data (bij), contributing to Bw or Bb, are not independent if they share a common individual (like bij and bjl). This prevents a correct application of parametric tests, such as the Student’s t‐test. Recently, a modification of this test has been proposed that should avoid the independence problem. Using a large number of samples of fingerprints, simulated from an appropriate ‘genetic’ model, under a wide range of conditions, we compared the performances of the Student’s t‐test, the modified t‐test and five new permutation tests, where individuals, rather than bij values, are permuted. We found that: (i) the Student’s t‐test can be very permissive, rejecting too often the null hypothesis when true, but is correct or conservative in certain cases; (ii) the modified t‐test is extremely conservative when the null hypothesis is true and very inefficient otherwise; (iii) all five permutation tests are strictly correct, provided that individuals are ordered randomly on gels; and (iv) in this case, the permutation tests are equally efficient, and are not inferior to the Student’s t‐test when the latter is approximately correct and provides a fair benchmark.