Monday, October 17, 2016

Reviewing peer review: gender, location and other sources of bias

For academic scientists, publications are the primary currency for success, and so peer review is a central part of scientific life. When discussing peer review, it’s always worth remembering that since it depends on ‘peers’, broader issues across ecology are often reflected in issues with peer review. A series of papers from Charles W. Fox--and coauthors Burns, Muncy, and Meyer--do a great job of illustrating this point, showing how diversity issues in ecology are writ small in the peer review process.

The journal Functional Ecology provided the authors up to 10 years of data on the submission, editorial, and review process (between 2004 and 2014, maximum). This data provides a unique opportunity to explore how factors such as gender and geographic local affects the peer review process and outcomes, and also how this has changed over the past decade.

Author and reviewer gender were assigned using an online database (genderize.io) that includes 200,000 names and an associated probability reflecting the genders for each name. Geographic location of editors and reviewers were also identified based on their profiles. There are some clear limitations to this approach, particularly that Asian names had to be excluded. Still, 97% of names were present in the genderize.io database, and 94% of those names were associated with a single gender >90% of the time.

Many—even most—of Fox et al.’s findings are in line with what has already been shown regarding the causes and effects of gender gaps in academia. But they are interesting, nonetheless. Some of the gender gaps seem to be tied to age: senior editors were all male, and although females make up 43% of first authors on papers submitted to Functional Ecology, they are only 25% of senior authors.

Implicit biases in identifying reviewers are also fairly common: far fewer women were suggested then men, even when female authors or female editors were identifying reviewers. Female editors did invite more female reviewers than male editors. ("Male editors selected less than 25 percent female reviewers even in the year they selected the most women, but female editors consistently selected ~30–35 percent female").  Female authors also suggested slightly more female reviewers than male authors did.

Some of the statistics are great news: there was no effect of author gender or editor gender on how papers were handled and their chances of acceptance, for example. Further, the mean score given to a paper by male and female reviewers did not differ – reviewer gender isn’t affecting your paper’s chance of acceptance. And when the last or senior author on a paper is female, a greater proportion of all the authors on the paper are female too.

The most surprising statistic, to me, was that there was a small (2%) but consistent effect of handling editor gender on the likelihood that male reviewers would respond to review requests. They were less likely to respond and less likely to agree to review, if the editor making the request is female.

That there are still observable effects of gender in peer review despite an increasing awareness of the issue should tell us that the effects of other forms of less-discussed bias are probably similar or greater. Fox et al. hint at this when they show how important the effect of geographic locale is on reviewer choice. Overwhelmingly editors over-selected reviewers from their own geographic locality. This is not surprising, since social and professional networks are geographically driven, but it can have the effect of making science more insular. Other sources of bias – race, country of origin, language – are more difficult to measure from this data, but hopefully the results from these papers are reminders that such biases can have measurable effects.

From Fox et al. 2016a. 

Thursday, October 6, 2016

When individual differences matter - intraspecific variation in 2016

Maybe it is just confirmation bias, but there seems to have been an upswing in the number of cool papers on the role of intraspecific variation in ecology. For example, three new papers highlight the importance of variation among individuals for topics ranging from conservation, coexistence, and community responses to changing environments. All are worth a deeper read.

An Anthropocene map of genetic diversity’ asks how intraspecific variation is distributed globally, a simple but important question. Genetic diversity in a species is an important predictor of their ability to adapt to changing environments. For many species, however, as their populations decline in size, become fragmented, or experience strong selection related to human activities, genetic diversity may be in decline. Quantifying a baseline for global genetic diversity is an important goal. Further, with the rise of ‘big data’ (as people love to brand it) it is now an accessible one: there are now millions of genetic sequences in GenBank and associated GPS coordinates. 
Many of the global patterns in genetic diversity agree with those seen for other forms of diversity: for example, some of the highest levels are observed in the tropical Andes and Amazonia, and there is a peak in the mid-latitudes and human presence seems to decrease genetic diversity.

From Miraldo et al. (2016): Map of uncertainty. Areas in green represent high sequence availability and taxonomic coverage (of all species known to be present in a cell). All other colors represent areas lacking important data.
The resulting data set represents ~ 5000 species, so naturally the rarest species and the least charismatic are underrepresented. The authors identify this global distribution of ignorance, highlighting just how small our big data still is.

Miraldo, Andreia, et al. "An Anthropocene map of genetic diversity." Science353.6307 (2016): 1532-1535.


In ‘How variation between individuals affects species coexistence’, Simon Hart et al. do the much needed work to answer the question of how intraspecific variation fits into coexistence theory. Their results reinforce the suggestion that in general, intraspecific variation should making coexistence more difficult, since it increases the dominance of superior competitors, and reduces species' niche differentiation. (Note this is a contrast to the argument Jim Clark has made with individual trees, eg. Clark 2010)

Hart, Simon P., Sebastian J. Schreiber, and Jonathan M. Levine. "How variation between individuals affects species coexistence." Ecology letters (2016).


The topic of evolutionary rescue is an interesting, highlighting (see work from Andy Gonzalez and Graham Bell for more details) the ability of populations to adapt to stressors and changing environments, provided enough underlying additive genetic variation and time is available. It has been suggested that phenotypic plasticity can reduce the chance of evolutionary rescue, since it reduces selection on genetic traits. Alternatively, by increasing survival time following environmental change, it may aid evolutionary rescue. Ashander et al. use a theoretical approach to explore how plasticity interacts with a change in environmental conditions (mean and predictability/autocorrelation) to affect extinction risk (and so the chance of evolutionary rescue). Their results provide insight into how the predictability of new environments, through an affect on stochasticity, in turn changes extinction risk and rescue.