The more equations a paper has, the less it will be cited by other biologists. This should come as a surprise to few people, but if it does, Fig.1 from Fawcett and Higginson (2012) makes this pretty clear. Papers with many equations per page are cited less often by non-theoretical papers (A). In fact, citations by non-theoretical papers decrease by 35% for each additional equation per page. This is not true of theoretical papers, which happily cite other equation-filled theoretical works (B). It’s an interesting conundrum: theory unifies empirical observations and generates predictions, but theory uses equations. And papers with equations have less impact.
The authors make suggestions for both sides of this divide.
All biologists should have adequate mathematical training so that equations are
not necessarily considered daunting or confusing. Theoreticians should strive
to communicate their works in accessible ways (something Steve Ellner covered
nicely in the aptly named “How to write a theoretical ecology paper that people will cite”).
The authors also suggest increased placement of equations in appendices, where
they do not decrease citation rates. (However, if equations don’t decrease
citation rates when in the appendix, you wonder if this is because equations
are easier to ignore there). The surprising thing about this bias
is that I don’t think it exists as much in the other direction. Theoretical papers
generally do cite empirical works. Reviewers frequently require that model assumptions
be justified based on empirical knowledge. A balance between theory and empiricism seems important for ecology, and while this paper doesn't tell us anything surprising, it makes it quite clear that there is a problem.
From Fawcett and Higginson 2012. |
4 comments:
Blogged this over on Dynamic Ecology. My views are basically the same as yours, I think.
http://dynamicecology.wordpress.com/2012/07/18/on-equations-citations-and-mathematical-understanding/
As to whether the bias exists in the reverse direction, you'd have to collect the data to find out.
Future hope : No statistics, but understanding - and deeds, which are left to be done at all
http://www.youtube.com/watch?v=BgfWUTD1g3s
* * * * *
What a neat study! But I wonder why they used that ordinal version of the number of equations per page? I haven't actually downloaded the full paper so I might be jumping to conclusions here, but it would be easy enough to show all the information in the data in a scatterplot by plotting the actual number of equations per page on the x-axis. That way we could see the full bivariate distribution and reveal things like thresholds. Also, maybe we want to maximize the number of equations per page (because we feel that it improves our communication with theorists), while still maintaining a fairly high citation rate among non-theorists. The full bivariate distribution would allow for that kind of 'paper engineering'.
That's great Steve - a very creative approach to solving the problem. I leave it to you to do the reanalysis though...
Post a Comment