What do we mean when we talk about the niche?

The niche concept is a good example of an idea in ecology that is continually changing. It is probably the most important idea in ecology that no one has yet nailed down. As most histories of the niche mention, the niche has developed from its first mention by Grinnell (in 1917) to Hutchinson’s multi-dimensional niche space, to mechanistic descriptions of resource usage and R*s (from MacArthur’s warblers to Tilman’s algae). Its most recent incarnation can be found in what has been called modern coexistence theory, as first proposed by Peter Chesson in his seminal 2000 paper.

Chesson’s mathematical framework has come to dominate a lot of discussion amongst community ecologists, with good reason. It provides a clear way to understand stable coexistence amongst local populations in terms of their ability to recover from low densities, and further by noting that those low density growth rates are the outcome of two types of processes: those driven by fitness differences and those driven by stabilizing effects that reduce interspecific competition relative to intraspecific competition. Many of the different specific mechanisms of coexistence can be classified in terms of this framework of equalizing and stabilizing effects. “Niche” differences between species in this framework can be defined as those differences that increase negative intraspecific density dependence compared to interspecific effects. If, as a simplistic example, two plant species have different rooting depths and so access different depths of the water table, then this increases competition for water between similar root-depth conspecifics relative to interspecific competition. Thus, this is a niche difference. Extensions on modern niche theory have offered insights into everything from invasion success, restoration, and eco-phylogenetic analyses.

But it seems as though the rise of 'modern coexistence theory' is changing the language that ecologists use to discuss the niche concept. When Thomas Kuhn talks about paradigm shifts, he notes that it is not only theory that changes but also the worldview organized around a given idea. At least amongst community ecologists, it seems as though this had focused the discussion of the niche to an increasingly local scale, particularly in terms of stabilizing and equalizing terms measured as fixed quantities made under homogenous, local conditions. A recognition of the role of spatial and temporal conditions in altering these variables seems less common, compared to the direction of earlier, Hutchinsonian-type discussions of the niche.

Note that this was not Chesson's original definition, since he is explicit that: “The theoretical literature supports the concept that stable coexistence necessarily requires important ecological differences between species that we may think of as distinguishing their niches and that often involve tradeoffs, as discussed above. For the purpose of this review, niche space is conceived as having four axes: resources, predators (and other natural enemies), time, and space.”

On a recent manuscript, an editor commented that the term 'niche processes' shouldn't be used to refer to environmental filtering since (paraphrased) “when ecologists refer to niche processes, they are usually thinking of processes that constrain species’ abundances locally, confer an advantage on rare species...” But is it fair to say that this is the only thing we mean (or should mean) when we discuss niches? I’ve had discussions with other people who’ve had this kind of response – e.g., reviewers asking for simulations to be reframed from niches defined in terms of environmental tolerances to things that fit more clearly into equalizing and stabilizing terms. That is a good description of a stabilizing process, which is termed a 'niche difference' in the modern coexistence literature. But there is still a lot of grey space we have yet to address in terms of how to integrate (e.g.) the effects of the environment (including over larger scales) into local 'niche processes' or stabilizing effects. It's a subtle argument - that we can use the framework established by Chesson, but we should try to do so without dismissing too-quickly the concepts that don't fit easily within it. In addition, elsewhere the niche is still conceptualized in varying ways from comparative evolutionary biologists who talk about niche conservatism and mean the maintenance of ancestral trait values or environmental tolerances; to functional ecologists who may refer to multidimensional differences in trait space; to species distribution modellers who thinks of large-scale environmental correlates or physiological determinants of species’ distributions. 

The niche is probably the most fundamental, yet vaguely–defined and poorly understood idea in ecology. So, formalizing the definition and constraining it is a necessary idea. And modern coexistence theory has provided great deal of insight into local coexistence and thus has allowed for a better understanding of the niche concept. But there is also a need to be careful in how quickly and how much we restrict our discussion of the niche. It's possible to gain both the strengths of modern coexistence theory as well as appreciate its current limitations. Modern coexistence theory isn’t yet complete or sufficient. It’s currently easier to estimate stabilizing and equalizing terms from experimental data in which conditions are controlled and homogenous, and this can inadvertently focus future research and discussion on those types of conditions. Models which consider larger scale processes and the impacts of changing abiotic conditions through space in time exist, but across different literatures, and these need continued synthesis. There is still a need to understand how to most realistically incorporating and understand the complex interactions between multiple species (e.g. Levine et al. 2017). The application of modern coexistence theory to observational data in particular is still limited, and such data is essential when species are slow lived or experimentally unwieldy. Further, when quantities of interest (particularly traits or phylogenetic differences) contribute to both equalizing and stabilizing effects, its still not clear how to partition their contributions meaningfully.

-->