Repeat After Me

Listening to NPR’s On the Media this weekend, I was struck by a story (first broadcast in 2006) about how certain “sticky” numbers—however dubious—find their way into the media landscape and beyond, as On the Media co-host Brooke Gladstone noted:

“Four years ago, we delved into the mysterious number, said to be 50,000, of child predators online at any given time. It was cited by the NBC Dateline program “To Catch a Predator” and also by then Attorney General Alberto Gonzales.

But spokespersons for the FBI, the National Center for Missing and Exploited Children, and the Crimes against Children Research Center said it was not based on any research they were aware of. The A.G.’s office at the time, well, they said it came from Dateline.”

Wall Street Journal columnist Carl Bialik, who spoke to Gladstone for the story, described the process whereby such slippery figures gain traction:

“An interesting phenomenon of these numbers is that they’ll often be cited to an agency or some government body, and then a study will pick it up, and then the press will repeat it from that study. And then once it appears in the press, public officials will repeat it again, and now it’s become an official number.”

All of which sounds very familiar—Bialik could easily be describing the “official numbers” put out by so many TNR opponents. Among those that have gained the most currency are the predation estimates from the Wisconsin Study, the American Bird Conservancy’s figure for the proportion of birds in the diets of free-roaming cats, and Dauphiné and Cooper’s estimate of free-roaming cats in the U.S.

The Wisconsin Study
Despite its having been discredited long ago (see, for example, “Addressing the Wisconsin Study”), the Wisconsin Study continues to be cited as if its estimate of 8–219 million birds killed by the state’s rural cats [1] was credible. As recently as last year, Longcore et al. cited the work in their essay “Critical Assessment of Claims Regarding Management of Feral Cats by Trap–Neuter–Return.” [2]

This, despite the fact that—15 years earlier—co-author Stanley Temple told the press:

“The media has had a field day with this since we started. Those figures were from our proposal. They aren’t actual data; that was just our projection to show how bad it might be.” [3]

It’s true: the media has had a field day. Among the major newspapers to cite the Wisconsin Study are the Wall Street Journal [4], the New York Times [5], and the Los Angeles Times [6]. However, as I’ve described previously, it’s been the wildlife conservationists and bird advocates who’ve really had a field day with the Wisconsin Study:

  • The American Bird Conservancy (ABC) refers to the study, in its brochure Domestic Cat Predation on Birds and Other Wildlife. And the ABC goes one step further, pointing out that Coleman and Temple’s estimate was for rural cats, and that “suburban and urban cats add to that toll.” [7]
  • A 2009 article in Audubon Magazine suggests “cats were annually knocking off somewhere in the neighborhood of 8 million birds just in rural Wisconsin.” [9] To the magazine’s credit, they used Coleman and Temple’s low estimate—but none of the numbers from the Wisconsin Study are scientifically sound.

Birds Represent 20–30% of the Diet of Free-roaming Cats
According to an ABC report (downloadable from their website), “extensive studies of the feeding habits of domestic, free-roaming cats… show that approximately… 20 to 30 percent [of their diet] are birds.”

This, apparently, is the same report that Ellen Perry Berkeley debunked in her book, TNR Past Present and Future: A history of the trap-neuter-return movement, noting that the ABC’s 20–30% figure was not based on “extensive studies” at all. [10] In fact, just three sources were used: the now-classic “English Village” study by Churcher and Lawton [11], the Wisconsin Study (described above), and Mike Fitzgerald’s contribution to “The Domestic Cat: The Biology of Its Behaviour.” [12]

This gets a little complicated, so bear with me.

When Churcher and Lawton reported, “overall, birds comprised 35% of the total catch,” [11] they were referring to prey tallies recorded by study participants—not to the overall diets of the cats involved. Figures obtained through similar methods for the Wisconsin Study were 20–23%, [1, 13, 14] which the authors suggest—citing Fitzgerald’s comprehensive review of predation and dietary studies—are in line with other work:

“Extensive studies of the feeding habits of free-ranging domestic cats over 50 years and four continents [12] indicate that small mammals make up approximately 70% of these cats’ prey while birds make up about 20%.” [14]

But they’re comparing apples and oranges. Both the English Village and Wisconsin Studies report the percentage of birds returned as a portion of the “total catch,” whereas Fitzgerald reports percentage by frequency (i.e., the occurrence of birds in the stomach contents or scats of free-roaming cats), a point apparently lost on Coleman and Craven. The 21% figure [12] they refer to, then, is simply not comparable to their own (or that of the English Village study, a fact Churcher and Lawton acknowledge in their paper). As Berkeley notes, “this would put birds, as a portion of the diet of cats, at roughly 7 to 10.5 percent—nowhere near the ‘20 to 30 percent’ figures unleashed on the unscientific public by ABC!”

To put all of this into more familiar terms, it’s a bit like saying that coffee makes up 20–30% of the American diet versus saying that 20–30% of Americans drink coffee each day.

Nevertheless, 13 years after the ABC first published its report, the myth persists. The report—including the mistaken dietary figures—is still available. And the National Audubon Society has helped perpetuate the error, noting in its Resolution Regarding Control and Management of Feral and Free-Ranging Domestic Cats:

“…it has been estimated that birds represent 20–30% of the prey of feral and free-ranging domestic cats.”

Estimates of Free-roaming Cats
In January, Steve Holmer, the ABC’s Senior Policy Advisor, told the Los Angeles Times, “The latest estimates are that there are about . . . 160 million feral cats [nationwide].” Sounds like an awful lot of cats—nearly one for every two humans in the country. So where does this figure come from?

The source is a paper by Nico Dauphiné and Robert Cooper (which can be downloaded via the ABC website), presented at the Fourth International Partners in Flight conference. In it, Dauphiné and Cooper use some remarkably creative accounting, beginning with an unsubstantiated estimate of unowned cats, to which they add an inflated number of owned cats that spend time outdoors. In the end, they conclude that there are “117–157 million free-ranging cats in the United States.” [15] (For a more thorough explanation, see my previous post on the subject.)

Estimating the number of free-roaming cats wasn’t even the point of their paper. As the title—“Impacts of Free-ranging Domestic Cats (Felis catus) On Birds In the United States: A Review of Recent Research with Conservation and Management Recommendations”—suggests, the primary purpose was to describe the cats’ impact on birds. The authors’ exaggerated figure was merely a convenient route to their estimate of birds killed annually by cats: “a minimum of one billion birds” [15] (which, it should be clear, has the potential to become a very sticky number).

Holmer goes a step further, using only the upper limit of the range published by Dauphiné and Cooper, and making the subtle—but important—shift from free-ranging to feral cats.

When I asked him about this, he explained that those figures were “based on an earlier version of Nico’s latest paper and are now being updated in our materials.” I don’t know that any such changes were made; and in any event, the bogus estimate has already been published in the L.A. Times—as if it were true.

*     *     *

TNR opponents will often point to the vast collection of research studies, government reports, news accounts, and the like, that support their assertions. Drill down a bit into that collection, though, and they all start to look alike: the same familiar sources, the same flawed studies—and the same bogus figures. These figures have become the kind of “official numbers” Bialik refers to: quantitative poseurs owing their popularity to tireless—and irresponsible—repetition more than anything else.

Literature Cited
1. Coleman, J.S. and Temple, S.A., On the Prowl, in Wisconsin Natural Resources. 1996, Wisconsin Department of Natural Resources: Madison, WI. p. 4–8. http://dnr.wi.gov/wnrmag/html/stories/1996/dec96/cats.htm

2. Longcore, T., Rich, C., and Sullivan, L.M., “Critical Assessment of Claims Regarding Management of Feral Cats by Trap–Neuter–Return.” Conservation Biology. 2009. 23(4): p. 887–894.

3. Elliott, J., The Accused, in The Sonoma County Independent. 1994. p. 1, 10.

4. Sterba, J.P., Tooth and Claw: Kill Kitty?, in Wall Street Journal. 2002: New York. p. A.1

5. Barcott, B., Kill the Cat That Kills the Bird?, in New York Times. 2007: New York. http://www.nytimes.com/2007/12/02/magazine/02cats-v–birds-t.html

6. Kennedy, J.M., Killer Among Us, in Los Angeles Times. 2003: Los Angeles. http://articles.latimes.com/2003/dec/23/news/os-cat23

7. ABC, Domestic Cat Predation on Birds and Other Wildlife. n.d., American Bird Conservancy: The Plains, VA. www.abcbirds.org/abcprograms/policy/cats/materials/predation.pdf

8. FWS, Migratory Bird Mortality. 2002, U.S. Fish and Wildlife Service: Arlington, VA. www.fws.gov/birds/mortality-fact-sheet.pdf

9. Williams, T., Felines Fatale, in Audubon Magazine. 2009, National Audubon Society: New York, NY. http://www.audubonmagazine.org/incite/incite0909.html

10. Berkeley, E.P., TNR Past present and future: A history of the trap-neuter-return movement. 2004, Bethesda, MD: Alley Cat Allies.

11. Churcher, P.B. and Lawton, J.H., “Predation by domestic cats in an English village.” Journal of Zoology. 1987. 212(3): p. 439-455.

12. Fitzgerald, B.M., Diet of domestic cats and their impact on prey populations, in The Domestic cat: The biology of its behaviour, D.C. Turner and P.P.G. Bateson, Editors. 1988, Cambridge University Press: Cambridge; New York. p. 123–147.

13. Coleman, J.S. and Temple, S.A., Effects of Free-Ranging Cats on Wildlife: A Progress Report, in Fourth Eastern Wildlife Damaage Control Conference. 1989: University of Nebraska—Lincoln. p. 8–12. http://digitalcommons.unl.edu/ewdcc4/7

14. Coleman, J.S., Temple, S.A., and Craven, S.R., Cats and Wildlife: A Conservation Dilemma. 1997, University of Wisconsin, Wildlife Extension. http://forestandwildlifeecology.wisc.edu/wl_extension/catfly3.htm

15. Dauphiné, N. and Cooper, R.J., Impacts of Free-ranging Domestic Cats (Felis catus) on birds in the United States: A review of recent research with conservation and management recommendations, in Fourth International Partners in Flight Conference: Tundra to Tropics. 2009. p. 205–219.

The Work Speaks—Part 3: Predatory Blending?

In April, Conservation Biology published a comment authored by Christopher A. Lepczyk, Nico Dauphiné, David M. Bird, Sheila Conant, Robert J. Cooper, David C. Duffy, Pamela Jo Hatley, Peter P. Marra, Elizabeth Stone, and Stanley A. Temple. In it, the authors “applaud the recent essay by Longcore et al. (2009) in raising the awareness about trap-neuter-return (TNR) to the conservation community,” [1] and puzzle at the lack of TNR opposition among the larger scientific community:

“…it may be that conservation biologists and wildlife ecologists believe the issue of feral cats has already been studied enough and that the work speaks for itself, suggesting that no further research is needed.”

In fact, “the work”—taken as a whole—is neither as rigorous nor as conclusive as Lepczyk et al. suggest. And far too much of it is plagued by exaggeration, misrepresentations, errors, and obvious bias. In a previous post, I presented examples of researchers drawing big conclusions from small sample sizes. Here, I’ll discuss the important distinction between compensatory and additive predation—a point too often left out of the feral cat/TNR discussion.

Sins of Omission
Focusing on the number of prey injured or killed by cats, without also recognizing that there are different types of predation, implies that each and every bird, mammal, reptile, etc. is destined to be part of its species’ breeding population. Of course, that’s not at all how things work out in the natural world—with or without predation by cats.

And yet, numerous studies [2-10], reviews [11], and other published papers [12-14] fail to acknowledge the critical difference between compensatory predation (in which prey would have died even in the absence of a particular predator, due to illness, starvation, other predators, etc.) and additive predation (in which healthy prey are killed). It’s the difference between, as Beckerman et al. put it, the “doomed surplus hypothesis” and the “hapless survivor hypothesis.” [15]

This is a critical point when it comes to connecting predation rates (from cats or any other predator) to population impacts. The more additive the predation, the greater the potential impact on population numbers. Purely compensatory predation, on the other hand, is less likely to affect overall populations. Of course, the connection is seldom so simple and direct, and a number of factors (e.g., habitat area and type, base population numbers, etc.) influence the ultimate outcome—making it quite difficult to tease out specific causal relationships. Nevertheless, if we want to better understand the impact of free-roaming cats on wildlife, we cannot ignore the distinction between—and inherent implications of—these two types of predation.

Honorable Mentions
Although Churcher and Lawton failed to mention the distinction between compensatory and additive predation in their now-classic “English village” study [4], Churcher later suggested that their findings were largely in the compensatory category: “If the cats weren’t there, something else would be killing the sparrows or otherwise preventing them from breeding.” [16]

Woods et al. don’t address the topic directly, but warn against drawing direct connections between predation numbers and potential effects on population dynamics:

“Our estimates of the total numbers of animals brought home by cats throughout Britain should be treated with requisite caution and these figures do not equate to an assessment of the impact of cats on wildlife populations.” [3]

Unfortunately, other researchers have used this study to make exactly that connection. In “Critical Assessment,” for example, Longcore et al. cite Woods et al. (along with Lepczyk et al. 2003, the subject of a future post) when they write, “evidence indicates that cats can play an important role in fluctuations of bird populations.” [11]

Under-Compensating?
In their 2008 study, Baker et al. found that “birds killed by cats in this study had significantly lower fat and pectoral muscle mass scores than those killed by collisions,” [17] suggesting that they may have been among the “doomed surplus” portion of the population. Similar results were reported eight years earlier by Møller and Erritzøe, who found that “small passerine birds falling prey to cats had spleens that were significantly smaller than those of conspecifics that died for other reasons,” concluding ultimately that the birds killed by cats “often have a poor health status.” [18]

But Baker et al. express caution about their findings:

“…the distinction between compensatory and additive mortality does… become increasingly redundant as the number of birds killed in a given area increases: where large numbers of prey are killed, predators would probably be killing a combination of individuals with poor and good long-term survival chances.”

Whatever their concerns, it must be noted that Baker et al. inflated their predation numbers by a factor of 3.3 on the basis of Kays and DeWan’s dubious conclusions [9] (which I discussed in some detail previously). Doing so raises considerable doubts about any level of “redundancy,” as well the authors’ suggestion that cat predation in the area might be “creating a dispersal sink for more productive neighboring areas.” [19] (Such “sinks” can occur when predation outstrips local prey populations, requiring that prey be “recruited” from surrounding areas.)

Implications
Given all the work that’s been done on cat predation, one might expect the subject of compensatory predation to be addressed more fully and more often. By omitting this important issue from the feral cat/TNR discussion, researchers portray a situation both simpler and harsher (in terms of what it implies about the impact of free-roaming cats) than reality suggests. Whether or not such omissions are intentional, I cannot say. I do, however, find it curious—what’s included compared to what’s left out, and by whom.

References
1. Lepczyk, C.A., et al., “What Conservation Biologists Can Do to Counter Trap-Neuter-Return: Response to Longcore et al.” Conservation Biology. 2010. 24(2): p. 627-629.

2. Coleman, J.S. and Temple, S.A., On the Prowl, in Wisconsin Natural Resources. 1996, Wisconsin Department of Natural Resources: Madison, WI. p. 4–8. http://dnr.wi.gov/wnrmag/html/stories/1996/dec96/cats.htm

3. Woods, M., McDonald, R.A., and Harris, S., “Predation of wildlife by domestic cats Felis catus in Great Britain.” Mammal Review. 2003. 33(2): p. 174-188.

4. Churcher, P.B. and Lawton, J.H., “Predation by domestic cats in an English village.” Journal of Zoology. 1987. 212(3): p. 439-455.

5. Coleman, J.S. and Temple, S.A., “Rural Residents’ Free-Ranging Domestic Cats: A Survey.” Wildlife Society Bulletin. 1993. 21(4): p. 381–390.

6. Coleman, J.S. and Temple, S.A., Effects of Free-Ranging Cats on Wildlife: A Progress Report, in Fourth Eastern Wildlife Damaage Control Conference. 1989: University of Nebraska—Lincoln. p. 8–12. http://digitalcommons.unl.edu/ewdcc4/7

7. Hawkins, C.C., Impact of a subsidized exotic predator on native biota: Effect of house cats (Felis catus) on California birds and rodents. 1998. PhD Dissertation, Texas A&M University.

8. Hawkins, C.C., Grant, W.E., and Longnecker, M.T., “Effects of Subsidized House Cats on California Birds and Rodents.” Transactions of the Western Section of the Wildlife Society. 1999. 35: p. 29–33.

9. Kays, R.W. and DeWan, A.A., “Ecological impact of inside/outside house cats around a suburban nature preserve.” Animal Conservation. 2004. 7(3): p. 273-283.

10. Lepczyk, C.A., Mertig, A.G., and Liu, J., “Landowners and cat predation across rural-to-urban landscapes.” Biological Conservation. 2003. 115(2): p. 191-201.

11. Longcore, T., Rich, C., and Sullivan, L.M., “Critical Assessment of Claims Regarding Management of Feral Cats by Trap–Neuter–Return.” Conservation Biology. 2009. 23(4): p. 887–894.

12. Dauphiné, N. and Cooper, R.J., Impacts of Free-ranging Domestic Cats (Felis catus) on birds in the United States: A review of recent research with conservation and management recommendations, in Fourth International Partners in Flight Conference: Tundra to Tropics. 2010. p. 205–219

13. Coleman, J.S., Temple, S.A., and Craven, S.R., Cats and Wildlife: A Conservation Dilemma. 1997, University of Wisconsin, Wildlife Extension. http://forestandwildlifeecology.wisc.edu/wl_extension/catfly3.htm

14. Andersen, M.C., Martin, B.J., and Roemer, G.W., “Use of matrix population models to estimate the efficacy of euthanasia versus trap-neuter-return for management of free-roaming cats.” Journal of the American Veterinary Medical Association. 2004. 225(12): p. 1871-1876.

15. Beckerman, A.P., Boots, M., and Gaston, K.J., “Urban bird declines and the fear of cats.” Animal Conservation. 2007. 10(3): p. 320-325.

16. n.a., What the Cat Dragged In, in Catnip. 1995, Tufts University School of Veterinary Medicine: Boston, MA. p. 4–6

17. Baker, P.J., et al., “Cats about town: is predation by free-ranging pet cats Felis catus likely to affect urban bird populations? Ibis. 2008. 150: p. 86-99.

18. Møller, A.P. and Erritzøe, J., “Predation against birds with low immunocompetence.” Oecologia. 2000. 122(4): p. 500-504.

The Work Speaks—Part 1: Lost in Translation

In April, Conservation Biology published a comment authored by Christopher A. Lepczyk, Nico Dauphiné, David M. Bird, Sheila Conant, Robert J. Cooper, David C. Duffy, Pamela Jo Hatley, Peter P. Marra, Elizabeth Stone, and Stanley A. Temple. In it, the authors “applaud the recent essay by Longcore et al. (2009) in raising the awareness about trap-neuter-return (TNR) to the conservation community,” [1] and puzzle at the lack of TNR opposition among the larger scientific community:

“…it may be that conservation biologists and wildlife ecologists believe the issue of feral cats has already been studied enough and that the work speaks for itself, suggesting that no further research is needed.”

In fact, “the work”—taken as a whole—is neither as rigorous nor as conclusive as Lepczyk et al. suggest. And far too much of it is plagued by exaggerations, misrepresentations, errors, and obvious bias. For the next few posts, I’m going to present a sampling of its more serious flaws, beginning with how some researchers “reinterpret” work of others to suit their own purposes.

Tell It Like It Is
Studies of cat predation frequently cite the work of William G. George, who, in 1974, published a paper documenting his meticulous observations of the hunting behavior of three cats on his southern Illinois farm. “The results,” wrote George, “established a basis for examining the possibility that cat predation may result in depleted winter populations of microtine rodents and other prey of Red-tailed Hawks, Marsh Hawks, and American Kestrels.” [2]

Thirty years later, David A. Jessup interpreted things rather differently, giving George’s work an additional—and unwarranted—degree of certainty. Gone are the doubts that George expressed—first, regarding the impact of cat predation on rodent and other prey populations; second, regarding the relationship between these populations and the raptors that feed on them. For Jessup—who offers no additional evidence—it’s all very straightforward: “Feral cats also indirectly kill native predators by removing their food base.” [3]

More recently, Guttilla and Stapp seem to prefer Jessup’s take: “Human-subsidized cats… can spill over into less densely populated wildland areas where they reduce prey for native predators (George 1974).” [4]

If any additional work has been done on the subject (surely there are more cats in the area these days; how are the voles and raptors faring?), it seems to have gone unnoticed. Instead, Jessup, Guttilla, and Stapp (and others, too, no doubt) have simply rewritten George’s conclusion to suit their own purposes. Perhaps their version makes for a better story, but it’s rather poor science.

Credit Where Little/None Is Due
When the Lancet recently retracted a 1998 paper linking vaccinations to autism in children—“research” that sparked the ongoing backlash against vaccinations—it was headline news. The move prompted this criticism from one member of the British Parliament: “The Lancet article should never have been published, and its peer review system failed. The article should now be expunged from the academic record…”

At the risk of drawing too many parallels between the two papers, I think the same can be said for Coleman and Temple’s infamous “Wisconsin Study.” (On the other hand, it does serve a useful purpose as a red flag.) Actually, as Goldstein et al. point out, Coleman and Temple’s paper was never peer-reviewed (not necessarily a deal-breaker in my book, but such publications do warrant additional scrutiny), but achieved its mythical status by being cited ad nauseam in peer-reviewed journals, as well as the mainstream media.

Does anybody actually believe the numbers suggested by Coleman and Temple? Stanley Temple (one of the co-authors of the recent anti-feral cat/TNR comment in Conservation Biology) himself admitted their published figures “aren’t actual data; that was just our projection to show how bad it might be.” [5]

I don’t think Longcore et al. [6] or the editors at Conservation Biology put much stock in the Wisconsin Study—so why continue to publish “projections” that have been so thoroughly discredited? Because doing so strengthens their case, at least among those who don’t know any better—especially people outside the scientific community, including many journalists, policy makers, judges, and the general public.

In their recent comment, Lepczyk et al. suggest that conservation biologists and wildlife ecologists “look to the evolutionary biology community” [1] for an example of how to influence policy:

“When local policies or regulations are put forth that promote the teaching of creationism or intelligent design, the evolutionary biologists have responded in force from across the nation and world.” [1]

Let’s set aside for the moment all the baggage associated with their analogy. My question is this: Is the evolutionary biology community still publishing bogus “projections” from 13 years ago? I doubt it.

Check Your Premises
In their recent paper (available for download via the American Bird Conservancy (ABC) website), Dauphiné and Cooper arrive at their absurd figure of “117–157 million free-ranging cats in the United States,” [7] in part, by way of Jessup’s “estimated 60 to 100 million feral and abandoned cats in the United States.” [3]

So where does Jessup’s figure come from? We have no idea—there’s no citation. And Jessup is no authority on the subject—having conducted no studies or reviews of studies that quantify the feral cat population. What’s more, his “estimation” is among the highest figures published. Yet this is the shaky foundation upon which Dauphiné and Cooper attempt to build their subsequent argument.

The authors then add to the (dubious) number of feral cats the proportion of pet cats allowed outdoors. They refer to a 2004 paper by Linda Winter, director of ABC’s Cats Indoors! campaign, in which it was reported, “A 1997 nationwide random telephone survey indicated that 66% of cat owners let their cats outdoors some or all of the time.” [8]

That’s an interesting way to put it—Winter makes it sound like two-thirds of pet cats are essentially outdoor cats. But the surveycommissioned by ABC!—actually indicates that “35% keep their cats indoors all of the time” and “31% keep them indoors mostly with some outside access.” [9] The difference in wording is subtle, and hampered by imprecision—it all comes down to the meaning of some.

Winter’s 2004 paper implies that there are twice as many outdoor pet cats as was indicated in the original survey—an interpretation Dauphiné and Cooper seem to embrace. Had they looked further—and to a less biased source—they might have been able to get a better handle on the degree of outdoor access. For example: a 2003 survey conducted by Clancy, Moore, and Bertone [10] revealing that nearly half of the cats with outdoor access were outside for two or fewer hours a day. And 29% were outdoors for less than an hour each day.

Do these “part-timers” have the same impact on wildlife as feral cats? Dauphiné and Cooper would have us believe they do.

[Note: For a closer look at the flaws in Dauphiné and Cooper’s paper, download “One Billion Birds,” by Laurie D. Goldstein.]

The lesson? Credible research begins with a solid foundation; a weak foundation—one plagued with unsubstantiated claims—on the other hand, leads to pseudoscience.

Or worse. ABC’s Senior Policy Advisor, Steve Holmer, cited Dauphiné and Cooper’s bogus numbers when he spoke to the Los Angeles Times about his organization’s involvement with the legal battle against TNR. It’s like the Wisconsin Study all over again.

When All Else Fails, Look It Up
Though this would seem to be utterly obvious, it apparently bears repeating: Don’t cite work you haven’t actually read.

Isn’t this emphasized in all graduate (indeed, undergraduate, too) programs? What grad student isn’t, at one time or another, tempted to take the easy way out—ride the coattails of somebody else who’s (presumably) done the real work? In addition to the ethical implications, such shortcuts tend to invite more immediate troubles, too. Again, George’s work (described above) provides an excellent case study. Below are some examples of how his work has been referenced in the cat predation literature:

“It is very unlikely that cats bring home all of the prey that they capture. What proportion they bring home has been little studied. George (1974) on a farm in Illinois USA found that three house cats, all adequately fed, brought home about 50% of the prey that they killed.” [11]

“George found that about 50% of prey were indeed brought home, with the other 50% being eaten, scavenged by other animals or simply not found.” [12]

“These approximations are probably underestimates, assuming that cats do not bring back all the prey that they kill.” [13]

Trouble is, George never said these things; what he said was:

“… the cats never ate or deposited prey where caught but instead carried it into a ‘delivery area,’ consisting of the house and lawn. The exclusive use of this delivery area was verified in 18 to 70 mammal captures per cat, as witnessed between early 1967 and 1971.” [2]

In 2000, Fitzgerald and Turner pointed out the fact that George’s work was being misrepresented, noting that the erroneous 50% figure “has been reported widely, though it is unfounded.” [14] Nevertheless, the myth persists—even in 2010.

“In Illinois, George (1974) found that only about half of animals killed by cats were provided to their owners, and in upstate New York, Kays and DeWan (2004) found that observed cat predation rates were 3.3 times higher than predation rates measured through prey returns to owners. Thus, predation rates measured through prey returns may represent one half to less than one third of what pet cats actually kill…” [7]

As Dauphiné and Cooper demonstrate, the “reinterpreted” version of George’s work makes for a very convenient multiplier—suddenly, every kill reported is doubled (or tripled, if Kays and DeWan are to be believed—and they’re not, but that’s a topic for another post). Never mind the fact that it has no basis in actual fact.

Getting a copy of George’s study isn’t difficult, especially with the inter-library loan services available today. To reference it—to use George’s work so that your own appears more credible—without ever having actually read it, is simply inexcusable. But citing it blindly suggests more than laziness—it points to a certain coziness that has no place in scientific discourse. Too much Kool-Aid drinking, and not enough honest research.

*     *     *

Scientists can (and do) look at identical results and come to very different conclusions. But misinterpreting, misrepresenting, or dismissing the conclusions of others, is something else altogether. As the above examples (and there are many, many more!) illustrate, this happens far too often in the feral cat/TNR literature. And if we can’t believe what researchers are saying about the work of others, why would we believe what they say about their own work?

Next, I’ll focus on some of the major flaws in the feral cat/TNR literature—beginning with small sample sizes

References
1. Lepczyk, C.A., et al., “What Conservation Biologists Can Do to Counter Trap-Neuter-Return: Response to Longcore et al.” Conservation Biology. 2010. 24(2): p. 627-629.

2. George, W., “Domestic cats as predators and factors in winter shortages of raptor prey.” The Wilson Bulletin. 1974. 86(4): p. 384–396.

3. Jessup, D.A., “The welfare of feral cats and wildlife.” Journal of the American Veterinary Medical Association. 2004. 225(9): p. 1377-1383.

4. Guttilla, D.A. and Stapp, P., “Effects of sterilization on movements of feral cats at a wildland-urban interface.” Journal of Mammalogy. 2010. 91(2): p. 482-489.

5. Elliott, J., The Accused, in The Sonoma County Independent. 1994. p. 1, 10

6. Longcore, T., Rich, C., and Sullivan, L.M., “Critical Assessment of Claims Regarding Management of Feral Cats by Trap–Neuter–Return.” Conservation Biology. 2009. 23(4): p. 887–894.

7. Dauphiné, N. and Cooper, R.J., Impacts of Free-ranging Domestic Cats (Felis catus) on birds in the United States: A review of recent research with conservation and management recommendations, in Fourth International Partners in Flight Conference: Tundra to Tropics. 2010. p. 205–219

8. Winter, L., “Trap-neuter-release programs: the reality and the impacts.” Journal of the American Veterinary Medical Association. 2004. 225(9): p. 1369-1376.

9. ABC, Human Attitudes and Behavior Regarding Cats. 1997, American Bird Conservancy: Washington, DC. http://www.abcbirds.org/abcprograms/policy/cats/materials/attitude.pdf

10. Clancy, E.A., Moore, A.S., and Bertone, E.R., “Evaluation of cat and owner characteristics and their relationships to outdoor access of owned cats.” Journal of the American Veterinary Medical Association. 2003. 222(11): p. 1541-1545.

11. Churcher, P.B. and Lawton, J.H., “Predation by domestic cats in an English village.” Journal of Zoology. 1987. 212(3): p. 439-455.

12. May, R.M., “Control of feline delinquency.” Nature. 1988. 332(March): p. 392-393.

13. Crooks, K.R. and Soule, M.E., “Mesopredator release and avifaunal extinctions in a fragmented system.” Nature. 1999. 400(6744): p. 563.

14. Fitzgerald, B.M. and Turner, D.C., Hunting Behaviour of domestic cats and their impact on prey populations, in The Domestic Cat: The biology of its behaviour, D.C. Turner and P.P.G. Bateson, Editors. 2000, Cambridge University Press: Cambridge, U.K.; New York. p. 151–175.

A Critical Assessment of “Critical Assessment”—Part 1

The first in a series of posts that breaks down my critique of the essay “Critical Assessment of Claims Regarding Management of Feral Cats by Trap-Neuter-Return” (Conservation Biology, Volume 23, No. 4, 887–894) by Travis Longcore, Catherine Rich, and Lauren M. Sullivan.

How many birds are killed by cats? It’s a fair question. And if Longcore et al. are to be believed, we actually have a pretty good handle on this issue:

Feral and free-roaming cats are efficient predators, and their abundance results in substantial annual mortality of wildlife. Churcher and Lawton (1987) concluded that cats were responsible for 30% of the mortality of House Sparrows (Passer domesticus) in an English village. May (1988) extrapolated their results to an estimated 100 million birds and small mammals killed per year in England. Although this extrapolation is often criticized for the limited geographic scope and number of cats studied, Woods et al. (2003) confirmed and refined this result with a larger sample size and geographic area that included England, Scotland, and Wales. From a survey of cat owners that documented prey returned by 696 cats, Woods et al. (2003) estimated that the 9 million cats in Britain kill at least 52–63 million mammals, 25–29 million birds, and 4–6 million reptiles each summer. In North America Coleman and Temple (1996) developed estimates of cat densities in Wisconsin and associated mortality of 8–217 million birds per year.

The relationship between cat predation and bird populations is highly complex, and our understanding quite limited—something Longcore et al. only hint at. It doesn’t help matters that results of small, isolated studies are often extrapolated from rural to urban environments, from one region to another, and so forth. In 1995, Churcher himself cautioned against making such leaps: “I’d be very wary about extrapolating our results even for the rest of Britain, let alone America,” he told Catnip, a newsletter published by the Cummings School of Veterinary Medicine at Tufts University.

Actually, Churcher went much further: “I don’t really go along with the idea of cats being a threat to wildlife. If the cats weren’t there, something else would be killing the sparrows or otherwise preventing them from breeding.” [1] Although Longcore et al. seem eager to cite Churcher and Lawton’s now-classic work as “evidence” of the damage cats can do, they make no mention of Churcher’s later comments (just one of many examples of their tendency to “cherry pick” from the literature only the bits and pieces that fit neatly into their argument).

But back to the number of birds killed by cats. Many of the studies on the subject—including those cited by Longcore et al.—are quite flawed. Among the numerous issues that call into question their estimates are assumptions regarding the number of cats that actually hunt, the number of cats allowed outdoors, the number of cats that live in a particular area, and so forth. And then, of course, there are the risks inherent in estimating population numbers and characteristics based on a small sample size.

(In fact, Woods et al. go to some lengths to emphasize the limitations of their study, conceding, for example, that they “may have focused on predatory cats.” [2] This is just one of many reasons the authors cite for requesting that their work be treated “with requisite caution”—a request apparently ignored by Longcore et al.)

By referring uncritically to such studies, Longcore et al. give far greater importance to this work than is warranted. Repeating—and therefore reinforcing—figures known to be erroneous and/or misleading is simply irresponsible.

The fact that the “English village” study and “Wisconsin Study” have been so thoroughly discredited (see, for example, the comments of Nathan Winograd, director of the No Kill Advocacy Center, and a report by Laurie D. Goldstein, Christine L. O’Keefe, and Heidi L. Bickel) raises some unsettling questions about their inclusion in a paper billed as a “critical assessment.” For example: Are the authors interested enough in rigorous scientific inquiry to look beyond “the usual suspects” in their assessment of the key issues?

One might also wonder: Given the important literature that Longcore et al. choose to overlook, ignore, or dismiss (to be addressed in detail in future posts), what is their motivation for writing the essay in the first place? Actually, this question was answered in January, two months after the paper’s publication, when L.A. Superior Court Judge Thomas McKnew decided in favor of an injunction against publicly supported TNR in Los Angeles (LASC BS115483). The Urban Wildlands Group (for which Longcore serves as Science Director, and Rich as Executive Officer) was the lead petitioner in the case.

If “Critical Assessment” is any indication, the case had much more to do with politics, PR, and marketing than with science.

References
1. n.a. (1995). What the Cat Dragged In. Catnip, 4–6.

2. Woods, M., Mcdonald, R. A., & Harris, S. (2003). Predation of wildlife by domestic cats Felis catus in Great Britain. Mammal Review, 33(2), 174-188.

Works cited in “Critical Assessment” excerpt:

• Churcher, P. B., & Lawton, J. H. (1987). Predation by domestic cats in an English village. Journal of Zoology, 212(3), 439-455.
• Coleman, J. S., & Temple, S. A. (1996). On the Prowl. Wisconsin Natural Resources, 20, 4–8.
• May, R. M. (1988). Control of feline delinquency. Nature, 332, 392-393.