data

Questionable numbers: US Chamber of Commerce

by bledsoe on October 10, 2008

David Kravets of Wired magazine has an interesting post on a number that has made its way into a US Chamber of Commerce letter to the president, encouraging him to sign into law a bill focused on stronger enforcement of intellectual property law, including the creation of a cabinet-level "copyright czar" to oversee these efforts. The number in question declares that 750,000 American jobs have been lost due to counterfeiting and piracy of intellectual property, a number which, as Kravets points out, is pretty impressive, and would make up 8% of the 9.4 million Americans who are currently unemployed.

The only problem is, no one seems to know where the number came from. The US Chamber of Commerce says they got the number from the US Department of Commerce (yes, that's two different agencies), but the US Department of Commerce says they got the number from the US Chamber of Commerce. Not only that, but the number is also quoted by the US Customs and Border Protection, which says the number comes from the International Anti-Counterfeiting Coalition, but the IACC says the number comes from, you guessed it, the CBP.

This kind of circular quoting of statistics is not nearly as uncommon as you might think. Daniel Gardner, in his book "The Science of Fear," tells the story of "50,000 pedophiles prowling the internet at any given time," a number widely quoted by a number of news reports and government officials, including former US Attorney General Alberto Gonzales. This number turned out to be essentially a number that an FBI agent once heard and didn't know where it came from, but thought was a "fairly reasonable figure." (Gardner offers this as an example of the use of what psychologists call the anchoring and adjustment heuristic.)

This is not to downplay the value of experts estimating the size of a particular phenomenon. Experts often have insight into their fields, or expertise in certain modeling or statistical analysis techniques, that others don't have; that's what makes them experts. But when people (or government agencies) are presenting information in an attempt to persuade us of the correctness of their position (or in an attempt to convince the president to sign a bill into law) it's appropriate to ask how exactly these estimates were arrived at, not to mention who exactly arrived at the estimate, as that knowledge may affect how much weight we assign to it. If an estimate turns out to be just a "fairly reasonable figure" that someone essentially pulled out of the air, that's something that's good to know.

{ 0 comments }

Famous people commissioning surveys: The Dilbert Guy

October 10, 2008

Rock musician Trent Reznor wasn't the only famous person who recently conducted a survey. Scott Adams, creator of the well-known comic strip "Dilbert," decided he wanted some "useful and unbiased information about which candidate has the best plans for the economy" and decided the best way to get that information was to ask a bunch [...]

Read the full article →

Famous people commissioning surveys: Trent Reznor

October 5, 2008

During the month of September, 2008, at least two famous people did something that famous people don't often do: they surveyed a bunch of people to find out something they wanted to know. One of these famous people is Trent Reznor, of the industrial rock band Nine Inch Nails. (The other is Scott Adams, creator [...]

Read the full article →

Twitter figures prominently in Lacy-Zuckerberg interview

March 12, 2008

One might think that a simple hour-long interview, even an interview with a minor celebrity like Mark Zuckerberg, the 23-year-old founder and CEO of Facebook, would not be enough to inspire bitter heckling and furious public attacks, but one would be wrong. Sarah Lacy, an author and columnist for Business Week magazine, has interviewed Zuckerberg [...]

Read the full article →