He has provided a forum for the stories of people who:
work hard in chicken processing plants:
http://www.youtube.com/watch?v=Y510mj5J99I

are employed in the new renewal energy economy:
http://www.youtube.com/watch?v=50yOR5bvMV0

who are having their homes foreclosed:
http://www.youtube.com/watch?v=9i_GWrYkcCI

who have in New Orleans been left devastated from the effects of Hurricane Katrina:
http://www.youtube.com/watch?v=xAqktFnA4nk&feature=PlayList&p=EB1EC8919DC5DC52&index=0

More Blogs | National Post Home | Financial Post Home | News | Opinion | Arts | Life | Sports | Multimedia | Your Post

Main | About | Contact Editor | Subscribe RSS

Check the numbers
Posted: February 19, 2009, 8:01 PM by NP Editor
Ross McKitrick and Bruce D. McCullough, research practices
From the U.S. subprime crisis to global warming, bad research is driving disastrous public policy

By Ross McKitrick and Bruce D. McCullough

Empirical research in what are commonly called “peer-reviewed” academic journals is often used as the basis for public policy decisions, in part because people think that “peer-review” involves checking the accuracy of the research. That might have been the case in the distant past, but times have long since changed. Academic journals rarely, if ever, check data and calculations for accuracy during the review process, nor do they claim to. Journal editors only claim that in selecting a paper for publication they think it merits examination by the research community.

But the other dirty secret of academic research is that the data and computational methods are so seldom disclosed that independent examination and replication has become nearly impossible for most published research. In a new report we wrote for the Fraser Institute, we review a series of efforts in recent years to replicate empirical studies published in economics journals. Over a thousand papers have now been examined. In over half the cases the data were not archived. When the authors were asked for their data, the majority reported being unable or unwilling to provide it. Where data was provided, the computer code used to generate the results was almost never released, greatly complicating the task of replicating the statistical results. Overall, the vast majority of economics papers could not be independently verified, even in some cases where the authors agreed to assist the replication efforts.

A set of interlocking problems in the peer review system have become pervasive throughout academia: authors do not release their data, journals do not ask for it, thousands of papers get published each year that nobody checks for accuracy and independent replication has become so costly and difficult that it is rarely attempted.

In researching this issue we have noticed two inconsistent opinions: Some non-academics are surprised to find out that peer review does not involve checking data and calculations while academics are surprised that anyone thought it did.

Our report also explores numerous examples from other academic disciplines, such as medicine, history, environmental science and forestry, in which prominent or policy-relevant research was shielded from independent scrutiny by withholding data and/or computer code. In some cases the research was exposed as faulty only years later, sometimes only through government intervention to force data disclosure, and sometimes after laws had already been passed based on the faulty research.

Non-disclosure of essential research materials may have deleterious scientific consequences, but our ultimate concern is the growing negative effects on public policy formation.

One striking example in the context of the current U.S. housing meltdown concerns a 1992 study by economists at the Boston Federal Reserve, published in the prestigious American Economic Review, that purported to show statistically significant evidence of racial discrimination in U.S. mortgage lending practices. Based on this study, federal regulations were rushed into place that forced banks to loosen lending standards and threatened them with severe financial penalties for failure to correct the alleged discrimination.

It took nearly six years, and a Freedom of Information Act request, for independent economists to discover coding errors in the data that invalidated the original conclusions. But by this time the new lending rules were in place that ultimately contributed to the buildup of bad mortgage debt now ravaging the U.S. financial system.

A related feature of this problem is that when a study becomes prominent in a policy debate, academics can end up forming a protective cheering squad around it, defending it from independent scrutiny. In 2006, a U.S.-appointed expert review panel looking at a controversial global warming study noted that when the issue became politically heated, scientists working in the area formed a “self-reinforcing feedback mechanism” that made it effectively impossible for them to critically assess the work in question, while dismissing the efforts of outsiders who were trying to do so. It should not be assumed that the scientific process will reliably correct erroneous research: The sociological process within science is just as likely to protect false results from scrutiny.

Users of academic research must recognize that scientific findings in journal articles are not checked for accuracy and, unless proven otherwise, are likely not independently replicable. In our report, we spell out a simple checklist of conditions that government policymakers should be prepared to verify before basing public-policy decisions on the claims in an academic journal article. These are not complicated or contentious matters, they are things long assumed to be true: that the data described in the paper were actually used in the analysis, that the data are available for independent inspection, that the calculations described in the paper match those in the computer code, etc. If these things can’t be shown to be true, the paper should not be relied on.

Academics rightly insist on the freedom to do their research without public or political interference. But when that research influences policy, the public has a right to demand independent verification. Researchers might want to influence policy but if they plan to keep their data and computer code to themselves, they should keep their results to themselves too.

Financial Post
Ross McKitrick, an Associate Professor of Economics at the University of Guelph, and Bruce D. McCullough, a Professor of Decision Sciences at Drexel University in Philadelphia, are authors of “Check the Numbers: The Case for Due Diligence in Policy Formation,” published by the Fraser Institute.

Never-the-less, I am concerned with my fellow man. I am concerned for our Nation as a world power. I am concerned with other world countries. All the poor, who are suffering horribly.

Yet, *you* are ignorantly glib. All because of politics. What are you???

I have am comfortable in assets. Have a beautiful home. Live in a wonderful city. But, anyone saying that the next few years is “going to be a blast” is ignorant to the extreme.

What is going to be such a blast? More people getting unemployed? More small businesses closing? The rise in crime, specifically, murder, which comes hand-in-hand with a poor economy?

I don’t have to work. Never-the-less, I

The other America knew Obama was a lying racist promoted by the liberal MSM. They saw the kid glove treatment he got and the “racist” accusations thrown at anyone who dared question his banal platitudes or lack of experience.
Those people bought guns, ammo, gold and food, and they hate the Democrats and the MSM with a bitter and unabiding hatred. That hatred grows by the day.

I’m fully expecting to see a day in the very near future when people sporting Obama/Biden bumper stickers start reporting that other people have put a 12 gauge charge of 00 buck through their back window as an indication of their dislike for people who voted for Obama. It’s coming; bet on it. The left threw out the rules of political civility during the last eight years and payback is going to be a bitch.

I mean, well, obama would be a hypocrite if he said that.

Shall we subtract the number of illegal aliens that have jobs?

That figure is in the millions. Go refigure the equation please.
Question, those that have stopped looking for jobs and no longer receive unemployment benefits exactly how are they surviving? How many jobs are NOT on the books? Still more refiguring. Yeah, things are a little down but it is not close to the 25% unemployment of the great depression. Also, how many women were there in the work force in 1933? Furthermore, recent articles reveal that even after several years of the New Deal over 13% remained unemployed. FDR’s policies doesn’t seem quite so successful. Consider also there weren’t many illegals in 1939 to lower that figure. Numbers don’t alleviate the problem but don’t try to exacerbate the problem with faulty equations.