Can we ever know how many jobs the Obama Administration has saved?

Almost two months ago, President Obama set a specific employment goal for his Administration:

I think my initial measure of success is creating or saving 4 million jobs.

It is clear that this “create or save” phrase is now a standard and important part of the Administration’s economic message.

Greg Mankiw quickly identified both the quantitative ambiguity and political creativity in defining the goal in this way.  Now that we have a couple of months of data, I’d like to reprise Greg’s post with a concrete example of why this is a misleading metric that is vulnerable to manipulation.

The Bureau of Labor Statistics reported the following on Friday:

Nonfarm employment level, January 2009

134,333,000

… plus change in February

-653,000

… plus change in March

-661,000

… equals nonfarm employment level, March 2009

133,019,000

Net change in Obama Administration

-1,314,000

You can see that the U.S. economy has lost a net 1.314 million jobs since January.  Let’s look at it graphically:

net job loss since January 2009


The traditional way to measure jobs “created” or “lost” is by taking the change between the starting point and the ending point of your timeframe.  I have displayed this in red on the graph.  Administrations are always judged (at least by the press) based on the change in the level of employment from January 20th in their first year to the current level.

I think the traditional way is a poor metric because political and business cycles don’t line up.  I will expand on this further in a separate post about starting points, and whether it’s fair to assign blame or credit to the Obama Administration for jobs lost in the first two months of their Administration.  (Hint:  It’s not, but it is always done so they are stuck with it.)  For now I want to focus on the “or saved” point.  We start with the factual statement that the U.S. economy has lost a net 1.314 million jobs since the beginning of the Obama Administration.

Suppose, however, that you had anticipated the situation would be even worse.  Suppose you had thought that the employment level would be down to 132.5 million in March, rather than the actual 133.0 million.  I’ll draw this as a new yellow line on the same graph and label it the “counterfactual baseline.”  This is what you could argue you think the employment situation would have looked like, had no new policies been enacted.  I should emphasize that the specific yellow line I show here does not represent any numbers cited by the Obama Administration.  I have chosen these illustrative numbers to explain the concept.

net job loss since January 2009 with counterfactual

The green line shows actual employment, and it includes the effects of policy changes enacted over the past two months.  The yellow line represents the “counterfactual” – what you think (or claim) employment would have looked like had your policies not been enacted.  You could argue that the 133.019 million people employed in March is 519,000 more people than would have been employed had your policies not been enacted.  (Again, I emphasize so that nobody miconstrues me:  I have chosen the numbers for the yellow line to illustrate the concept.)  You would be trying to “frame” the numbers by measuring the positive orange change, rather than the negative red change.

In a world with no politics, that could be legit.  I hope that the Administration’s policy changes will increase employment to be above what it would otherwise be, had those policies not been enacted.  I did not like the so-called “stimulus” bill, and have big questions about the magnitude, efficiency, and timing of the economic benefits, but there is no question on the direction:  these policies should be positive for employment, although over a much longer time period than that covered by this graph.

The problem is that the Administration can draw the yellow line anywhere they want it to be.  Since the number of jobs “saved” (orange) is the difference between the green and the yellow lines, if you let me draw the yellow line, I can make the orange number as big as I want, and later claim credit for a large number of jobs saved.  I would be arguing, “Sure things are bad.  But I saved ____ million jobs from where it would have been had we done nothing.”  I would not be able to prove that this number is correct, but you could not disprove it either.  That’s why it is politically clever.  It is specific, can be asserted, and can never be disproven.

As Greg wrote in February:

You can measure how many jobs are created [or lost  –kbh] between two points in time. But there is no way to measure how many jobs are saved. Even if things get much, much worse, the President can say that there would have been 4 million fewer jobs without the stimulus.

This makes intuitive sense if you think about it on the personal level.  If someone was unemployed on January 20th and they have a job on July 20th, you can understand why it would seem reasonable to count that as one additional job created since the beginning of the Obama Administration, even though policy may have had nothing to do with it.

If you had a job on January 20th, however, and you are in that same job on July 20th, does it seem reasonable to count your job as having been saved by the President’s policies?  Maybe it was, but it is easy to see how that could be gimmicked by someone with a political incentive to make the numbers look good.  How many of the 134.3 million people who were employed on January 20th would otherwise have lost their job?  We’ll never know.  A policy wonk would say that “you can neither prove nor disprove the counterfactual.”

You could correctly point out that the Administration has published an economic forecast that implicitly contains projections for employment, so we could at least hold the Administration to the yellow line they implicitly defined when they released their economic forecast in late February.  The problem is that these official forecasts get updated every six months, and so the yellow line moves around.  It will be impossible to tell how much of the yellow line’s movement from the February forecast to the July revision is legitimate changes in forecasting, and how much is political shading by an Administration that knows it will be judged on this metric.  Note that I am not accusing this Administration of biasing their forecast, but instead trying to show that “or save” is an unreliable and misleading metric.  We need a reliable factual metric that cannot be gimmicked or manipulated by political advocates from either side of the partisan fight.

The New York Times slipped the President’s phrasing into an editorial on Saturday that argued for even more spending and expansion of union-friendly policies:

It is painfully clear, however, that the law’s potential to create or save a few million jobs will not be enough to combat the current scale of unemployment.

Let’s return to the President’s statement from February 9th.  Can we measure that?

Had he said that his Administration would create 4 million jobs, then we would have a simple metric:  134.3 million + 4 million = 138.3 million.  Each month, we could compare the nonfarm employment level to 138.3 million to see if it was higher or lower than that goal.

Suppose, however, that a year from now this numbers is instead 133.3 million.  If we measure this the way it has been measured for at least the past two Administrations, a fair reporter would write that “the economy has lost a net 1 million jobs since President Obama took office.”  But the Administration could argue that employment would have been 129.3 million, and that they therefore saved 4 million jobs.  And nobody could prove them right or wrong.

“Create or save” is unreliable and vulnerable to manipulation.  Any time I hear it, I know that I am being spun.


Related Posts

(best matches are listed first)
  1. Jobs Day
  2. The jobs battle
  3. A good jobs day
  4. Auto loans, part 2: options for the President
  5. Jobs Day January 2010
  6. Understanding the GM bankruptcy
  7. Will the stimulus come too late?
  8. The Administration’s employment projections
Twitter Digg Delicious Stumbleupon Technorati Facebook Email

This website uses IntenseDebate comments, but they are not currently loaded because either your browser doesn't support JavaScript, or they didn't load fast enough.

20 Responses to “Can we ever know how many jobs the Obama Administration has saved?”

  1. Mitch Baker 6 April at 9:14 pm

    Actually, a claim of saving 4 million jobs can be disproven. If we lose another 130,000,000 jobs, there will be less than 4 million jobs total. I sure hope that doesn't happen. Of course, if I'm one of those 4 million, I'll likely be one of the only people who can afford to buy anything (not that there'd be anything to buy, or, if there was, that people wouldn't just be fighting for it).

  2. Karl Smith 6 April at 11:29 pm

    Actually there is a more fundamental problem with this.

    Suppose I had said on Jan 1st of 2004 that I had a new policy that would create 2 million jobs over the next year. It is as follows: I will turn around three times and click my heals. Judged by the metric of jobs created, my policy should be rated a success. By Jan 1st of 2005 the economy did indeed have 2 million more jobs.

    However, I think that most of us believe it unlikely that the policy was responsible for those jobs.

    In short, one never has the counterfactual, the addition of the term saved does not change that.

    In all cases one is basing success or failure on comparison to a forecast.

  3. During the President's interview with Steve Kroft of 60 Minutes he was asked the following question:
    Were you surprised at the depth of this recession when you got here? Did you know it was this bad?

    PRESIDENT OBAMA:

    I don't think that we anticipated how steep the decline would be, particularly in employment. I mean if you look at just, you know, hundreds of thousands, now millions of jobs being shed over the course of two months– or three months, that slope is a lot steeper than anything that we've said– we've seen before.

    Now–there's a potential silver– silver lining, which may be that things are so accelerated now, the modern economy is so intertwined and– and wired, that things happen really fast– for ill, but things may recover faster than they have in the past.

    I am not an economist, in fact I am just a housewife, but I do have common sense. If the economy continues to shed jobs at the current rate, it is unlikely the public will be assuaged by magical job saving from a "stimulus" created before the administration or Congress had any real sense of the scope of the problem.

  4. I think you miss part of their political strategy.

    There are plenty of friendly mayors and governors out there who will provide the "saved jobs". I believe it was Cincinnati where the mayor's answer to shrinking revenues was to eliminate a few dozen police trainees. In sweeps Obama with a stimulus handout and—voila—jobs "saved"! See how easy it is? I've heard several subsequent speeches where the president specifically mentioned these as jobs "saved".

    There are pols all over the country who can announce public employee layoffs, knowing full well the layoffs will never occur (because they know the stimulus money is on the way.) Then, when the "announced" layoffs are canceled, Obama gets to add all those "saved" jobs to his accomplishments. Call me cynical, but I suspect coordination between local officials and Obama's team: "Hey, Mayor, we'll send you the money but you have to announce the layoffs before we publicly provide the cash".

    Never mind that it's all politics and has no relationship to the real economy. It's just a cynical game.

  5. I am more troubled by the the notion one can 'create' or 'save' a job. The labor market is like any other market. Want to 'create' a bunch of jobs? Then lower the minimum wage or remove the 'fair and prevailing wage' limitation on federal spending. There will be more jobs, but the total amount of pay will be the same. Jobs alone are not a good measure of success.

  6. I am inclined to agree with Marcus … jobs alone are not a good measure. Should all jobs — at all pay levels, at all skill levels, in all industries — count the same? Indeed, I have thought each time I have heard an official from the Administration or a member of Congress tout those millions of new jobs, "Oh geez, don't promise that!" Given the complexities of the economy, it would be nice if we could avoid oversimplification, especially when those statements are potentially misleading. (I know. I know. I'm politically naive.)

    I would like to ask:

    1. What about the supposed multiplier effects of public investment? Setting aside exactly when the various forms of stimulus will reach the economy, is it not fair to estimate job creation based on dollars spent?
    2. Would Jeanne B (or KBH) say it is legitimate for the Administration to take credit for "saving" auto jobs in Detroit and beyond?

  7. It's amazing how many right-wing economists *now* don't like the idea of counterfactuals, or ceteris paribus, or looking at forecasts. Perhaps one could consult with James Heckman or Donald Rubin to understand such things.

  8. Obviously, the refusal by Bush to enact more fiscal stimulus in 2008 was a huge mistake that made his failure even worse.

    You should at least start counting from Jan 20 instead of Jan 1.

  9. Perhaps it would have been wise for the Obama Administration to enact a stimulus designed to create jobs now rather than after 2010. The bloated "Stimulus" passed in secrecy and in great haste was a travesty. The President should roll it back and design a real stimulus package before unemployment hits over 10%.

  10. Monetary stimulus is usually preferred over fiscal stimulus because fiscal stimulus has a delay in implementation. There is no help but for stimulus passed today to carry into 2010. This is why it was stupid for Bush to block fiscal stimlus last year. The large increase in unemployment we have today could have been tempered if Bush would have done the decent thing instead of being a total elitist tool. Fiscal stimulus is important now because monetary policy is in liquidity trap. Plus, the way out of the current downturn is to pump money into the lower rungs of the economic ladder. Monetary policy has a much tougher time with wealth transfer than fiscal policy.