Incorrect predictions

Do the experts know anything about oil prices? 12

Finally, after a four-month stretch in which oil prices rose from under $70 to over $95, oil industry analysts seem to have caught on that prices are rising. From Bloomberg news (emphasis added):

Twenty-one of 35 analysts surveyed, or 60 percent, said oil prices will rise through Nov. 9 ... Respondents [had] predicted price drops in the previous 16 weeks.

That's right, for each of the preceding 16 weeks, the consensus of oil industry experts was that prices would fall in the coming week. They were right five times, wrong 11 times -- and crude prices rose by over a third during the stretch. So much for expertise.

Over the longer term, the oil industry analysts haven't fared much better:

The oil survey has correctly predicted the direction of futures 52 percent of the time since the survey's introduction in 2004.

Statistically, that's barely better than a coin flip. And, as it turns out, it's considerably worse than if the analysts had mailed it in and simply guessed that prices would rise each week.

So what's behind this dismal record, from people who allegedly know the oil industry? Wishful thinking? Incompetence? Market manipulation? Probably none of the above. As we've noted before, the futures markets don't always do a great job of predicting energy prices either. And arguably, futures markets are the very best methods we have of predicting prices, since they aggregate the guesses of thousands of well-informed people with a financial stake in getting the answers right.

No real point here -- except that when it comes to energy costs, it no longer makes much sense (if it ever did) to rely on expertise, or experience, or even the collective wisdom of the masses. Oil prices are seemingly charting their own direction. Recently, despite the opinions of the allegedly well-informed, that direction has been up.

Clark Williams-Derry is research director for the Seattle-based Sightline Institute, a nonprofit sustainability think tank working to promote smart solutions for the Pacific Northwest. He was formerly the webmaster for Grist.

Advertisement
Advertisement
  1. Delay And Deny's avatar

    Delay And Deny Posted 7:10 am
    05 Nov 2007

    Derivative Pricing

    You realize of course, that the primary providers are no longer setting the prices, but the new combines are the exchanges that buy up the oil and set them...the futures.   You have to remember that those guys compete against each other -- you and I filling up our Pontiacs are the flea on the elephant.  However, because they tend to cut each other up, eventually the price will come down.
    http://www.washingtonpost.com/wp-dyn/content/article/2007 ...
    "It just seems that the market is spasming here," said Adam Robinson, an oil analyst at Lehman Brothers. If slowly declining petroleum inventories start to build again, he said, "the radical increase we've seen to the upside can repeat on the way down." Oppenheimer & Sons analyst Fadel Gheit says oil is $30 a barrel overpriced.

    John Bailo


    Sutext:
  2. Sean Casten's avatar

    Sean Casten Posted 7:41 am
    05 Nov 2007

    Short term vs. long termMost of what I've seen on natural gas markets (the only one that I'm at least passably familiar with) is that you used to be able to predict prices based on structural considerations, especially looking at daily demand vs. storage reserves (e.g., the stuff that's already in our country and in storage).  The ratio of the two gives you a crude sense of supply and demand and used to index pretty well to price.  However, the linkage has broken down of late, to the extent that price is consistently above where those historic models would predict.  The theory - which I believe to be true - is that the gap is a function of market speculation, and that this will ALWAYS put a price premium, since market trading works on churn and is driven by people buying with no intent to consume.  Add more buyers with no corresponding shift in consumption and the price goes up.  In the short term, that's probably a $1 - 3/MMBtu adder on gas prices that isn't going away - but to date, isn't really factored into a lot of the models.  Indeed, the presence of those players also adds quite a bit of innate volatility to market pricing, which is in many ways a bigger story.  (If you look at daily gas prices over the last 30 years, you see a slow upward trend, but much more notable is the massive increase in volatility: the plots look like a radio signal that starts flat and goes crazy.)
    The longer term projections though are almost universal garbage, exactly as you point out.  And it's worth noting that the modelers acknowledge as much.  Knowing how much gas is in reserve today and what the demand is is fairly straightforward.  But knowing what's going to happen 3 years from now is pure speculation - simply too many variables from economic growth to regulation to globalization to make meaningful predictions of supply or demand.  And so the modelers base predictions just on linear extrapolation of past trends.  If we've had 2 years of price rises, they predict the price will rise.  2 years of declines, they predict the price will fall.  It's the way the models work, and the modelers admit as much, but figure it's better than anything else.
    In short, I agree with your point - but I'm not sure it's either new info, nor something worth getting too concerned about.  We simply ought to acknowledge the limitations of the projections before we use them too much for future planning.
  3. odograph Posted 7:55 am
    05 Nov 2007

    Black Swan, Babyhere's the introductory video
  4. odograph Posted 7:58 am
    05 Nov 2007

    BTWIf I recall correctly, there is a bit in the middle of that presentation, about the habit oil industry analysts have to reset their predictions, and move on, without explaining what happened to the old ones.
    That is, the answer to new conditions is a new prediction, and not a backwards looking analysis about the value of their predictions.
  5. Colin Wright Posted 9:21 am
    05 Nov 2007

    How about experts who think independently?Clark, you may want to read Kunstler's latest piece, Ignoring the Obvious.
  6. GonzoDon Posted 1:11 pm
    05 Nov 2007

    Regarding KunstlerI much enjoy J.H. Kunstler's web page, as he is a wickedly good writer and does a tremendous job of spotlighting the ludicrous excesses and follies of our age.
    That said, though, Kunstler is a self-proclaimed 'expert' who has produced his own share of embarassingly off-target predictions.  My favorite being his prediction at the beginning of 2005 that the Dow Jones stock market average would plummet to 4,000 by the end of the year.  (For those of you who haven't been paying attention, it has gradually risen since 2005 to record highs of 14,000+, and currently hovers around 13,500).
    OK, so he was only off by 350%.  I guess we all have our bad days.
    Nevertheless, while Kunstler's apocalyptic vision of American's future probably contains more than a few grains of truth, I recommend against letting him manage your stock portfolio.  
  7. trock Posted 11:05 pm
    05 Nov 2007

    sure things and variablesIt's good to think about those things that we are absolutely sure of, those things that might the true, those things that won't happen and how we evaluate them all.
    Are markets, like oil markets, variable like the weather?  Or are they variable like climate?  Hell, we've got scientists who from their comments make me think they don't know the difference between weather and climate.
    Just like I might not know on which at bat a hitter in baseball might get a homerun, doesn't mean I can't guess that there will be about as many total home runs in baseball as last year.  Weather is each at bat, climate is the total at bats for the year.
    Thinking I know all that is one reason I don't bet on baseball, sports or commodities markets.  I don't have a good grasp of all those variables.  

  8. odograph Posted 12:20 am
    06 Nov 2007

    predictions after known errorsOne of the things we aren't supposed to talk about are Kunstler's old Y2K predictions, but really that is like forgiving him for the '05 stock market crash prediction, and then moving on.
    I guess it's kind of nice and human for us to forgive our sooth-sayers, but it's kind of weird too.
    I don't know why we should suddenly expect them to be right in the future, especially on "the big one."
  9. Whiskerfish Posted 2:40 am
    06 Nov 2007

    OPECfunny - the experts I spoke to at OPEC in Vienna a couple months ago said (with the caveat that 'predictions are always wrong') that oil would trade in the range of 80-110 dollars per barrel for the forseeable future. Prices might never go down beyond 70 ever again.
    Whiskerfish
  10. trock Posted 4:14 am
    06 Nov 2007

    great web pageThat is a great web page, just great.   It gives a look into how consistent people's thinking can be.  
    Just because you're paranoid, doesn't mean they aren't out to get you.  Just because you predicted catastrophe before and were wrong, doesn't mean you'll be wrong again doing the same thing.  Maybe it just means you can sell books with the same message to different problems.

  11. zxzkzkz Posted 5:44 am
    06 Nov 2007

    Revelations about marketsWow, next you'll be telling us that people who announce stock market predictions are no better than darts thrown at a dart board.
  12. Steve Erickson Posted 12:57 pm
    06 Nov 2007

    They make more noise . . . when they hit it. "Ouch," they squeal!

    Steve E.

Add a Comment

You are not logged in. Thus, you cannot post a comment. If you have an account, log in. If you don't have an account, well, by all means go make one! Meet you back here in five.

Hello, Visitor!    Why not register?

Advertisement