The problem with measuring forecasting accuracy (flag)
www.hardballtimes.com — Monday, October 13, 2008 The problem with measuring forecasting accuracy Posted by Victor Wang at 1:02am David Gassko recently published an article on how various projection systems performed. I am not a big fan of these types of articles. This is not an attack on David or other ...

2 Comments
  • Derek Carty Derek Carty
    +1

    Great article, Victor.  There was actually a similar discussion going on at The Book Blog.

    I think it would be very intersting to see how these systems do on players who were projected to be below a certain level (replacement level, maybe?).  How many winded up receiving little playing time and how many went on to get a lot of it because they outperformed the projection?  I'm not sure of the best scientific way to go about this, there could be some factors you really might not be able to consider (managerial tendecies, etc.) and you could easily end up making some arbitrary benchmarks, but if done correctly, this type of thing would be really cool.

    Posted 10/13/2008 respond (flag)
    • Victor Wang Victor Wang
      +1
      Thanks Derek.  You're right that a better way  of measuring accuracy would to use a method that you describe.  However, actually doing something like that would be very difficult.  I too would like to see someone try something like that.
      Posted 10/14/2008 respond (flag)
Related Content
How Nate Silver Went From Forecasting Baseball Games to Forecasting Elections -- New York Magazine
nymag.com 10/14/2008 — I n a month when the Dow had its worst single-day plunge in over twenty years, when Lehman imploded, AIG faltered, and WaMu failed, when the word crisis became an everyday staple in newspaper headlines and the presidential race pulled close, then ...
I n a month when the Dow had its worst single-day plunge in over twenty years, when Lehman imploded, AIG faltered, and WaMu failed, when the word crisis became an everyday staple in newspaper headlines and the presidential race pulled close, then ...
Forecasting the 08-09 Bucks
basketball-statistics.com 10/23/2008 — Basketball-Statistics.com continues its previews of various teams. This time it's the Milwaukee Bucks, and the outlook doesn't look so positive.
Basketball-Statistics.com continues its previews of various teams. This time it's the Milwaukee Bucks, and the outlook doesn't look so positive.
Forecasting the 08-09 Warriors
basketball-statistics.com 10/20/2008 — Basketball-Statistics.com gives a nice analysis of what the Warriors did in the offseason and predicts how they'll look in the upcoming year.
Basketball-Statistics.com gives a nice analysis of what the Warriors did in the offseason and predicts how they'll look in the upcoming year.
Swift Head-Work and Accuracy in Passing the Ball
blog.cleveland.com 10/21/2008 — Cannot get enough of the "early days." And by early, I mean when Naismith was still telling people coaching basketball was a ridiculous concept. So there I was, reading back issues of The Free Lance (The Pennsylvania State University monthly...
Cannot get enough of the "early days." And by early, I mean when Naismith was still telling people coaching basketball was a ridiculous concept. So there I was, reading back issues of The Free Lance (The Pennsylvania State University monthly...
Brown's accuracy brings NFC honor
www.stltoday.com 10/30/2008 — Brown's accuracy brings NFC honor
Brown's accuracy brings NFC honor
Forecasting
www.hardballtimes.com 1/29/2009 — On Listening to the Experts (Part 1) Click the title to read more. Order the Hardball Times 2009 Season Preview today !
On Listening to the Experts (Part 1) Click the title to read more. Order the Hardball Times 2009 Season Preview today !