FanGraphs Baseball


RSS feed for comments on this post.

  1. David, how far back do you have WPA data available? If you have several years worth, you might try something like an auto-regressive (AR1) covariance matrix to find out what the intra-class correlation is. (For those who don’t know, this is a multiple observation technique that allows a more complete picture of how much correlation there is from year to year on an individual level.) If you like, e-mail me (I believe you can see my e-mail address from my post.)

    Comment by Pizza Cutter — April 10, 2007 @ 4:40 pm

  2. And you will find that WPA/LI will have even more predicatability.

    However, the big question, does “clutch” or WPA minus WPA/LI have predicability? You’ll likely get an r under .10.

    Comment by tangotiger — April 10, 2007 @ 4:58 pm

  3. Thanks David. I’ve been one of the guilty and have now seen the light.

    Comment by Erik — April 11, 2007 @ 2:43 pm

  4. WPA/LI for 2005 to 2006 was .36. For Clutch, it’s .01, as suspected.

    Comment by David Appelman — April 11, 2007 @ 8:16 pm

  5. Great, so WPA/LI and OPS are equally predictive.

    Comment by tangotiger — April 13, 2007 @ 9:20 pm

  6. I take it that the Clutch season-to-season correlation of .01 is significant evidence for the theory, in all of sabermetric history one of the most heavily debated, that the timing of hitting performance (to perform better in particularly advantageous moments) is not a “skill” in the sense that it is repeatable but rather is essentially random. It also suggests, I guess, that most of the season-to-season correlation for WPA, and its similarity to the correlation for OPS, is simply a reflection of the fact that most of WPA derives from overall hitting skill (reflected fairly well by OPS, pace tango), which we know is repeatable, and that only a small component of total WPA reflects timing issues. I still love WPAs, but not because they reflect some repeatable skill different from that already expressed by OPS and similar stats, but rather because they express important elements of the value of past player performance not already reflected in OPS and similar stats.

    Comment by birtelcom — April 15, 2007 @ 12:15 pm

  7. Exactly – if you were to control for a few player ability measures, such as ability to get on base or hit extra-base hits, WPA would have no predictive usefulness.

    Comment by Chris Constancio — April 15, 2007 @ 3:22 pm

  8. Right, the power of WPA is to tell you a particular story. At the end of the season, we’d be able to easily pick out the 20 PA that most influenced a real-life game. That’s its value.

    If you’re looking for “is he really better than that guy”, WPA has little, if any, competitive advantage over anything else out there.

    WPA should be treated for what it’s built for.

    Comment by tangotiger — April 16, 2007 @ 10:45 am

  9. The last three commenters get it right. In addition, WPA is so team dependent (not to mention inning dependent) that your going to get some significant correlation from year to year. Hitters on better teams, hitters who consistently hit higher in the order, are going to have higher WPA because the are more likely to hit in close games and hit later in the game.

    Comment by enoscountry — April 26, 2007 @ 2:18 pm

  10. I don’t feel like I have enough information to know whether WPA is a great predictor of future success, but I do think it’s the best outcome measure I’ve seen for assessing current-season-to-date success. That is, it may not tell me if a player is lucky or good, but it tells me who got good results.

    If anyone else buys into that, here’s what I’d like to know. What’s the best prior-year predictor of current-year-to-date WPA? Is it prior-year WPA or is it one of the other measures? I don’t care that much how well last year’s OPS predicts this year’s OPS if last year’s OPS doesn’t predict this year’s WPA.

    Comment by dpm — May 13, 2007 @ 12:10 am

  11. There’s no question that prior year OPS and prior year WPA/LI will predict current year WPA the best.

    I agree with your assessment that we don’t care about OPS-to-OPS predictability, but rather what in the prior years predicts the next year’s WPA, since what we are after is wins.

    Comment by tangotiger — June 7, 2007 @ 3:02 pm

  12. I think you’re probably right, but I’d still like to see the numbers. Maybe this is covered in an FAQ elsewhere, but is it possible to download a dataset that has each player’s WPA and some of the other key stats? I’d be happy to crunch the numbers myself if I had the data.

    Comment by dpm — June 23, 2007 @ 12:32 am

  13. @dpm (and TangoTiger)

    I realize this post is ancient, however, I think you are really asking the right questions and would love to know if there has been any follow up on this. (Particularly, what are the best predictors of WPA and related issues. Probably RE24 could also be in the discussion at this point.)

    Comment by zack — July 2, 2013 @ 12:36 pm

  14. by the way, i am zacksf, email

    Comment by zacksf — July 2, 2013 @ 12:38 pm

  15. I believe the OPS part, but I am skeptical about the power of WPA/LI to predict next years WPA. All those divisions by small numbers worry me. Do you have any numbers for correlations that support that assertion?

    Comment by zacksf — February 12, 2014 @ 12:58 am

Leave a comment

Line and paragraph breaks automatic, e-mail address never displayed, HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Current day month ye@r *

Close this window.

0.128 Powered by WordPress