A Reality Check From the Draft Hype

The major league draft has come a long way in terms of coverage. In this age of twitter and blogs, we get more and more information on these prospective major league players than ever before. We also have seen two of the most hyped players in draft history set to go in consecutive years. Steven Strasburg received an insane amount of hype and continues to do so, while Bryce Harper made the cover of Sports Illustrated as a 16-year-old kid.

Around this time we begin to see mock drafts, hear rumors and get all sorts of pre-draft hype leading up until draft day. That’s all fine and good, and I’m not here to rain on anyone’s parade, but we need to counterbalance some of the draft hysteria with a healthy dose of reality.

Using Rally’s historical WAR database, I compiled the WAR figures for every player drafted in the first round in the 1990s. I only compiled the WAR totals for the player’s first six years of major league service, or in other words, his team-controlled years. Teams benefit the most when the player is a relative bargain, not when he’s being paid what he is worth on the free agent market. There’s many different angles we can look at with the data I put together, and maybe we’ll look at some later, but for now I just want to take a look at the attrition rates to help sober us up from the draft prospect propaganda.

-63.4% of first rounders busted, or produced between zero and 1.5 WAR.

-12.9% of first rounders produced 1.6 WAR and 6 WAR. These would be your role players; that is, your middle relievers, bench players.

-12.9% of first rounders were worth between 6.1 and 12 WAR. These are, but are not limited to, your starters on the fringe to average regulars.

-5% were worth between 12.1 and 18 WAR, 6.8% were worth 18.1 WAR or greater. That grouping includes some of today’s stars; Alex Rodriguez, C.C. Sabathia, Roy Halladay, Manny Ramirez and *ahem* Jason Kendall.

(Once upon a time, Jason Kendall was pretty awesome.)

So that’s about three-quarters of all first rounders failing to live up to the hype. Every team envisions their first round pick as a fixture in their every day lineup or pitching rotation, but the odds are they produce little to nil in the big leagues. I do not envy the job of the scouting director; it’s a job where you swing for the fences but often come up empty. On the other side of the coin, the payoffs can be huge for the ones that do pan out.

Print This Post

Erik Manning is the founder of Future Redbirds and covers the Cardinals for Heater Magazine. You can get more of his analysis and rantings in bite-sized bits by following him on twitter.

14 Responses to “A Reality Check From the Draft Hype”

You can follow any responses to this entry through the RSS 2.0 feed.
  1. GZ says:

    Good stuff… It’d be interesting to see the correlation between pick (1-30) or bonus paid and WAR.

    Vote -1 Vote +1

    • Aaron/YYZ says:

      If you can find a copy of BP’s Baseball Between The Numbers, there’s a whole article on that subject. The short version (from memory) is that there’s a relatively smooth curve of rapidly declining value as you go from the 1st overall pick to the 30th pick. #1 overall draft picks on average do produce more value than any other player in their draft.

      Vote -1 Vote +1

  2. Craig says:

    This analysis evaluates a number 30 pick and a number 1 pick in the same way. Are all first rounders created equal?

    Vote -1 Vote +1

  3. John says:

    I’d like to see this correlate to the bottom half of the first round/supplemental picks such as teams get for Type A free agents. You always hear fans of a team say that they’ll just “take the draft picks” rather than take a couple of good prospects who have had success at higher levels. What are the odds that these picks become good players? How many of them become 12+ WAR players as compared to those that become busts or average players? It’d be interesting to know on average whether it’s better to take good prospects (as opposed to the team’s elite prospects, since we know it’s a no-brainer to take two of a team’s best prospects) or the draft picks. Of course, you’d have to define what a “good” prospect is, what level (AA, AAA, etc.), and other factors so it’s probably a little complicated, but it would seem to me that would be a very valuable tool for GMs.

    Vote -1 Vote +1

    • Mike says:

      That would be interesting, but the player being traded also needs his value for that time period kept in the calculation too.

      Vote -1 Vote +1

  4. jimn says:

    we don’t have any jason kendall types in pittsburgh anymore. he inherited the working man’s torch from van slyke. garrett jones is the closest we’ve got at this point, but just not the same. cutch and pedro could make that bottom bullet point, but they come from the school of stardom, not the workhorse school of van slyke and kendall.

    Vote -1 Vote +1

    • Brett says:

      Kendall picked 23rd overall in ’92. Not exactly from out of nowhere.
      Van Slyke was the 6th overall pick in ’79 draft.

      Vote -1 Vote +1

  5. adam says:

    It would be fascinating to see the rates broken down by team, too. You always see e.g. Oakland lauded for their talent evaluation and minor league systems, but there are never any numbers.

    Vote -1 Vote +1

  6. Marc says:

    I’d be very interested in whether this has been changing over time. Has drafting and scouting improved from 10 years ago, indicated by an increasing correlation, or are we still just as (in)accurate in guessing how each person will do?

    Vote -1 Vote +1

  7. Red Sox Talk says:

    Erik, thanks for reminding us quantitatively what prospects are worth, even really good ones. I did something kind of similar a few years back using BA’s top 100 prospects lists, though I didn’t use WAR at the time:

    Vote -1 Vote +1

  8. Red Sox Talk says:

    Some other good work that’s been done on this topic:

    Victor Wang at THT (2/09):
    Part 1: Draft pick values by tier

    Part 2: College and high school players

    Alex Pedicini at THT (2/10):
    Breakdown by round, college vs HS, and position

    Vote -1 Vote +1

  9. Ryan says:

    Adam -
    I put together the results for each team…

    The top 3 were the Jays, Mariners and Red Sox while the 3 worst were the Giants, Dodgers and… Royals (surprise?).

    The A’s were among the top 5 thanks to Chavez, Mulder and Zito, but just based on their first round picks it wouldn’t be prudent to draw any generalization about their ability to draft and develop players

    Full list can be found here: http://www.realclearsports.com/blognetwork/mlb_insights/2010/05/how-well-did-your-favourite-team-draft-in-the-90s.html

    Vote -1 Vote +1

  10. I wrote about this a long time ago: http://sfgiants.scout.com/2/343576.html

    I’m glad that more recent studies using better available data still validates my overall conclusions.

    That is something that most people miss, which is that the odds of a first rounder working well is pretty bad.

    Another conclusion that I covered was that the odds of success in selecting a good player was exponentially better between the top 5 picks and the last 10 picks of the first round, basically the picks that playoff or near-playoff teams got in the draft.

    The difference (roughly 4X) is significant enough to suggest that winning teams have a real disadvantage versus losing teams in terms of rebuilding via the draft, and thus why playoff teams have regularly signed players who had higher first round talent but had fallen due to signability issues. I would like to see this data sliced up that way.

    This is also why comparing how teams did in the first round is a useless exercise for the most part because of the low probabilities involved for the latter picks. At roughly 12% probability (sum of top two above) of finding a good to great player (main reason people interested in the draft), after 5 picks there is still over 50% chance of coming up with no good player selected. And even after 10 picks, there is still nearly a third chance (28.5%) that a team ends up not selecting a good player, simply from random luck.

    Winning teams find little success in drafting in the back of the first and thus had to adjust and sign those considered unsignable in a later round. The Giants appear to have started that trend with their signing of Travis Ishikawa in a much later round for roughly first round money, and teams have moved up until now teams regularly select prospects who fell due to signability issues in the late first round.

    In addition, the teams who are considered successes tend to be those who had those early picks, like the A’s. Because they were losers at that time. Compare that with how well the A’s did during the Moneyball draft and subsequent drafts, when they were winners, to see the difference. Same guy and organization, much different results.

    Lastly, I would add that my categorization methodology is probably a better way to analyze the draft than comparing by WAR. It is not like teams can control how good a WAR their best players picked are, it is a crapshoot just to find one, let alone the best one. So saying that one team has the most WAR does not mean anything if they lucked out and selected the player who happened to generate the most WAR.

    Basically, the categories here are like the ones I chose. Above 18 WAR are the stars. 12.1-18 WAR are the good players. 6.1-12 are the useful player. 1.6-6.0 are the marginal players. And 1.5 and under are the busts (I was kinder and used “The Rest”, but it is what it is).

    They seem kind of pre-selected though, so I think it would be better to go through the list and create ranges that holds together better as a methodology, whether you use standard deviations (say, what was the mean WAR anyhow?), look at how the data grouped together, or whatever (I defined statistical levels plus playing/usage time standards).

    Though I must say that the splits here are roughly like what I found for the first round, so perhaps I’m being too picky about this.

    Another good study of the draft, using BP’s VORP, was by someone on Son Of Sam Horn’s blog-site a few years back.

    Vote -1 Vote +1

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Current day month ye@r *