I suggested this in the comments to your piece last week, but it’s more on-topic here. If we’re going to use some system to rank free agents for compensation purposes [separate debate], why do we even need to use statistics? Why not just use his actual market value?
That is, something like: a guy signs a contract over $30M and he becomes a Type A, between $10M and $30M and he becomes a Type B, and between $5M and $10M and he becomes a Type C.
Or alternatively, come opening day, rank all of the offseason’s free agent signings according to the size of the contract, and make the top 15 guys Type A’s, the next 15 Type B’s, and the next 15 Type C’s.
I arbitrarily picked the numbers, and you can adjust them so that the appropriate number of players fall into each box. Or come up with any number of variations.
But such a system would eliminate the disconnect between a player’s ranking and his actual market value. The result would be that teams couldn’t game the system to collect picks, and individual players wouldn’t have their salary artificially deflated because of their ranking.
Comment by Yirmiyahu — November 15, 2011 @ 11:36 am
I have been preaching that Elias should use money as the measuring stick to determine compensation. Actually, you wouldn’t need Elias, or much of any formula. Use the average annual value of the contract that the free agent player signs with his new club. After all, that IS his value, and that is the reason that his former club should be compensated for losing the player. They’ve lost a player worth X amount of money, so they should receive a corresponding amount in compensation, though not full value in raw dollar terms.
If a Type A player is defined as one in the top 20%, then take the top 20% of MLB salaries, and any player making above that amount is a Type A free agent. If his club offers arbitration and he signs elsewhere, the club gets a draft pick in Round A- or two picks, however the formula works. Position doesn’t matter. If the market values players at certain positions higher than others, that will be reflected in the rankings.
Comment by tigerdog1 — November 15, 2011 @ 11:37 am
Thank you Mario! But our Type A Free Agents are in Another Castle!
I think the idea of using a player’s market value to determine compensation is a very good idea, so long as the compensation is not taken from another team – the comp should be in some sort of sandwich round, where no team is directly penalized. Also, I think that all ordinal ranking are inherently flawed. It assumes that all players over a certain threshold are of equal value. When you rank players, you don’t take into account the margin between each player, only that playeri >playeri+1. I think this also needs to be addressed.
Out of curiosity, which 2 C, 4 1B/OF/DH, 2 2B/3B/SS, and 2 SP are Type A per Elias but not per your WAR criteria?
Comment by reillocity — November 15, 2011 @ 11:48 am
I third the call to rank players according to the value of their contracts.
There is no reason to replace one flawed statistical evaluation with another flawed statistical evaluation. WAR obviously overrates defense and underrates many relief pitchers relative to the market. The fact that according to WAR many teams overpay relief pitchers does not change the fact that your team lost a relief pitcher to a team willing to pay him a lot of money.
Where does the AAV vs total amount trade-off come into play with this system? Do we just average out the contract total and ignore what the player is actually getting paid that year? What about team/player/vesting options?
I like this idea in theory, but there are going to be ways to pay players but game the system (just like with taxes!).
Comment by Food For Thought — November 15, 2011 @ 12:38 pm
I am loving the use of Mario sprites on this site recently.
I say total guaranteed contract. You could do total guaranteed value divided by total guaranteed years (i.e., AAV), but I think using AAV would overvalue certain older players who are good but seen as too risky to give long-term contracts to (like Oswalt and Ortiz this year).
As far as options and incentives, it’d be a minor problem if teams tried to use them to game the system, but I think that issue infinitely pales in comparison to the problem of using the Elias system or WAR or any other statistical-based system.
Comment by Yirmiyahu — November 15, 2011 @ 12:50 pm
Disagree. Suddenly we’d see guaranteed contracts at league minimum and $15m incentives that kick in at 3 PA or 1 IP.
I suppose the system will never be able to perfectly evaluate players (if so, give us that stat Elias!), but the money system is just too easy to game. At least with some measure of past player performance, you are not affecting a player’s value based on… well… his value. The system you proposed will dampen the high end salaries while raising the low end ones. That is NOT a direction you want a league to go (see: NBA).
Really I just don’t think that teams should be compensated for losing free agents, but that’s another story.
Comment by Further Food For Thought — November 15, 2011 @ 1:29 pm
Comment by making money the measuring stick — November 15, 2011 @ 3:52 pm
“$15m incentives that kick in at 3 PA or 1 IP”
Here’s a way around this problem. Look at the last N years of the player’s performance and count the fraction where the player has reached those incentives as a part of the AAV of the contract.
Let’s say a team signs Erik Bedard to an incentive laden contract which pays a $1M bonus at 75 IP and $1M for every 25 additional IPs up to 200. Let’s arbitrarily pick N = 3. In the last three season, Bedard has pitched 83, 0, and 129 innings. This system would give him a 2/3 chance to reach 75 IP, a 1/3 chance to reach 100 IPs and 125 IPs, and no chance to reach 150 or more IPs. So add $666,667, $333,333, and $333,333 to the guaranteed AAV of the contract.
Yirmiyahu almost read my mind. I was thinking more along the lines of which poor bastards, if free agents, would likely only be signed by a team picking in the first half of the first round, since said club would part with a 2nd round pick rather than a 1st round pick (at least until the free agent draft compensation pick system gets blown up). I guess Cuddyer and Ramon Hernandez fit that description this offseason.
Comment by reillocity — November 15, 2011 @ 6:36 pm
I don’t understand why the total ranked players is different between Elias and FanGraphs. For example, why are there 26 more SP’s in the exclusively blue section than in the exclusively red section. Shouldn’t the total number of players ranked be the same?
The only explanation I can think of is that 26 more FA SP’s are ranked in the top 20% of all SP’s, but that seems like a large enough number to question whether or not the qualifications for the two lists are the same.
There “should” be the same number of players in the red circles as there are in the blue circles. If you add up the number of players in red you get 176 and if you add up all the players in blue, you get 169. This discrepancy is due to rounding errors, but keep in mind there are over 900 players in my sample so that both groups have close to 20% of the sample.
So did you just take the top 20% of all players regardless of their positions to find which players should qualify for Type A under WAR? Elias takes the top 20% based on positional grouping I believe. So wouldn’t that be the reason why the blue circles don’t equal the red circles in each Venn Diagram? Your essentially just kicking the relief pitchers out of type A and adding more players at every other position to Type A. Is that correct?
The first round rankings are done by position (as explained in the post), then the positions are aggregated and the top 20% of the entire league is labeled type A. That is not the same as taking the top 20% of each position. And yes, I just took the top 20% of WAR for all the players eligible to create my WAR ranking. If you did it by position where the top 20% of each group by WAR was a type A you would encounter the same problems as Elias – RPs would be way overvalued, Catchers would be overvalued as well, but to a lessor degree.
I am the Yankees. I want to tank another team. I pay some scrub $30 million because I can afford it. They are treated as Type A. I sit them on the bench all season to play someone else that I bought for less.
Is it possible that good defensive catchers are undervalued by WAR? It seems like there’s more room for hidden value at that position than anywhere else, because their defensive role is so complicated and because of their effect on the pitching staff. But that’s not really a problem with the article, just something I thought about when he said catchers were overvalued.
Wait, what? First of all, if the Yankees did this, they’d be giving the other team a draft pick. How does that qualify as “tanking?” Second of all, even the Yankees don’t have unlimited money. They’re not going to pay a scrub some absurd amount of money just to spite another team.
There are ways to cheat the proposed system. This isn’t one of them.
I completely agree, I think a catcher’s true value is not completely captured by WAR (though most of it probably is). I think looking into catcher values would be an interesting future post. Thanks for the comment.
My biggest problem with WAR is that I have no idea how it’s computed, and I seriously doubt you can have one stat measure everything. It’s kinda like the NFL’s quarterback rating, but at least they show out that’s computed on the NFL website. And once you learn how to compute the quarterback rating, you realize you don’t need it. It basically mirrors touchdown-to-interception rate. What’s more, you can actually compare a team’s winning percentage with a certain player as opposed to without him, and figure out an actual “wins above replacement” rate without the complicated formula.
Total max contract value, including ALL incentives + options would be the best way to go if this system was used.
But if you do this then there would be tons of contracts given out to players just below whatever threshold is established for each level. And those thresholds would then artificially impact the market rate for players, which is what were trying to avoid in the first place.
No matter how you compensate/punish teams for signing FA’s, there will always be drawbacks and ways to manipulate the system