Does it pay to play the match-ups with your SPs?

image
Jamie Moyer may be well past his prime and an afterthought in most leagues, but he can make for a great start in certain situations.(Icon/SMI)

Over the past week or so, there has been a lot of talk around the fantasy baseball world about whether or not it makes sense to play the match-ups with our starting pitchers. Does it do more harm than good? Is micromanaging worth the effort? Does it pay to sit a decent starter against the Yankees and play a poor one against the Astros? While the answer to this last question may seem like an obvious “yes” to some, others don’t seem to be convinced.

Here’s an excerpt from a recent Tim Dierkes post at RotoAuthority:

I have waffled over the years as to whether it makes sense to bench your starting pitchers occasionally if they’re facing tough offenses. I always seem to guess wrong. Tom Gorzelanny against the Pirates, that’s a must-start. But Gorzelanny in Citizens Bank against the best offense in the NL, especially against lefties—I’ll sit him. The result: I’ve danced around Gorzelanny’s best starts.

The philosophy I hope to abide by: If he’s good enough to be a permanent part of your roster, he should be active for all starts.

In his most recent newsletter, Baseball HQ’s Ron Shandler said this:

As much as we hate to admit it, doing match-up analyses has about the same rate of accuracy as tossing spaghetti. No matter what you do, you are going to have to weather occasional meltdowns and sterling performances from the bench.

Maybe the answer is simple. When it comes to aggravation in this game, we just have to live with it.

On the other side of the coin is RotoWire’s Chris Liss, who benched Ricky Romero in our CardRunners AL league this week due to match-ups:

Eric [Kesselman (co-commissioner of the league)] thought this was a curious decision and asked me to write about it. The short answer is that it was a gut call.

The longer answer is that [it was] based on the matchups…

Despite the fact that Chris and I landed on opposites sides of the Quants vs. Intuition debate, I’m on his side here. Read on.

The study

Tim Dierkes conducted a mini-study shortly after the above-quoted post and concluded that “if you are able to identify the ‘marginal’ starters correctly, as well as the offenses that will be the best all year, there is a small gain to be had over the long run. Season to season, with probably no more than two marginal guys on your regular roster, you’d probably have a lot of years where you wished you hadn’t benched any starters.”

I’m going to a run a study that goes a little more in-depth and comes to a different conclusion. The main question I wanted to answer was “Do pitchers perform better against poor offenses and worse against good offenses?

My study took data from 2004 to 2009 and compared how pitchers performed against good offenses and bad offenses. For the purposes of this study, “good offenses” are defined as the top four teams in year-end runs scored in each league (AL and NL). “Bad offenses” are the four lowest-scoring teams in each league.*

I then looked at all pitchers who faced at least one good offense and one bad offense and compared their starts against these teams in our four standard roto categories (W, ERA, WHIP, and K), weighted by the least of his starts vs. good offenses and starts vs. bad offenses.

*There are certainly problems here, as year-end stats don’t perfectly reflect our in-season opinions about teams, but I think it will be close enough to let us examine this match-up dilemma. Last year, for example, saw the Yankees, Angels, Red Sox, Twins, Phillies, Rockies, Brewers, and Dodgers make this list. Most of these are teams that were expected to be pretty darn good offensively.

May I Have Your Autograph, Please?
The payoff of being polite.

Results

The results of the study are below, showing the advantage of facing a bad offense over a good one.

+--------+---------+--------+--------+--------+
| IP     | Win/GS  | ERA    | WHIP   | K      |
+--------+---------+--------+--------+--------+
| + 0.34 | + 9.66% | - 1.10 | - 0.17 | + 1.12 |
+--------+---------+--------+--------+--------+

As you can see, there is a significant advantage to facing a poor offense over a good one. All else equal, if your starter gets to face the Astros instead of the Phillies, he’ll stay in the game for an extra out, strike out an extra batter, win an extra game every 10 starts, and have an ERA a full run lower. That’s a highly significant difference. It means that if you’re starting Ross Ohlendorf against the Indians, you might as well be starting Cole Hamels against an average opponent.

Now, of course, we must consider that this study knows who the good and bad offenses will end up being in any given year. In June, we don’t know with that kind of certainty who the best and worst offenses are. While we might not gain that full run ERA difference by playing match-ups (or streaming), I do think we’ll be close. After all, there’s a very high probability that teams like the Yankees, Red Sox and Rays are actually good offenses and the Pirates, Astros and Orioles are actually poor offenses. We just need to be selective. And the deeper we go into the season, the more certain we can be about playing match-ups.

Finally, we must realize that this study deals with the extremes. We’re not always going to be faced with the decision of Ian Snell against the Rays or Joe Saunders against the Mariners (where we’d obviously take Saunders). Mediocre teams will be in the mix, and decisions will be made a little tougher. The important thing to remember is that everything should be taken within proper context and all situations analyzed individually.

Wrapping up

There are, of course, other things to consider when deciding whether to insert a pitcher into your active lineup (ballpark, weather, home/away, opposing pitcher, etc), but there should no longer be any question whether there’s an advantage to playing match-ups. There is. And honestly, isn’t that the logical answer? Shouldn’t we expect that pitchers perform better against poor teams?

Sure, occasionally you’ll end up with Dallas Braden perfect-gaming the Rays or Brett Anderson giving up six runs to the Orioles. That’s the nature of small sample sizes. It’s no different than Albert Pujols going a week or two without a home run. And if that happens, we’re not suddenly going to declare chasing power a fool’s errand, are we? As with all small samples, extreme random variation is a possibility, but in the long run, things even out. In the long run, you’re far better off playing the match-ups. They won’t all work out as expected, but when you add them all up at the end of the year, you’ll come out ahead.

Concluding thoughts

My main point can be summed up very easily: play the match-ups! While some may be convinced that it’s a crap shoot, it’s not. In the movie Rounders, Matt Damon’s character muses about a similar phenomenon:

In Confessions of a Winning Poker Player, Jack King said, “Few players recall big pots they have won, strange as it seems, but every player can remember with remarkable accuracy the outstanding tough beats of his career.” It seems true to me, cause walking in here, I can hardly remember how I built my bankroll, but I can’t stop thinking of how I lost it.

It’s easy to recall the time a spot start blew up in your face, but the marginally good match-ups are easily forgotten. They all count, though, and in the long run, playing the odds is the way to go.

Finally, I ask that you please not comment to tell me that it’s obvious that a pitcher does better facing a poor offense. To me (and likely to many others), it is obvious, but when other analysts—particularly ones as well-known as Ron Shandler—are doubting it, I thought it best to put some concrete numbers out there.


Print This Post
Sort by:   newest | oldest | most voted
Oscar
Guest
Oscar
What are your thoughts on the following scenario: Josh Johnson @ Philly tomorrow vs Halladay Of course, Johnson is a beast but is it worth the risk to start him against a good offense when the win probability is low?  I started him against Philly his last outing since Philly was slumping and it was in Florida but even though he only gave up the unearned run it was a loss thanks to the perfect game.  Do you think it’s foolish to even consider benching him at Philly vs Halladay?  Even with his last great outing against Philly, Johnson is… Read more »
JB (the original)
Guest
JB (the original)

You don’t mention it, so can I assume that your league does not use Quality Starts as a category?  If your league did, how would that alter (if at all) your methodology?  Would you still play the same match-ups, maybe play more great pitcher against good teams?  Only go with high “K” guys in more marginal match-up choices to at least better the odds in other categories?

buck turgidson
Guest
buck turgidson

I play the matchups when it comes to borderline starters.  But elite pitchers need to be in the lineup every start.  Even if they have been faltering.

D.Diaz
Guest
D.Diaz
Love the site, loooove this topic. I totally fall under and advocate the match up camp.  If you are truly on top of all relevant stats and related factors, you can have fairly good success ratio with matchups.  Three years ago I took over an expansion team in a loooong running keeper league.  Team had absolutely zero pitching, and good hitting.  I spot started my way to top three ERAs and WHIPS and made it to the finals (lost – dammit).  It was without a doubt the most enjoyable fantasy baseball experience I’ve ever had, more so then when I’ve… Read more »
Chris
Guest
Chris
I sat Masterson vs the Yankees figuring that the Yankees are lefty heavy (with lots of switch hitters) and in New York with that short porch in RF Masterson would be forced to commit ritual suicide after the game. He pitched 6.2 IP 7 H, 1 BB, 3 ER, 8 K’s and got the ND. a 4.05 ERA isn’t stellar, but man I could have used those K’s and that 1.20 WHIP. I just can’t seem to wrap my head around it even now that he was affective and got a QS vs the Yankees in New York given his… Read more »
Alex
Guest
Alex
I’m totally in the ‘play the matchups’ camp, but there’s something in your results that doesn’t past the ‘smell test’.  If our guys are getting an extra 3 innings pitched against a worse offense, how they heck are they only striking out one additional batter?  Even aside from that, the extra 2.8 innings sounds fishy.  I doubt the average start averages less than 5 innings pitched against the good offenses.  That would mean that they’re averaging almost 8 innings pitched against the bad offenses.  That sounds implausible.  I suspect something is wrong with that IP number…maybe it should be a… Read more »
Klatz
Guest
Klatz

You need to put in the confidence intervals.  Even if on average you get an advantage if there’s so much variation it’s not going to matter with the sample size you’re talking about.  In a single season, it’s going to be about 10-15 starts that are against poor offenses.  Even then you might limit the benching to the poorest of the poor.

Derek Carty
Guest
Derek Carty
Don’t I feel silly.  Thanks, Alex, for pointing that out.  I forgot to use a denominator for IP.  It should be roughly 1/3 of an inning extra for starts against bad opponents.  Everything else stays the same.  It’s been fixed in the article.  I originally assumed that maybe you only got 4 IP vs good opponents and 7 IP vs bad opponents or something like that. Klatz, I’ll look into getting some confidence intervals later tonight.  I’m not sure we’re dealing with just 10-15 starts, though.  If you designate 6 spots on your team for SPs and get 32 starts… Read more »
Derek Carty
Guest
Derek Carty

Oscar,
Unless you’re in a really shallow league, I’d play him.

JB (the original),
Quality Start per Game Started percentage would get a + 10.8 on the chart in the article.

Chris,
That kind of thinking is exactly what I was trying to discourage with this article.  Sure, over a two start sample you can see weird results, but if you are making 100 start/sit calls in a year, in the long run you’re going to be better off making them than simply riding it out.

phil
Guest
phil

i sat cliff lee in texas last nite based on historical numbers, and that one bite me in the behind…I guess play all your top tier guys in any situation, and spot start everyone else, that’s my strategery

Toffer
Guest
Toffer
I think a simplified log5 calculation would work decently to figure out whether to start or sit a player. If you divide an opponent’s wOBA by league average and then multiply by your starter’s ERA I think you should get a rough approximation of the starter’s expected ERA. For example, James Shields’ ZiPS RoS projection is 3.95, the Yankees current wOBA is .359 (ideally we would use a projected wOBA rather than season to date but this will do)  and league average is ~.333. (359/333)*3.95 = 4.26. I haven’t done all of the math but I would be surprised if… Read more »
RotoScoop.com
Guest
RotoScoop.com

A real quick and dirty way to help make these decisions is to simply use the Vegas odds on a given game (it’s also helpful to look at the O/U too). But yeah, Dierkes’ stance on this sort of baffled me when I read it. Nice to see some real data to back up my innate thoughts (and actions).

3FingersBrown
Guest
3FingersBrown
Great article Derek. I play matchups more often in h2h rather than roto, since the week’s scoring situation often dictates my strategy. I have played matchups more in my roto league this season however, perhaps because I feel I’ve gotten better at identifying ‘good’ and ‘bad’ starts. Like others have said, I usually will throw my top starters against just about anyone, but keep my last two pitching spots for streaming spot starters based on matchups. I picked up Hammel this week in hopes of getting a win against Houston but figuring I’d probably bench him at Toronto. Worked out… Read more »
Eric Kesselman
Guest
Eric Kesselman

For the record, my point with Chris Liss’s benching of Romero wasn’t that it was wrong to play match ups, but that it surprised me that he didn’t heavily shop Romero around before doing so. I don’t like to see value wasted on the bench.

Also, the Cr league uses two week long periods largely to discourage excessive decision making based on match ups.

Derek Ambrosino
Guest
Derek Ambrosino

Nice piece, Derek.

I assume handedness could be a relevant consideration too. For example, Philly may be a worse match-up for a B-level righty than a C-level lefty.

Derek Carty
Guest
Derek Carty
Alright, Klatz, I’ve got some intervals here, based on this methodology: http://en.wikipedia.org/wiki/Weighted_mean#Weighted_sample_variance +———+———-+————-+————————————-+ | Stat | StDev | Mean   | 95% Confidence Interval | +———+———-+————-+————————————-+ | IP   |  0.12 | + 0.34 |      + 0.23 to + 0.46 | | W%  |  3.7% | + 9.66% |    + 5.94% to + 13.38% | | ERA |  0.61 | – 1.10 |      – 1.71 to – 0.49 | | WHIP |  0.08 | – 0.17 |      – 0.24 to – 0.09 | | K   |  2.19 | + 1.12 |   … Read more »
Ron Shandler
Guest
Ron Shandler
Derek… Interesting analysis, but I have a few comments. First, could you validate the following two assessments and comment on them? 1. According to your study, 47% of the time, our starters will be facing teams that are not among the top 4 or bottom 4 in offense. So nearly half the time, the percentage play for playing matchups would be far more dubious. 2. At the time when we make these match-up decisions (particularly early in the season, but really any time works), we do not know which teams are among the top or bottom offensively, and those rankings… Read more »
Derek Carty
Guest
Derek Carty
Thanks for commenting, Ron.  You’re absolutely right on both points. 1) I made note of this in the final paragraph of the “Results” section: “Finally, we must realize that this study deals with the extremes. We’re not always going to be faced with the decision of Ian Snell against the Rays or Joe Saunders against the Mariners (where we’d obviously take Saunders). Mediocre teams will be in the mix, and decisions will be made a little tougher. The important thing to remember is that everything should be taken within proper context and all situations analyzed individually.” In many cases, playing… Read more »
Jason B
Guest
Jason B
Derek— I’ve been trying to play the same matchup game with my OF/util slots in a mixed league; we only play 3 OF and 1 util, so I’ve kept Ethier and Justin Upton in two of the OF slots and have been rotating Jay Bruce, Brad Hawpe, Garrett Jones, and/or Adam LaRoche among the other OF and UT slot.  Keeping a careful eye on home/road and L/R splits in trying to set those slots, as well as the quality of the opposing pitcher. After a month of toying and tinkering, it’s been painfully disastrous and is giving me (even more)… Read more »
wpDiscuz