The Quality of Opposition Factor in the AL Cy Young Race

The AL Cy Young race has gotten pretty interesting. A month ago, Max Scherzer looked like a near lock, with his glistening 19-1 record and strong peripherals that supported the idea that he’d pitched like an ace this year. However, he’s gone 1-2 with a 4.66 ERA in his last five starts, perhaps opening the door for voters to take a closer look at all the candidates. And when they’re investigating, they just may find that the difference in quality of competition is a pretty significant factor this year.

For example, let’s look at the competition effect for Scherzer and Chris Sale. On first glance, you might think that there wouldn’t be a huge difference here, since both pitch in the AL Central and face a lot of common opponents. However, breaking down their starts by opposition reveals some striking differences. The following table lists their opponents in common first, then the teams that they faced that the other did not.

Opponent Scherzer Sale
Cleveland 4 4
Houston 2 2
Kansas City 4 3
Minnesota 2 2
New York Mets 1 1
New York Yankees 1 2
Oakland 2 2
Tampa Bay 2 2
Texas 1 2
Toronto 1 1
Seattle 1 1
Opponent Scherzer Sale
Chicago White Sox 5 0
Boston 2 0
Baltimore 2 0
Philadelphia 1 0
Opponent Scherzer Sale
Detroit 0 5
Anaheim 0 2

Among the teams in common, there aren’t many major differences. Scherzer got one extra start against the Royals, and Sale drew the Rangers one more time, but by and large, they basically matched up pretty similarly in teams that both pitched against. However, when it comes to the teams that one faced and the other did not, the story gets a lot different.

Both Scherzer and Sale have managed to draw five starts during the series in which their teams play each other. For Scherzer, that means five starts against the worst offense in the American League, as the White Sox have scored just 3.7 runs per game this year; for Sale, that means five starts against the Tigers and their 5.0 runs per game offense. This is one of the hidden advantages of pitching on a good team that inflates a pitcher’s W-L record: not only do you get the benefit of run support in helping decisions swing your way, but you never have to face your own offense, lowering your overall quality of competition at the same time.

Nowhere is this don’t-pitch-against-teammates divide larger than with Scherzer and Sale, as Sale essentially was selected out of facing the most feeble AL line-up, while Scherzer wasn’t forced to have a single confrontation with Miguel Cabrera or Prince Fielder this year. Having good hitters on your team doesn’t only get you more runs when you’re pitching, but makes it less likely that you’re going to give up runs, since that’s fewer good hitters you have to face yourself.

For the record, Sale was absolutely brilliant against the Tigers this year, giving up just 10 runs in those five starts, and throwing 39 innings in the process, so it will be tempting for some to wave away this difference as only theoretical, since all those extra starts against Detroit didn’t drag down Sale’s numbers. But by doing that, we’re marginalizing the very best performances Sale had all season, where he shut down an elite line-up and nearly averaged a complete game each time out. We should not just ignore Sale’s dominance against tough competition because he managed to overcome it rather than get beaten down by an offense that regularly beat down lesser pitchers.

For reference, here are the seven pitchers who currently have an RA9-WAR of between +5.5 and +6.5 — using RA9 instead of FIP because this is the pool that voters will likely consider — and the average runs scored by their opponents, per Baseball Reference’s calculations:

Pitcher Opponents RA9
Chris Sale 4.54
Yu Darvish 4.46
Hisashi Iwakuma 4.42
James Shields 4.36
Max Scherzer 4.30
Bartolo Colon 4.29
Anibal Sanchez 4.27

Not surprisingly, we see the two Detroit pitchers near the bottom, with the Oakland A’s — 4th in the majors in runs per game — represented at about the same level, while the pitchers on teams with less effective offenses have each faced teams that have averaged about two-tenths of a run more per game.

This isn’t a large enough factor to be the deciding reason to pick one AL Cy young candidate over another, but the reality is that this race is really about splitting hairs, at least for voters who won’t put much or any weight on win-loss record. These guys have all pitched well this season, and there isn’t a huge separation between the pitchers at the top of the pack. There are a variety of candidates with arguments in their favor, and I wouldn’t say that Sale should win simply because he drew five starts against the Tigers.

It should be a factor, though. This is basically the same thing as a park effect, and it’s pretty well established at this point that a pitcher who posts a 3.00 ERA in Texas was more valuable than a pitcher who put up the same number in San Diego. We could essentially lump this difference in with park factors and refer to them in total as degree of difficulty, since opposing hitter quality affects the value of a raw number in a similar way to a park effect.

In a close race, this isn’t something that should be overlooked. And this year, it is a close race, even with Scherzer being the only pitcher to notch 20 wins. Sale and his 11-13 record are unlikely to get serious consideration, but he’s had a great season, especially once you factor in the schedule he’s had to face.



Print This Post



Dave is the Managing Editor of FanGraphs.


Sort by:   newest | oldest | most voted
chuckb
Guest
chuckb
3 years 1 day ago

Is your table for RA/9 weighted by number of games against those opponents or does each opponent count equally?

I’m not that familiar with B-R’s numbers since I spend so much time over here.

chuckb
Guest
chuckb
3 years 1 day ago

I should add that this is really interesting stuff. I would like to see if Fangraphs could come up with some version of its numbers that includes the quality of competition. It would be great (though I know it would be a humongous task) to be able to compare players by the level of competition they faced, especially if it could be done by player rather than just by team.

In other words, a certain hitter faced pitchers who combined for a FIP of … and a pitcher faced hitters who combined for a wOBA of (whatever). It doesn’t all even out, which I think is Dave’s point here.

Supertom
Guest
Supertom
3 years 1 day ago

I’ve had this idea before (adjusted batting metric based on quality of pitchers faced) but sadly in my situation I do not have the ability to obtain and manipulate such specific/tedious data. I would love to see results anybody finds. I became stuck on how to determine the quality of the pitcher faced. Would it be to look at each pitcher’s FIP in that game, or 1 start before and 1 after, or 1 half of the season?

pft
Guest
pft
3 years 1 day ago

This is available in BP’s stat section they look at OPS of the hitter for pitcher and pitcher for hitter. Scherzer for example has the lowest opposition OPS of any AL pitcher with 150 IP, 731 IIRC

A bookie
Guest
A bookie
3 years 1 day ago

Yeah, get on that.

Rex Manning Day
Guest
Rex Manning Day
3 years 1 day ago

“We could essentially lump this difference in with park factors and refer to them in total as degree of difficulty, since opposing hitter quality affects the value of a raw number in a similar way to a park effect.”

Confirmed: Degree Of Difficulty coming to Fangraphs custom leaderboards by next season.

Oh, Beepy
Guest
Oh, Beepy
3 years 1 day ago

Your username is among the best I’ve seen.

dave k
Guest
dave k
3 years 1 day ago

I know Scherzer gets all the attention, but I think Sanchez deserves it more. If it wasn’t for his midseason injury I think he’d be getting a lot more attention.

Bip
Member
Member
Bip
3 years 1 day ago

I know (player with a lot of wins) gets all the attention but I think (player with fewer wins but better peripherals) deserves it more.

There’s going to be quite a few of these every season until Mr Brian Kenney succeeds in his crusade.

dave k
Guest
dave k
3 years 19 hours ago

When you put it like that you make it sound like Scherzer’s wins are all luck but that’s not really the case…his peripherals are quite good too and on par with the other contenders.

To Kevin’s point below, had Sanchez been able to rack up more innings while maintaining the same level of performance I think he’d be in (and perhaps leading) the conversation. Same goes for Felix. Innings matter.

Kevin
Guest
Kevin
3 years 1 day ago

That injury really kinda hurt his chances. 27th in Innings pitched. His numbers have been incredible when he’s healthy. But missing almost an entire month is a tough sell especially when other pitchers have done pretty well.

When trying to win a Cy Young, don’t miss all of june.

Tim A
Guest
Tim A
3 years 1 day ago

I think WaR is unfair to Oakland pitchers. From what I can tell they have an entire team built too beat FIP. Is there going too be some park factor sort of adjustment? All season long this team has beat the xFIP by a mile, and knowing Beane I would surmise that is not an accident, so will pitchers continue getting dinged on WaR totals, simply because they play for a team thats philosophically against traditional pitcher metrics for success?

Spit Ball
Guest
Spit Ball
3 years 1 day ago

Lots of foul ground generally helps pitchers more than hitters.

Spit Ball
Guest
Spit Ball
3 years 1 day ago

Sorry Dave, didn’t mean to double up on your comment, It was not there when I entered it but the clock says you beat me to it.

Kyle
Member
Kyle
3 years 1 day ago

This is offtopic of course.

Having the lowest HR/FB rate in the AL could have more to do with how you build your stadium than how you build your team. Having the lowest BABIP in the AL could have something to do with defense. I think those are reasonable justifications for “dinging” A’s pitchers. They didn’t do that.

Tim A
Guest
Tim A
3 years 1 day ago

-13D as a team this year why does everybody keep saying the D did it? Either they have better D then the system says, or they are being hurt by the defense not helped, get it straight people.

Nathan
Guest
Nathan
3 years 16 hours ago

I’m not sure what “-13D” refers to. I’m not seeing any team fielding numbers like this for the A’s.

In any case, this isn’t a zero-sum situation. The defense’s UZR (or whatever number you’re looking at) does not have to be an exact compliment to the pitching staff’s RAR/WAR. Your view that it’s “one or the other” is a false dilemma.

My feeling is that the mistake you’re making in your thinking that leads you to this false dilemma is that you’re not consciously considering that the statistics you are citing are context-neutral. The purpose of statistics that measure the value of a player is to give us a context-neutral assessment of what a player did, because with very few exceptions, no player can control the context of a situation that he’s put in on the baseball field.

When you add in the context (e.g. runners on when this catch was made, empty bases when that strikeout happened), then you get the stuff that causes the value measurements to appear as if they are “wrong” because they don’t match the “results.” But really, nothing is wrong except the lack of understanding about which numbers contain context, and which ones do not.

Scott J Marcus
Guest
Scott J Marcus
3 years 1 day ago

In looking at the teams that Sale and Scherzer faced, one can see that Scherzer faced Boston twice, and Baltimore twice — one great offense, and one fairly good one. On the flip side, Sale did face the Angels twice, and they are a decent offense.

But given the extra starts for Scherzer against the Red Sox and Orioles, I see the difference between their difficulty level as fairly small.

what...?
Guest
what...?
3 years 1 day ago

Cameron already listed the ra9’s of their opponents. There’s a 0.24 RA9 difference, which I’d say is not insignificant.

Brandon
Guest
Brandon
3 years 1 day ago

The Angels are pretty darn close to the Red Sox in wRC+ (109 vs. 113) so I’d say they’re closer to a “great” offense than a “decent” offense.

Free Bryan LaHair
Member
Free Bryan LaHair
3 years 1 day ago

the pressure of having to pitch at an elite level knowing the run support will most likely not come is a major factor for me. Sale would’ve cruised through lineups on a team with run support similar to Detroit’s. what intrinsic pressure did scherzer or sanchez ever have to deal with when they woke up every 5th day with a peace-of-mind knowing that their lineup was better than everybody else’s?

isavage30
Guest
isavage30
3 years 1 day ago

Not sure how meaningful a quality of competition analysis is. Sale’s an interesting guy to choose for this, because what destroyed his numbers was not the 5 starts against Detroit, it was the 4 starts against Cleveland (6th in the AL in wOBA). He gave up almost 1/3 of his earned runs on the year in those 4 starts, and would have a good Cy Young case if you could eliminate those 4 starts.

How would you break this down in a meaningful way? Pitching a shutout against Detroit may be more impressive than doing the same against Chicago, but what about giving up 22 runs in 23 innings to Cleveland’s average offense? (which would look even more average if not for the 4 games where they got to beat up Chris Sale). How does that work to penalize his overall numbers, especially considering the Indians’ team wOBA is higher than it would be because of the starts against Sale? I would think this tends to even out enough, that breaking it down to who faced who just confuses things.

Jamie
Guest
Jamie
3 years 1 day ago

Also, Sale is a LHP, and the Tigers have been very bad this year against LHP, which would lead one to wonder whether his success against the Tigers should be downgraded given how little success the Tigers have had against any LHP.

Brandon
Guest
Brandon
3 years 1 day ago

??? By what measure are the Tigers bad against lefties?!

Jamie
Guest
Jamie
3 years 1 day ago

They were worse against lefties in AVG, OBP, SLG, wOBA, ISO, etc.

Kyle
Member
Kyle
3 years 1 day ago

Sure, it’s a thorny situation, but we treat park and league adjustments the same way, don’t we?

isavage30
Guest
isavage30
3 years 1 day ago

Well, something like park should be an independent variable, but personally, I think the Fangraphs team pitching WAR, for example, is a pretty crazy thing. How do the Mariners, with a 4.33 ERA and 3.93 FIP, have a higher WAR than the Rays (3.76/3.74)? Do you really think the Mariners have better pitchers than the Rays? That stuff is useful at the extremes, looking at individual pitchers in Colorado, for example, but in the aggregate I think it gets very murky.

When you’re looking at something like this, it’s even more complicated because there is no independent variable. The White Sox offense is affected by their performance against Scherzer in those 5 starts, etc. You’d have to look splits, and at the actual players in the lineup on the days they faced the particular teams, and look at those players’ performance when they’re not facing the pitcher you’re evaluating … you face the Twins now sans Mauer and Morneau, it’s different then facing them earlier in the year. Or the White Sox, with Rios. So even looking at team wOBA could be hugely misleading when you’re talking about a handful of starts. I just don’t see how you’re going to get a result that’s more meaningful than their actual performance against the teams they faced, and it would be absurdly complicated to be done right. Looking at a flat ra/9 for opponents and making a judgment off of that I would say is next to meaningless, as in the case of Sale, where what hurt his numbers against Cleveland … what does the fact that he shut down Detroit and got be up by Cleveland and didn’t get to face his own team do for his Cy Young case? I have no idea

Wes
Guest
Wes
3 years 1 day ago

So Scherzer held opponents to a 2.74 FIP, compared to their RA9 of 4.30 (a difference of 1.56).

Sale held opponents to a 3.20 FIP, compared to their RA9 of 4.54 (a difference of 1.34)

Even if we account for the quality of opposition, then, it seems that Scherzer has the edge over Sale.

pft
Guest
pft
3 years 1 day ago

Yet its Darvish who is really the man who should be the front runner and be compared, Both Darvish and Sale pitched in much more of a hitters park than Scherzer.

Ian
Guest
Ian
3 years 1 day ago

Except that Comerica was a better hitters park than the other two this season…other than that, for sure you’re right.

pft
Guest
pft
3 years 1 day ago

Parks themselves don’t change much from Y2Y, and minor changes in temp and wind won’t affect them that much. Extreme Y2Y variance is likely a SSS artifact. Like using 1/2 year of UZR, you have to use multi-year park factors and consider the handedness of the pitcher and hitter (eg Safeco is not as friendly to RHP’ers as LHP’ers).

Jacks
Guest
Jacks
3 years 1 day ago

Cleveland is definitely Sale’s kryptonite. In 23 innings vs CLE this year, Sale has given up 22 ER. That inflates his ERA vs winning teams by quite a bit: 3.35 vs teams .500 or better, 2.16 vs losing teams. Turns out that mirrors Scherzers: 3.35 vs winning teams, 2.5 vs losing.

CFIC
Guest
3 years 1 day ago

last time I checked, Felix Hernandez was having him quite the season

Bob Welch
Guest
Bob Welch
3 years 1 day ago

“…perhaps opening the door for voters to take a closer look at all the candidates.”

You may be giving said voters a little too much credit.

Feeding the Abscess
Guest
Feeding the Abscess
3 years 1 day ago

More than just RA/9 per team, Sale has faced teams that have done very well left-handed pitching:

Cleveland, 1st in MLB in wOBA versus lefties: 4 starts
Oakland, 2nd: 2 starts
Detroit, 3rd: 5 starts
Texas, 4th: 2 starts
LAA, 5th: 2 starts
Tampa, 7th: 2 starts

17 of Sale’s 29 starts have come against teams in the top 7 in baseball against LHP, and 11 against the top 3. Whoever said the Indians offense is average is simply wrong. Same goes for the person who said the Tigers offense against LHP has been ‘very bad’.

I would think that any degree of difficulty stat should factor in offenses against pitcher-handedness rather than overall offense, as some teams show a wide disparity in performance against differing pitcher-handedness. For example the Astros: one of the three worst offenses in baseball by wOBA against RHP, the Astros come in at a respectable 12th against LHP.

isavage30
Guest
isavage30
3 years 1 day ago

But one of the reasons Cleveland’s numbers against lefties are so good is they beat up Sale himself. 110 of their 1890 plate appearances, almost 6% of their LH plate appearances, were against Sale, and they hit .340/.391/.570 in those plate appearances. Where would they rank against non-Sale lefties?

Feeding the Abscess
Guest
Feeding the Abscess
3 years 1 day ago

Sale did well against Detroit and destroyed the Angels in both his starts against LAA. Both teams would have would ranked better against lefties had they not faced Sale.

Feeding the Abscess
Guest
Feeding the Abscess
3 years 1 day ago

Besides, Cleveland had a .335 wOBA. Give them league average production in those 6% of PA that were against Sale and it’d be, what, .333 or .334? That would place them second behind Oakland. If you adjust Detroit and LAA upward a point or two each, Cleveland’s drop is negated, if not overly compensated for.

isavage30
Guest
3 years 1 day ago

My point being, the idea of quality of opposition factoring into Cy Young race is way more complicated than just looking at opponent RA/9. Even when looking at an opponent by their split, you are looking at that split influenced by the performance against the pitchers you are analyzing. I think you can dissect stats too deeply, where instead of making things more clear and getting more to the reality, you’re just confusing it even more and the new information makes it more difficult to conclude anything. Breaking down pitcher performance by their opponents being one of those cases.

Feeding the Abscess
Guest
Feeding the Abscess
3 years 1 day ago

Quality of opposition is factored into analysis of AL versus NL pitchers. Why can’t that be distilled into a formula that can apply to pitchers from the same league? The same team?

isavage30
Guest
isavage30
3 years 13 hours ago

There are problems with the park and league adjustments too. Personally I take them with a grain of salt, one of the reasons WAR isn’t meant to be viewed as accurate to the decimal point. I don’t honestly know much about how league adjustments are calculated. With the NL, the drop-off of facing the pitcher is pretty much a league-wide thing though, with some outliers like Greinke who are actually decent hitters. But the adjustment would be made league-wide with one common fact of light-hitting pitchers being the primary driver of the variation between the leagues, while the adjustment Dave’s talking about here is on a team-by-team basis, and there’s a hell of a lot more variation on individual games against individual teams than there is when you’re looking at the league as a whole Say Darvish faces Detroit and shuts them down. Looks good, but what if Miggy’s hurt, Peralta’s suspended, Victor Martinez is getting a day off? Do you account for that? If you don’t break it down to actual lineups faced, then it’s not definitely not accurate.

If your goal is to see who pitched the best in relation to the toughness of their outs, I think there’s a lot more variation in just day-to-day streaks, injuries, and lineups faced, than breaking it down as who faced what team and thinking that has some greater meaning than their overall results. Just because Scherzer doesn’t have to go against Detroit and Sale didn’t get to face the White Sox doesn’t say that much, and I don’t think you can break that down into a formula with any degree of accuracy/reality. You might be able to do something on a division-by-division basis that’s meaningful, but getting more granular than that and I’d think it’s pretty much nonsense.

I Agree Guy
Guest
I Agree Guy
3 years 1 day ago

“Chris Sale will be nothing more than a reliever.” – me, circa 2010

Thankfully I didn’t quit my day job.

Guest
Guest
Guest
3 years 17 hours ago

Hey man at least you can admit it.

JS7
Member
JS7
3 years 1 day ago

Felix Hernandez should be in the conversation as well.

Michael Allen
Guest
Michael Allen
3 years 1 day ago

“Having good hitters on your team doesn’t only get you more runs when you’re pitching, but makes it less likely that you’re going to give up runs, since that’s fewer good hitters you have to face yourself.”

You don’t say.

FeslenR
Guest
FeslenR
3 years 20 hours ago

good information Dave,

the issue is “traditional writers who votes” usually just look at traditional stats.

wpDiscuz