CSS Button No Image Css3Menu.com

Baseball Prospectus home
  
  
Click here to log in Click here to subscribe
<< Previous Article
Internet Baseball Awar... (11/12)
<< Previous Column
Pebble Hunting: The St... (11/06)
Next Column >>
Premium Article Pebble Hunting: The Ha... (11/19)
Next Article >>
Premium Article Rumor Roundup: The Hig... (11/12)

November 12, 2013

Pebble Hunting

Rereading Nate Silver: 5. The Colorado Effect

by Sam Miller

the archives are now free.

All Baseball Prospectus Premium and Fantasy articles more than a year old are now free as a thank you to the entire Internet for making our work possible.

Not a subscriber? Get exclusive content like this delivered hot to your inbox every weekday. Click here for more information on Baseball Prospectus subscriptions or use the buttons to the right to subscribe and get instant access to the best baseball content on the web.

Subscribe for $4.95 per month
Recurring subscription - cancel anytime.


a 33% savings over the monthly price!

Purchase a $39.95 gift subscription
a 33% savings over the monthly price!

Already a subscriber? Click here and use the blue login bar to log in.

Note: This winter, I'm rereading and reviewing Nate Silver's entire archive here at BP. Today will be a longer one.

5. PECOTA at Altitude: A Review of Major League Hitters in Colorado
February 21, 2003

Abstract: Using PECOTA’s breakdown of players’ hitting attributes, Nate looks for correlations between certain offensive approaches and success (beyond PECOTA expectations) in Colorado’s thin air. He concludes, from a sample of 29 major-league hitters, that batters with high strikeout rates benefit from Colorado, and batters with high walk rates suffer. (Isolated power showed no advantage.) “For each one percent increase in strikeout walk rate, a Rockie hitter receives a "bonus" of about two points of EQA above and beyond his performance in a neutral park; for each one percent increase in his walk rate, he receives a penalty of four points of EQA.”

Key Quote: “However, the Rockies may also have a profound structural advantage that they stand to benefit from: based on the history to date of performance in Denver, certain types of hitters appear to benefit disproportionately from the high-altitude environment. In particular, high-strikeout, low-walk hitters - players like Wilson, Hernandez, and Johnson - are more valuable to the Rockies than they are to anyone else. In stockpiling these players, potentially at a market discount, the Rockies have a comparative advantage.”

Follow-up: So far as I can find, Silver never revisited this, and so far as I can find nobody else did, either. But, of course, Major League Baseball itself kept scheduling baseball games in Colorado, so the follow-up data is there for any of us to look at. Let's!

First, the specific predictions:

What does that mean for players that will be new to Coors this year? All three of the Rockies' major position player acquisitions--Preston Wilson, Jose Hernandez, and Charles Johnson--are in a position to benefit. … The differences are substantial. Our model believes that Jose Hernandez could gain as many as forty points of EQA by virtue of being a Rockie. Because that score accounts for both his performance both at home and on the road, his performance at Coors could be truly lights out.

Adjusted for the Coors Field effect, Silver speculated that Wilson’s .279 projected EQa could become .299, that Hernandez’s .240 becomes .278, and that Johnson’s .261 turns into .277. Actual results: Wilson .276, Hernandez .224, Johnson .250. So not only did the three high-strikeout/low-walk Rockies not get the high-strikeout/low-walk boost, they all underperformed PECOTA’s unadjusted projections. The specific prediction flopped, badly.

As for the larger idea, I recreated Silver’s approach, more or less. I took a few shortcuts (because of time, and because of my more limited ability to grab, sort, and interpret data the way Silver can), and instead of EqA I used the since-updated version of it, True Average, for continuity. I found 26 player-seasons since 2003 by new Rockies who had substantial playing time with another team. “Substantial” was a minimum of 400 plate appearances in the previous three seasons, though if that seems low to you then rest assured that 25 had at least 600 plate appearances, and 22 had at least 1,000. Instead of PECOTA projections—running PECOTA TAvs to project a stat that didn't even exist in 2003 would have been extremely labor-intensive for somebody around here—I used a simple 5:3:2 weighting method for the previous three seasons to generate a simple projection for each player’s first year in Coors. (Silver himself sometimes used the 5:3:2 method as "a reasonable proxy for the player's expected productivity" at the time.) For players’ strikeout and walk rates, I took the players’ rates over the previous three seasons, unweighted and unadjusted.

So 26 players with significant time elsewhere, each of whom gets a projection for his first year in Colorado, and each of whom is classified as a high- or low-strikeout and high- or low-walk hitter. As Silver did, here’s the chart of players, with projections and actual performance:

Player First Coors Year Forecast Actual TAv Delta
Tyler Colvin 2012 0.217 0.273 56
Kaz Matsui 2007 0.208 0.254 46
Ronnie Belliard 2003 0.226 0.255 29
Vinny Castilla 2004 0.238 0.257 20
Willy Taveras 2007 0.237 0.254 17
Yorvit Torrealba 2006 0.229 0.242 13
Melvin Mora 2010 0.252 0.262 10
Jeromy Burnitz 2004 0.266 0.273 7
Royce Clayton 2004 0.226 0.231 5
Todd Greene 2004 0.234 0.238 4
Preston Wilson 2003 0.268 0.271 3
Jamey Carroll 2006 0.250 0.253 3
Miguel Olivo 2010 0.249 0.251 2
Mark Bellhorn 2003 0.247 0.245 -2
Chris Stynes 2003 0.255 0.251 -4
Michael Cuddyer 2012 0.285 0.28 -5
Scott Podsednik 2008 0.237 0.232 -5
Charles Johnson 2004 0.255 0.248 -7
Ty Wigginton 2011 0.257 0.249 -8
Jason Giambi 2010 0.279 0.268 -11
Desi Relaford 2005 0.232 0.219 -13
Mark Ellis 2011 0.264 0.237 -27
Marco Scutaro 2012 0.270 0.24 -30
Dustan Mohr 2005 0.271 0.238 -33
Jose Hernandez 2003 0.262 0.221 -41
Ramon Hernandez 2012 0.262 0.208 -54

Keeping in mind that the projections are very, very rough, that’s 13 players who outperformed expectations and 13 who underperformed. Hard to find the pattern by eyeballing it—Colvin and Belliard are polar opposites at the top, as are Scutaro and Jose Hernandez at the bottom. It’s not really much easier to find the pattern by charting it. Blue is good, green is bad:

(Click for larger.)

High-strikeout/low-walk guys are in the top left quarter and low-strikeout/high-walk guys are at the bottom right. In a typical ballpark, the bottom-right players would be ideal acquisitions, but when Silver made a similar chart the best signings were grouped in the top left:

Five hitters in the sample had walk rates significantly below the league average, and strikeout rates significantly above it. All of them exceeded their PECOTA forecast, and four of them - Bichette, Galarraga, Charlie Hayes, and Todd Hollandsworth - exceeded it by at least 25 points of EQA. Certainly, your mileage may vary.

Our mileage does vary (though we should note one last time the caveat that we're using a much rougher system for projecting). There’s a bit of concentration of modestly good results on the left, for low-walk guys, but not really in the top, for high-strikeout guys. Olivo and Greene are both in the top left and outperformed their projections, but by very small marginstwo points of TAv for Olivo, and four points for Greene (who, perhaps relevantly, is the guy who provided the fewest plate appearances from which to generate a projection).

Seven players outperformed projections by 10 points or more. Six of the seven were low-walk hitters (and three of those were also high-strikeout hitters), but only three of the seven were high-strikeout hitters.

Seven players underperformed projections by 10 points or more. Those seven are in all four quadrants. Three of seven were high-walk hitters. Three of seven were high-K hitters.

The correlation between walk rates (compared to league average) and Coors field overperformance is -.26, which is a bit more than half the -.44 correlation that Silver found—still reasonably strong. But the correlation between strikeout rates (compared to league average) and Coors Field overperformance is just .10, down from Silver’s .29 and hard to take seriously anymore.

Taken together, then, we might still conclude that the Rockies could make a tidy profit by signing low-walk hitters, who are more valuable to them than to any other team in the league. Signing high-strikeout hitters might be useful, but to a much smaller degree.

***

The larger question, really, is why the Rockies haven’t figured out a way to win consistently in the 11 seasons since Silver wrote this. Intuitively, Silver’s findings suggest that the Rockies should have a huge advantage. While 29 teams are fighting for one type of player, the Rockies can quietly scoop up the other type. They can (theoretically) do it at a huge discount: if there’s an army of .220-TAv guys who become .250-TAv guys as Rockies, then Colorado ought to be able to sign a bunch of .250-TAv guys at .220-TAv prices. (Note: this should work for pitchers, too. If the style of play affects particular hitters more than others, it stands to reason there is a corresponding type of pitcher who can be had cheaply.) If we trust the data, we would encourage the Rockies to consider a particular type of available player this offseason: free agents like Marlon Byrd, A.J. Pierzynski, Michael Morse, and Alex Rios; trade targets like Mark Trumbo, Chris Heisey, and Howie Kendrick; scrap-heap buys like Brent Lillibridge, Clint Barmes, and Jesus Flores.

Yet the intuitively crackable nut has been demonstratively tough to crack. The Rockies have lost an average of 86 games per season since Silver’s piece. They’ve still never in franchise history won the NL West. The two-percent Rays have won 90 games in five of the past six years; the Rockies, who apparently have their own two percent in the very air they breath, have managed to win 90 games twice in two decades. They appear to have ignored Silver's prescription: of the 26 established players they have added, seven are in the desired quadrant. (To be fair, if we toss out the strikeout component (which now seems to be less important or unimportant), they seem much more intentional, with almost 70 percent of their additions walking less than the league average.) We forecast the 26 to cumulatively produce a .249 TAv in a non-Colorado environment. They have actually produced a .248 TAv. Whether Silver answered the question 11 years ago—and it appears he discovered something true, if not as true as it appeared—it doesn't appear that the Rockies have yet figured out how to turn an asset into a profit.

***

Proto-PECOTA joke: “With an interspersion of red triangles and green diamonds that is neither wholly ordered nor wholly random, the chart looks a little bit like a thirty dollar rug from IKEA (PEKÖTA?).”

Tables: 4
Graphs: 1
Equations: 0

On the Nate Silver Must-Read Scale: 2

Sam Miller is an author of Baseball Prospectus. 
Click here to see Sam's other articles. You can contact Sam by clicking here

Related Content:  Coors Field,  Colorado Rockies,  Nate Silver

2 comments have been left for this article.

<< Previous Article
Internet Baseball Awar... (11/12)
<< Previous Column
Pebble Hunting: The St... (11/06)
Next Column >>
Premium Article Pebble Hunting: The Ha... (11/19)
Next Article >>
Premium Article Rumor Roundup: The Hig... (11/12)

RECENTLY AT BASEBALL PROSPECTUS
Playoff Prospectus: Come Undone
BP En Espanol: Previa de la NLCS: Cubs vs. D...
Playoff Prospectus: How Did This Team Get Ma...
Playoff Prospectus: Too Slow, Too Late
Premium Article Playoff Prospectus: PECOTA Odds and ALCS Gam...
Premium Article Playoff Prospectus: PECOTA Odds and NLCS Gam...
Playoff Prospectus: NLCS Preview: Cubs vs. D...

MORE FROM NOVEMBER 12, 2013
Premium Article Overthinking It: Picking an Appropriate Card...
Premium Article One Move: American League West
Premium Article Minor League Update: AFL Recap for Games of ...
Premium Article Transaction Analysis: Perez Built On
Premium Article Rumor Roundup: The High Price of Free Agent ...
Internet Baseball Awards: NL Top Manager
Internet Baseball Awards: AL Top Manager

MORE BY SAM MILLER
2013-11-14 - BP Unfiltered: Rereading Nate Silver: 7. Day...
2013-11-13 - BP Daily Podcast: Effectively Wild Episode 3...
2013-11-13 - BP Unfiltered: Rereading Nate Silver: 6. Inj...
2013-11-12 - Premium Article Pebble Hunting: Rereading Nate Silver: 5. Th...
2013-11-12 - BP Daily Podcast: Effectively Wild Episode 3...
2013-11-11 - BP Daily Podcast: Effectively Wild Episode 3...
2013-11-08 - BP Daily Podcast: Effectively Wild Episode 3...
More...

MORE PEBBLE HUNTING
2014-01-03 - Premium Article Pebble Hunting: The Weirdness of Walking Bar...
2013-11-26 - Premium Article Pebble Hunting: Extrapolating the Breakdown ...
2013-11-19 - Premium Article Pebble Hunting: The Hall of Fame 50 Percent ...
2013-11-12 - Premium Article Pebble Hunting: Rereading Nate Silver: 5. Th...
2013-11-06 - Pebble Hunting: The Stupidest Part of Baseba...
2013-11-04 - Premium Article Pebble Hunting: Your New Favorite Player
2013-10-23 - Premium Article Pebble Hunting: What To Talk About When the ...
More...