« Previous Entry | Back to Blissful Knowledge | Next Entry »


August 24, 2003
DIPS-STUCK?

Some of you might have been too distracted by recent events in Israel and Iraq to notice the most important event of the summer: the publishing of the results of a major study by Diamond Mind Baseball testing the veracity of the radical “DIPS” theory of Voros McCracken. For those who might be unaware, McCracken’s theory is that pitchers have little if any impact on the outcome of balls put into play; whatever happens to balls put into play is attributable to the defense or luck. Most tests of McCracken’s theory have tended to support it; it has been endorsed by Bill James and made famous by Michael Lewis in Moneyball.
Well, the people at Diamond Mind did an exhaustive study of the previous 90 seasons to test McCracken’s theory. And the punch line was:

I am convinced that pitchers do influence in-play outcomes to a significant degree. There's a reason why Charlie Hough and Jamie Moyer and Phil Niekro and Tom Glavine and Bud Black have had successful careers despite mediocre strikeout rates. There's a reason why the top strikeout pitchers have also suppressed in-play hits at a good rate. Using power or control or deception or a knuckleball, pitchers can keep hitters off balance and induce more than their share of routine grounders, popups, and lazy fly balls.

Those results are noteworthy enough, but the ramifications are greater than I’ve seen discussed anywhere on the Net.
Aside from McCracken’s theory, the greatest advances in sabermetrics over the last couple of years have been in measuring defensive performance. The most noteworthy examples are the the defensive component of Bill James’ “Win Shares” and similar methods used by Baseball Prospectus.
At the heart of both of those methods are analyses of the outcomes of balls put into play against the defense. They thus were developed in partial response to the issue that Baseball Prospectus called one of the game’s “Hibert Problems” in its 2000 book – namely, how to distinguish the respective contributions of pitching and defense to run prevention. Or, as Michael Lewis writes on pp.235-236 of Moneyball:

…Voros saw someone say that no matter how much research was done, no one would be able to distinguish pitching from defense. That is, no one would be able to distinguish pitching from defense. That is, no one would ever come up with good fielding statistics or, therefore, good pitching statistics. If you don’t know how to credit the fielder for what happens after a ball gets put into play, you also, by definition, don’t know how to debit the pitcher. And, therefore, you would never be able to say with any real certainty how good any given pitcher was. Or, for that matter, any given fielder.
When Voros read that, “I thought, ‘That’s a stupid attitude. Can’t you do something?’…”

And he began the research that would culminate in his “DIPS” theory.
Here’s the problem: As noted above, the new advances in the measurement of fielding performance are based on analyses of the results of balls put in play. As such, absent McCracken’s theory, they are based on a kind of question-begging: they assume that the results of balls put into play are attributable to the fielders rather than the pitchers. If the pitchers influence the results of balls put into play, then don’t you have to take that into account? And if that’s the case, then haven’t you merely reopened the “Hibert Problem” of distinguishing pitching and defense?
McCracken’s theory had value beyond what it said about pitchers’ performance. By largely removing the influence of pitchers from the results of balls put into play, it also provided the justification for the foundation of Bill James’ and Baseball Prospectus’ methods of measuring fielding performance. But now, it seems like we have taken several steps backward. To use an example cited in the Diamond Mind study, in measuring the defensive performance of the Seattle Mariners over the last several years, don’t you have to adjust for the influence of Jamie Moyer? And again, doesn’t that merely reopen the “Hibert Problem” of distinguishing pitching from defense?
Maybe I’m missing something here, but I’m not sure what it is.
UPDATE: David Pinto supplies what I'm missing:

What Tippett is saying here is that you can predict strikeout rates pretty well just by looking at the previous season of the pitcher, but you can't predict -play batting average relative to the team well at all. That's what correlation means. Correlation goes on a scale of -1 to 1, where 1 is perfect correlation (the best at one will be the best at the other), -1 is perfect opposite correlation (the best at one will be the worst at the other) and 0 means no correlation at all; in other words, being the best at one will tell us nothing about how you do at the other. The statistican I learned from used to tell me that if he sees .5 correlation, he assumes the data is random. Seeing a .09 correlation tells me the data is very random. It's not 0, but it's very close to 0.
So, as to Dr. Manhattan's question; yes, you are missing something. The effect Tippett is showing is small, so small that DIPS is still valid. Bill James knew about this when he wrote win shares, but for the aggregate I think it works really well. We don't have to reopen the “Hibert Problem”; we just have to understand that the solution is just an approximation.

So what I was, and am, missing is a real education in statistics. Oh well...

ANOTHER UPDATE: I've just fixed my post. Sorry - my Baseball Prospectus 2000 is in storage so I couldn't double-check it. The correct term is "Hibert" problems. Those problems were a list of 23 fundamental mathematical problems propounded around the turn of the century by a mathemetician nmaed Hibert. In BP2K, Keith Woolner tried his hand at setting out a list of parallel questions, and a primary one was the distinction of pitching and defense. The piece helped inspire Voros McCracken.
A FINAL UPDATE: The name is "Hilbert," not "Hibert." Thanks to Mike Molloy for the tip.

Posted by Dr. Manhattan at 11:12 AM |



TrackBack

Listed below are links to weblogs that reference DIPS-STUCK?:

» BASEBALL: Rethinking a Rethinking from Baseball Crank
Dr. Manhattan notes something I'd thought about myself: that Tom Tippett's analysis of balls in play against pitchers (which I noted here) -- which concluded that at least some pitchers do have an effect on balls in play, in a... [Read More]

» http://www.baseballmusings.com/archives/004369.php from Baseball Musings
Dr. Manhattan at Blissful Knowledge writes a post about the recent study by Tom Tippett at Diamond Mind Baseball on the Voros McCracken's DIPS theory. He's not sure about something: McCracken’s theory had value beyond what it said about pitchers’... [Read More]

Comments

It seems obvious to me that pitchers have an effect on filding. Measuring that effect is remains much more obscure.

In addition to the effect the pitcher has on hitters by deception or otherwise (e.g inducing weak grounders or lazy flies) there is also the effct that pitchers have on fielders.

Ray Miller's dictum of "work fast, throw strikes and change speeds" is an example. The "work fast" is predicated onthe notion that fielder's have limited concentration. By working fast, it becomes easier to remain alert which may result in better preparation and might result in a greater percentage of balls in play being reached.

In addition, if the portion of the field avialable to the hitter can be limited bu control (keep it down and in to a lefty to induce a ball hit to the right side), then the defense can cheat just a little to that side. That cheating is, in effect, increasing the range of the fielders. The cheating is obviously gong to be more effective when the pitcher does not make the mistake of leaving one high and outside.

In defense of your initial assertion "Those results are noteworthy enough, but the ramifications are greater than I’ve seen discussed anywhere on the Net." & meredith's most sensible post...

DIPs argues bascially that pitchers have no influence on the rate at which balls-in-play are turned into outs by the defense. And advocates take this as a pure 'truth' in a binary true/false way.

Tippett, using a lot more data than McCracken, delivers data that says pitchers, when taken as a vast group, have a small but measureable effect on the rate at which balls-in-play are turned into outs by the D. It also leaves open the possibility that some *individual* pitchers may have a significant effect on that rate, while not arguing that for pitchers-as-a-class.

His study doesn't "prove" or "disprove" McCracken's. It indicates what most rigorous follow-up studies to exciting paradigm-shattering studies indicate: that reality doesn't neatly fit into single-variable measures, into simple binary 0 or 1 divisions or into bell curves. DIPS is important, Tippett's is moreso, because it leads to possible follow-up analysis that might lead to predictive indicators.

Pitching (as measured by DIPS) is a concept. Pitchers (as measured by Tippett's) are individuals. DIPS and Tippett's follow-up can co-exist.


Blog Archives
March 2008
December 2005
August 2005
June 2005
May 2005
April 2005
March 2005
November 2004
September 2004
August 2004
April 2004
March 2004
February 2004
January 2004
December 2003
November 2003
October 2003
September 2003
August 2003
July 2003
June 2003
May 2003
February 2003
January 2003
December 2002
November 2002
October 2002
September 2002
August 2002
July 2002
June 2002
May 2002
April 2002
March 2002
February 2002
Click for archives by week


Blog Categories
Autism
Baseball
From Blogger
Jewish/Israel
Markets
News
Other
Personal
Politics & Policy
War
Website related


Bloggers & Columnists
&c.
A Small Victory
A Taxing Blog
About Last Night
Agitator
Agonist
Aidel Maidel
Alas, a Blog
Allah
Altercation
Amish Tech Support
Amitai Etzioni
Amygdala
An Unsealed Room
Andrew Ferguson
Andrew Olmstead
Andrew Sullivan
Apt. 11D
Apikorsus Online
Armed Liberal
Arnold Kling
Asymmetrical Information
Atlantic Blog
Back Row of the 'Beis
Balkinization
Balloon Juice
Baraita
Baynonim
Beauty of Gray
Belgravia Dispatch
Ben Chorin
Best of the Web
Bloghead
Bloviator
Brad DeLong
Bring Back Sincerity
Brink Lindsey
Brothers Judd
Buck Stops Here
Buzz Machine
California Insider
CalPundit/Political Animal
CantWatch
Capital Games
Chakira
Charles Krauthammer
Charles Murtaugh
Chayyei Sarah
ChicagoBoyz
Chris Mooney
Clayton Cramer
Colby Cosh
Cold Fury
Common Sense and Wonder
Confessions of an Orthodox Jewish Straight Theatre Queen
Conspiracy to Keep You Poor and Stupid
Command Post
Cooped Up
The Corner
Cornfield Commentary
Corp Law Blog
CounterRevolutionary
Counterspin Central
Crescat Sententia
Critical Mass
Crooked Timber
Croooow Blog
Cut on the Bias
Daily Howler
DailyKOS
Daily Pundit
Daimnation!
Daniel W. Drezner
Daniel Pipes
Dave Barry
David Frum
DefenseTech
Deionychus antirrhopus
Discriminations
Disgusted Liberal
Dr. Weevil
D-Squared Digest
Easterblogg
Economic Principals
EconoPundit
Edge of England's Sword
Eject! Eject! Eject!
Electric Venom
Elizabeth Spiers
Eschaton
Eve Tushnet
Expat Egghead
Frum Dad
Frum Talk
Gawker
GedankenPundit
Gene Expression
George F. Will
Giants and Dwarfs
Gideon's Blog
GirlHock
God of the Machine
Goldberg File
Haggai's Place
Hasidic Rebel
Head Heeb
Hirhurim
Hit and Run
House of Hock
How Appealing
Howard Kurtz
HoyStory
Iberian Notes
Idealogian
Imshin
In the Pipeline
IndePundit
InstaLawyer
InstaPundit
Intel Dump
Invisible Adjunct
Israeli Guy
IsraPundit
IvyJews
Jacob T. Levy
James Lileks
Jason Rylander
Jewish Musings
Joanne Jacobs
John Ellis
John Leo
Jonathan Rauch
Juan Cole
Juan Gato
Junius
Just One Minute
Kausfiles
Ken Layne
Kesher Talk
KickAAS
Kicker
Kieran Healy
The Knowledge Problem
The Kolkata Libertarian
L.A. Examiner
Letter from Gotham
Little Green Footballs
Man Without Qualities
Mark Kleiman
Mark Steyn
Martin Kramer
Marvin Schick
Matt Welch
Matthew Miller
Matthew Yglesias
Max Power
MaxSpeak
MedPundit
MedRants
Meryl Yourish
Michael Barone
Michael Kelly
Michael Lewis
Michael J. Totten
Michelle Malkin
Midwest Conservative Journal
MOChassid
Mullings
Muslim Pundit
Norah Vincent
Norwegian Blogger
The Note
N.Z. Bear
Oliver Willis
One Hand Clapping
Outside the Beltway
Overlawyered
OxBlog
Patio Pundit
Patrick Ruffini
Paul Krugman (unofficial)
Pejman Pundit
PLA
Political Aims
The Poor Man
Porphyrogenitus
Power Line
Priorities and Frivolities
Professor Bainbridge
Protein Wisdom
Protocols
Protocols of the Yuppies of Zion
PunditWatch
QuasiPundit
Rachel Lucas
Rand Simberg
Rantburg
Real Clear Politics
Regions of Mind
Respectful of Otters
Ribbity Frog
Right Wing News
Rob Lyman
Robert Kagan
Roger L. Simon
Safety Valve
Samizdata
Sand in the Gears
Sgt. Stryker
Scrappleface
Sebastian Holsclaw
Seraphic Secret
Shadow of the Hegemon
Shaigetz
Shark Blog
Shiloh Bucher
Silent Running
Sine qua Non Pundit
Somewhere on A1A
Sneaking Suspicions
SoxBlog
SpinSanity
Spinsters
The Spoons Experience
Steve Chapman (Tribune)
Steven Chapman (blog)
Strategy Page
Styx
Tacitus
Tal G. in Jerusalem
Talk Left
Talking Dog
Talking Points Memo
TAPPED
Ted Barlow
This Normal Life
This Woman's Work
Tightly Wound
Tim Blair
Treppenwitz
Town Crier
2Blowhards
Unqualified Offerings
U.S.S. Clueless
Victor Davis Hanson
View from Here
Virginia Postrel
VodkaPundit
The Volokh Conspiracy
Wampum
War Liberal
Where is Raed
William Burton
William Saletan
Winds of Change
Wonkette
Yale Pundits
YUtopia
Zogby Blog


Jewish & Israel
Azure
Bar-Ilan University
Chief Rabbi (UK)
Edah
eParsha
Ha-aretz
Hebrew University
OU Institute for Public Affairs
Israeli Defense Forces
Jerusalem Post
Jerusalem Report
JewishLaw
Jewish Theological Seminary
Jewish Week
Jewish World Review
Jewsweek
Kashrut.com
Meimad
Middle East Media Research Institute
Orthodox Union
Shalem Institute
Kosher Restaurant Database
Soloveitchik Institute
Tanach Study Center
Virtual Beit Midrash
Yeshiva University
Yeshivat Chovevei Torah
YIVO Institute for Jewish Research


Baseball & Other Sports
Aaron's Baseball Blog
Against the Grain
All-Baseball.com
Allen Barra
Always Amazin'
Armchair GM
Astros Daily
Bambino's Curse
Baseball Crank
Baseball Immortals
Baseball Musings
Baseball Prospectus
Baseball Primer
Baseball Outsider
Baseball Reference
Baseball Savant
Baseball Truth
Baseball Widow
Baysball
Bench Coach
Big Bad Baseball
Bill Simmons
Birds in the Belfry
Boy of Summer
Braves Journal
Bronx Banter
Clifford's Big Red Blog
Cub Reporter
Dan Lewis
Dodger Thoughts
Dominican Players
Doug Pappas' Business of Baseball
Dugout Dollars
East Coast Agony
Eddie Kranepool Society
Elephants in Oakland
Football Outsiders
Fun with Win Shares
Futility Infielder
Hardball Times
Honest Wagner
Idiots Write About Sports
Joel Sherman
MLB.com
Mariner Musings
Mike's Baseball Rants
Mudville Magazine
Off-Wing Opinion
Only Baseball Matters
Peter Gammons
Pinstriped Bible
Pinstripe News
Raindrops
Redbird Nation
Replacement Level Yankees Weblog
Retrosheet
Rookie's Life
Rich's Weekend Baseball BEAT
Rob Neyer
SaberMets
Talking Baseball
Thomas Boswell
Thoughts from Diamond Mind Tom Verducci
Transaction Guy
Transition Game
U.S.S. Mariner
Universal Baseball Blog, Inc.
View from the 700 Level
Wait Til Next Year
Weblog that Derek Built
West 116th Street
WhatifSports.com
Will Carroll
Win Shares (in-season)
Yankees, Mets and the Rest


Publications & Policy
American Enterprise Institute
The American Prospect
Arts & Letters Daily
Atlantic Monthly
Brookings Institute
Cato Institute
City Journal
Commentary
Economist
Financial Times
Foreign Affairs
Heritage Foundation
Manhattan Institute
National Review Online
The New Republic
The New Yorker
New York Sun
New York Times
Progressive Policy Institute
RAND
Reason
Resources for the Future
Roll Call
Salon
Slate
Tech Central Station
Wall Street Journal
Washington Monthly
Washington Post
Weekly Standard
Wilson Quarterly


Miscellaneous Links
Bangitout.com
Dilbert Zone
The Great Movies
Neil Gaiman
The Onion
Snopes


Search the Site

Try advanced site search

Site Credits

last 50 hits in



Listed on BlogShares





E-mail Me