Sign In
  • Support FanGraphs
    FanGraphs Membership
    FanGraphs Shirts
    FanGraphs Mugs
    Gift a Membership
    Donate to FanGraphs
  • Games
    Ottoneu Fantasy Baseball
    Signup, FAQ, Blog Posts
  • Blogs
    Blog Roll

    FanGraphs
    Podcasts: FanGraphs Audio | Effectively Wild | Chin Music

    FanGraphs Prospects

    RotoGraphs
    Podcasts: The Sleeper and The Bust | Field of Streams | Beat the Shift

    Community Research

    Archived Blogs: The Hardball Times | NotGraphs | TechGraphs | FanGraphs+
    Archived THT: THT Live | Dispatch | Fantasy | ShysterBall
    Archived Podcasts: Stealing Home | Doing It For Bartolo | OttoGraphs | UMP: The Untitled McDongenhagen Project
  • Projections
    2022 Pre-Season Projections
    ZiPS, ZiPS DC
    Steamer
    Depth Charts
    ATC
    THE BAT, THE BAT X
    2022 600 PA / 200 IP Projections
    Steamer600
    2022 Updated In-Season Projections
    ZiPS (RoS), ZiPS (Update)
    Steamer (RoS), Steamer (Update)
    Depth Charts (RoS)
    THE BAT (RoS), THE BAT X (RoS)
    3 Year Projections
    ZiPS 2023, ZiPS 2024
    On-Pace Leaders
    Every Game Played, Games Played %
    Auction Calculator
    Auction Calculator (New Interface)
  • Scores
    Today
    Live Scoreboard, Probable Pitchers
    Live Daily Leaderboards
    Win Probability & Box Scores
    2022, 2021, 2020, 2019, 2018, 2017...
  • Standings
    2022 Projected Standings
    2022 Playoff Odds, Playoff Odds Graphs
    ZiPS Postseason Game-By-Game Odds
    AL East
    AL Central
    AL West
    NL East
    NL Central
    NL West
  • Leaders
    Major League Leaders
    Batting: 2022, 2021, 2020, 2019, 2018, Career
    Pitching: 2022, 2021, 2020, 2019, 2018, Career
    Fielding: 2022, 2021, 2020, 2019, 2018, Career
    Splits Leaderboards
    Season Stat Grid
    60-Game Span Leaderboards (Special)

    KBO Leaders
    Batting, Pitching

    Minor League Leaders
    AAA: Triple-A East, Triple-A West, Mexican
    AA: Double-A Northeast, Double-A South, Double-A Central
    A+: High-A Central, High-A East, High-A West
    A: Low-A West, Low-A East, Low-A Southeast
    R: Appalachian, Gulf Coast, Pioneer, Arizona
    R: Dominican
    WAR Tools
    Combined WAR Leaderboards
    WAR Graphs
    WPA Tools
    WPA Inquirer
    Rookie Leaders
    Batters 2022, Pitchers 2022
    Splits Leaders
    Batters: vs L, vs R, Home, Away
    Pitchers: vs L , vs R, Home, Away
  • Teams
    Team Batting Stats
    2022, 2021, 2020, 2019, 2018, 2017...
    Team Pitching Stats
    2022, 2021, 2020, 2019, 2018, 2017...
    Team WAR Totals (RoS)
    AL East
    Blue Jays  |  DC
    Orioles  |  DC
    Rays  |  DC
    Red Sox  |  DC
    Yankees  |  DC
    AL Central
    Guardians  |  DC
    Royals  |  DC
    Tigers  |  DC
    Twins  |  DC
    White Sox  |  DC
    AL West
    Angels  |  DC
    Astros  |  DC
    Athletics  |  DC
    Mariners  |  DC
    Rangers  |  DC
    NL East
    Braves  |  DC
    Marlins  |  DC
    Mets  |  DC
    Nationals  |  DC
    Phillies  |  DC
    NL Central
    Brewers  |  DC
    Cardinals  |  DC
    Cubs  |  DC
    Pirates  |  DC
    Reds  |  DC
    NL West
    D-backs  |  DC
    Dodgers  |  DC
    Giants  |  DC
    Padres  |  DC
    Rockies  |  DC
    Positional Depth Charts
    Batters: C, 1B, 2B, SS, 3B, LF, CF, RF, DH
    Pitchers: SP, RP
  • RosterResource
    Current Depth Charts
    AL East
    Blue Jays
    Orioles
    Rays
    Red Sox
    Yankees
    AL Central
    Guardians
    Royals
    Tigers
    Twins
    White Sox
    AL West
    Angels
    Astros
    Athletics
    Mariners
    Rangers
    NL East
    Braves
    Marlins
    Mets
    Nationals
    Phillies
    NL Central
    Brewers
    Cardinals
    Cubs
    Pirates
    Reds
    NL West
    D-backs
    Dodgers
    Giants
    Padres
    Rockies
    In-Season Tools
    2022 Closer Depth Chart
    2022 Injury Report
    2022 Lineup Tracker
    2022 Probables Grid
    2022 Schedule Grid
    2022 Transaction Tracker
    Offseason Tools
    2022 Opening Day Tracker
    2022 Offseason Tracker
    2022 Free Agent Tracker
  • Prospects
    Prospects Home
    THE BOARD!
    THE BOARD: Scouting + Stats!
    How To Use THE BOARD: A Tutorial
    Top Prospects List
    Top Prospects
    2022 2021
    AL
    BALCHWHOU
    BOSCLELAA
    NYYDETOAK
    TBRKCRSEA
    TORMINTEX
    NL
    ATLCHCARI
    MIACINCOL
    NYMMILLAD
    PHIPITSDP
    WSNSTLSFG
    AL
    BALCHWHOU
    BOSCLELAA
    NYYDETOAK
    TBRKCRSEA
    TORMINTEX
    NL
    ATLCHCARI
    MIACINCOL
    NYMMILLAD
    PHIPITSDP
    WSNSTLSFG

    • 2022 Preseason Top 100


    • 2021 Preseason Top 100

  • Glossary
    Library
    Batting Stats
    wOBA, wRC+, ISO, K% & BB%, more...
    Pitching Stats
    FIP, xFIP, BABIP, K/9 & BB/9, more...
    Defensive Stats
    UZR Primer, DRS, FSR, TZ & TZL, more...
    More
    WAR, UBR Primer, WPA, LI, Clutch
    Guts!
    Seasonal Constants
    Park Factors
    Park Factors by Handedness
  • Sign In
Help Support FanGraphs


Become a Member No Thanks
Already a member? Log In
  • Intro
  • Features
  • Offense
    • Complete List (Offense)
    • OBP
    • OPS and OPS+
    • wOBA
    • wRC and wRC+
    • wRAA
    • Off
    • BsR
    • UBR
    • wSB
    • wGDP
    • BABIP
    • ISO
    • HR/FB
    • Spd
    • Pull%/Cent%/Oppo%
    • Soft%/Med%/Hard%
    • GB%, LD%, FB%
    • K% and BB%
    • Plate Discipline (O-Swing%, Z-Swing%, etc.)
    • Pitch Type Linear Weights
    • Pace
  • Defense
    • Overview
    • Def
    • UZR
    • DRS
    • Defensive Runs Saved – 2020 Update
    • Inside Edge Fielding
    • Catcher Defense
    • FSR
    • RZR
    • TZ / TZL
  • Pitching
    • Complete List (Pitching)
    • ERA
    • WHIP
    • FIP
    • xFIP
    • SIERA
    • Strikeout and Walk Rates
    • Pull%/Cent%/Oppo%
    • Soft%/Med%/Hard%
    • GB%, LD%, FB%
    • BABIP
    • HR/FB
    • LOB%
    • Pitch Type Linear Weights
    • SD / MD
    • ERA- / FIP- / xFIP-
    • Plate Discipline (O-Swing%, Z-Swing%, etc.)
    • Pace
    • PITCHF/x
      • What is PITCHF/x?
      • Pitch Type Abbreviations & Classifications
      • Heat Maps
      • Common Mistakes
      • PITCHf/x Resources
  • WE/RE/LI
    • RE24
    • Win Expectancy
    • WPA
    • LI
    • WPA/LI
    • Clutch
  • Principles
    • DIPS
    • Regression toward the Mean
    • Replacement Level
    • Sample Size
    • Splits
    • Projection Systems
    • Linear Weights
    • Counting vs. Rate Statistics
    • Park Factors
    • Park Factors – 5 Year Regressed
    • Positional Adjustment
    • Aging Curve
    • League Equivalencies
    • Pythagorean Win-Loss
    • Luck
  • WAR
    • What is WAR?
    • WAR for Position Players
    • WAR for Pitchers
    • FDP
    • fWAR, rWAR, and WARP
    • WAR Misconceptions
  • Business

Overview

by Neil Weinberg
March 12, 2015

For every run scored, a run is allowed. That’s cemented in the rules of the game and the laws of physics. To score a run, someone else has to let a run score. While most of that allowance belongs to the pitcher, there are eight other players on the field with him at any given moment and they deserve some of the blame or credit for how often a run does or doesn’t score.

Unfortunately, for most of baseball history, we’ve had exceptionally lousy practices for measuring defense. Errors and fielding percentage seem to make sense at first but if you peel back the onion at all, they just don’t get the job done. Defense is a meaningful slice of run prevention and we care about measuring run prevention, ergo, we need to do a decent job of measuring defense. How do we go about doing that?

Recently, we’ve settled on defensive metrics measured in “runs saved.” The two most popular ones are Defensive Runs Saved (DRS) and Ultimate Zone Rating (UZR), but there are other efforts to capture the same idea. How many runs does a player prevent while playing the field? That fundamental question sets up everything we’re doing with respect to defensive statistics. There may be other ways to measure skill, and skill certainly predicts the future better than past results, but if we want to measure how well we believe a player has performed, we want to measure the runs he has prevented.

Defensive metrics are not perfect. They suffer from sample size issues, measurement errors, and data availability flaws. To their credit, however, hitting and pitching stats have many of the same types of flaws, we’re just less forgiving about those.

This page will offer an overview of why we need defensive metrics and how they work. Click around to the other pages for specific information on individual metrics.

*****

Why Errors and Fielding Percentage Come Up Short

For decades, the basic measurements of defensive performance were errors and fielding percentage. We used to judge players based on how well they avoided making errors on balls they fielded. If you didn’t kick the ball or let a throw sail wide, you were considered a quality defender. Certainly, those who were able to watch enough games developed a sense about which players were better defenders, but from a statistical standpoint, all we had were errors, assists, and putouts.

These statistics aren’t very useful, however. You certainly want to avoid errors because in order for something to be called an error you have, by definition, failed to convert a batted ball into an out. Yet there are two key problems with errors. First, they are determined by official scorers who don’t always make the right decision. Human error isn’t a problem, per se, but you’ve all seen enough scoring decisions to be skeptical about the quality of their decision making.

More importantly, however, is that errors are a subset of misplays. Even if official scorers got the rule book definition exactly right and perfectly uniform, we would still be ignoring a huge portion of bad defensive plays. Think back to a moment when you watched a player get a horrible jump on an easy ball. Think about the time an infielder took too long to get the ball out of their glove. Picture an easy pop fly falling four feet from the second baseman. None of those are errors even though they are relatively easy plays.

Measuring defense using Assists + Put Outs / Assists + Put Outs + Errors  ignores a huge slice of defense. If a player fails to get to an easy ball, there is no penalty. That alone should be reason enough for you to want something better.

Turning Batted Balls Into Outs

So if errors and fielding percentage fail to provide the entire picture of defense, what exactly should we be using? It’s not that errors lack importance, it’s that making an error isn’t the only way to screw up.

Instead of fielding percentage, the next step forward is something like defensive efficiency or Revised Zone Rating (RZR). Both statistics strive to tell you similar truths; how often a fielder turns batted balls into outs. In other words, we don’t care whether you make an error or if you don’t get to the ball. We care if you made an out or if you didn’t. The distinction between an error and a play not made is arbitrary. If 200 batted balls were hit to the third baseman’s zone during a given period of time, do we care if he made 20 errors and failed to get to 20 balls or if he made 10 errors and failed to get to 30? For the most part, we do not (unless they were horrible throwing errors leading to multiple extra bases). In both cases, he turned 80% of batted balls into outs.

This is a much better way to measure defense because it captures every play rather than just the subset of plays in which the fielder came in contact with the baseball. However, this type of metric has it’s limitations because it does not control for the difficulty or importance of the play.

Not All Batted Balls Are Alike

This is another simple truth about which everyone can agree. A rocket off the bat of Miguel Cabrera and a routine grounder from Seth Smith are very different batted balls. We want a defensive metric that includes all batted balls, but we also recognize that even moving in that direction doesn’t take use far enough.

Turning 80% of balls in your defensive zone into outs is great, but if a large portion of those are easy plays, that’s much less impressive than if they were more difficult.

Difficulty

A screaming line drive up the left center field gap and a routine fly ball to center field are both in the center fielder’s defensive zone. One of those balls is much easier to field than the other, so it stands to reason that more talented defenders would get to the more difficult play more often.

So we want a defensive statistic that does something to control for how challenging that particular play was to make. You should get more credit for a tough play than for an easy play. Typically, the modern defensive statistics (UZR, DRS, etc) measures this variable by determining how often that play is made by the entire league.

For example, if a certain play is made 40% of the time, then if the fielder makes the play, he gets credit for 0.6 times the run value of that play (we’ll get to this in a second). Because the average fielder should make that play 40% of the time, by making the play you get credit for the difference.

The advanced defensive stats all include these percentages based on multiple years of data. So if that screaming line drive is caught 30% of the time by center fielders, we’re basing that on all similar line drives over the last six seasons, for example. Humans have to code where the ball was hit, the approximate elevation, etc, but the algorithm is the one analyzing the data. The human being doesn’t say “that was a 40/60 play,” they say, “that ball was hit to X at about Y speed” and the computer compares it to all other similarly coded plays. There can be measurement error in defensive stats, but we aren’t talking about a random person guessing at the difficulty of the play.

Run Value

Using all plays and controlling for their difficulty is important, but we also want to consider how valuable it was to make that play. For example, imagine a hard hit ground ball deep in the hole at short. Maybe one out of every fifteen shortstops are able to turn it into an out. Call it a 7% chance the play gets made. If you make that play, you will get a lot of credit because it was very difficult, but if you hadn’t made the play, how much would it have cost your team?

In addition to difficulty, we also want to add in the average run value of the batted ball in some way. On that tough ground ball, if the play isn’t made then it’s almost always a clean single. It wouldn’t go for extra bases. No one is scoring from first. The play is hard to make, but the cost of failing to execute is lower than if we’re talking about a ball up the gap. So we want to multiply the difficulty times the value of making the play. You can read all about the specifics of this at our UZR Primer, but the concept should be pretty clear. You want the difficulty times the value of making the play.

So What Do We Have?

Instead of errors and fielding percentage, we want a defensive statistic that considers all batted balls and not just times the fielder touches the ball. We want a stat that measures the difficulty and the value of each play. That’s exactly what our advanced defensive metrics do. There’s nothing subjective or subversive going on here.

We’re taking some very fundamental questions about every play and we’re using multiple years of data to answer them. Limiting the number of errors you make is good, all else equal, but if you can get to 10% more batted balls than someone else while making a couple more errors, you’re almost certainly the better defensive player.

Limitations

It’s important to note that this does not mean that defensive stats are perfect. We’re relying on imperfect data. The video scouts can’t perfectly determine the location, velocity, and angle of every batted ball from watching the game tape. They do a very nice job, but there is measurement error. There will always be measurement error.

Additionally, sample size is an important consideration. There are a pretty small number of difficult batted balls hit to every fielder each year. If you luck into a few good plays or miss a few because you happened to be working with a bum ankle, your rating can fall quickly. That’s not a flaw of measurement, it’s a fact of baseball. You don’t get 700 chances to make dazzling plays each season. Even if we could get our measurements from an omnipotent baseball deity, we couldn’t do anything about sample size.

The same thing is true with offensive statistics. If a hitter goes 20 for 40 (a .500 batting average), you don’t say that his batting average is wrong. He got those 20 hits. What you might say is that 40 at bats is too small a sample to tell us very much about this hitter even if it is an accurate reflection of those 40 at bats.

Defensive metrics work the same way with respect to sample size. The metric isn’t wrong just because the output looks too large or small (although it could be wrong), but it might not be a very good reflection of what will happen in the future or how talented the fielder was for the previous few games.

You don’t need to take the precise measurements as gospel and I wouldn’t recommend it. But you should appreciate what these numbers are trying to tell you. These stats are answering the questions you want to have answered. There are all sorts of ways we might improve the measurements included in these stats and the ways in which we use them to determine talent and performance, but the fundamental logic is exactly what you want.

You want to know something about every ball hit to a fielder’s zone. You want to know how often that play gets made and if the fielder made it. And you want to know how valuable that play is on average. You don’t care about errors and put outs. You care about outs and things that aren’t outs. Don’t you?





Getting Started
 
wGDP

Neil Weinberg is the Site Educator at FanGraphs and can be found writing enthusiastically about the Detroit Tigers at New English D. Follow and interact with him on Twitter @NeilWeinberg44.

Login
Please login to comment
0 Comments
Inline Feedbacks
View all comments
You are going to send email to

Move Comment

Updated: Sunday, July 3, 2022 11:09 PM ETUpdated: 7/3/2022 11:09 PM ET
Player Linker - @fangraphs - Contact Us - Advertise - Terms of Service - Privacy Policy
sis_logo
All major league baseball data including pitch type, velocity, batted ball location, and play-by-play data provided by Sports Info Solutions.
mlb logo
Major League and Minor League Baseball data provided by Major League Baseball.
Mitchel Lichtman
All UZR (ultimate zone rating) calculations are provided courtesy of Mitchel Lichtman.
TangoTiger.com
All Win Expectancy, Leverage Index, Run Expectancy, and Fans Scouting Report data licenced from TangoTiger.com
Retrosheet.org
Play-by-play data prior to 2002 was obtained free of charge from and is copyrighted by Retrosheet.