- Joined
- Jan 15, 2013
- Messages
- 8,330
- Name
- Erik
http://mmqb.si.com/2015/02/04/russell-wilson-super-bowl-49-interception-statistical-analysis/
John Biever/SI/The MMQB
There Was a 3.1% Chance of an Interception
'Worst play call in NFL history'? Hardly. Looking at all plays from the 1-yard line over the past 15 seasons, and factoring in time management, the Seahawks' play-calling wasn't ideal, but it wasn't that bad either
By Keith Goldner
numberFire.com
Super Bowl XLIX ended with one of the most incredible plays in NFL history: Malcolm Butler jumping Russell Wilson’s quick slant at the 1-yard line. After the interception, Pete Carroll and offensive coordinator Darrell Bevell were immediately crucified for the decision to pass instead of run the ball with beast of a running back Marshawn Lynch. Emmitt Smith, Peter King and many others called it some variation of “the worst play call in the history of football.” But was it really? We analyzed the numbers to find out.
The Situation
A refresher: The Seahawks were down four with 26 seconds remaining. Seattle, the most efficient rushing team in the NFL since 2000, faced a second-and-goal. They had one timeout remaining and New England, with three defensive backs on the field, lined up in man-to-man coverage against Seattle’s three-receiver set.
The Logic
In the NFL, with man-to-man coverage, the advantage goes to the offense. After burning two timeouts earlier in the drive, and with only 26 seconds remaining, it was not really feasible for the Seahawks to run the ball three straight plays. If they ran the ball on second down and failed, they would need to call their final timeout. Without a timeout, if they ran and were stopped on third down, it is unlikely they would have time to lineup for a fourth-down attempt. There are massive pileups at the goal line and it takes a while to get unpiled and set up. Obviously, three plays to score the go-ahead touchdown are better than two.
So, it appears the Seahawks would need to throw the ball on either second or third down to ensure three attempts. By throwing on second down and conserving their timeout, the Patriots would still have to play for either the pass or the run on third down. If they ran on second down, the Seahawks would almost surely pass on third down—which simplifies things for Bill Belichick’s defense.
The Execution
Every time I watch the play, I’m more and more convinced it was actually the execution that could have been better, rather than the play call. Ricardo Lockette runs a quick slant behind Jermaine Kearse, who tries (and fails) to set a pick for him. Lockette is certainly open, but Butler makes a tremendous break on the ball, somehow coming up with the interception.
If Wilson throws that ball into Lockette’s chest, like a quarterback is supposed to do on that throw, that’s a touchdown (or, worst case, an incompletion). If Lockette goes in stronger and anticipates the contact—which it appeared he did not—he’s in position for a touchdown as well (or, worst case, an incompletion).
It’s up to the quarterback and the receiver to make sure the defender has to go through the back of the receiver in order to make a play on the slant. While this is not the exact same situation (since they are at the 11-yard line, not the goal line), look where Tom Brady puts this ball on the slant to Brandon LaFell for a touchdown earlier in the game. Also, look at how LaFell has positioned himself between the ball and the corner.
The Stats
Enough qualitative analysis—what do the numbers say? If you recall earlier this year,we wrote about goal-to-go scenarios after the Eagles chose to pass the ball instead of run it at the goal line against the 49ers. Since 2000, teams on the 1-yard line have run the ball 74.0% of the time and were successful 53.9% of the time. Teams passing succeeded 48.3% of the time.
This year, both numbers were significantly higher. Teams ran in 129 touchdowns on 226 attempts (57.1%) and threw 66 touchdowns on 115 attempts (57.4%). But keep in mind, one year of data is still a pretty small sample size. 2013’s touchdown rate was just 49.5%, so there can be dramatic shifts from year to year.
Many are citing the fact that this was the first interception on the goal line all year. Historically, though, interceptions occur on 3.1% of passing plays from the 1-yard line. The biggest difference between rushing and passing on the goal line is the potential for bad outcomes. Large rushing losses are not common on dive plays, only fumbles. With a pass play, there are interceptions, sacks, and fumbles. Since 2000, sacks occurred on 4.4% of pass plays from the 1. Fumbles (both lost and recovered by the offense) occurred on 3.1% of rushing plays and 1.0% of pass plays (about half of those resulted in turnovers).
Our internal efficiency metric at numberFire.com, Net Expected Points (NEP) tells us that rushing plays at the 1 average +0.15 NEP per attempt, while pass plays lose -0.05 per drop back. That’s a one-point difference for every five plays.
These league-wide baselines are a great starting point, but unfortunately, they do not take into account the specific teams playing, score differential, time remaining, or personnel groupings.
In 2014, the Patriots faced seven plays at the goal line (six rush, one pass). They surrendered six touchdowns (five on rushes, one through the air). The Seahawks ran nine plays from the goal line, running the ball seven times (scoring just three times, 42.9%) and throwing twice (scoring once). These sample sizes are clearly far too small to draw any conclusions.
Last, let’s look at the specific situation: down by four to eight points (one possession but more than a field goal) with under one minute remaining. Since 2000, there are 73 such situations with a success rate of just 42.5%—dramatically lower than the rest of the game. Passes converted 48.5% of the time and rushes a measly 37.5% on 40 attempts.
This is, of course, another small sample size issue and there is a slight sample bias in that the trailing team will typically be the less-efficient team. If we look at all trailing teams, that expands the sample to 153 plays: 41.1% pass success, 43.0% run success. It’s also worth noting that the pass-to-run ratio is much closer to 50-50 in these end-of-game situations.
In short-yardage situations, running the ball is generally the better option. But, teams cannot run the ball every time, as there is a huge element of game theory in play calling. Offenses try to capitalize and increase their odds with specific matchups (like man-to-man coverage).
There does appear to be a decline in conversion rates in these high-stress situations, when quick but critical judgments need to be made. We would need more data, though, to truly verify this theory.
The Seahawks probably should have run the ball—although that’s much easier to say with hindsight on our side. Conversion rates are higher and thus, the Seahawks chances of winning would be higher, we estimate by about 5.6%. But, was the decision to throw the ball the worst play call in history? Not even close.
If the Seahawks score there, no one thinks twice about the decision. Instead, Belichick would be ridiculed for the blatant mistake of not taking his timeouts once the Seahawks were in a goal-to-go scenario. But the interception happened, so it’s Carroll taking the heat.
Keith Goldner is the chief analyst at numberFire.com. Follow him @keithgoldner.
This piece is full of fallacies and bad reasoning and is every bit as guilty as the same thing that led to the bad playcall in the first place - overthinking things.
First of all, all those statistics don't mean squat to the actual game situation in which the play call was made. It's not blackjack, i.e. it's not a case where past results affect present results. It's more like craps. Rolling snake eyes 6 times in a row has absolutely no bearing whatsoever on whether roll #7 results in snake eyes.
Second, the statistics lump all passes from the one yard line into the same category. No distinction among fade patterns (much safer and harder to intercept), play action (which could freeze the defense for a split second), or throwing into the middle of the field on a pass where the QB has little if any time to make a read.
Third, it doesn't fully take into account of the particular game situation - and importantly - the emotional state of the teams at the moment. The Seahawks had just put the ball on the five yard line with an insanely good (or lucky ... or both) catch, followed by Lynch picking up four yards to the one on the next play. The Patriots had to be sweating bullets and fearing the worst at the moment, and they were ripe for getting bowled over by sheer physicality.
Fourth, even if you do pass, there are passes that are much, much safer than the one they threw. A fade pass has a much lower probability of getting intercepted than one thrown into the middle of the field. A play action pass, when everybody was expecting a Lynch run, could have easily sprung somebody open while buying Wilson an extra second to be sure of the throw.
However, in the end, sometimes the simple and obvious solution is the best one, even if the other team knows what's coming. Running the ball in from the one in that situation - second and goal, one timeout remaining - is more a matter of will than a matter of strategy. You bring in your personnel for short yardage running, line your guys up against their guys and challenge them to beat them one on one. It's just a matter of will. And when you have a back like Lynch who is physical and great at breaking tackles, your odds are significantly increased. Here is Exhibit A of that, Super Bowl 17. Redskins ball, 4th and inches. Redskins in short yardage rushing personnel. Dolphins D in short yardage personnel, up on the line of scrimmage. The only bit of trickery at all is an H-back who goes in motion and reverses. Still, everybody in that stadium, including EVERY Dolphin defender KNEW what was going to happen when the ball was snapped. The KNEW that Theisman would turn around and hand the ball to John Riggins. No strategy here, just two teams trying to impose their will on each other, with only one team successful.
If Carroll and Bevel didn't think their offense could impose its will on the Patriots defense, in that situation and with Beast Mode int he backfield, then yes, they most certainly deserved to lose that game.
