"My rule was I wouldn't recruit a kid if he had grass in front of his house.
That's not my world. My world was a cracked sidewalk." —Al McGuire

Saturday, February 08, 2025

Cracketology: What's a Protected Seed Worth?

 

Marquette was the #12 overall seed when they reached the 2013 Elite Eight

Photo by Alex Brandon | AP Photo

Next week the NCAA Selection Committee will reveal their midseason top-16 seeds. The reveal is often considered a way for teams to gauge where they are at and for bracketologists to get an idea of how the Committee will approach Selection and Seeding. However we also hear about how in a single-elimination tournament, anything can happen and every team has a chance to win it all through their conference tournament and luck of the NCAA draw. Today, we will dig into the truth of that.

2012 was the first year the NCAA revealed their complete S-Curve. Cracked Sidewalks went back through every bracket since that reveal and pulled the data to see how far each of the protected seeds went. Past is not always a perfect predictor, but this might be worth bookmarking for March if you want an idea of how successful the various seeds are.

First, let's talk about what the table shows. Each seed is broken into four columns for the four exact seeds. So if we look at the first column, that represents the #1 overall seed, projected to be the favorite by the Selection Committee. The top line represents wins (see the leftmost column) by that exact seed, color coded so no shading represents an outcome that has never happened, lighter green shading representing fewer instances and darker shading representing more likely outcomes. The bottom shows the average number of wins per seed and the number of times that exact seed reached the Final Four (4 or more wins). With the data above, let's go seed by seed to see the best case scenario, worst case scenario, and expected results.

UConn captured the title as the #1 overall seed in 2024

Photo by Tyler Schank | NCAA Photos

1-Seeds

#1

Best Case: National Champions (2012 Kentucky, 2013 Louisville, 2024 Connecticut)

Worst Case: First Round loss (2018 Virginia)

Expectations: Half of all #1 seeds made the Final Four, with half of those winning it all. All but two made the second weekend, so if you are getting this seed, the expectation should be a second or third weekend run with odds as good as anyone of winning the title. 3.5 wins puts the average outcome between the Elite Eight and Final Four. Interestingly, this is the only exact seed that has had ever possible outcome, from zero wins to six.

#2

Best Case: National Champions (2018 Villanova, 2019 Virginia, 2021 Baylor)

Worst Case: Second Round loss (2015 Villanova)

Expectations: 33% of these teams reach the Final Four, but 92% made the second weekend, the highest rate of any exact seed. The #2 overall has been unlikely to be upset early and has also won the national title as often as any other seed. 3.42 wins puts the average outcome between the Elite Eight and Final Four, leaning slightly toward the former.

#3

Best Case: National Champions (2015 Duke, 2017 North Carolina, 2022 Kansas)

Worst Case: Second Round loss (2014 Wichita State, 2021 Illinois, 2023 Kansas)

Expectations: The #3 overall is less likely to go to the Final Four (42%) than the #1 but more likely to be a first weekend victim (25%) than the #2. 3.33 wins puts the average outcome between the Elite Eight and Final Four, leaning more likely to the former.

#4

Best Case: Runner-Up (2015 Wisconsin, 2017 Gonzaga)

Worst Case: First Round loss (2023 Purdue)

Expectations: This is the first notable expectation dropoff. Only 17% reach the Final Four, half as much as any other 1-Seed. 33% do not get out of the first weekend and the 2.33 wins on average puts the expected outcome between the Sweet Sixteen and Elite Eight with the former being more likely. Interestingly, when #4 seeds do get to the Final Four, they have always made the title game.

Kris Jenkins' buzzer beater won the title for #7 overall Villanova in 2016

Photo by Bob Donnan | USA Today

2-Seeds

#5

Best Case: Runner-Up (2012 Kansas)

Worst Case: First Round loss (2016 Michigan State)

Expectations: Considering this seed is the first team to not be a 1-Seed, it feels disappointing. No Final Four appearances since 2012, the fewest average wins of any 1/2-Seed and there are teams on the 3-Seed and 4-Seed lines that average more wins than the #5 overall. 1.92 average wins means the outcome is between one win and the Sweet Sixteen, with the latter far more likely.

#6

Best Case: Final Four (2016 Oklahoma, 2019 Michigan State)

Worst Case: First Round loss (2012 Duke, 2021 Ohio State, 2022 Kentucky)

Expectations: If the #6 can get out of the first round (three losses are the most for any 1/2-Seed) they will most likely go to the Elite Eight. Five times ending the season there is one of the highest prevalence outcomes. Despite that, the average win total of 2.25 (pulled down by the first round exits) puts them between the Sweet Sixteen and Elite Eight as the average finish, with the former more likely.

#7

Best Case: National Champions (2016 Villanova)

Worst Case: First Round loss (2013 Georgetown, 2023 Arizona)

Expectations: This is one of just three non-1-Seeds to win the title. This seed has a wide range of outcomes, and while the 2.25 win average puts them between the Sweet Sixteen and Elite Eight with the former more likely, having multiple outcomes of every possibility from a first round exit through the Final Four makes this one of the more unpredictable seeds.

#8

Best Case: Final Four (2014 Wisconsin, 2021 Houston, 2022 Duke)

Worst Case: First Round loss (2012 Missouri)

Expectations: The most frequent outcome is a second round loss, but when the #8 does get out of the first weekend, they make it to the Final Four half the time. The 2.00 average win total equates to a Sweet Sixteen expectation.

#10 overall seed Texas Tech came up short in 2019

Photo by Hannah Foslien | Getty Images

 

3-Seeds

#9

Best Case: Final Four (2017 Oregon)

Worst Case: First Round loss (2013 New Mexico, 2014 Duke, 2015 Iowa State, 2016 West Virginia)

Expectations: Like the #5 overall, the top 3-Seed is the least successful on its line. It stands out that this seed suffered four straight first round upsets followed by its only Final Four appearance. The four first round losses are tied for the most of any protected seed. By and large, this seed loses early. 67% of the time the #9 does not get out of the first weekend. 1.33 wins on average puts the expectation between one win and the Sweet Sixteen, with the former more likely.

#10

Best Case: Runner-Up (2019 Texas Tech)

Worst Case: First Round loss (2015 Baylor)

Expectations: While the highest frequency outcome is one win, this seed's outcomes are evenly split between a first weekend exit and making the Sweet Sixteen or better. 1.83 wins projects between one win and the Sweet 16, with the latter more likely.

#11

Best Case: Runner-Up (2018 Michigan)

Worst Case: First Round loss (2021 Texas, 2024 Kentucky)

Expectations: The Sweet Sixteen is the most frequent outcome, but they rarely go further than that (83% lose in the Sweet Sixteen or earlier). This is the seed that led to Shaka Smart leaving Texas for Marquette after the loss to Abilene Christian. 1.75 average wins puts most outcomes between the second round and Sweet 16, with the latter more likely.

#12

Best Case: Elite Eight (2013 Marquette, 2015 Notre Dame, 2018 Texas Tech, 2019 Purdue, 2024 Illinois)

Worst Case: Second Round loss (2012 Georgetown, 2021 Kansas)

Expectations: This has the narrowest range of outcomes, with every #12 seed winning between 1-3 games. 83% made the second weekend, but none went further. Because of the low volatility, the 2.25 average wins puts the expected outcome between the Sweet Sixteen and Elite Eight, with the former more likely. This seed has the best win average of any 3-Seed. Marquette checks in at #12 in today's S-Curve.

#13 overall UConn is the lowest protected seed to win a national title

Photo from Getty Images

 

4-Seeds

#13

Best Case: National Champions (2023 Connecticut)

Worst Case: First Round loss (2012 Michigan)

Expectations: This is the lowest protected seed to win it all, though 2014 7-Seed UConn won it from outside the protected seeds. While there's a wide outcome range, half of these teams saw their season end in the Sweet Sixteen, and the 2.33 average wins is the best exact seed outcome for any team outside the 1-Seed line. That win average leads to an expected finish between the Sweet Sixteen and Elite Eight, with the former more likely.

#14

Best Case: Elite Eight (2014 Michigan State, 2017 Florida)

Worst Case: First Round loss (2013 Kansas State, 2016 California, 2018 Wichita State, 2021 Purdue)

Expectations: This is the least successful protected seed. It is the only protected seed that has seen less than 50% of its teams reach the second weekend or beyond. The 1.25 win average puts the expectation between the second round and Sweet 16, with the former being more likely. The four first round losses are tied for the most of any protected seed.

#15

Best Case: Elite Eight (2015 Louisville)

Worst Case: First Round loss (2019 Kansas State, 2024 Auburn)

Expectations: This is the second least successful protected seed. It also has a narrow range of outcomes, with 75% of the teams winning 1-2 games. The 1.42 win average puts the expectation between the second round and Sweet 16, with the former being slightly more likely.

#16

Best Case: Final Four (2012 Louisville, 2024 Alabama)

Worst Case: First Round loss (2018 Arizona, 2021 Virginia, 2023 Virginia)

Expectations: The most frequent outcome is the Sweet 16, but there is a wide range of outcomes. The 2.00 win average puts the expectation at the Sweet 16.

Here's the updated S-Curve and bracket:


Multibid Leagues

SEC: 13

Big 10: 10

Big 12: 7

Big East: 4

ACC:4

MWC: 3

Big West: 2

WCC: 2

Monday, February 03, 2025

Yep, we have the NMD Sads too

 Welcome back #mubb fans, and we at #scrambledeggs are just as sad about the NMD result as you. We kind of, sort of, skip over the Butler game and jump right to the disappointing result against UCONN. We break down what we saw in the game, what we're concerned about, and how this team pivots from this moment. We then spend a lot of time talking about the St John's game on the road as it is likely the toughest test left on the schedule. We also talk about the road game at Creighton and what #mubb can do to replicate the early conference season victory. It's gonna be a tough week but there's potential to come out at the end of the week fighting for possession of a conference title. Enjoy!

Saturday, February 01, 2025

Cracketology: Is BPI Fixed?

 


ESPN's BPI metric has drawn criticism from all corners of bracketology

Image from espn.com

In 2022, Cracked Sidewalks called out a discrepancy in the rankings witnessed on the Basketball Power Index metric. It is one of the predictive metrics used on the NCAA's official team sheets that help with selection and (more so) seeding when it comes to the NCAA Tournament field. One of the things that really stood out at the time was how much BPI seemed to favor teams that were in leagues with ESPN television contracts. The reason that seemed newsworthy is because BPI was designed and is run by ESPN. That metric, along with another ESPN resume metric Strength of Record, are the only metrics on the team sheets that are owned and operated by a media company that has a vested financial interest in which teams are selected and perform well in the NCAA Tournament.

Earlier this week, @JBRBracketology pointed out that it looked like BPI might have been fixed. In recent years, BPI had a strong bias against Mountain West teams compared to other predictive metrics. JBR noted that over the years, BPI compared to kenpom rated MWC teams 39.2% worse (2022), 25.9% worse (2023), and 32.2% worse (2024). But compare last year to this year and it's a stark difference:

Comparison from @JBRBracketology

When we first looked at this our focus was on the 21 teams in the 2022 NET Top-100 that had BPI as a 10+ spot outlier from both of the other metrics in either a positive or negative direction. These are teams that are typically in the running for NCAA bids, either as at-large teams or the better performing mid-major teams that are able to earn automatic bids through their conference tournament. Here is the original graph we shared, with the "Average" being the average of the three predictive metrics at the time (BPI, kenpom, Sagarin) and the "Change" being the amount that BPI improved or decreased a team's metric average from the average of the other two metrics.

A few things stand out. First is the number of teams with radical changes in their ranking. 6 of the 21 outlier teams had a metric drag of greater than -10. The teams most effected were from the western part of the country, primarily in the Mountain West. Further, every team that had a metric advantage was broadcast on an ESPN network. We weren't the only ones to take issue with BPI. Another bracketologist pointed out that BPI had by design a negative impact on teams that played at elevation:

This certainly explained why teams like Wyoming, Colorado State, and BYU were negatively impacted. This also was a problem that provided a true issue for the teams it impacted. In the 2024 NCAA Tournament, excepting BYU and Gonzaga who were swapped seed lines to adhere to bracketing principles, here are the 6 teams that bracketmatrix.com found to be furthest away from their expected seed from the 227 bracketologists that participated:

Five of the six largest bracketmatrix discrepancies were negative seed impacts on Mountain West teams that play at elevation (Boise isn't in Made For March's tweet above, but they play 2,700 feet above sea level). Considering the league's lack of success in recent years, maybe those Mountain West teams were due to lose regardless, but their paths were significantly more difficult than would have been expected. Nevada, Boise, New Mexico, and Colorado State all lost in the Round of 64 as underdogs. Utah State won their opener in an 8/9 game, but then faced Purdue and lost. Might these teams have fared better if they had been given the expected 6-9 seeds their non-BPI metrics indicated they earned?

The excellent bracketology blog Bauertology also took BPI to task last year. He cites many different sources in his longer article but it all comes to the same conclusion Cracked Sidewalks had in 2022, that BPI was a problem that was an outlier from the other metrics and was negatively impacting teams. Now in 2025, it seems that these cries may not have fallen on deaf ears as the metric has clearly been reworked. First, let's look at a 2025 version of the top-100 NET outliers:


There are once again 21 outliers in the top-100, but only one team (#100 South Dakota State) is at a metric gain or drag of greater than 10. Not a single Mountain West team appears in our outliers, and Big East teams like UConn, Butler, and Providence actually benefit more from BPI than any other metrics, indicating the appearance of a network bias that seemed present in 2022 has been corrected, with eleven of the twelve most negatively impacted teams having ESPN contracts.

For those with Big East interests, eight of the eleven teams in the league have BPI as their best of the three predictive metrics, while just one (St. John's) has BPI as their worst metric. I would still argue this bears monitoring. It seems problematic that any of the team sheet metrics are intellectual property of a media outlet that has a vested interest in their media properties succeeding. I feel the NCAA would be better served still by replacing BPI with another predictive metric like Haslametrics or evanmiya that does not make money on league or team successes. I would much rather see something like BRCT (pronounced "bracket") on the team sheet than SOR. But if nothing else, an improvement to BPI is a welcome change.

Now let's see what BPI and the rest of the team sheet metrics and on-court results have produced with our latest S-Curve and bracket:



Multibid Leagues

SEC: 13

Big 10: 9

Big 12: 8

Big East: 4

ACC: 4

Mountain West: 3

WCC: 2

Big West: 2