October 19, 2011

NCAA Regional Rankings (aka 'The Rankings that Matter')

By Christan Shirk

Today the NCAA Division III men’s and women’s soccer committees will release their first of three weekly regional rankings leading up to “selection Sunday” and the release of the tournament brackets.  Those new to the D-III soccer scene (and maybe some not so new) might be confused about what these rankings are since we already have the NSCAA regional and national rankings and the D3soccer.com national Top 25.  Even though the NCAA includes them on their site, adding to the potential confusion, the NSCAA (note the “S”) rankings are not NCAA rankings but rather rankings done by the National Soccer Coachers Association of America.  You may have heard long-time fans chide that “the NSCAA and D3soccer.com rankings don't mean anything; it's the NCAA rankings that matter.”  And they are right in that the NSCAA and D3soocer.com rankings do not play any part in the process of selecting teams for the NCAA championship tournaments; the NCAA's own rankings do as will be explained below. 

However, I think it’s unfair to say the NSCAA and D3soccer.com rankings don't mean anything.  They are useful for acknowledging the most successful teams and for fans to discover what schools outside their conference and their region are having great seasons.  If done well, they can also give fans a feel for the relative strength of the teams they have seen when put in the nationwide context.  That is, they can be educational and informative.  But equally they have entertainment value and can spark conversation and debate among fans.  D-I basketball fans can banter and argue over the rankings while knowing they do not decide tournament berths, and there's no reason D-III soccer fans shouldn’t as well.  Those who pooh-pooh these rankings as meaningless and chose (or do they just feign?) to ignore them miss the point and miss the fun.

That said, it is the NCAA regional rankings that are a critical piece of the pre-tournament puzzle, so let’s have a quick look at how they work and why they matter.

 

NCAA REGIONAL RANKINGS

The NCAA regional rankings are done by the same national and regional committees which will make the at-large selections for the men's and women's NCAA tournaments and the rankings are done by applying the same criteria which is used for making the at-large selections.  The rankings are released following the fourth last, third last, and second last weeks prior to the tournament selections being made.  Therefore, by design, these rankings are a direct foreshadowing of the at-large selections providing a certain level of transparency to the at-large selection process.  It is for this reason that these rankings are so important and meaningful.

All information about the regional rankings is found in the Division III Soccer Pre-Championship Manual, which can be linked to from the NCAA Division III Men's and Women's Soccer Administration pages.  Much of what follows highlights, summarizes, or quotes the manual.

Ranking Committees

The NCAA regional rankings are done by the eight-member NCAA Division III Men's and Women's Soccer Committees which are each composed of the chairs of their respective regional advisory committees.  The Regional Advisory Committees assist the national committee in evaluating teams.  These are the same national and regional committees which will make the Pool B and Pool C at-large selections for the men's and women's NCAA tournaments.  The members of these committees can be found on pages 10-14 of the Pre-Championship Manual.

Release Dates

As per the Pre-Championship Manual (pgs. 14, 19-20), the rankings will be released on the following dates which correspond to the last three Wednesdays prior to the tournament selections being made:

• Wednesday, October 19

• Wednesday, October 26

• Wednesday, November 2

Like the NSCAA and D3Soccer.com rankings, they are based on results through the Sunday prior to their release.

Where to find the Rankings

The rankings are posted by the NCAA on their men's and women's soccer pages, under the "Rankings" tab and right here on our site where they can be found by selecting “Regional Rankings” from the “News” pull-down menu above or by clicking on the following links:

Men's Regional Rankings

Women's Regional Rankings

Size of the Rankings

The number of teams ranked differs from region to region and from men to women based on the number of eligible teams in each region.  The top 15 percent of eligible teams (or a minimum of four) are ranked by the committees.  As per the Pre-Championship Manual (pgs. 19-20), the number of teams to be ranked in 2011 is as follows:

Men's Rankings

Central Region—6

East Region—9

Great Lakes Region—7

Mid-Atlantic Region—7

New England Region—11

North Region—7

South Atlantic Region—7

West Region—6

 

Women's Rankings

Central Region—6

East Region—8

Great Lakes Region—7

Mid-Atlantic Region—8

New England Region—12

North Region—8

South Atlantic Region—9

West Region—6

The regional alignments and school sponsorship and eligibility by region can be found in Appendix B “Sport Sponsorship” of the Pre-Championship Manual (pgs. 31-42)

Ranking Criteria

The rankings are done by applying the same criteria which is used for making the at-large selections.  The at-large tournament selection criteria are found in Section 2.4 of the Pre-Championship Manual (pgs. 24-25).  The criteria is divided between primary criteria which only consider regional competition and secondary criteria that introduce out-of-region and non-Division III competition, the later only being considered if the former does not enable a distinction to be made between schools.

Primary Criteria (not listed in priority order)

  • Win-loss percentage against regional opponents
  • Strength-of-schedule (only contests versus regional competition)
  • In-region head-to-head competition
  • In-region results versus common regional opponents
  • In-region results versus regionally ranked teams

Secondary Criteria (not listed in priority order)

  • Out-of-region head-to-head competition
  • Overall Division III win-loss percentage
  • Results versus common non Division III opponents
  • Results versus all Division III ranked teams
  • Overall win-loss percentage
  • Results versus all common opponents
  • Overall DIII Strength of Schedule

 

Strength-of-Schedule

The Strength-of-Schedule used by the Division III soccer committees is based on Opponents' Average Winning Percentage (OWP) and Opponents' Opponents' Average Winning Percentage (OOWP) with home and away multipliers being applied on the men’s side for the first time in 2011 (no multipliers are applied on the women's side).   A multiplier of 0.85 is applied for home games and 1.25 for away games.  Though not specified, neutral site games are assumed to be unfactored.  An explanation with an example of these calculations is found in Appendix C (pg. 43) of the Pre-Championship Manual.

Opponents' Average Winning Percentage (OWP):

The average of applicable opponents' winning percentages versus D-III competition excluding the results against the team in question.
(For men's teams, winning percentages are factored by 0.85 for opponents played at home and by 1.25 when played away.)

Opponents' Opponents' Average Winning Percentage (OOWP):

The average of the OWP's of all applicable opponents.

Strength-of-Schedule (SOS):

The weighted OWP-OOWP, never specified but deduced to be
2/3 OWP + 1/3 OOWP

 

It will be interesting to observe the effect of this new wrinkle that differentiates between home and away games.  While in general it seems an improvement to make this distinction, I can imagine some complaints about the degree to which it is factored into the calculation.  An away game is basically worth 1.5 times a home game (1.25/0.85=1.47).  Is it really 50% more difficult to defeat a given opponent away versus at home?—that's the question.     

Definition of In-Region Competition

The rankings will list each ranked school's in-region and overall record.  Many are initially confused by some of the regional records they see because they somewhat sensibly assume that only opponents from the same region would count towards one's in-region record.  However, page 23 of the Pre-Championship Manual defines in-region competition much more broadly than that.

An opponent is considered in-region if any one of the following criteria is met:

  • within the same defined region
  • within a 200-mile driving radius
  • within the same membership geographical region defined as follows:

Region 1 - Connecticut, Delaware, District of Columbia, Maine, Maryland, Massachusetts, New Hampshire, New Jersey, Rhode Island, Vermont

Region 2 - New York, Pennsylvania

Region 3 - Alabama, Arkansas, Florida, Georgia, Indiana, Kentucky, Louisiana, Michigan, Mississippi, North Carolina, Ohio, Puerto Rico, South Carolina, Tennessee, Virginia, West Virginia

Region 4 - Alaska, Arizona, California, Colorado, Hawaii, Idaho, Illinois, Iowa, Kansas, Minnesota, Missouri, Montana, Nebraska, Nevada, New Mexico, North Dakota, Oklahoma, Oregon, South Dakota, Texas, Utah, Washington, Wisconsin, Wyoming

  • within the same conference (in a conference scheduled match)
    (note: though not specified in the manual, in practice all matches of multi-region conferences have been counted as in-region)

 

Regional Data Sheets

Along with the rankings, regional data sheets will be made available that summarize some of the in-region data (primary criteria) for all teams in the region.  The following in-region data is listed: win percentage, OWP, OOWP, SOS, and record versus ranked teams.  These sheets allow one a look at the numbers the committees had in front of them and therefore insight into why some teams are ranked and others not.  The NCAA provides links to this data below the rankings.  Direct links to the current data sheets are given below:

Men's Data Sheets

Central Region

East Region

Great Lakes Region

Mid-Atlantic Region

New England Region

North Region

South Atlantic Region

West Region

 

Women's Data Sheets

Central Region

East Region

Great Lakes Region

Mid-Atlantic Region

New England Region

North Region

South Atlantic Region

West Region

 

"Secret" Final Rankings

As part of the at-large tournament selection process, the committees do final rankings that include the results from the final week prior to the tournament, usually the completion of conference tournaments.  These rankings are not released prior to the announcement of the Pool B and Pool C at-large berths and the tournament brackets.  Two years ago these previously secret final rankings were made available after the fact, but last year they were once again were not. If they are not released or until such time as they are, one can only guess at how the final week's results may have prompted changes in the ranking of teams since the third of the scheduled rankings. 

 

FORESHADOWING THE AT-LARGE SELECTIONS:

SOME COMMENTS AND OBSERVATIONS

• Since these rankings are done by the same committees that make the at-large selections, using the same criteria as for at-large selections, they (as intended) have very accurately foreshadowed the eventual at-large selections.  Since their inception in 2003, last year is the only year in which there was more than one real head-scratcher on the men's side with many years having none.

• As such, a team that is not ranked has no shot at a Pool C berth.  You can get your hopes up, but it's just not going to happen if history is any guide.  In the past four years (2007-2010) no men's team that was unranked in the third released rankings got selected.  In 2005 and 2006 it happened once each year, and at least in one of those cases the results of the final week easily explained the unranked team having improved their standing.

 • There will be nearly twice as many Pool C candidates in the rankings as available berths, so it isn't good enough to simply be ranked to make the NCAA's as most regions will have 2 or 3 ranked teams not selected, with the strongest couple regions having just one left out.  In the past two years no region had all their ranked men's teams make the NCAA's.

 • History tells us that little changes in the ranking of teams in that last week, last year being the first time that perception was somewhat challenged.  And that makes sense as one week only represents about 10% of the total schedule.  Also there has been a sense that conference tournament results aren't weighted extra for being most recent and for being conference tournament results, which would be consistent with the primary and secondary criteria.  So do not expect big jumps or falls due to the final week's results (mostly conference tournaments). 

 • Comparison of the in-region data sheets with the rankings has shown in the past that strength of schedule is very important.  The other thing that is important is record against ranked teams.  If you do not understand why one team isn't ranked and another team is, or why one team is ranked higher than another, it probably is related to S-O-S and results against ranked teams.

 


Comments or feedback for the author?  Email Christan Shirk.

Want to discuss this article with other fans?  Opine here.



James Derrick

 

Christan Shirk is a Messiah College graduate (1993, Civil Engineering) and has been a keen and passionate observer of D-III soccer for over a decade.  Never more than a rec-league player himself, Chris brings an analytical approach and nationwide perspective to his writing.  He loves D-III soccer history, statistical number-crunching, and off-the-radar action, all of which he gladly shares with his readers. 

 

2010 columnist: James Derrick 

Previous