October 23, 2013

New criteria debuts in today's NCAA Regional Rankings

By Christan Shirk

Today the NCAA Division III men’s and women’s soccer committees will release their first of three weekly regional rankings leading up to “selection Sunday” and the Monday release of the tournament field and brackets. And the primary and secondary ranking criteria have undergone some fairly significant revisions since last season. But before getting into that a more general introduction to the rankings is in order for those new to D-III soccer or those still not clear on the distinction and significance of the different rankings that exist.

By this point in the season, even new fans should be aware of the NSCAA regional and national rankings and the D3soccer.com national Top 25, but some might be confused when hearing about the NCAA regional rankings and have questions such as: Are these yet other rankings? Why haven't I seen these rankings yet this season? Are they important? Do they matter? Adding to the potential confusion, the NCAA includes the NSCAA (note the “S”) rankings on their website even though they are not NCAA rankings but rather rankings done by the National Soccer Coaches Association of America. You may have heard some fans chide that “the NSCAA and D3soccer.com rankings don't mean anything; it's the NCAA rankings that matter.” And they are right in that the NSCAA and D3soccer.com rankings do not play any part in the process of selecting teams for the NCAA championship tournaments; the NCAA's own rankings do as will be explained below.

However, I think it’s unfair to say the NSCAA and D3soccer.com rankings don't mean anything. They are useful for acknowledging the most successful teams and for fans to discover what schools outside their conference and their region are having great seasons. If done well, they can also give fans a feel for the relative strength of the teams they have seen when put in the national context. That is, they can be educational and informative. But equally they have entertainment value and can spark conversation and debate among fans. D-I basketball fans can banter and argue over the rankings while knowing they do not decide tournament berths, and there's no reason D-III soccer fans shouldn’t as well. Those who pooh-pooh these rankings as meaningless and chose to ignore them (or do they just feign?) miss the point and miss the fun.

That said, it is the NCAA regional rankings that are a critical piece of the pre-tournament puzzle, so let’s have a quick look at how they work and why they matter.

 

NCAA REGIONAL RANKINGS

The NCAA regional rankings are done by the same national and regional committees which will make the at-large selections for the men's and women's NCAA tournaments and the rankings are done by applying the same criteria which is used for making the at-large selections. The rankings are released following the fourth last, third last, and second last weeks prior to the tournament selections being made. Therefore, by design, these rankings are a direct foreshadowing of the at-large selections providing a certain level of transparency to the at-large selection process. It is for this reason that these rankings are so important and meaningful.

All information about the regional rankings is found in the Division III Soccer Pre-Championship Manual. Much of what follows highlights, summarizes, or quotes the manual.

Ranking Committees

The NCAA regional rankings are done by the eight-member NCAA Division III Men's and Women's Soccer Committees which are each composed of the chairs of their respective regional advisory committees. The Regional Advisory Committees assist the national committee in evaluating teams.  These are the same national and regional committees which will make the Pool B and Pool C at-large selections for the men's and women's NCAA tournaments. The members of these committees can be found on pages 9-12 of the Pre-Championship Manual.

Release Dates

As per the Pre-Championship Manual (pgs. 12 and 17), the rankings will be released on the following dates which correspond to the last three Wednesdays prior to the tournament selections being made:

• Wednesday, October 23

• Wednesday, October 30

• Wednesday, November 6

Like the NSCAA and D3Soccer.com rankings, they are based on results through the Sunday prior to their release.

Where to find the Rankings

The rankings are posted by the NCAA on their Division III men's and women's soccer webpages under "Rankings" where you must select the "Regional Rankings" option from the pull-down menu.  They are also conveniently available here on our site by selecting “Regional Rankings” from the “News” pull-down menu above or by clicking on the following links:

Men's Regional Rankings

Women's Regional Rankings

Size of the Rankings

The number of teams ranked differs from region to region and from men to women based on the number of eligible teams in each region. The top 15 percent of eligible teams (or a minimum of four) are ranked by the committees. As per the Pre-Championship Manual (pg. 17), the number of teams to be ranked in 2013 is as follows:

Men's Rankings

Central Region—6

East Region—9

Great Lakes Region—8

Mid-Atlantic Region—8

New England Region—11

North Region—7

South Atlantic Region—7

West Region—6

 

Women's Rankings

Central Region—6

East Region—8

Great Lakes Region—8

Mid-Atlantic Region—8

New England Region—12

North Region—8

South Atlantic Region—9

West Region—6

The regional alignments, school sponsorship, and eligibility by region can be found in Appendices B and C (“Men's Sponsorship” and "Women's Sponsorship, respectively) of the Pre-Championship Manual(pgs. 27-43).

Ranking Criteria  [revised for 2013]

The rankings are done by applying the same criteria which is used for making the at-large tournament selections. The at-large selection criteria are found in Section 2.4 of the Pre-Championship Manual (pg. 20). The criteria is divided between primary and secondary criteria, the latter only being considered if the former does not enable a distinction to be made between schools. The criteria has undergone a significant change for the 2013 season. Previously, only games versus "in-region" opponents were considered as part of the primary criteria, with secondary criteria considering "out-of-region" and non-Division III competition. The in-region/out-of-region distinction has been abandoned with primary criteria now considering all Division III opponents, while results versus non-Division III opponents (NAIA, NCCAA, Division II, Division I) are considered secondary criteria.

Primary Criteria (not listed in priority order)

  • Win-loss percentage against Division III opponents
  • Division III head-to-head competition
  • Results versus common Division III opponents
  • Results versus ranked Division III teams
  • Division III Strength-of-schedule

Secondary Criteria (not listed in priority order)

  • Non-Division III win-loss percentage
  • Results versus common non-Division III opponents
  • Non-Division III Strength-of-schedule

 

Strength-of-Schedule

The Strength-of-Schedule used by the Division III soccer committees is based on Opponents' Average Winning Percentage (OWP) and Opponents' Opponents' Average Winning Percentage (OOWP) with home and away multipliers being applied for men’s soccer but not for women's soccer. For men's schedules, a multiplier of 0.85 is applied for home games and 1.25 for away games. Neutral site games are assumed to be unfactored. An explanation with an example of these calculations is found in Appendix D (pg. 44) of the Pre-Championship Manual.

Opponents' Average Winning Percentage (OWP):

The average of opponents' winning percentages versus D-III competition excluding the results against the team in question.
(For men's teams, winning percentages are factored by 0.85 for opponents played at home and by 1.25 when played away.)

Opponents' Opponents' Average Winning Percentage (OOWP):

The average of the OWP's of all opponents.

Strength-of-Schedule (SOS):

The weighted OWP-OOWP, never specified but deduced to be
2/3 OWP + 1/3 OOWP

 

Regional Data Sheets

Along with the rankings, data sheets for each region are made available.  These data sheets, which include all teams in each region, provide some (but not all) of the data that was considered by the ranking committee.  The following data is listed: record and winning percentage against Division III opponents, results versus ranked Division III opponents, Division III SOS (all primary criteria), and non-Division III winning percentage (secondary criteria).  These sheets allow one a look at the numbers the committees had in front of them and therefore insight into why some teams are ranked and others not. The NCAA provides links to this data below the rankings. Direct links to the latest released data sheets are given below:

Men's Data Sheets

Central Region

East Region

Great Lakes Region

Mid-Atlantic Region

New England Region

North Region

South Atlantic Region

West Region

 

Women's Data Sheets

Central Region

East Region

Great Lakes Region

Mid-Atlantic Region

New England Region

North Region

South Atlantic Region

West Region

The data sheets can also be accessed by clicking the links on our regional rankings pages.

Definition of In-Region Competition

Starting with the current 2013 season, the in-region/out-of-region distinction no longer matters for ranking and at-large selection criteria. However, the NCAA has not removed all encouragement to minimize travel and missed class time as teams are still required to play a minimum of 70 percent of their games against in-region Division III opponents to simply be eligible for at-large tournament selection. So the distinction could still be important for teams that like to fill their non-conference schedule with a good number of opponents from outside their region. But given how broadly in-region competition is defined on page 19 of the Pre-Championship Manual to include much more than just other teams from your defined region (e.g. New England, East, Mid-Atlantic, etc.), this requirement isn't difficult to meet.

An opponent is considered in-region if any one of the following criteria is met:

  • within the same defined region
  • within a 200-mile driving radius
  • within the same membership geographical region defined as follows:

Region 1- Connecticut, Delaware, District of Columbia, Maine, Maryland, Massachusetts, New Hampshire, New Jersey, Rhode Island, Vermont

Region 2 - New York, Pennsylvania

Region 3- Alabama, Arkansas, Florida, Georgia, Indiana, Kentucky, Louisiana, Michigan, Mississippi, North Carolina, Ohio, Puerto Rico, South Carolina, Tennessee, Virginia, West Virginia

Region 4- Alaska, Arizona, California, Colorado, Hawaii, Idaho, Illinois, Iowa, Kansas, Minnesota, Missouri, Montana, Nebraska, Nevada, New Mexico, North Dakota, Oklahoma, Oregon, South Dakota, Texas, Utah, Washington, Wisconsin, Wyoming

  • within the same conference (in a conference scheduled match)
    (note: though not specified in the manual, in practice all matches of multi-region conferences have been counted as in-region)

 

"Secret" Final Rankings

As part of the at-large tournament selection process, the committees do final rankings that include the results from the final week prior to the tournament, usually the completion of conference tournaments. These rankings are not released, so one can only guess at how the final week's results may have prompted changes in the ranking of teams after the third of the scheduled rankings.  

FORESHADOWING THE AT-LARGE SELECTIONS:

SOME COMMENTS AND OBSERVATIONS

• Since these rankings are done by the same committees that make the at-large selections, using the same criteria as for at-large selections, they (as intended) have in the past very accurately foreshadowed the eventual at-large selections. Since their inception in 2003, there has only been one year (2010) in which there was more than one real head-scratcher on the men's side with many years having none.

• As such, a team that is not ranked has virtuially no shot at a Pool C berth. You can get your hopes up, but it's just not going to happen if history is any guide. In the past six years (2007-2012) no men's team that was unranked in the third weekly rankings (those released the Wednesday before the selections) got selected for the post-season tournament. In 2005 and 2006 it happened once each year, and at least in one of those cases the results of the final week easily explained the unranked team having improved their standing.

 • There will be nearly twice as many Pool C candidates in the rankings as available berths, so it isn't good enough to simply be ranked to make the NCAA tournament as most regions will have two to three ranked teams not selected. Even the strongest regions do not have all their ranked teams selected. A team typically needs to be in the top half of their regional rankings to be a safe bet for an at-large berth in the tournament.

 • History seems to indicate that the ranking of teams changes little in that last week. That is, rarely does a lower ranked team in the third weekly rankings get selected ahead of a higher ranked team. And that makes sense as one week only represents about 10% of the total schedule. There has also been a sense that conference tournament results do not have extra weighting because they are the most recent results nor because they may be considered "big" games, which is consistent with the established selection criteria. So do not expect big jumps or falls due to the final week's results.

 • Comparison of the regional data sheets with the rankings has shown in the past that strength of schedule is very important. The other thing that is important is record against ranked teams. If you do not understand why one team isn't ranked and another team is, or why one team is ranked higher than another, it probably is related to S-O-S and results against ranked teams.

 


Comments or feedback for the author?  Email Christan Shirk.



Jim Matson, Christan Shirk, Ryan Harmanis, and other staff writers and contributors help cover the games and results across the nation.

Questions or comments?

»  E-mail
Previous
Feb 28: Middlebury's Saward to retire after 2017 season
Nov 7: Midweek Wrap - Week 10
Nov 6: Upstate Update - Conference Playoff Edition
Nov 4: Women's Watch - Weekend #10
Nov 3: Week 10 Midwest Roundup
Oct 31: Midweek Wrap - Week 9
Oct 29: Week 9 Midwest Roundup
Oct 28: Upstate Update - Week 9
Oct 28: Women's Watch - Weekend #9
Oct 24: Midweek Wrap - Week 8
Oct 22: Week 8 Midwest Roundup
Oct 22: Upstate Update - Week 8
Oct 20: Women's Watch - Weekend #8
Oct 17: Midweek Wrap - Week 7
Oct 15: Week 7 Midwest Roundup
Oct 14: Upstate Update - Week 7
Oct 13: Women's Watch - Weekend #7
Oct 10: Midweek Wrap - Week 6
Oct 8: Week 6 Midwest Roundup
Oct 7: Upstate Update - Week 6
Oct 6: Women's Watch - Weekend #6
Oct 3: Midweek Wrap - Week 5
Oct 1: Midwest Roundup - Week 5
Sep 30: Upstate Update - Week 5
Sep 29: Women's Watch - Weekend #5
Sep 26: Midweek Wrap - Week 4
Sep 23: Midwest Roundup - Week 4
Sep 22: Upstate Update - Week 4
Sep 22: Women's Watch - Weekend #4
Sep 19: Midweek Wrap - Week 3
Sep 17: Midwest Roundup - Week 3
Sep 15: Upstate Update - Week 3
Sep 12: Midweek Wrap - Week 2
Sep 9: Midwest Roundup - Week 2
Sep 9: Upstate Update - Week 2
Sep 8: Women's Watch - Weekend #2
Sep 8: D-III soccer represented among Top 30 honorees for NCAA Woman of the Year
Sep 4: Midweek Wrap - Week 1
Sep 3: Midwest Roundup - Week 1
Aug 29: Curtains on three coaching legends
Aug 25: Midwest Roundup - 2014 Men's Preview
Nov 22: Getting to know the 2013 men's Sweet 16
Nov 10: Men's at-large berth analysis and predictions
Nov 7: AQ's, Pool B and Pool C? What does it all mean?
Oct 23: New criteria debuts in today's NCAA Regional Rankings
Sep 15: Week 3 Flybys, weekend edition
Aug 29: What's new in 2013?
Nov 14: Welcome to the Sweet 16, Part 2: the Men
Nov 13: Welcome to the Sweet 16, Part 1: the Women
Nov 4: At-large berth analysis and predictions
Nov 3: AQ's, Pool B and Pool C? What does it all mean?
Oct 1: Dear Men's Top 25 Voters
Sep 22: Week 4 Flybys, weekend edition
Sep 21: Week 4 Flybys, midweek edition
Sep 17: Week 3 Flybys
Sep 4: Labor Day Weekend Flybys
Sep 3: New rules, new conference, name changes
Aug 31: 2012 Preseason Flybys (INCOMPLETE)
Nov 14: Hellooooo Neumann!
Nov 13: A Super Saturday to like and dislike
Nov 6: At-large berth analysis and predictions
Nov 4: So what's this talk about AQ's, Pool B and Pool C?
Oct 24: Week 8 Flyby Distractions
Oct 19: NCAA Regional Rankings (aka 'The Rankings that Matter')
Oct 17: Week 7 Flybys, Conference Edition
Oct 14: Midseason stars and surprises
Oct 8: Week 6 Flybys, weekend edition
Oct 6: Week 6 Flybys, midweek edition
Oct 1: Week 5 Flybys, weekend edition
Sep 29: Week 5 Flybys, midweek edition
Sep 26: Did you know?
Sep 19: Who's top dog after 3 weeks?
Sep 10: Friday Notes, Weekend Questions
Sep 2: Off with a bang!
Sep 1: Preseason perspectives
Sep 1: After 17 years, trailblazer calls it a day
Dec 4: Inside the women's semifinals
Dec 4: Messiah takes the title in overtime
Dec 3: The stalwart against the upstart
Nov 30: Men's NCAA semifinal preview
Nov 30: Women's NCAA semifinal preview
Nov 21: NCAA men: Welcome to San Antonio!
Nov 21: NCAA women: Sunday's wins are a ticket to Texas
Nov 20: Sweet Saturday: HSU, Oshkosh are on to Texas
Nov 18: NCAA Sweet 16 men's preview
Nov 17: NCAA Sweet 16 women's preview
Nov 7: The AQs are in! Weekend in review
Oct 24: Big weekend for ranked teams
Oct 24: Hardin-Simmons keeps rolling
Oct 17: Did CNU's goal beat the clock?