How Legit Is This New Online MBA Ranking?

Online

COMMENTARY:

Business school rankings have become as common as UFO sightings a few years ago—and more often than not lists that purport to measure the quality of an MBA experience is an unidentified flying object of sorts.

Even at the highest level—the five most influential rankings of MBA programs by U.S. News & World Report, The Financial Times, Bloomberg Businessweek, The Economist and Forbes—they are filled with substantial flaws, intellectual dishonesty, and downright stupidity by people who design the often senseless methodologies.

But at least in those rankings, you know exactly what is getting measured. The inputs and outputs are fairly transparent, along with the weights applied to each metric used to crank out the ranking. Which leads us to the most important advice for every applicant looking at a ranking: If there is little to no transparency in a ranking, it has flunked the smell test. Pay no attention whatsoever to it because the “ranking” is little more than an attempt to generate clicks on the Web. Nothing more. Nothing less.

THE LAUGHING STOCK OF THE RANKINGS COMES OUT WITH ANOTHER LAUGHING STOCK

That’s the case with the latest ranking by the Princeton Review, published yesterday (May 12), of online MBA programs. This is the first time the test prep company has ranked online offerings. Its ranking of the best business schools and programs for entrepreneurship has long been considered by many “the laughing stock” of all the rankings. So there’s little surprise that this new list of online programs would be any different.

Here’s the basic problem: The Princeton Review fails to disclose exactly how it is ranking these programs so no ONE really knows what exactly is being measured. The organization vaguely says the ranking is “based on comprehensive surveys conducted in the 2014 academic year of students and administrators at MBA programs offering at least 75% of their program of study online.”

A VAGUE METHODOLOGY THAT DOESN’T TELL YOU SQUAT

The most detail you get into the methodology is reduced to two vague sentences:

“The survey for school administrators, which evaluated more than 30 fields, covers admissions selectivity, graduation and retention rates, faculty training and credentials, technological infrastructure, student indebtedness, and career outcomes among other items.”

“The survey for students, which also evaluates more than 30 unique fields, allows students to rate their faculty, their fellow students, career preparation, academics, the technology platform, and overall satisfaction with their programs.”

How Two Online MBA Rankings Compare

SchoolPrinceton Review RankU.S. News Rank
North Carolina (Kenan-Flagler)11
Indiana (Kelley)21
IE Business School3NR
Arizona State (Carey)44
Temple (Fox)51
Florida (Hough)64
Rochester Institute of Tech (Saunders)725
Thunderbird821
Texas-Dallas (Jindal)96
Northeastern (D’Amore-McKim)1036
James Madison1112
Auburn (Harbert)1210
North Dakota1332
North Texas1447
Hofstra (Zarb)1541
South Dakota (Beacom)1641
Nebraska-Lincoln1721
Syracuse (Whitman)1857
George Washington1944
North Carolina State209
West Georgia (Richards)2144
State University of New York-Oswego2257
Memphis (Fogelman)2366
Nevada-Reno2429
Washington State (Carson)2521

Source: Poets&Quants analysis of U.S. News and Princeton Review 2015 rankings of online MBA programs