The Best of the “Best Schools” Ratings

If there’s one thing I’ve learned this summer about what parents read it is that, most of the time, it has to do with the question starter “Where do I find the best…?”

Parents, I am right there with you. I love lists – the shorter the better – and ideally with pictures.

So, here’s a meta-exercise. Let’s rank school rankings.

Methodology? Ugh!

Parents are busy people who care about getting their children the “best.” We want to find out where the “best” is, how much the “best” will cost, and how can we can get the “best” at the best price. Parents want the data quickly, and they want the data in a pre-chewed fashion. These are just a few simple reasons why lists work.

But, not all school rankings are created equally. In fact, they’re extraordinarily unequal. As parents, we often put far too much faith in the idea that other people, or “experts,” know best about what’s best.

Here’s the thing: They don’t because they’re not usually experts.

The trouble is that in order to understand how these sources generate their lists, you need someone to give a darn about the study’s methodology. But, ugh…who wants to do that?

I am such a person.

It has forever bothered me that school rankings are based on one or two-dimensional statistics such as the number of Advanced Placement courses offered in the school like the Daily Beast’s list (pre-2014), or average scores on state-mandated tests like Great Schools, and School Diggeror combination of similar metrics like the US News and World Report Best High Schools list.

These rankings are seriously limited because the methodologies are seriously flawed.

Curious Measures of School Quality

First, who determined that those factors make a school “the best?” Basing school ratings on advanced placement classes matters very little and tells parents even less about the quality of a school when their child doesn’t qualify. Even when they do qualify to take the class, odds are against them that they will earn a high enough score on the AP test to “place out” of first-year college coursework anyway.

Only 20% high school graduates, or about 607,000 students, earned a “3” or higher on an AP exam in 2013. Remember, since America only graduates about 80% of students from high school, this means that only one-fifth of that 80% of high school students take and pass an AP exam.

This article in the Atlantic exposed the ratings machine as “meaningless,” and issued a full-out take down of AP as signifying anything but the antithesis of quality and rigor. The author notes these classes are typically about memorization and regurgitation rather than critical reading, reflection, analysis or synthesis – the high-leverage skills of a quality education. (For a counter-point on AP check out this article by Jay Mathews in the Washington Post.)

At the same time, the Atlantic article credited these organizations for making slight but important adjustments to their measurements:

To their credit, US News and Newsweek/Daily Beast, which also use AP and IB courses as a measure, have made their rankings more sophisticated and reasonable by also adding other measures of a school’s quality, such as graduation rates and college-acceptance rates, and performance on state accountability tests and the proficiency rates of a school’s least advantaged students on those tests.

Despite these amendments, the measures are flawed for the simple reason that they don’t help parents make informed decisions about where to buy a home to start their family. Young families want to know where to find the best Kindergarten. These parents realize the first years in elementary school are crucial. High school is nearly a decade away.

Are We Just Looking at Rankings of the Richest Districts?

Second, these rankings identify “best” schools where very few middle class Americans can afford to buy a home.

If you’ve ever read any of my previous blog posts, or if you follow these rankings and school data at all, you know that school performance is typically in direct relationship to the wealth of the school district. Put another way, wealth and poverty matter.

Newsweek’s recently released high school rankings (again limited geographically to participating schools and limited to averages on standardized tests) have taken to creating two different school rankings. They clarify:

The question, “What are the best schools?” has two different answers depending on whether or not student poverty is taken into account. In an effort to address the effect of socioeconomic disadvantage on education, Newsweek is publishing two lists: our “absolute” list and … our “relative” list, which ranks schools based on performance while also controlling for student poverty rates.

If you’re someone who prioritizes having your children attend a public school with other children from diverse socioeconomic backgrounds, or if you’re like a friend of mine who doesn’t want to “raise a child who is afraid of poor people,” you might want to know how a school performs regardless of what’s in the savings accounts of the parents who send their children to school there.

What are the “Best Metrics” for Measuring “Best Schools?”

Finally, these rankings are flawed because they mask so many indicators of quality that families and educators should prioritize.

There are many metrics that can tell you how well a school is performing just as well or better than standardized test scores. For example, many people might want to know how parents review the school, school safety in the district, the budgeting track record of administrators, the quality of the teaching force, or the size and diversity of the district.

So, drumroll please. Here is the shortlist of the best of the best school ratings that manages to do all that:

  1. Niche
  2. See above
  3. Sorry, that’s probably the only one, but I’m still looking.

Niche Rankings

Why Niche Wins

Niche has five winning features, and I can express them in a quick list too:

  1. They employ expert statisticians who
  2. draw from a fantastically rich dataset (NCES)
  3. to identify, cluster and weight important indicators
  4. with very little over-emphasis on any single indicator, and
  5. provide tools to parents on their website to dig and play in the data.

I’ll say more about each of these indicators and what they mean in a future blog post, and since you’re likely scurrying off to explore Niche’s ratings and rankings, I won’t say very much about Niche’s methodology either. Suffice it to say any group that references Bayesian probability and their subsequent weighting decisions in it’s How do we Compute our Rankings” section is an outlier among these groups in terms of their attention to detail.

I could deconstruct any list of “the best,” but if you’re looking for a fast source with interesting and accessible data, Niche is the best of the best.

Where are the “Good Schools?”

When I tell people that I teach about education and education politics, I quickly hear their observations and misgivings about their communities. This often sounds like, “We bought our house before kids, and now we realize our neighborhood school’s test scores aren’t very good.”

Or, people express understandable concerns about the cost of living in the towns with the supposedly “good schools.” I love getting the question, “Where are the good schools?,” and I get it often.

The Home Advantage

At the end of the day, most parents who ask the question, “where are the good schools” are already doing many things in their typical parenting that are academically advantageous for their children: waiting to have children until they’re a little older and done with school, raising children with another adult co-parent, reading to -and reading in front of – their children.

Those home benefits, or what Annette Lareau calls the “Home Advantage” far outweigh some of the perceived risks of staying in or moving to a community that has less-than-desirable test scores in comparison to other area schools. (More on this in later posts.)

School rankings aren’t all equal

Despite this, people get a little…crazy… and start checking school rankings on websites like US News and World Report‘s best schools list or Great Schools. These rankings are generated based on a number of factors – chief among them are mean standardized test scores for a community.

One thing we all remember about means is that a few very low scores can really skew the mean. One other fundamental question to keep in mind is, “Is doing well on a standardized test really an indication of the type of intelligence I hope for my own child to exhibit?” It may be, but it’s still a worthwhile question to consider.

So, if you’re looking at these rankings to make decisions about where to raise a family, keep in mind that ranking methodology matters.  I like the group Niche‘s ranking metrics because they treat economic and cultural diversity as an asset in their methodology … because going to school with children from different cultural and socioeconomic backgrounds isn’t just an asset for all developing children, it is necessary for becoming a functional, thinking adult.

Other ways to determine school quality

Having said all that, I fully endorse the drive-by school check.  You can learn a lot by a school and by the level of parent involvement by how fresh the annuals look in the garden beds and how many parents linger at drop off and pick up. I think “parent-lingering” is a good measure of a positive community and high social capital (if not the presence of a lot of mama-gossips).

We drove by several elementary schools in several different towns before we settled on the town we chose.**  If you want to get deeply into it, check out state statistics on per pupil expenditure (usually direct correlation to the property tax rate) and there are a few other measures that are public information that I would direct you to if interested. A good one is average teacher salary, another is the student teacher ratio, and the number of average years the teaching force stays. Higher teacher attrition can often signal poor administration or weak social capital. Many of these stats are listed on the Niche site so that’s one-stop-shopping.

**This is a luxury that not everyone can exercise. Still there is much you can do to support your child’s education no matter how your community schools “rank” on these metrics. More on that in later posts as well.