The Best of the “Best Schools” Ratings

If there’s one thing I’ve learned this summer about what parents read it is that, most of the time, it has to do with the question starter “Where do I find the best…?”

Parents, I am right there with you. I love lists – the shorter the better – and ideally with pictures.

So, here’s a meta-exercise. Let’s rank school rankings.

Methodology? Ugh!

Parents are busy people who care about getting their children the “best.” We want to find out where the “best” is, how much the “best” will cost, and how can we can get the “best” at the best price. Parents want the data quickly, and they want the data in a pre-chewed fashion. These are just a few simple reasons why lists work.

But, not all school rankings are created equally. In fact, they’re extraordinarily unequal. As parents, we often put far too much faith in the idea that other people, or “experts,” know best about what’s best.

Here’s the thing: They don’t because they’re not usually experts.

The trouble is that in order to understand how these sources generate their lists, you need someone to give a darn about the study’s methodology. But, ugh…who wants to do that?

I am such a person.

It has forever bothered me that school rankings are based on one or two-dimensional statistics such as the number of Advanced Placement courses offered in the school like the Daily Beast’s list (pre-2014), or average scores on state-mandated tests like Great Schools, and School Diggeror combination of similar metrics like the US News and World Report Best High Schools list.

These rankings are seriously limited because the methodologies are seriously flawed.

Curious Measures of School Quality

First, who determined that those factors make a school “the best?” Basing school ratings on advanced placement classes matters very little and tells parents even less about the quality of a school when their child doesn’t qualify. Even when they do qualify to take the class, odds are against them that they will earn a high enough score on the AP test to “place out” of first-year college coursework anyway.

Only 20% high school graduates, or about 607,000 students, earned a “3” or higher on an AP exam in 2013. Remember, since America only graduates about 80% of students from high school, this means that only one-fifth of that 80% of high school students take and pass an AP exam.

This article in the Atlantic exposed the ratings machine as “meaningless,” and issued a full-out take down of AP as signifying anything but the antithesis of quality and rigor. The author notes these classes are typically about memorization and regurgitation rather than critical reading, reflection, analysis or synthesis – the high-leverage skills of a quality education. (For a counter-point on AP check out this article by Jay Mathews in the Washington Post.)

At the same time, the Atlantic article credited these organizations for making slight but important adjustments to their measurements:

To their credit, US News and Newsweek/Daily Beast, which also use AP and IB courses as a measure, have made their rankings more sophisticated and reasonable by also adding other measures of a school’s quality, such as graduation rates and college-acceptance rates, and performance on state accountability tests and the proficiency rates of a school’s least advantaged students on those tests.

Despite these amendments, the measures are flawed for the simple reason that they don’t help parents make informed decisions about where to buy a home to start their family. Young families want to know where to find the best Kindergarten. These parents realize the first years in elementary school are crucial. High school is nearly a decade away.

Are We Just Looking at Rankings of the Richest Districts?

Second, these rankings identify “best” schools where very few middle class Americans can afford to buy a home.

If you’ve ever read any of my previous blog posts, or if you follow these rankings and school data at all, you know that school performance is typically in direct relationship to the wealth of the school district. Put another way, wealth and poverty matter.

Newsweek’s recently released high school rankings (again limited geographically to participating schools and limited to averages on standardized tests) have taken to creating two different school rankings. They clarify:

The question, “What are the best schools?” has two different answers depending on whether or not student poverty is taken into account. In an effort to address the effect of socioeconomic disadvantage on education, Newsweek is publishing two lists: our “absolute” list and … our “relative” list, which ranks schools based on performance while also controlling for student poverty rates.

If you’re someone who prioritizes having your children attend a public school with other children from diverse socioeconomic backgrounds, or if you’re like a friend of mine who doesn’t want to “raise a child who is afraid of poor people,” you might want to know how a school performs regardless of what’s in the savings accounts of the parents who send their children to school there.

What are the “Best Metrics” for Measuring “Best Schools?”

Finally, these rankings are flawed because they mask so many indicators of quality that families and educators should prioritize.

There are many metrics that can tell you how well a school is performing just as well or better than standardized test scores. For example, many people might want to know how parents review the school, school safety in the district, the budgeting track record of administrators, the quality of the teaching force, or the size and diversity of the district.

So, drumroll please. Here is the shortlist of the best of the best school ratings that manages to do all that:

  1. Niche
  2. See above
  3. Sorry, that’s probably the only one, but I’m still looking.

Niche Rankings

Why Niche Wins

Niche has five winning features, and I can express them in a quick list too:

  1. They employ expert statisticians who
  2. draw from a fantastically rich dataset (NCES)
  3. to identify, cluster and weight important indicators
  4. with very little over-emphasis on any single indicator, and
  5. provide tools to parents on their website to dig and play in the data.

I’ll say more about each of these indicators and what they mean in a future blog post, and since you’re likely scurrying off to explore Niche’s ratings and rankings, I won’t say very much about Niche’s methodology either. Suffice it to say any group that references Bayesian probability and their subsequent weighting decisions in it’s How do we Compute our Rankings” section is an outlier among these groups in terms of their attention to detail.

I could deconstruct any list of “the best,” but if you’re looking for a fast source with interesting and accessible data, Niche is the best of the best.

The Shocking Truth about American Schools

Rafiq Sarlie "Shocked That I am Quitting Facebook"

We are bombarded by constant messages about the many failures of our nation’s schools, and how poorly America is doing in comparison to other nations.

I am not impervious to the allure of an outrageous headline. Sometimes I resist. Generally, I am a sucker for click-bait.

It’s old hat that people are instinctually drawn to these stories. There are few things more human than our desire to rubber-neck at the scene of an accident or obsess over people’s unchecked base instincts gone awry.

In studying these stories of the human condition, we tell ourselves we are learning what not to do and behaviors, people and scenarios to avoid.

We are also learning to be afraid … very, very afraid.

And so it goes with American public schools. Our nation appears to love stories about the failure of schools to the point where no other narrative can take hold.

I get lulled into the abyss of mediocrity and filth just as much as the next person by following headlines about teachers who show up drunk and pantless to the first day of school. I’m simultaneously repulsed by – and engrossed in – the endless deluge of stories about teachers who have abused their power and authority with children.

The shocking truth is that most American schools in most American states are actually doing very well. Even though it’s true, this message consistently falls on deaf ears. Decent and even exceptional performance in American schools simply doesn’t make for a good headline.

Headline News: American Public Schools do Shockingly Well

Your gut response to this headline might be skepticism or, even worse, boredom.

Let’s examine the evidence. Take a hard look at the information conveyed by this image:

b0f123c41This image is just a sliver of data consolidated by the National Center on Education Statistics (NCES). For more detailed information on international performance on math and science, check out the TIMSS data here. For more details on international tests of reading, take a look at PIRLS results here.

In a nutshell, international tests of eighth-graders’ math skills on the TIMSS test reveal:

  • American students in 34 states outperform students in Australia.
  • American students in 27 states outperform students in England.
  • American students in 25 states outperform students in Hong Kong.
  • American students in six states outperform students in Finland (the holy grail of school reform).
  • American students in two states (Massachusetts and Vermont) outperform students in Korea and Japan.

Here’s a question, why don’t the headlines read, “8th graders in Massachusetts and Vermont top all but two countries in the world at math?” or better yet “Six of Top-Ten Performing Education Systems in the World are in the U.S.?”

The news is even better for American students’ performance in reading on the PIRLS test. American students typically do better on reading assessments than they do on math assessments, and the stark differences between states and socioeconomic classes that appear in the TIMSS dataset are slightly less pronounced with reading.

Other good news is that our nation’s performance on reading assessments is on an upward trajectory, and the enormous achievement gaps revealed forty years ago are slowly shrinking.

Meanwhile, we’re all still drinking the “sucky schools Kool-aid.”

Parents in Poorly-Performing Schools Can Improve Children’s Outcomes in School

One thing that these results highlight is the stark inequality between states. This vast inequality is unappealing for many Americans. While we’re okay with unequal wealth, we are most certainly not okay with unequal opportunities to get wealth(y). So how can parents help level the playing field for their kids?

In an earlier post I mentioned that, knowing schools generally aren’t equal, many parents shop around for school districts that perform well. Parents who are able to shop around might also consider moving to a state that performs well by using this tool.

Even when a parent is not in the market for a new home, and even when a parent is living in state that is performing below the United States average (e.g. Mississippi or Alabama – sorry folks), parents should know that most of the inequality between schools is driven by poverty.

PIRLS results show that some strategies parents engage in to improve students’ scores are related to income. For example, children do better in reading when their parents read to and in front of their children. Meanwhile, we know that families living in poverty are disproportionately illiterate.

Parents are also encouraged to send well-rested children to schools, yet we know that in many cases, children living in poverty are housing-insecure or reside in multi-family households where it’s harder, for obvious reasons, to get good sleep. Two other income-dependent, parenting practices are:

  • sending children to schools that have safe and orderly environments
  • sending children who are well-fed to school

On the other hand, we also know that parents, regardless of income-level, can exercise a lot of influence. Variables deflating math and reading scores can be offset by proactive, income-independent parenting strategies. When the data is distilled down to just a handful of critical parenting practices, it turns out that all parents, regardless of income, can engage in these two high-leverage, research-proven strategies:

  • engender in their children a positive attitude toward reading.
  • stock the home with high quality books (borrowed or bought).

Confounding the Trend

American parents are largely distrustful of American public schools. In fact, in a recent poll 84% of parents gave American public schools the grade of “C” or worse. One thing is for sure, the media knows that distrust exists, and they play into it. The public eats it right up because it confirms our suspicions and fears. It’s a vicious cycle.

Would it be interesting to know the drunk and pantless “teacher” in that national story was a last-second hire, and was actually a substitute teacher not a full-time classroom teacher? Should we be appalled by her behavior? Yes. Does she exemplify the 3.5 million teachers who are generally well-qualified and who always remember to wear their pants when they go to work? Definitely not.

Professor Emeritus David Berliner of Arizona State University regularly argues that the “bad schools” narrative is manufactured crisis. Others, like Valerie Strauss from the Answer Sheet, and Diane Ravitch claim the “bad schools” message is strategically encouraged by wealthy, small-government political activists with the aim of encouraging Americans to divest from government-run public schools and invest in for-profit charter schools, private schools and vouchers programs to save our supposedly “failing system.”

To digest this data, and to understand that things are going pretty well in schools requires an understanding of the nuance behind the headline. Nuance doesn’t play well at the water cooler or in a 140-character Tweet.

The next time someone quips, “Gosh, our nation’s schools suck.” Your informed response could include that nuance. Just in case, here are some new soundbites for your witty retort.

  • Many American students are still outperforming their international peers.
  • American schools are educating a more diverse and global population than the “good ole days.”
  • 3,499,999 out of 3,500,000 teachers show up to school fully-dressed.
  • American schools are building a largely-literate nation through a publicly-funded initiative.

Scholars would call this “interrupting the narrative.” I might just call it “conveying truth.”

My only hope in countering this message is that parents begin to understand how much power they have in improving their children’s education. And, you don’t have to live in the wealthiest, highest-performing district in a top-performing state to support you children’s education either.

 

**I am inclined to advocate for BOTH structural adjustments our nation can make to offset the effects of poverty in schools AND local or individual adjustments we can make to offset those effects.

Why Douglas County, Colorado, Vouchers Were Ruled Unconstitutional

Diane Ravitch adds to the conversation on Colorado Supreme Court’s recent decision by grabbing the language from the state Constitution! It pays to follow the blog of an educational historian at dianeravitch.net The whole deal seems pretty cut and dry. Nevada next?

Diane Ravitch's blog

A few days ago, the Colorado Supreme Court ruled that the voucher plan adopted by the school board in Douglas County was unconstitutional. It was a split decision. It is puzzling that it was a split decision, because the Colorado state constitution explicitly prohibits any public funding of religious institutions.
Text of Section 7:
Aid to Private Schools, Churches, Sectarian Purpose, Forbidden.

Neither the general assembly, nor any county, city, town, township, school district or other public corporation, shall ever make any appropriation, or pay from any public fund or moneys whatever, anything in aid of any church or sectarian society, or for any sectarian purpose, or to help support or sustain any school, academy, seminary, college, university or other literary or scientific institution, controlled by any church or sectarian denomination whatsoever; nor shall any grant or donation of land, money or other personal property, ever be made by the…

View original post 91 more words

Where are the “Good Schools?”

When I tell people that I teach about education and education politics, I quickly hear their observations and misgivings about their communities. This often sounds like, “We bought our house before kids, and now we realize our neighborhood school’s test scores aren’t very good.”

Or, people express understandable concerns about the cost of living in the towns with the supposedly “good schools.” I love getting the question, “Where are the good schools?,” and I get it often.

The Home Advantage

At the end of the day, most parents who ask the question, “where are the good schools” are already doing many things in their typical parenting that are academically advantageous for their children: waiting to have children until they’re a little older and done with school, raising children with another adult co-parent, reading to -and reading in front of – their children.

Those home benefits, or what Annette Lareau calls the “Home Advantage” far outweigh some of the perceived risks of staying in or moving to a community that has less-than-desirable test scores in comparison to other area schools. (More on this in later posts.)

School rankings aren’t all equal

Despite this, people get a little…crazy… and start checking school rankings on websites like US News and World Report‘s best schools list or Great Schools. These rankings are generated based on a number of factors – chief among them are mean standardized test scores for a community.

One thing we all remember about means is that a few very low scores can really skew the mean. One other fundamental question to keep in mind is, “Is doing well on a standardized test really an indication of the type of intelligence I hope for my own child to exhibit?” It may be, but it’s still a worthwhile question to consider.

So, if you’re looking at these rankings to make decisions about where to raise a family, keep in mind that ranking methodology matters.  I like the group Niche‘s ranking metrics because they treat economic and cultural diversity as an asset in their methodology … because going to school with children from different cultural and socioeconomic backgrounds isn’t just an asset for all developing children, it is necessary for becoming a functional, thinking adult.

Other ways to determine school quality

Having said all that, I fully endorse the drive-by school check.  You can learn a lot by a school and by the level of parent involvement by how fresh the annuals look in the garden beds and how many parents linger at drop off and pick up. I think “parent-lingering” is a good measure of a positive community and high social capital (if not the presence of a lot of mama-gossips).

We drove by several elementary schools in several different towns before we settled on the town we chose.**  If you want to get deeply into it, check out state statistics on per pupil expenditure (usually direct correlation to the property tax rate) and there are a few other measures that are public information that I would direct you to if interested. A good one is average teacher salary, another is the student teacher ratio, and the number of average years the teaching force stays. Higher teacher attrition can often signal poor administration or weak social capital. Many of these stats are listed on the Niche site so that’s one-stop-shopping.

**This is a luxury that not everyone can exercise. Still there is much you can do to support your child’s education no matter how your community schools “rank” on these metrics. More on that in later posts as well.