The Best of the “Best Schools” Ratings

If there’s one thing I’ve learned this summer about what parents read it is that, most of the time, it has to do with the question starter “Where do I find the best…?”

Parents, I am right there with you. I love lists – the shorter the better – and ideally with pictures.

So, here’s a meta-exercise. Let’s rank school rankings.

Methodology? Ugh!

Parents are busy people who care about getting their children the “best.” We want to find out where the “best” is, how much the “best” will cost, and how can we can get the “best” at the best price. Parents want the data quickly, and they want the data in a pre-chewed fashion. These are just a few simple reasons why lists work.

But, not all school rankings are created equally. In fact, they’re extraordinarily unequal. As parents, we often put far too much faith in the idea that other people, or “experts,” know best about what’s best.

Here’s the thing: They don’t because they’re not usually experts.

The trouble is that in order to understand how these sources generate their lists, you need someone to give a darn about the study’s methodology. But, ugh…who wants to do that?

I am such a person.

It has forever bothered me that school rankings are based on one or two-dimensional statistics such as the number of Advanced Placement courses offered in the school like the Daily Beast’s list (pre-2014), or average scores on state-mandated tests like Great Schools, and School Diggeror combination of similar metrics like the US News and World Report Best High Schools list.

These rankings are seriously limited because the methodologies are seriously flawed.

Curious Measures of School Quality

First, who determined that those factors make a school “the best?” Basing school ratings on advanced placement classes matters very little and tells parents even less about the quality of a school when their child doesn’t qualify. Even when they do qualify to take the class, odds are against them that they will earn a high enough score on the AP test to “place out” of first-year college coursework anyway.

Only 20% high school graduates, or about 607,000 students, earned a “3” or higher on an AP exam in 2013. Remember, since America only graduates about 80% of students from high school, this means that only one-fifth of that 80% of high school students take and pass an AP exam.

This article in the Atlantic exposed the ratings machine as “meaningless,” and issued a full-out take down of AP as signifying anything but the antithesis of quality and rigor. The author notes these classes are typically about memorization and regurgitation rather than critical reading, reflection, analysis or synthesis – the high-leverage skills of a quality education. (For a counter-point on AP check out this article by Jay Mathews in the Washington Post.)

At the same time, the Atlantic article credited these organizations for making slight but important adjustments to their measurements:

To their credit, US News and Newsweek/Daily Beast, which also use AP and IB courses as a measure, have made their rankings more sophisticated and reasonable by also adding other measures of a school’s quality, such as graduation rates and college-acceptance rates, and performance on state accountability tests and the proficiency rates of a school’s least advantaged students on those tests.

Despite these amendments, the measures are flawed for the simple reason that they don’t help parents make informed decisions about where to buy a home to start their family. Young families want to know where to find the best Kindergarten. These parents realize the first years in elementary school are crucial. High school is nearly a decade away.

Are We Just Looking at Rankings of the Richest Districts?

Second, these rankings identify “best” schools where very few middle class Americans can afford to buy a home.

If you’ve ever read any of my previous blog posts, or if you follow these rankings and school data at all, you know that school performance is typically in direct relationship to the wealth of the school district. Put another way, wealth and poverty matter.

Newsweek’s recently released high school rankings (again limited geographically to participating schools and limited to averages on standardized tests) have taken to creating two different school rankings. They clarify:

The question, “What are the best schools?” has two different answers depending on whether or not student poverty is taken into account. In an effort to address the effect of socioeconomic disadvantage on education, Newsweek is publishing two lists: our “absolute” list and … our “relative” list, which ranks schools based on performance while also controlling for student poverty rates.

If you’re someone who prioritizes having your children attend a public school with other children from diverse socioeconomic backgrounds, or if you’re like a friend of mine who doesn’t want to “raise a child who is afraid of poor people,” you might want to know how a school performs regardless of what’s in the savings accounts of the parents who send their children to school there.

What are the “Best Metrics” for Measuring “Best Schools?”

Finally, these rankings are flawed because they mask so many indicators of quality that families and educators should prioritize.

There are many metrics that can tell you how well a school is performing just as well or better than standardized test scores. For example, many people might want to know how parents review the school, school safety in the district, the budgeting track record of administrators, the quality of the teaching force, or the size and diversity of the district.

So, drumroll please. Here is the shortlist of the best of the best school ratings that manages to do all that:

  1. Niche
  2. See above
  3. Sorry, that’s probably the only one, but I’m still looking.

Niche Rankings

Why Niche Wins

Niche has five winning features, and I can express them in a quick list too:

  1. They employ expert statisticians who
  2. draw from a fantastically rich dataset (NCES)
  3. to identify, cluster and weight important indicators
  4. with very little over-emphasis on any single indicator, and
  5. provide tools to parents on their website to dig and play in the data.

I’ll say more about each of these indicators and what they mean in a future blog post, and since you’re likely scurrying off to explore Niche’s ratings and rankings, I won’t say very much about Niche’s methodology either. Suffice it to say any group that references Bayesian probability and their subsequent weighting decisions in it’s How do we Compute our Rankings” section is an outlier among these groups in terms of their attention to detail.

I could deconstruct any list of “the best,” but if you’re looking for a fast source with interesting and accessible data, Niche is the best of the best.

The Shocking Truth about American Schools

Rafiq Sarlie "Shocked That I am Quitting Facebook"

We are bombarded by constant messages about the many failures of our nation’s schools, and how poorly America is doing in comparison to other nations.

I am not impervious to the allure of an outrageous headline. Sometimes I resist. Generally, I am a sucker for click-bait.

It’s old hat that people are instinctually drawn to these stories. There are few things more human than our desire to rubber-neck at the scene of an accident or obsess over people’s unchecked base instincts gone awry.

In studying these stories of the human condition, we tell ourselves we are learning what not to do and behaviors, people and scenarios to avoid.

We are also learning to be afraid … very, very afraid.

And so it goes with American public schools. Our nation appears to love stories about the failure of schools to the point where no other narrative can take hold.

I get lulled into the abyss of mediocrity and filth just as much as the next person by following headlines about teachers who show up drunk and pantless to the first day of school. I’m simultaneously repulsed by – and engrossed in – the endless deluge of stories about teachers who have abused their power and authority with children.

The shocking truth is that most American schools in most American states are actually doing very well. Even though it’s true, this message consistently falls on deaf ears. Decent and even exceptional performance in American schools simply doesn’t make for a good headline.

Headline News: American Public Schools do Shockingly Well

Your gut response to this headline might be skepticism or, even worse, boredom.

Let’s examine the evidence. Take a hard look at the information conveyed by this image:

b0f123c41This image is just a sliver of data consolidated by the National Center on Education Statistics (NCES). For more detailed information on international performance on math and science, check out the TIMSS data here. For more details on international tests of reading, take a look at PIRLS results here.

In a nutshell, international tests of eighth-graders’ math skills on the TIMSS test reveal:

  • American students in 34 states outperform students in Australia.
  • American students in 27 states outperform students in England.
  • American students in 25 states outperform students in Hong Kong.
  • American students in six states outperform students in Finland (the holy grail of school reform).
  • American students in two states (Massachusetts and Vermont) outperform students in Korea and Japan.

Here’s a question, why don’t the headlines read, “8th graders in Massachusetts and Vermont top all but two countries in the world at math?” or better yet “Six of Top-Ten Performing Education Systems in the World are in the U.S.?”

The news is even better for American students’ performance in reading on the PIRLS test. American students typically do better on reading assessments than they do on math assessments, and the stark differences between states and socioeconomic classes that appear in the TIMSS dataset are slightly less pronounced with reading.

Other good news is that our nation’s performance on reading assessments is on an upward trajectory, and the enormous achievement gaps revealed forty years ago are slowly shrinking.

Meanwhile, we’re all still drinking the “sucky schools Kool-aid.”

Parents in Poorly-Performing Schools Can Improve Children’s Outcomes in School

One thing that these results highlight is the stark inequality between states. This vast inequality is unappealing for many Americans. While we’re okay with unequal wealth, we are most certainly not okay with unequal opportunities to get wealth(y). So how can parents help level the playing field for their kids?

In an earlier post I mentioned that, knowing schools generally aren’t equal, many parents shop around for school districts that perform well. Parents who are able to shop around might also consider moving to a state that performs well by using this tool.

Even when a parent is not in the market for a new home, and even when a parent is living in state that is performing below the United States average (e.g. Mississippi or Alabama – sorry folks), parents should know that most of the inequality between schools is driven by poverty.

PIRLS results show that some strategies parents engage in to improve students’ scores are related to income. For example, children do better in reading when their parents read to and in front of their children. Meanwhile, we know that families living in poverty are disproportionately illiterate.

Parents are also encouraged to send well-rested children to schools, yet we know that in many cases, children living in poverty are housing-insecure or reside in multi-family households where it’s harder, for obvious reasons, to get good sleep. Two other income-dependent, parenting practices are:

  • sending children to schools that have safe and orderly environments
  • sending children who are well-fed to school

On the other hand, we also know that parents, regardless of income-level, can exercise a lot of influence. Variables deflating math and reading scores can be offset by proactive, income-independent parenting strategies. When the data is distilled down to just a handful of critical parenting practices, it turns out that all parents, regardless of income, can engage in these two high-leverage, research-proven strategies:

  • engender in their children a positive attitude toward reading.
  • stock the home with high quality books (borrowed or bought).

Confounding the Trend

American parents are largely distrustful of American public schools. In fact, in a recent poll 84% of parents gave American public schools the grade of “C” or worse. One thing is for sure, the media knows that distrust exists, and they play into it. The public eats it right up because it confirms our suspicions and fears. It’s a vicious cycle.

Would it be interesting to know the drunk and pantless “teacher” in that national story was a last-second hire, and was actually a substitute teacher not a full-time classroom teacher? Should we be appalled by her behavior? Yes. Does she exemplify the 3.5 million teachers who are generally well-qualified and who always remember to wear their pants when they go to work? Definitely not.

Professor Emeritus David Berliner of Arizona State University regularly argues that the “bad schools” narrative is manufactured crisis. Others, like Valerie Strauss from the Answer Sheet, and Diane Ravitch claim the “bad schools” message is strategically encouraged by wealthy, small-government political activists with the aim of encouraging Americans to divest from government-run public schools and invest in for-profit charter schools, private schools and vouchers programs to save our supposedly “failing system.”

To digest this data, and to understand that things are going pretty well in schools requires an understanding of the nuance behind the headline. Nuance doesn’t play well at the water cooler or in a 140-character Tweet.

The next time someone quips, “Gosh, our nation’s schools suck.” Your informed response could include that nuance. Just in case, here are some new soundbites for your witty retort.

  • Many American students are still outperforming their international peers.
  • American schools are educating a more diverse and global population than the “good ole days.”
  • 3,499,999 out of 3,500,000 teachers show up to school fully-dressed.
  • American schools are building a largely-literate nation through a publicly-funded initiative.

Scholars would call this “interrupting the narrative.” I might just call it “conveying truth.”

My only hope in countering this message is that parents begin to understand how much power they have in improving their children’s education. And, you don’t have to live in the wealthiest, highest-performing district in a top-performing state to support you children’s education either.

 

**I am inclined to advocate for BOTH structural adjustments our nation can make to offset the effects of poverty in schools AND local or individual adjustments we can make to offset those effects.

Posts in the cooker… Bringing research to the foreground

I have scores of ideas of things I’d like to blog about, but here’s the shortlist. If you’re interested in knowing the history behind features of schools, or what the “research says” about schools, please comment with your suggestions!

Cheers – Dianna

  1. What does it mean to “Opt-Out” of a standardized test, and should I do it?
  2. How do schools in different states stack up?
  3. Louis C.K. broke my heart when he called out the Common Core
  4. Is homework for kids or their parents?
  5. LGBTQ kids ARE our kids
  6. What’s the deal with 7 AM start times?
  7. Is there really a teacher shortage?
  8. My child’s report card makes no sense to me (& competency based grading)
  9. What’s the point of “group work?”
  10. Why is the site called “Our Kids?”
  11. Calling a truce in the mommy wars.
  12. Talking about American race relations with kids – a white momma’s work.
  13. The manner in which teachers are portrayed in the media is killing the profession.
  14. My friend says her kids are “totally average,” and I admire that attitude.
  15. The shocking reality about how few kids finish college.
  16. College shouldn’t be “four years at Hogwarts” (truthfully put by Martin O’Malley)
  17. The U.S. is actually not doing badly in international ratings – it just depends on how you slice the data.
  18. Should we lengthen the school year?
  19. Reforms that might work in our schools.
  20. How parents can support schools.
  21. Things *not* to say at the parent-teacher conference & questions to ask.
  22. Decoding the standardized test report
  23. The obesity epidemic and school lunch programs.
  24. The anti-Vax movement and CA’s new mandate for measles vaccine.

Do Tiger Moms Hibernate over Summer Break?

I visited a friend who has a friend who has a house on Martha’s Vineyard for a work retreat, and I couldn’t stop myself from sneering a little at the mommas getting on the boat for summer vacation. You know, like, the whole summer vacation?

(Let’s be honest, I should have tried a little harder to stop myself.)

You ask, am I jealous? YES. Totally. 100%. No denying.

For the most part, though, these aren’t the “Tiger Moms” we’ve been hearing about through the years. These are moms who are looking forward to relaxing time at their island home. And though I know very little about what happens in the lives of children who spend the summer months at their other house (yes, still jealous), it’s likely that their time is spent in very different ways than the children of Tiger Moms.

Tiger Moms, grrrrrrrrr. These are women who are dedicated at extraordinary levels to enriching the lives of their children through consistent exposure to intellectual activity; encouraging them to practice Bach’s Chaconne from Partita in d minor until their fingers are swollen; traveling hours, with free library passes in hand, to the Bodies exhibit at the Museum of Science; first in line in January to sign up for the summer institute for the gifted and talented

While they do have critics, and boy do they have their criticseverywhere…, Tiger Moms are kicking my ass at parenting. And “NO!” they do not hibernate during summer months. That’s when they kick it into high gear like a Kentucky Derby race horse on the inside track. (I can picture them peeling away from me as I wave the cloud of dust from my eyes.)

Learning from the Tiger Momma – without the “hysteria”

You can learn something from everyone, and I think Tiger Moms have something going here. We know through decades of research that a very real phenomenon called summer learning loss plagues classroom teachers at the opening of every academic year.

This isn’t a hard concept to grasp as most of us vividly recall those early weeks of the school year walking through the school hallways in a haze, desperately trying to reset our circadian rhythms to the obscene hours that schools typically start, and feeling like we wanted to pound our heads against the wall because we know we knew that last year, but now – for the life of us – that learning seems to have disappeared.

Summer learning loss a real thing, and Tiger Cubs probably don’t deal with this phenomenon as acutely, so that’s a plus-one for the Tiger Mom. My own children, however, seem to be just fine and happy resting on their laurels through another episode of WildKratts (thank you very much). Yet, I know it’s worth taking a page from the Tiger Mom’s book.  What do I mean here?

Kids add important skills in the summer too

A lot of very important learning happens during the summer months. I stalwartly defend the summer vacation that has come under increasing scrutiny in recent years – and not because I like my ten-month academic calendar (though it is nice to be a SAHM for two months). It is because we know through decades of research that critical to a child’s academic success is developing strong social and emotional skills (think grit, perseverance, patience, humility, tenacity to name only a few).

Summertime, as it turns out, is the perfect time for parents to work with their children to develop, strengthen and hone those crucial soft skills.

There are many ways that you can work with your kids on these skills. Step one would be to improve your feedback to your children. We are a nation obsessed with telling our kids they’ve done a “good job,” though it tells a child nothing about what was “good” about the “job” they did. Ergo, they may not realize when they’re repeating it or should repeat it.

Changing meaningless praise to meaningful feedback

An alternative is to name the behavior and and commend them on it. For example, imagine your child is having a difficult time piecing together the three dimensional homage to Mickey Mouse they’re creating from felt, tape and glue. (This scenario did just happen this morning. My daughter’s art unfolds on many planes.) You see them quelling their rage with the Elmers. After over an hour they create their…er…masterpiece. Instead of saying, “Good Job!,” you might say,” That was really frustrating, but you really stuck with it.” Or, “You had something in mind the whole time and you made it!”

If there’s one thing we know about offering praise to a child, there’s a way that leads to entitlement, and there’s a way that leads to motivation. These commendations acknowledge the child’s perseverance, not their “talents.”

I’m slowly learning the art of higher-quality feedback under the tutelage of our family’s favorite Kindergarten teacher – a women who’s been working with five-year-olds for over forty years. She would point you toward a great book by Adele Faber that helps you fill in the spaces when you don’t know how to respond to your child’s meltdown.

Getting gritty with it

Another soft skill worth developing is your child’s grit, which sounds peculiar and slightly machiavellian, but many athletic families parent this disposition to a science. Parenting your child’s ability to lose with grace is something that is often overlooked, and there are very real academic benefits when kids have a gritty outlook.

Finally, help your child learn some good old-fashioned self-restraint. This one is particularly difficult for me because short term allowances for indulgence tend to lead to more quiet-time in the house. Long-term, however, I know what happens when you over-indulge a child.

My seven year old was fascinated by this famous study that found that children who could put off eating a marshmallow with the promise of two marshmallows in the future were found to finish college at higher rates and were generally more successful in life. Viewing the video together also provided a good opportunity to introduce the notion of self-restraint.

Teachers need parents’ help with soft skills

Social and emotional skills are where kids (and teachers) need the most help from parents, because with an average student teacher ratio of 21:1 for elementary schools and 26:1 for secondary schools, your child’s teacher cannot patiently peel your kid off the ceiling – as the other kids watch – after she couldn’t calculate the correct least common denominator. (Don’t worry kid, I can’t remember how to do that either.)

These soft skills lead to clear academic bennies. And, anyway, wouldn’t it be nice to raise children who don’t kick, scream and stage a (usually public) hissy fit after losing a soccer match or game of “Go Fish?”

So while I won’t be making my children practice their (imaginary) cello, or complete pages of the district-endorsed workbooks to keep their academic skills sharp over the summer, I will be embracing my inner-fledgling-tiger-momma by working with my kids this summer on social grace and emotional intelligence. Let’s wish us all good luck on that!