Here’s the nugget that goes along way to explaining it, IMO
> Ever since the federal education policy known as No Child Left Behind went into effect in 2002 and tied students’ test performance to rewards and sanctions for schools, achievement testing has been a primary driver of public education in the United States
Intentionally or not, the No Child Left Behind Act has created (accelerated?) the practice of not only teaching to the test it has also encouraged the practice of schools being held to the outcomes of the standard tests for funding (failing schools can lose funding sources from federal grants and programs for example) therefore teacher livelihoods are at stake.
Now it’s a situation where there is this thing, that if you don’t do well as a school (or schools district) you lose a big chunk of funding and may also make you ineligible for certain grants and other programs as well, but the state controls the means of which the standards are graded and reported, there are nothing but incentives through the entire system for this to be happening.
Since federal funding and grants make up a healthy portion of a good many state education budgets, it’s no shock that gaming compliance is something that happens, and I imagine this goes beyond Texas
mox1 · 1d ago
But this was doing the opposite...it was effectively making the test harder every year. If one wanted to game the No Child Left Behind Act, shouldn't you endeavor to make the test easier every year?
sorcerer-mar · 1d ago
No it wasn't (or at least that is not stated/proven by the article).
It says they were adjusting the scores, not in any one direction.
If kids were doing worse and you have flat scores, that'd indicate the test being adjusted to be easier.
If kids were doing better and you have flat scores, that'd indicate the test being adjusted to be harder.
Because they've designed this to produce flat scores, it obscures which of those two statements is true.
riffraff · 1d ago
The shortened title on HN is misleading, "masking improvement" vs "masking whether the students improved".
The former seems to say the students did improve but this was not visible.
1659447091 · 1d ago
The article makes statements that the test were getting more difficult:
>> In addition, norm-referenced tests [STAAR] are designed so that a certain share of students always fail, because success is gauged by one’s position on the “bell curve” in relation to other students. Following this logic, STAAR developers use practices like omitting easier questions and adjusting scores to cancel out gains due to better teaching.
Followed by:
>> Ultimately, the STAAR tests ... were not designed to show improvement. Since the test is designed to keep scores flat, it’s impossible to know for sure if a lack of expected learning gains following big increases in per-student spending was because the extra funds failed to improve teaching and learning, or simply because the test hid the improvements.
>> Texas’ educational accountability system has been in place since 1980, and it is well known in the state that the stakes and difficulty of Texas’ academic readiness tests increase with each new version, which typically come out every five to 10 years. What the Texas public may not know is that the tests have been adjusted each and every year – at the expense of really knowing who should “pass” or “fail.”
What is not clear or known for sure is the gains, gained, from an increase of money spent per-student because the test, by it's nature, is designed to be flat and not show improvements. But the test itself is designed by the developers to cancel out gains by making it harder. Therefore, the test could not be used to assess that. It is just written a bit funny.
This hurt the lower income students most as the wealthier schools with better teaching resources improved faster, it made the test more difficult for poorer performing schools. This is used as a measure to close or take over schools by the state. There's a bit of a kerfuffle going on currently about some schools getting F ratings and the state wanting to take them over, which in other states that might be okay, by here -- they are about to mandate that the 10 Commandments be displayed in classrooms[0]. They are also on track to getting rid of the STAAR test[1]. Hopefully the new assessment they replace it with will be better, supposedly it will be to show improvements, I fear it will then fall into the "no child left behind" trap that STAAR may have prevented by keeping scores flat, even with major investment in education; but it may also help lower income students who are hurt by the current testing practice in that they will receive the funds they earned for their improvement instead of losing them because wealthy districts outpaced them in gains -- even thou they both gained. Texas is weird sometimes.
The author does imply that the test is effectively getting more difficult, but it seems like they're simply assuming that the adjustment must be happening in that direction without actual evidence.
In reality, because the test was normalized, it is useless for determining the change in academic achievement over time, and it could just as easily end up being normalized in the direction of effectively making the test easier. Because the scores can't be used for this purpose, other evidence would be needed to determine how achievement is actually changing over time (and therefore whether the normalization is effectively increasing or decreasing scores) and the author doesn't present any evidence that would show which is the case.
However, either way the decision to normalize the scores on a test that's apparently supposed to be used to show changes over time seems odd if the author is correct that normalized scores are being used for that purpose.
1659447091 · 1h ago
She did a peer-reviewed deep dive into the test design documentation [0] Stated in the second sentence of this article with the link.
Where she found:
>> According to policies buried in the documentation, the agency administering the tests adjusted their difficulty level every year.
She goes on to say that difficultly is increased. As shown in my original quotes of the article above.
I have not read her paper or the test design documents; but it appears she has and that she does have the evidence.
Look at how the formula handles remediation funding, that would be the most likely reason you wouldn't want to do anything that disrupts an optimal (for funding) bell curve
abracadaniel · 23h ago
Or trying to make the worst schools in the district look better by hiding improvements in the schools that were already doing well enough.
bko · 1d ago
What's the alternative? Should failing schools be given more money and discretion? Should we not have some kind of objective measures to aim for?
Because if the alternative is just vibes or through money at the problem and pray for the best, then I'm not on board.
I personally think school choice works best. If schools are bad, parents are the best to judge. And they should be allowed to send their kids elsewhere, new schools should open and bad ones should close. You know, how basically every other market system works
kjkjadksj · 1d ago
If the school is bad because some of the children have a terrible home life, closing the poor performing schools to open new ones is just playing musical chairs with the issue at hand.
bko · 1d ago
You have relative standards. Basically test the kids at the beginning, then at the end. See how much they improved.
These are the kids you can least afford to fail. It's like having a fast progressing cancer. You have to try a lot of things because the alternative is so bad.
LargeWu · 1d ago
They're also the kids that are least likely to improve despite any number of things that might happen in the school, including basically unlimited educational funding.
The solution to improving the outcomes for these kids doesn't start at school, it has to start at home.
bsder · 23h ago
> They're also the kids that are least likely to improve despite any number of things that might happen in the school, including basically unlimited educational funding.
This is not true.
The Gates Foundation, whom I generally dislike quite intensely for being busybody carpetbaggers who muck things up and disappear, documented this all very well. 2 teachers and 15 students per class works. Period. Every single program that did this showed significant improvements with the most improvement in the lowest performers.
The biggest problem, of course, is that when you ask for money for 2 teachers per 15 students everybody loses their minds (except the rich, of course, who understand the correlation perfectly). Every single one of the programs that the Gates Foundation documented as working were eventually shut down because of lack of funding.
People only say they want better education. Their actions say otherwise.
nothercastle · 22h ago
You can’t even get this at a 20k a year private school. They still do 20 kids and 1 teacher. You probably won’t see this till the 50-60k level
no_wizard · 21h ago
You say this like it would be a bad thing for us to seriously consider as a nation suitably aligning our schools with more funding to provide would be unachievable.
The US is one of the wealthiest countries in the world, we can figure this out.
bsder · 21h ago
Only because "profit" is in the way. $20K a year with 20 students is $400K per year which is more than enough for two teachers and the infrastructure and then some.
While this is fine in elementary and early middle school (which is where the Gates foudnation documented), this probably breaks down as you enter high school where teachers need to be specialized and you need to have a pool of teachers to cover all subjects.
No comments yet
ryan93 · 1d ago
Evidence that they would perform just as well as kids from “good homes” if they had good homes?
triceratops · 1d ago
The kids from good homes perform better.
watwut · 1d ago
Huh, it is pretty much settled that kids from "good homes" have better school results then the ones from "bad homes". The kids themselves are under less stres, they eat better, they sleep more, they have someone who cares about their school results. The parents have more resources (time, ability, inclination) to intervene when things go badly regardless of what school does.
bsder · 23h ago
The Gates Foundation documented that underperforming students tend to actually gain on the average throughout the school year.
The problem is that those same students lose terribly over the summer break. Students from better socioeconomic strata gain over the summer break while those of lower socioeconomic strata do not. Thus, when the school year begins again, any gains made over the school year have been more than cancelled out over the summer.
This is one of the big arguments for year-round school.
em-bee · 23h ago
how does that work? they forget everything they learned in the past year if they don't go to school for two months? i can understand setbacks, increase of behavioral issues, but completely cancelling out?
bsder · 23h ago
Over 3 months it's easy to forget something that you probably only had a tenuous grasp on. My father was a high school teacher and loathed Christmas break. "I spend 4 months pouring information in, and it's gone in 4 days."
In addition, higher socioeconomic status children keep making progress during the summer.
AuthorizedCust · 1d ago
If the test is good, then “teaching to the test” is desirable.
no_wizard · 1d ago
The problem with standardized testing in education is the following question: standardized for who?[0]
The ultimate "sin", if you will, is that they tied test outcomes to funding and in practice is used to hold teachers to an arbitrary standard, not to help understand and guide the learning for students.
For example, what could be done with standardized tests is that schools could use them at regular intervals to understand where each student is at, and adjust their learning resources accordingly to help students that aren't at grade level reach appropriate grade level academically, like if a student tests poorly in Math but not English Comprehension, it would make sense to adjust their schedule to give them more time to learn what they're struggling with and assigning resources appropriately, be it an extra half hour of math learning time with a tutor. That would actually make them useful.
Instead, they're used to bludgeon teachers and school districts, and really the student outcomes are at best secondary to the whole operation, and since so much critical funding comes from sources tied to these outcomes, both good and bad outcomes mind you, hence the reason for the deliberate bell curve. Thats the real issue.
In the US, education has become incredibly politicized to the point that I firmly feel it stopped being about actually educating students to be productive members of society and its about entrenched interests using it as a tool to push a broader political battle at the cost of student outcomes
[0]: Not to mention that the pace of learning and aptitudes is varied by individual, some students will excel in X but not Y. This is a related, but for the purpose of this discussion, separate issue. Not to mention how much environment plays a role (a good home vs bad home situation for example).
potato3732842 · 1d ago
>In the US, education has become incredibly politicized to the point that I firmly feel it stopped being about actually educating students to be productive members of society and its about entrenched interests using it as a tool to push a broader political battle at the cost of student outcomes
I.e. exactly what those pesky naysayers decades ago said would happen eventually.
anon291 · 1d ago
This nuance becomes reasonable in high school / college. For elementary schoolers, it's actually a great binary. Can you do two-digit addition or not is a pretty straightforwards question? Same with... can you identify grammar errors in this English sentence? Binary questions.
The assessments to guide student learning are not the standardize tests meant to measure school performance and do state-level planning
SketchySeaBeast · 1d ago
Have we found an exception to Goodhart's Law?
"When a measure becomes a target, it ceases to be a good measure, except when the measure is good."
viraptor · 22h ago
I don't think so. You can still teach to a good test badly. For example: reading a variety of books and letting people do more on their own would be would be better overall than reading just things on the level of the test, asking just the test style questions and spending time learning the answering style to get 100%.
It's kind of like those articles about young kids passing IT certifications. Those tests are reasonably good, but those kids just memorised lots of material and never actually worked as, for example, a networking engineer.
Or like in IELTS style language test you can easily score higher (even than a native English speaker) if you learn the format enough.
DougN7 · 1d ago
… so if the test is good …
Reading is such a basic skill it seems like a pretty reasonable thing to come up with a decent test.
SketchySeaBeast · 1d ago
"When a measure becomes a target, it ceases to be a good measure, except when the measure is something basic, like teaching reading"?
Has the last twenty years of teaching to the test proven that out?
anon291 · 1d ago
'Teaching to the test' has not caused the drop in literacy. Rather, it's teaching reading using bizarre methods, like whole word recognition instead of phonics. This has nothing to do with 'teaching to the test', since phonics would teach more to the test than whole word anything. A phonetically competent adult would be able to make out almost any English word. A whole word one would not.
SketchySeaBeast · 20h ago
"When a measure becomes a target, it ceases to be a good measure, unless the teacher is poor"?
anon291 · 18h ago
This 'truth' is not always true. For binary questions, teaching to measure makes sense
SketchySeaBeast · 5h ago
Unfortunately, "is someone literate" is not a binary question. There's a whole range of possible answers there.
throwawaymaths · 1d ago
you trying to establish some sort of measure for Goodhart's law?
andrewflnr · 1d ago
The test is never that good.
larrled · 1d ago
In education, nothing is ever good enough.
no_wizard · 1d ago
This is my take: the real issue with education in the US goes back to trying to square two ideals.
One is the meritocracy[0]. I believe that No Child Left Behind Act was sold to the public as a way to promote meritocracy in education and having some reasonably unbiased[1] way of doing so. The foundation of which is a way for parents to hold institutions responsible much more easily[2][3]
The other is social and political stratification. This isn't merit based. Good examples of this would be the history of slavery, Jim Crow laws, the formerly legal practice of segregation by race, the drawing school district lines that keep students of wealthy parents away from folks who come from less economically advantaged backgrounds and enforcing this with district based school eligibility and funding.
These two don't exactly square very well. Which is why the top level idea sold to the public - meritocracy - is used to sell these policies, but in practice they are using it to pull levers to further political and social stratification.
[0]: Americans generally have a positive view of the term. I personally believe that most people don't have a proper understanding of the term to begin with, nor conceive what issues it could have in practice if they were given it.
[1]: Leaving out the other half of the narrative, which is how much macro and micro levels of a students environment will influence how well they learn.
[2]: Which made it easier for Republicans to continue to go after public education. They've been pushing for the voucher system for decades as a backdoor way to dismantle the public school system, reasons for wanting to do so vary but it all converges on this point.
[3]: Not to mention, it completely ignores micro and macro issues that students can have, be it poverty, domestic issues, systemic issues and a whole host of other things.
throwawaymaths · 1d ago
> Which made it easier for Republicans to continue to go after public education. They've been pushing for the voucher system for decades as a backdoor way to dismantle the public school system, reasons for wanting to do so vary but it all converges on this point.
in practice, republicans are perfectly happy with public schools when the schools are are "good enough" for their kids. so this caricature seems incorrect. there's a lot wrong with USA public schools, so something must be done. some very not-for-profit voucher schools have been doing excellent work where the public school systens have utterly failed, for example green dot animo in inglewood, or, dramatically, green dot locke in watts.
what is not a caricature: the vast majority of policymakers who want to keep status quo in the public school system send their kids to private schools.
no_wizard · 20h ago
> Republicans
Short hand for 'elected officials of the republican party', which have been systematically targeting public education for decades
throwawaymaths · 16h ago
you can make an evidenced argument that elected officials of the Democratic party have been systematically destroying public education for decades (for example cancelling algebra in California, repeat child abusers not let go in LAUSD, see "mark berndt" for an example of a multidecade offender that bounced between schools)
really, Republicans arent helping, but they arent necessary to destroy American schools thats happening just fine in ~one-party democrat states like California and hawaii.
watwut · 1d ago
Republicans are not perfectly happy when public schools are good enough ... they seek to defund them and vilify them anyway. Their complains have very little to do with reality of those schools and a lot to do with the project of privatization. Plus, you see conservatives who send their kids to private schools or home school to attack libraries in public schools.
BobaFloutist · 1d ago
No, that's simply not true. You can very easily overfit even good metrics.
reverendsteveii · 1d ago
that's a downright ponderous conditional at the beginning of this comment
triceratops · 1d ago
I actually didn't understand how NCLB incentivized failing a set percentage of students every year. Seems like it would do the opposite.
coredog64 · 1d ago
Allegedly, at the time of drafting and passage, it was understood that despite the name, the optimum number of children to leave behind was not zero. However, the optics of that were not great. The plan was to pass it as zero, and then update that value later. Here we are 20 years later and we haven't had the discussion about what the cutoff is.
KennyBlanken · 1d ago
If all the students pass then someone is going to claim it's too easy, and thus administrators will need to make it more difficult, develop new curriculum, train teachers on it, and so on.
All the while nobody learns anything except how to pass the test.
falcor84 · 1d ago
That's a strawman argument. We don't have to change the system just because "someone is going to claim it's too easy". I personally have been claiming a lot of things about a lot of systems and the're very persistent in not listening to me, even though I'm sure it would make them better. Anyway, if someone is annoyed by their (or their kid's) test being too easy, we can just give them bonus test
JumpCrisscross · 1d ago
> therefore teacher livelihoods are at stake
Does Texas fire underperforming teachers?
BobaFloutist · 1d ago
If a school doesn't have money, it can't pay teachers.
JumpCrisscross · 1d ago
> If a school doesn't have money, it can't pay teachers
I’m genuinely asking. In California and New York underperforming schools are almost never shut down on account of powerful teachers’ unions. When they are, the teachers are reässigned. Teachers’ livelihoods are thus never at stake.
BobaFloutist · 1d ago
In California, under performing schools get allocated more state funds, not less, to help them fix whatever's making them under perform. I can't speak to New York, but I know a lot of states have systems that financially penalize under performing schools with reduced funding, which is what I was referring to.
josefritzishere · 1d ago
Texas needs to fire underperforming governors and representatives.
No comments yet
horns4lyfe · 1d ago
My dad worked in education his whole career, from teacher up to district superintendent. No child left behind basically ruined the job for him, all the bad invectives and counterproductive rules made out too hard to actually educate.
triceratops · 1d ago
On the plus side, this means Texas students have maybe been doing better every year. On the massively negative side, holy stack ranking in grade school Batman!
ge96 · 1d ago
I remember when I was in college 10 years ago they did this grade curving thing and it made me feel bad like my achievement was masked since people that did poorly were lifted or the other way, I thought I should have failed but I passed
I am lucky that I picked up programming because I initially studied physics/engineering and I used to able to do math but now I can't anymore and my focus sucks. Writing code to me is way easier than doing math.
kjkjadksj · 1d ago
They have to curve in some classes though. In chemistry exam class averages were in the 55% range or so.
Ignoring the idiocy of No Child Left Behind, this is a good thing!
The author seems to think there is a magical alternative where students are graded to an absolute scale that doesn't change over time. That's not an option. Every grading system that ostensibly does this suffers from grade inflation. By the time you get to employers looking at grades, they just mentally convert the grades into a percentile. You end up back at grading on a curve/percentiles but with more steps.
At the scale of all students in Texas, the true rate of year-to-year change in ability is just going to be too small to measure (barring sudden events like the pandemic).
And speaking of the pandemic, where loosy goosy grading led to enormous grade inflation, what do you think employers/universities did? They obviously undid the inflation by regrading people back to the curve - "oh you did get 3 As but I can see that you graduated in 2020 so..."
neilv · 1d ago
> What still isn’t known
I didn't see in the article the question of why Texas was going out of their way to yield flat test numbers like this, year after year.
It looked the author could've (or maybe not) been hinting that this is numbers-rigging -- to smoothly pass No Child Left Behind metrics, or to affect the real estate market in some way, or some other government goal.
Rather than numbers-rigging, I suppose it could also be useful for educators to see who needs more help, relative to their peers.
skybrian · 1d ago
Adjusting scores would mask both improvement and decline. How do we know which it is? Are unadjusted scores available somewhere?
gpt5 · 1d ago
You can compare Texas performance to the rest of the nation using NAEP. It looks mostly flat.
It could be they are adjusting the test to make it easier each year. So it being flat doesn't actually tell you anything.
mox1 · 1d ago
Texas is not, according to the article they are making it harder every year.
horsawlarway · 1d ago
I think the article is implying but not proving this statement.
They are correctly pointing out that the test is essentially norm-referenced (by design) and that this matters if you're looking for improvement (it will mask that improvement) but it also doesn't imply that they're making the test harder.
If anything - the flat line indicates that they're keeping it norm-referenced and that masks change in both directions.
It could well be that they're actually making the test easier since covid, again - to keep the line flat and norm-referenced (hard to tell since a lot of the article's data stops in 2021).
---
Essentially - this test is good for saying "How is this school performing vs its peers". It is not good for showing baseline improvement or decline across all schools.
That distinction is important, but I'm also not sure that it matters that much in terms of funding allocation; I'm not deep in the weeds here, so it's possible Texas is missing on some upside, but generally... my assumption is that the "budget" for education is relatively fixed at both the state and federal level, and the goal is not to award states that improve baseline numbers ever increasing budgets, but rather to force states to allocate the fixed resources to schools that are over-performing compared to their peers.
If that's the goal... a norm referenced test makes a ton of sense.
sorcerer-mar · 1d ago
No, it says the difficulty is adjusted every year. You'd see the same flatness whether the entire population was doing better or if they were doing worse.
An alternative headline might read: "Texas’ annual reading test adjusted its difficulty every year, masking whether students are improving or getting worse"
larrled · 1d ago
“What still isn’t known
I plan to investigate if other states or the federal government use similarly designed tests to evaluate students.”
This person doesn’t seem to have any understanding of the topic area she apparently lectures her students about. Scary.
> Ever since the federal education policy known as No Child Left Behind went into effect in 2002 and tied students’ test performance to rewards and sanctions for schools, achievement testing has been a primary driver of public education in the United States
Intentionally or not, the No Child Left Behind Act has created (accelerated?) the practice of not only teaching to the test it has also encouraged the practice of schools being held to the outcomes of the standard tests for funding (failing schools can lose funding sources from federal grants and programs for example) therefore teacher livelihoods are at stake.
Now it’s a situation where there is this thing, that if you don’t do well as a school (or schools district) you lose a big chunk of funding and may also make you ineligible for certain grants and other programs as well, but the state controls the means of which the standards are graded and reported, there are nothing but incentives through the entire system for this to be happening.
Since federal funding and grants make up a healthy portion of a good many state education budgets, it’s no shock that gaming compliance is something that happens, and I imagine this goes beyond Texas
It says they were adjusting the scores, not in any one direction.
If kids were doing worse and you have flat scores, that'd indicate the test being adjusted to be easier.
If kids were doing better and you have flat scores, that'd indicate the test being adjusted to be harder.
Because they've designed this to produce flat scores, it obscures which of those two statements is true.
The former seems to say the students did improve but this was not visible.
>> In addition, norm-referenced tests [STAAR] are designed so that a certain share of students always fail, because success is gauged by one’s position on the “bell curve” in relation to other students. Following this logic, STAAR developers use practices like omitting easier questions and adjusting scores to cancel out gains due to better teaching.
Followed by:
>> Ultimately, the STAAR tests ... were not designed to show improvement. Since the test is designed to keep scores flat, it’s impossible to know for sure if a lack of expected learning gains following big increases in per-student spending was because the extra funds failed to improve teaching and learning, or simply because the test hid the improvements.
>> Texas’ educational accountability system has been in place since 1980, and it is well known in the state that the stakes and difficulty of Texas’ academic readiness tests increase with each new version, which typically come out every five to 10 years. What the Texas public may not know is that the tests have been adjusted each and every year – at the expense of really knowing who should “pass” or “fail.”
What is not clear or known for sure is the gains, gained, from an increase of money spent per-student because the test, by it's nature, is designed to be flat and not show improvements. But the test itself is designed by the developers to cancel out gains by making it harder. Therefore, the test could not be used to assess that. It is just written a bit funny.
This hurt the lower income students most as the wealthier schools with better teaching resources improved faster, it made the test more difficult for poorer performing schools. This is used as a measure to close or take over schools by the state. There's a bit of a kerfuffle going on currently about some schools getting F ratings and the state wanting to take them over, which in other states that might be okay, by here -- they are about to mandate that the 10 Commandments be displayed in classrooms[0]. They are also on track to getting rid of the STAAR test[1]. Hopefully the new assessment they replace it with will be better, supposedly it will be to show improvements, I fear it will then fall into the "no child left behind" trap that STAAR may have prevented by keeping scores flat, even with major investment in education; but it may also help lower income students who are hurt by the current testing practice in that they will receive the funds they earned for their improvement instead of losing them because wealthy districts outpaced them in gains -- even thou they both gained. Texas is weird sometimes.
[0] https://www.texastribune.org/2025/05/24/ten-commandments-tex...
[1] https://www.texastribune.org/2025/05/23/staar-test-texas-sch...
In reality, because the test was normalized, it is useless for determining the change in academic achievement over time, and it could just as easily end up being normalized in the direction of effectively making the test easier. Because the scores can't be used for this purpose, other evidence would be needed to determine how achievement is actually changing over time (and therefore whether the normalization is effectively increasing or decreasing scores) and the author doesn't present any evidence that would show which is the case.
However, either way the decision to normalize the scores on a test that's apparently supposed to be used to show changes over time seems odd if the author is correct that normalized scores are being used for that purpose.
Where she found:
>> According to policies buried in the documentation, the agency administering the tests adjusted their difficulty level every year.
She goes on to say that difficultly is increased. As shown in my original quotes of the article above.
I have not read her paper or the test design documents; but it appears she has and that she does have the evidence.
[0] https://doi.org/10.1080/15427587.2024.2415618
Because if the alternative is just vibes or through money at the problem and pray for the best, then I'm not on board.
I personally think school choice works best. If schools are bad, parents are the best to judge. And they should be allowed to send their kids elsewhere, new schools should open and bad ones should close. You know, how basically every other market system works
These are the kids you can least afford to fail. It's like having a fast progressing cancer. You have to try a lot of things because the alternative is so bad.
The solution to improving the outcomes for these kids doesn't start at school, it has to start at home.
This is not true.
The Gates Foundation, whom I generally dislike quite intensely for being busybody carpetbaggers who muck things up and disappear, documented this all very well. 2 teachers and 15 students per class works. Period. Every single program that did this showed significant improvements with the most improvement in the lowest performers.
The biggest problem, of course, is that when you ask for money for 2 teachers per 15 students everybody loses their minds (except the rich, of course, who understand the correlation perfectly). Every single one of the programs that the Gates Foundation documented as working were eventually shut down because of lack of funding.
People only say they want better education. Their actions say otherwise.
The US is one of the wealthiest countries in the world, we can figure this out.
While this is fine in elementary and early middle school (which is where the Gates foudnation documented), this probably breaks down as you enter high school where teachers need to be specialized and you need to have a pool of teachers to cover all subjects.
No comments yet
The problem is that those same students lose terribly over the summer break. Students from better socioeconomic strata gain over the summer break while those of lower socioeconomic strata do not. Thus, when the school year begins again, any gains made over the school year have been more than cancelled out over the summer.
This is one of the big arguments for year-round school.
In addition, higher socioeconomic status children keep making progress during the summer.
The ultimate "sin", if you will, is that they tied test outcomes to funding and in practice is used to hold teachers to an arbitrary standard, not to help understand and guide the learning for students.
For example, what could be done with standardized tests is that schools could use them at regular intervals to understand where each student is at, and adjust their learning resources accordingly to help students that aren't at grade level reach appropriate grade level academically, like if a student tests poorly in Math but not English Comprehension, it would make sense to adjust their schedule to give them more time to learn what they're struggling with and assigning resources appropriately, be it an extra half hour of math learning time with a tutor. That would actually make them useful.
Instead, they're used to bludgeon teachers and school districts, and really the student outcomes are at best secondary to the whole operation, and since so much critical funding comes from sources tied to these outcomes, both good and bad outcomes mind you, hence the reason for the deliberate bell curve. Thats the real issue.
In the US, education has become incredibly politicized to the point that I firmly feel it stopped being about actually educating students to be productive members of society and its about entrenched interests using it as a tool to push a broader political battle at the cost of student outcomes
[0]: Not to mention that the pace of learning and aptitudes is varied by individual, some students will excel in X but not Y. This is a related, but for the purpose of this discussion, separate issue. Not to mention how much environment plays a role (a good home vs bad home situation for example).
I.e. exactly what those pesky naysayers decades ago said would happen eventually.
The assessments to guide student learning are not the standardize tests meant to measure school performance and do state-level planning
"When a measure becomes a target, it ceases to be a good measure, except when the measure is good."
It's kind of like those articles about young kids passing IT certifications. Those tests are reasonably good, but those kids just memorised lots of material and never actually worked as, for example, a networking engineer.
Or like in IELTS style language test you can easily score higher (even than a native English speaker) if you learn the format enough.
Reading is such a basic skill it seems like a pretty reasonable thing to come up with a decent test.
Has the last twenty years of teaching to the test proven that out?
One is the meritocracy[0]. I believe that No Child Left Behind Act was sold to the public as a way to promote meritocracy in education and having some reasonably unbiased[1] way of doing so. The foundation of which is a way for parents to hold institutions responsible much more easily[2][3]
The other is social and political stratification. This isn't merit based. Good examples of this would be the history of slavery, Jim Crow laws, the formerly legal practice of segregation by race, the drawing school district lines that keep students of wealthy parents away from folks who come from less economically advantaged backgrounds and enforcing this with district based school eligibility and funding.
These two don't exactly square very well. Which is why the top level idea sold to the public - meritocracy - is used to sell these policies, but in practice they are using it to pull levers to further political and social stratification.
[0]: Americans generally have a positive view of the term. I personally believe that most people don't have a proper understanding of the term to begin with, nor conceive what issues it could have in practice if they were given it.
[1]: Leaving out the other half of the narrative, which is how much macro and micro levels of a students environment will influence how well they learn.
[2]: Which made it easier for Republicans to continue to go after public education. They've been pushing for the voucher system for decades as a backdoor way to dismantle the public school system, reasons for wanting to do so vary but it all converges on this point.
[3]: Not to mention, it completely ignores micro and macro issues that students can have, be it poverty, domestic issues, systemic issues and a whole host of other things.
in practice, republicans are perfectly happy with public schools when the schools are are "good enough" for their kids. so this caricature seems incorrect. there's a lot wrong with USA public schools, so something must be done. some very not-for-profit voucher schools have been doing excellent work where the public school systens have utterly failed, for example green dot animo in inglewood, or, dramatically, green dot locke in watts.
what is not a caricature: the vast majority of policymakers who want to keep status quo in the public school system send their kids to private schools.
Short hand for 'elected officials of the republican party', which have been systematically targeting public education for decades
really, Republicans arent helping, but they arent necessary to destroy American schools thats happening just fine in ~one-party democrat states like California and hawaii.
All the while nobody learns anything except how to pass the test.
Does Texas fire underperforming teachers?
I’m genuinely asking. In California and New York underperforming schools are almost never shut down on account of powerful teachers’ unions. When they are, the teachers are reässigned. Teachers’ livelihoods are thus never at stake.
No comments yet
I am lucky that I picked up programming because I initially studied physics/engineering and I used to able to do math but now I can't anymore and my focus sucks. Writing code to me is way easier than doing math.
The author seems to think there is a magical alternative where students are graded to an absolute scale that doesn't change over time. That's not an option. Every grading system that ostensibly does this suffers from grade inflation. By the time you get to employers looking at grades, they just mentally convert the grades into a percentile. You end up back at grading on a curve/percentiles but with more steps.
At the scale of all students in Texas, the true rate of year-to-year change in ability is just going to be too small to measure (barring sudden events like the pandemic).
And speaking of the pandemic, where loosy goosy grading led to enormous grade inflation, what do you think employers/universities did? They obviously undid the inflation by regrading people back to the curve - "oh you did get 3 As but I can see that you graduated in 2020 so..."
I didn't see in the article the question of why Texas was going out of their way to yield flat test numbers like this, year after year.
It looked the author could've (or maybe not) been hinting that this is numbers-rigging -- to smoothly pass No Child Left Behind metrics, or to affect the real estate market in some way, or some other government goal.
Rather than numbers-rigging, I suppose it could also be useful for educators to see who needs more help, relative to their peers.
https://www.commitpartnership.org/insights/latest-learnings/...
https://nces.ed.gov/fastfacts/display.asp?id=38
They are correctly pointing out that the test is essentially norm-referenced (by design) and that this matters if you're looking for improvement (it will mask that improvement) but it also doesn't imply that they're making the test harder.
If anything - the flat line indicates that they're keeping it norm-referenced and that masks change in both directions.
It could well be that they're actually making the test easier since covid, again - to keep the line flat and norm-referenced (hard to tell since a lot of the article's data stops in 2021).
---
Essentially - this test is good for saying "How is this school performing vs its peers". It is not good for showing baseline improvement or decline across all schools.
That distinction is important, but I'm also not sure that it matters that much in terms of funding allocation; I'm not deep in the weeds here, so it's possible Texas is missing on some upside, but generally... my assumption is that the "budget" for education is relatively fixed at both the state and federal level, and the goal is not to award states that improve baseline numbers ever increasing budgets, but rather to force states to allocate the fixed resources to schools that are over-performing compared to their peers.
If that's the goal... a norm referenced test makes a ton of sense.
An alternative headline might read: "Texas’ annual reading test adjusted its difficulty every year, masking whether students are improving or getting worse"
I plan to investigate if other states or the federal government use similarly designed tests to evaluate students.”
This person doesn’t seem to have any understanding of the topic area she apparently lectures her students about. Scary.