Kansas rejoins the modern era

In the back-and-forth battle for science education that roils in Kansas, science has once again gained the upper hand.

The newly-elected Kansas Board of Education dismantled the previous Board's work on behalf of "intelligent design" creationism. So "2+2=5" science will no longer be taught side-by-side with "2+2=4" science--or what scientists refer to as "science."

Read all about it in this Reuters article. Or enjoy the subtle, muted musings of The Bad Astronomer (c'mon Phil, tell us how you really feel). Or learn more about the ongoing, national nature of this battle at The National Center for Science Education website. Or click the graphic above to get it straight from the Kansas State Department of Education.

This is a debate that never seems to end. It didn't end with the Scopes Monkey Trial in 1925. It didn't end when the Supreme Court struck down Louisiana's Balanced Treatment Act in 1987. It didn't end with the thumping of "intelligent design" in Dover, PA in 2005 (a thumping delivered by a Bush-appointed judge). And it won't end with the Kansas Board of Education in 2007.

While this is more of an issue for our biology-teaching colleagues, the anti-science flotsam and jetsam does gurgle up into physics classrooms. The most common form is declaration that the Second Law of Thermodymanics prohibits the evolution of simpler forms of life to more complex ones. Some of the non-scientists who float this nonsense grant that simpler forms could evolve to more complex ones, but only if there were a huge source of energy available to earth-bound organisms. It's just embarrassing to be the one to point out the presence of the sun to them.

Anyway, today's action of the Kansas Board of Education was a victory for science in Kansas. And in this battle, a victory anywhere is a victory everywhere.

FedEx delivers bad science on Sundays

Superbowl Sunday, at least. Bad Astronomer Phil Plait posted nicely on this, so I will proceed to my flattery forthwith.

You had to pay $2.4E+6 to have a 30-second spot run during Superbowl XLI. Federal Express shelled out its cash for this catalog of science misconceptions.



But when FedEx delivers a lemon, I say turn it into a lesson!

Read the Bad Astronomy post for Phil's well-articulated objections. Then use this student worksheet and show the clip in class. Students really do enjoy ripping these things to shreds, and many will be inspired to be on the lookout for bad science in other ads, too.

Maybe we should pass a hat to fund more ad/"lessons" like this one!

Found video: Firewalkers put to the test

Richard Wiseman is a rockstar at The Amaz!ng Meetings. He was an accomplished magician before he became a highly-regarded researcher in psychology. He has an entertainer's sensibilities and he's British, so he's always fun to watch and listen to. He had the opportunity to put "mind-over-matter" firewalkers to the test through the auspices of a BBC television program. He showed a clip of the program at TAM3, but it wasn't included in the DVD set of TAM3 due to copyright restrictions. I recently did a Google search for the clip and turned up this take. It's not as robust as what we saw at TAM3, but it does the job.

The question at hand is whether firewalkers accomplish their spectacular feat (!) by way of an altered state of consciousness or by way of simple thermal physics. You already know the correct answer, but the video puts a dramatic exclamation point on that answer. And Wiseman tells the story well.


The clip as it exists at Google Video is here.

Wiseman warned us that the emcee of the program was also the announcer on an extreme sports show. So his empathy leaves something to be desired. Take out a stopwatch and measure the delay between the word, "commiserations," and his call for "Next!" Upon repeat viewings, notice that Wiseman holds back a smile or two while he describes the setup. I would not have done so well. Imagine multiple takes and me bursting out with laughter every time. It would take a day to shoot.

This clip is a great follow-on to Jearl Walker's Kinetic Karnival episode on The Leidenfrost Effect. I enthusiastically recommend Walker's series for high school physics classes. Note to teachers: you will want to preview the tapes and you might want to hit the mute button once or twice during in-class playback.

The content of Kinetic Karnival is fantastic and highly engaging. But you do have to endure the fact that Walker drinks beer and smokes cigarettes on film. If your students are unaware that adults engage in such behavior, Kinetic Karnival may not be for you.

I'm on Skepticality!

I am envious of people who listen to a lot of podcasts and contribute frequently to online forums. They cleary have better time-management skills than I do. I contribute to two online forums, The JREF Forum and Bad Astronomy, but that's only because I'm addicted to the content of those sites. I listen to one podcast: Skepticality. I found Skepticality in the summer of 2005 and became an instant fan of the show. It helped with my mid-year TAM withdrawl symptoms. Hosts Derek and Swoopy were producing top-shelf skeptical content on a regular basis. And with each episode, you got to know them better.

In September 2005, Steve Jobs named Skepticality as a top podcast. That same month, they suffered a setback that would have sent most podcasts into oblivion. But they re-emerged in 2006 as the official podcast of Skeptic magazine. What a ride!

Anyway, I think the world of Derek and Swoopy--two ordinary folks from Roswell, Georgia who built a polished, excellent podcast from scratch. Meeting them at TAM5 was a highlight of the meeting. The fact that they included me in their TAM5 episode was an unexpected thrill. Swoopy mentions me by name and says something nice about me, I get to weigh in on the ongoing "monkey news" controversy, and they linked to my website on their show notes for Episode 45.

Download that episode to get a sampling of TAM5 audio gems that Swoopy was able to catch. I'll post to report when I can get my head to fit through a doorway again.

Speak up and be seen!

I am eager to see your comments (good or bad) on the latest released CST questions. But so is The California Department of Education. So if you want your comments to be seen by me and other visitors to this site, post them in the comments. If you want your comments to be seen by someone important (who can make a difference), post them to this page:

http://www.cde.ca.gov/ta/tg/sr/ap/writestar.asp

Comments there go to people involved in the STAR (Standardized Testing And Reporting) Program.

The symphony of CST criticism: Somebody does it better

"California has lousy standards and assessments. If you want to see a state that gets it right, check out what they've done in [StateName]."
Actually, I've never seen this criticism. I hope for it every year, but it never comes through.

While it is a great and worthy exercise to criticize California's published and readily-available standards and assessments, the product of such criticism is a statement of "how it would be if I were king." And those are great. But alas, you are not king. Nor am I. (Make no mistake; I should be king. But I am not.) There is a process by which standards and assessments come about. The process is filled with panels, committees, the legislature, the state board of education, obligations to state and federal law, etc. None of which fetter your (or my) vision of the perfect assessment tool.

My challenge to the critics is to point out the state that got it right. Did Idaho nail it? Was it perfected in Kansas? Should we hope to emulate Texas? Which state does it in a manner you would approve of? (And your own state of mind doesn't count on this one.)

Some come close to this criticism when they mention Advanced Placement, SAT Physics, or the Force Concept Inventory.
The problem is that none of those are standards-based, criterion-referenced assessments intended for all high school students. That's what the CST is. So comparisons between the CST and those other exams are apples and oranges.

So let me rephrase to make the challenge more clear. California's statewide assessment of high school physics (The Physics CST) is the best one in the country. There isn't a single state in the union that does it better. If you think I'm wrong, let me know. And name the state.

The symphony of CST criticism: Burn down the mission

"Standards and assessments are wrong."
Fair enough. We should all have an opinion on that matter, and we're likely to disagree with one another. Nothing wrong with that. Some of my best friends in the biz are mortally opposed to standards and assessments. Nevertheless, here we are. Standards and assessments are the reality on the ground. Like them or not, here they are.

Some say that the standards and assessment in physics should be openly opposed by the AAPT. And that if physics teachers organized, we could put an end to the tyranny. The harsh reality is that we could not. Standards and assessment in physics is but one brick in the Standards and assessment fortress. Chemistry, biology, and earth science have them, too. As does math, English, and social studies. As do the lower grades and subject-areas. We might peck away at one brick, but bringing the whole fortress down is at least an order of magnitude harder.

In any case, I cannot do much about the existence of standards and assessments from my position on the Assessment Review Panel. Efforts to abolish standards and assessment should be directed to the state legislature. But don't hold your breath.

The symphony of CST criticism: Bad science

"The science is wrong in question X."
My experience with physics teachers (high school, college, and university) is that we tend to have some opinions on content and assessment. Strong opinions. And they don't all match.

Given a hundred potential exam items, I wonder how many would gain unanimous approval from attendees of a section meeting of The American Association of Physics Teachers. We're a clever lot, and we can likely poke holes in any test item you put before us, no matter how simple or straightforward you think it is.

All questions on the CST are vetted and field-tested. Items written for the testing contractor are vetted by the contractor, California Department of Education personnel, and the Assessment Review Panel, which is made up of professional scientists and science educators (kindergarten through university). Many questions get burned at one level or another as they make their way to the CST. Some less-than-perfect questions even get included on operation forms. But as far as anyone in the process knows, the questions have solid content and are aligned to standards.

And if I failed to mention it before, releasing a question puts it beyond the reach of future operational forms.

The symphony of CST criticism: Standard mismatch

"Question X doesn't match the standard it's supposed to assess."
This is nearly the only topic of criticism applicable to my service on the Assessment Review Panel. But it requires a knowledge of the state-approved content standards. And there is a level of nuance involved. For example, newly released question number 16 could be judged an inappropriate question for the Physics CST. The question requires a mathematical understanding of Newton's law of universal gravitation. Such knowledge is the subject of Physics Content Standard 1.m. That standard is an untested "opportunity to learn." Since the CST is not supposed to assess students on untested standards, the question could be deemed inappropriate.

When a question from the database of CST items is sent out as a released test question, it can never again be used on an operational form. It has been put out to pasture. If a question made it on to a live test but really wasn't aligned to a given standard as well as we hope for, the pasture is exactly where it should be.

The symphony of CST criticism: An overview

Now that the latest set of released CST questions has been published, it's open season on California's standards and assessments. And let me be clear: I'm all for it. An annual physics exam imposed by the state on all high school underclassmen enrolled in physics is a topic worthy of discussion and criticism. Anyone concerned with high school physics instruction in California should pour over the RTQs. And anyone who does so is likely to find shortcomings.

Some might become disillusioned from this exercise. Surely the only questions that would ever be put on such an important exam would be constructed by content experts who were also assessment professionals. And those questions would be vetted by a deliberative panel of experts. I'm all for such a process. But that's not the process we have. The process we have is pretty good, but it's not perfect. So the exam questions are not always perfect.

All the easier to criticize, I say. Some criticism has already been offered in the comments to the previous post. My experience with CST criticism is that it follows about four different paths. I will discuss those paths and the relative merit of each in the next few posts.