Saturday, March 23, 2019

Teaching Undergrad Stats without p, F, or t.

I taught a 10 week intro-level stats course without p, F, or t.

The course proceeded in the usual way:
  • one-group designs
  • two-group designs
  • many-group designs
  • factorial designs
  • OLS regression
  • multiple regression
  • mixed factors and continuous covariates (ANCOVA)
The key to the course was the concept of a model.  I spent quite a bit of time on a distribution and an observation from it.  I also talked about the random-variable notation like \(Y_i\) for each of \(i\) observations in a data set.    Then, all inference in the class was model comparison.  No hypotheses, only models that instantiate theoretically interesting positions.  The models always have to be written down before analysis.

So, for the one-group design, we carried two models.  Students had to master the following notation:

$$ \mbox{Null Model}: \quad Y_i \sim \mbox{Normal}(0,\sigma^2) $$
$$ \mbox{Effect Model}: \quad Y_i \sim \mbox{Normal}(\mu,\sigma^2) $$

I then asked them how the model accounted for each observation.  For example, if the data were the observations  (-2,-1,0,1), we would make the following tables:

Null-Model Table

Data Account Error Squared Error
-2 0 -2 4
-1 0 -1 1
0 0 0 0
1 0 1 1

Effects-Model Table

DataAccountError Squared Error

The next step is to calculate \(SS_E\), \(R^2\), and BIC, with \(R^2\) serving as a measure of effect size and BIC as a relative model comparison statistic.  Of course, I taught the formulas and meanings of these three quantities.  BIC, for example, was taught in terms of error and penalty, e.g., \( \mbox{BIC}=n\log(SS_E/n)+k\log(n)\).   Continuing, the following model-comparison table was produced:

Model Parameters SSE R^2 BIC

Here we the effect was actually pretty big in \(R^2\), but we do not have the resolution to prefer the effects model over the null model given the small sample size.  To help understand what \(R^2\) means, I provide a list of accounted-variances for various phenomena, say how much variance foes smoking account for in lung-cancer rates. 

Students were taught how to calculate all the values by calculator in small data sets and by spreadsheet in large data sets.  


For interpretation, students were taught that:
a. their inference was only as good as their models
b. no model was true or false, all were just helpful abstractions
c. their primary goal was model comparison rather than testing
d. they need not make decisions, just assess evidence judiciously
e. they should consider both model comparison (BIC) and effect size \(R^2\) in assessment


The above model-comparison-through-error approach extends gracefully to all linear model applications.  In this sense, once the mechanics and interpretations are mastered in the one-sample case, the extensions to more complex models, including multiple regression and multi-factor ANOVA are straightforward.  By getting the mechanics out early, we can focus on the models and how they account for phenomena.  Contrast this to the usual case where you may teach one set of mechanics for the t-test, another for F-tests, and a third for regression.  


The quarter went well.  The students mastered the material effectively.  I had fun.  They had fun.  And I never lost any sleep at night wondering why I was teaching what I was teaching.


JR said...

This is really interesting! Is there a way to get the lecture notes of your class?

MichiganWater said...

JR, I was going to ask the same, but then saw that professor Rouder posted a link the files on his Twitter account.


Thank you for making these materials available, professor Rouder.

P. Gomez said...
This comment has been removed by the author.
Donald Scott said...

HOW I WAS ABLE TO FLUSH OUT THE HERPES VIRUS WITH THE HELP OF DR. KHAM NATURAL PRODUCT, HIS EMAIL I was diagnosed with Herpes a year ago. It’s the worst thing that’s ever happened to me and  I feel like my life is over. Living with constant pain is something no one should have to go through, Herpes has also had a huge impact on my sleep . Since being diagnosed I’ve fallen so far into depression I see no way out because i have been to different hospital. I’m taking a high dose of antidepressants, as well as sedatives and sleeping-pills. I don’t know how I’ll ever accept that this is my life now…I keep asking why me because know changes? But I guess reading your testimony really made me feel happy because i believe what i had from people out there who you also help to cure the herpes virus, and i believe so much with your herbal medicine i am going to be out of this bad situation like others you also help before, what we i have done if not for the herbal medicine that i requested for that was able to flush out the bad virus that was making me go crazy. people out there how will i thank this man called DR. KHAM, i will advice you to email him direct if you have disease like herpes etc. or whatsapp him +2348159922297

Elvis Rose said...

Greetings to every one here. I want to let every one know that HPV is a serious and deadly disease which can't be cured through drugs or injections by the American doctors but the best way to deal with HPV is by taking natural herbs medicine for it to flushes out the virus and is only few American doctors that know about this herbal medicine from doctor Afrid a great herbalist doctor. I have read about Dr Afrid the great herbalist doctor from African who can cure HPV with his powerful herbal medicine. for the people suffering from the following diseases Epilepsy, Hiv, Herpes, Cancer, Als, Hepatitis, Diabetes, Hpv,Infections ETC should contact him for his herbal medicine because his herbal medicine cured all kinds of diseases or virus, i am telling you all this because i am a living testimony and i was cured of Hpv. and my child was cured of epilepsy. Although, i sent him what he requested and he sent me his medicine which i took for two weeks and today when i went for test i was tested Hpv negative. you can reach him through his EMAIL;[] And you can also whatsapp/call him through his number +2349057260738 or website   

Laura Mildred said...

Am Laura Mildred by name, i was diagnosed with Herpes 4 years ago i lived in pain with the knowledge that i wasn't going to ever be well again i contacted so many herbal doctors on this issue and wasted a large sum of money but my condition never got better i was determined to get my life back so one day i saw Mr. Morrison Hansen post on how Dr. Emu saved him from Herpes with herbal medicine i contacted Dr. Emu on his Email: we spoke on the issue i told him all that i went through and he told me not to worry that everything will be fine again so he prepared the medicine and send it to me and told me how to use it, after 14 days of usage I went to see the doctor for test,then the result was negative, am the happiest woman on earth now thanks to Dr. Emu God bless you. Email him at: Whats-app or Call him: +2347012841542 

Cookie Walker said...

Hello Am From The UK , I want to write a little testimony about the good work of doctor Oyagu who cured me from Hsv 1 and 2 for just 2 weeks with his herbal medicine, I never believe I can be normal again and have a good life like others I always regretted the day I got diagnose with the virus, I was lost of hope when my doctor told me there is no cure for it but I keep thinking and thinking about my future, if I can have kids of my own well I am so grateful for my helper who get me cured with his herbal medicine, I go online in search of anything that can help me because I can’t deal with it forever so I found this doc Oyagu email on a blog of someone who was cured by him I quickly contact him for help and explain all my pain to him, he told me not to worry about it there is cure for real, I never believe until he send me the herbal medicine when I order for it and I have it within 4 days that is how I took the medicine for 2 week and the following week I go for test just to confirm I was 100% cured from this sickness what a miracle in my life I am so happy right now, you can also get in contact with him if you have such sickness through email address or text him on what's app, phone number +2348101755322 Dr Oyagu also has remedy to others disease like COLD SORES,HIV/AIDS,DIABETES.CANCER,HIGH BLOOD PRESSURE AND MANY MORE. I oblige everyone to contact this powerful herbalist Dr Oyagu and be free from suffering.