Lasting Impressions. How Do You Think about Psychology and Our Class Now?

Psychology teachers and professors, like me, like to understand how our students’ thinking about Psychology changes as they go through our classes. Since Psychology is a science, we’re drawn to quantify what’s happening. That is, we make the qualitative things we see like your puzzled looks and ah ha moments, and turn them into numbers.

It might feel disappointing how we 'flatten' all the rich complexity of the world into numbers. Good point! And I feel like most people in psychology appreciate the intricacies of being human. So why still quantify? The reason we use numbers is we know how easy it is to see what we want to see, instead of what actually is. Many Psychology studies demonstrate this! Quantifying is a way we reduce our biased inclinations.

You completed a post-test. “Post” means after and we’re getting a sense of where you are after our class. At the beginning of the course, you probably did a a pre-test which is wonderful to compare with your results now.

There really was no correct or incorrect way to respond. It’s just seeing how you think about Psychology.

The Engagement and Impact Index is basically a sum of how often you engaged with class material and reported its impact in your life. It’s something professors like me hope for! There’s no “correct” amount of impact/engagement. Instead, your number is useful for your teacher to compare from semester to semester. As we make changes in our class, do we see changes in our impact and your engagement? If you're a teacher, you might be interested in a detailed pedagogical guide I wrote about this index, getting us feedback beyond course evaluations

The Folk to Scientific Psychology Knowledge score measures how much you answer psychology questions with folk psychology - intuitive ideas about how people work - and scientific psychology - what research finds. Oftentimes scientific and folk psychology are the same, but this measure is about when they’re opposites. Some items are surprising-but-true and other items are myths. A score of 0 means you’re very drawn to folk psychology and a score of 100 means you’re very drawn to scientific psychology

The Effect Size Estimate Complexity is a score of how you weigh many different factors that might matter for success versus failure. How to weigh all these variables “correctly” is debatable primarily because there’s a fuzzy boundary between them and they’re correlated with each other. Nevertheless, with statistics we can calculate an effect size to measure how much a variable matters. Your score estimates how close your estimates are to what effect sizes I found reviewing Psychology studies - 0 is a complete mismatch and 100 is a perfect match. If you think everything matters equally, you’d score about 50.  If you hold tightly to far right-wing or far left-wing ideology, your score would be about 25. That’s because there’s certainly an element of truth (as understood through science) in what people with strong political orientations believe, but they tend to very much over-estimate the impact of variables they focus on and very much under-estimate the variables the opposite “side” focuses on. In case you wondered why the demographics included your political identity this time, it’s because I’m trying to understand how much political lenses nudge people’s thinking.

You might wonder how I came up with a complexity estimate? It comes out of conversations I had with colleagues. I said the real point of Psychology classes is not our students knowing dozens of concepts. It’s really about deepening the way we understand the social world. A colleague with much more interest than me in SMART learning objectives pointedly asked, "how can you measure that?" That's a good question. For me, I let my intuition guide my teaching. I'm very aware of others' emotions and can feel students reacting, everything from boredom to ah ha moments. Still, as someone who does a science of psychology, I feel it's important to try an quantify my impressions. This estimate is what I came up with.

What do you think? How did your think your understanding of humanity change through your experience in a Psychology class?

Please remember your results with any activity are not who you are. Your results are a 'snapshot' of a moment when you did an activity. It's just one measure, a single thread, of the many strands of who you are. Any result is a guess with statistical error. And it's possible the measure is flawed in a way so it doesn't work for you. Please do not think of your results as definitive dogma. Instead they're a starting point for our self reflection. Please keep in mind too, self-reflection can feel uncomfortable. "Bad" feelings are not actually bad. They're information. So, even if your activity result is inaccurate and flawed, you might ask yourself what your feeling is trying to tell you? Trusted teachers, friends, and therapists can be helpful. I wrote an essay elaborating with concrete examples how we can appreciate uneasy feelings about our activity results.