315. Unessays

An unessay assignment provides students an opportunity to demonstrate their learning in innovative and creative ways. In this episode, Jessamyn Neuhaus and Maggie Schmuhl join us to discuss how they have employed unessay assignments in their courses.

Jessamyn is the Director of the SUNY Plattsburgh Center for Teaching Excellence and a Professor in the History Department at SUNY Plattsburgh. She is the author of Geeky Pedagogy: a Guide for Intellectuals, Introverts, and Nerds Who Want to be Effective Teachers. She is the editor of Picture a Professor: Interrupting Biases about Faculty and Increasing Student Learning. Maggie is an Associate Professor of Criminal Justice and the Associate Director of the Center for Excellence in Learning and Teaching at SUNY-Oswego.

Show Notes

  • Neuhaus, J. (2019). Geeky Pedagogy: A guide for intellectuals, introverts, and nerds who want to be effective teachers. Morgantown, WV, USA: West Virginia University Press.
  • Neuhaus, J. (2022). Picture a Professor: Interrupting Biases about Faculty and Increasing Student Learning. West Virginia University Press.
  • Neuhaus, J. (editor) (2022). Using the Unessay to Teach History. Teaching History: A Journal of Methods. Vol. 47. No. 1.
  • Cavanagh, S. R. (2023). Mind over Monsters: Supporting Youth Mental Health with Compassionate Challenge. Beacon Press.
  • Jessamyn’s American Promise Unessay Assignment
  • Pittman, Chavella (2022). “Strategizing for Success: Women Faculty of Color Navigating Teaching Inequities in Higher Ed” in Picture a Professor: Interrupting Biases about Faculty and Increasing Student Learning. Ed. by Jessamyn Neuhaus. West Virginia University Press.
  • Pittman, Chavella (2023). Navigating Teaching Inequities. Tea for Teaching Podcast. Episode 291. May 31.
  • POD Network Conference
  • Teaching, Engaging, and Thriving in Higher Education Series. University of Oklahoma Press.
  • American Historical Association Annual Meetings

Transcript

John: An unessay assignment provides students an opportunity to demonstrate their learning in innovative and creative ways. In this episode, we explore ways in which different faculty have employed unessay assignments in their courses

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guests today are Jessamyn Neuhaus and Maggie Schmuhl. Jessamyn is the Director of the SUNY Plattsburgh Center for Teaching Excellence and a Professor in the History Department at SUNY Plattsburgh. She is the author of Geeky Pedagogy: a Guide for Intellectuals, Introverts, and Nerds Who Want to be Effective Teachers. She is the editor of Picture a Professor: Interrupting Biases about Faculty and Increasing Student Learning. Maggie is an Associate Professor of Criminal Justice and the Associate Director of the Center for Excellence in Learning and Teaching at SUNY-Oswego. Welcome back, Jessamyn and Maggie.

Maggie: Hello.

Jessamyn: Hi. Thanks for having me.

Maggie: Good to be here.

John: Our teas today are:… Jessamyn, are you drinking any tea?

Jessamyn: I am. In preparation for this very question, I’m drinking a wild sweet orange.

Maggie: Oooh.

Rebecca: Sounds nice.

Maggie: That sounds very fall. I am drinking a bread pudding tea. It’s a black tea from a little tea shop in Sacketts Harbor.

Rebecca: That’s a first on our podcast for sure.

Maggie: I think it’s called Tea Thyme, the little shop. It’s quite lovely.

Rebecca: Nice. I have Irish breakfast this morning. So we’ve invited you both here today to discuss unessay assignments. Could you tell us a bit about what an essay is?

Maggie: I guess I’ll say an unessay is anything but an essay. Jessamyn probably has some more nuance? [LAUGHTER]

Jessamyn: Not really, that is the basic premise. In classes where you might traditionally ask students to show their learning via a standard essay, either like the five-paragraph essay or a research paper, an unessay project asks students to demonstrate their learning, increased understanding, via any other kind of format.

Rebecca: Jessamyn, can you tell us a little bit about why you decided to use unessays in your class?

Jessamyn: Sure. And this also relates to… I know, we were maybe going to talk about what was appealing for historians, in particular, about the unessay. And some points for history professors generally and me, what attracted us to considering using the unessay. A couple of things about our discipline: first, that the unessay, it’s a good way for students to explore some key historical thinking skills in different new ways for them, so things like citation, research, and historiography. So trying to understand what other historians have written and argued about the past. There’s also been a pretty significant sort of public history turn in the world at large, like trying to better understand different audiences for historical research. Some other more general reasons were issues of equity and inclusion, especially around Universal Design for Learning, trying to offer students some options as a way to increase their learning, increase engagement. And the final thing I’ll say, just for me personally, is that I wanted to make assessment and grading a more joyful and happy part of my teaching life. It had really started to drag me down. And I didn’t want to approach assessing student learning as a soul sucking slog, not just for personal reasons, but also that it was interfering with my ability to accurately assess. If I was absolutely dreading reading a stack of essays, then something was amiss, and I wasn’t going to be able to, in my view, really accurately assess what has this student achieved.

Rebecca: About you, Maggie?

Maggie: I think really a lot of what Jessamyn said echoes in the reasons I decided to incorporate the unessay in my classroom. I was actually inspired by a talk that Jessamyn gave to our faculty, I guess it was over a year ago now, about the unessay and I immediately thought of my senior seminar class. So in criminal justice, in our department particularly, it was common for students to write a 20- or 30-page long research paper, and they dreaded it. It was a source of anxiety for students. It was something in the end that I’m not entirely certain they felt proud of. They just were trying really hard to get the A in the class, to make it perfect, to spend lots of late nights trying to perfect this project and I don’t think it brought about the kind of learning gains that I was hoping to see with my students, it seemed like there was a lot of going through the motions. And the unessay just gave us an opportunity to really turn that on its head and give some of that autonomy back to students and some of that creativity back to learning.

Rebecca: I’m loving these themes of joy, creativity…

John: …which are not terms we often associate with either writing papers as students or with grading them as faculty, and Jessamyn, you were the editor of a fall 2022 issue of Teaching History that focused on unessays. Could you tell us a little bit about ways in which you and other historians have been using them in your classes… some examples of ways in which students have demonstrated their knowledge?

Jessamyn: Sure, and I’ll just give a little promo here, Teaching History: A Journal of Methods is an open access journal. So you can just Google Teaching History: A Journal of Methods, and it’ll take you to the open access platform. It’s hosted by Ball State University. And so that issue is still totally available for anyone interested in reading it. I would say, like some specific projects that were explored in that issue, there was an article about using maps as historical documents, there were a number of projects that were exploring how to present history and historical thinking in a public history setting. So along the lines of museum exhibits, and especially in a digital format, the upsurge in digital humanities is something several of the authors were looking at. And then there’s a whole range of examples that were discussed in the two interviews I did for everything from board games, to graphic novels, to quilt, to the annotated recipes. All those were discussed in that issue.

Rebecca: What are some specific projects, Jessamyn, that you’ve done in your classes,

Jessamyn: A couple that have come up that I used… it’s interesting… Maggie used the unessay with her senior students. And I have helped students in the history department here, they also have to do a major research project. And I’ve been the advisor on a number of non-traditional projects is what I called them at the time, and now would say unessay. So at the senior levels, students did major research projects, like a fictional interview with a historical figure, historical fiction would be another example. I’ve had a couple of students do online exhibits and one person do an in-person exhibit. But I also use the unessay assignment in my intro level class, which is a basic history survey class. And those projects ranged from again, the board game, I had a number of posters, I had one student who was a trained professional baker do a set of cookies with icing, comparing different protest movements, the Bonus Army March in the 1930s with the more recent climate change activism. And one of my very favorites was a video recording that a student did, showing step by step how she made a family recipe. And since the theme of the class was the American Promise, and the way that throughout our history, as a nation, we’ve struggled to achieve the ideals of equality and liberty for all. And we get closer and we fall short. And her recipe was from her family’s background from India. And she took us step by step through it. She had music playing and was describing the importance of this particular dish in her own family history. The unessay was encouraging them to see their location in the American Promise. And it really struck me, in my previous life as a historian of food and food waste. So that was interesting. But most striking to me was, this was a student who had been very, very quiet in class. I felt like I didn’t know her very well. She was doing great work, but she was sort of on the edge of things it seemed like, and with this unessay, it completely changed my perception of her. I felt like I got to know her so much better and so did the other students as well. Having students share their unessays is an important part of the work and It really changed just the whole classroom dynamic in that way. So that was really notable.

Maggie: Nice.

John: Maggie, what are some of the projects that your students have done as unessay assignments?

Maggie: Yeah, so I mentioned before that I assigned the unessay for my senior seminar class. So it’s a sort of capstone project. And there were some really awesome projects that came out of this and I probably don’t have time to talk about all of them. So cut me off at some point when I’ve been going on for too long. But I had a student who wanted to be a elementary school teacher, and had gone through our program and decided that being a practitioner in the field of criminal justice was not exactly where they wanted to be. And so his project was to create lesson plans for second graders to communicate some of the harms of incarceration and how it affects youth when their parents or caregivers are incarcerated. And so it was a really wonderful project, all the students had worksheets, kind of like you can think about having when you were in second grade, and little matching puzzles and games, and it was a really cool experience. And for him getting interested in a master’s of education program, it was a way that he could then take that project and show to his grad school applications and advisors, like, “Hey, this is something that I’m really passionate about. I’ve been working towards this. And yeah, it was a lot of fun.” We had a good time, even some spelling words thrown in there. [LAUGHTER] It was great. Another student project was a choose your own adventure story. There’s various examples of this. But in my youth, it was the Goosebumps choose your own adventure where you read to a certain part in the story, and then it gives you the option of what you want your protagonist to choose. And then you have to flip to a different area of the book and see the fate of that character. And so the students started a really great project, unfortunately, didn’t get to finish it for various reasons, but started a really great project about reentry. And so the main character was someone who was being released from prison and had to navigate all of the barriers and circumstances around reentry that made it difficult for him to assimilate back into society. So that was a big fan favorite amongst the class. They really enjoyed that. Of course, we also had some board games, one in particular, was a monopoly game that examines varying socioeconomic status, and how that influences someone’s path through the criminal justice system. So the players started off with different amounts of money. And as they would pull community cards and have to purchase property and such, they would be challenged to need to pay a particular court fine, and how that would set them back from being able to find a job. It was a very well thought out game of Monopoly. But the goal to show and highlight the inequalities related to income and how that affects criminal justice processing. I could probably keep going, but it really gave a lot of opportunities for students to combine what they were interested in. There was a student who had run their own podcast for a period of time. So she conducted a podcast series on Amber Alerts and their effectiveness. And it was something that when she had been traveling down to Texas, and had received a number of Amber Alerts in the short time that she was there, she was like, “Are these things really working? And how can I explore that through a medium that she was already quite drawn to?”

Rebecca: Unessays always sound like so much fun?

Maggie: Yeah. And they’re fun for us. I know Jessamyn touched on that, too. It’s a whole different experience as someone assessing the work that they’re doing when you know that they’re passionate about it. And it gets me excited about assessment, which I don’t think is something we can typically say.

Rebecca: There’s not a big line of faculty raising flags saying assessment is fun.

Maggie: Right. [LAUGHTER]

Jessamyn: I also wanted to follow up on a point Maggie’s touched on a couple times about student autonomy and agency. I think for both our student populations, this is a really key academic, professional, and personal skill that many of our students need to build, that they arrive to college with a sense of themselves as very passive recipients of education and have not had the opportunity to really see themselves as producers of knowledge. as having agency in academic settings. So for me, one of the great glories of the unessay, is that it’s starting point really is, what do you want to do? What do you want to do to demonstrate that you understand this topic, and for a lot of students, it’s scary at first. A few might think that you’re trying to trick them. And I know this was something we did want to talk about. It does require, on our part, a fair amount of structuring and transparency and communication with students, maybe even especially the highest achieving students. One of my favorite students of all time went on to become a high school social studies teacher. And she did a fantastic job in the intro class with the unessay and then told me like a year later, “You know, I hated that assignment when I did it.” And it was because she was very, very nervous. She was a straight A student who was really nervous about doing something different. But she said, “Now, it’s my favorite, looking back.” So providing that structure and support and transparency, a lot of careful thought on the front end.

John: And one of the things we’ve been talking about in one of our reading groups, Mind over Monsters this semester, at both of our institutions, is the importance of autonomy, in terms of increasing student motivation and giving them more sense of control. It sounds like it’s really helpful in motivating students.

Jessamyn: Yeah, I think so. In both of our disciplines, criminal justice and history, there is a major learning curve to helping students see themselves as having agency in this particular discipline, especially the way they may have interacted with it before. And for me, coming from a lot of their previous experiences with history has been learning what happened and not actually doing history or thinking about those processes and the unessay could really help them move towards that particular desirable learning outcome.

Rebecca: I think one of the challenges that faculty who have been engaged in unessays before see before they enter in is the complexity of having students doing many different kinds of things at one time and managing those projects and also assessing those projects. Can you talk a little bit about how you help provide that structure for yourselves and for students?

Maggie: Yeah, so for my criminal justice class, I spent a lot of time the summer before I implemented this project, creating very detailed instructions and expectations. Jessamyn, I went to your website, and I use some of the self assessment tools, and I adapted them for my class as well. It was a very mindful process to think about how to give students the structure they need to feel confident in their ability to carry out this project, but also give them enough flexibility and creativity to take this project where they want it to be. I also spend a lot of time reading about different alternative grading practices to also incorporate in this, so I use kind of a combination of ungrading and specifications grading as well to help students assess their work. And I met with students quite often throughout the semester, particularly we had a midterm and a final exam meeting where we talked about the strengths of their projects, where they needed to go and what areas they needed to work on, whether it was engaging more deeply in the research and how to communicate that effectively in their projects. It was a lot of work for the faculty, but it was worth it in my opinion. It wasn’t so onerous and it wasn’t boring. It was exciting to meet with students, even if it meant spending my entire midterm week in the office with the students. It was almost every minute of my day for an entire week doing this, but it was, I think, a unique opportunity for making those connections with my students.

Jessamyn: I have been lucky. I have a relatively light teaching load and small classes. So that did make a difference in how I thought about structuring and implementing the unessay. There would be challenges on a larger scale. I would also say that there’s components of the unessay, that it’s not just do anything you want, and then nothing, and then in the end they turn in something. No, there’s stages and components like usually a proposal process and I also was able to meet with students. You could meet with students in small groups as well, if it’s a larger size class to go over the proposals, and many unessay assignments also do have a written component like a bibliography, an intro. At the midterm and end there could be a reflective assignment or sort of summary of work achieved. I did co-create with students the assessment guidelines for their projects. So taking the autonomy and agency a step further, I didn’t leave it totally up to them, we worked together on it, but asked them, “So this is your idea, this is the project you have in mind. How will it show these important skills? How will it show that you’ve met these course learning objectives?” And we work together on it. And that part is always great for me, I just really enjoy trying to de-center myself a little bit as the instructor which again, is something I can do from a place of certain privileges. I have tenure, I’m white, I’m cisgendered. But trying to enlist students as partners more, decentering myself a little bit, and asking them to reflect on what would show that you have achieved this learning outcome with this unessay assignment. A nice bonus is always students, at least one student, will say this is so hard, teaching must be really, really hard. [LAUGHTER] So bringing them in on that assessment process can help them even reflect on what does grading and assessment mean? What would show me that you’ve successfully achieved this learning, this desirable outcome?

John: Do either of you use rubrics for the unessay assignments?

Jessamyn: Well, when I co-created assessment guidelines with students, some of them used a rubric form. A lot of my students found rubrics helpful for things like deadlines. And I did set deadlines for certain benchmarks. And that was something that was easy to map out and help them structure their work time and stay on track as well.

Maggie: Yeah, I created a checklist with that self assessment that was on Jessamyn’s website, geekypedagogy.com. I did have students go through that and rate themselves, and then we got together in a meeting to discuss where we felt the accuracy of each of those points. But I think it gave them some comfort in saying, “Okay, I know I did multiple revisions of this, and I incorporated all of the feedback I was given. And here’s the changes I’ve made, or here’s the areas that I think I probably could have done better, or I could have focused my time a little bit better in this way.” And it just gave them, I think, a nice guideline to be able to talk about the strengths and areas of improvement for their project.

Jessamyn: I’ve used rubrics before, when I was co-creating the assessments. That’s fine with me, if that’s what they want to use. I will say that this part of it, while being very cognizant, like I said, of my own privileges and positionality and aware of that, your teaching context can really shape what kinds of assessments you can implement, for sure. But I also think that it’s at least worth considering the idea of our academic egos and our investment in our discipline and expertise. And what the unessay may challenge us to do is let go of the thing we know how to do absolutely better than anything in the world. So as a historian, a trained historian, I know how to assess student writing better than any other task I do as a teacher. I know so much about it. And it’s easy for me to do, not joyful, [LAUGHTER] but not difficult. It doesn’t push me to think about anything outside my comfort zone. And when I assign an unessay, I have to let go of that and think about things differently. And again, keeping in mind that I know bandwidth is limited, the incredible pressure on a lot of people in the pandemic pivot and for all various reasons, our limited energy, it might be too big an ask, too big a lift. But I would encourage listeners, if it’s possible, to consider maybe it’s not about me. [LAUGHTER] It’s not about us, and what makes us most comfortable as the person with the PhD in the room. That being a little uncertain. how can I assess did students meet this learning outcome with a quilt, with a board game, with a podcast, that it’s okay for us to feel a little bit discomforted. That’s about maybe getting out of the students way a little bit.

Rebecca: When I hear folks talk about unessays, both of you as well as others that I’ve heard talk about unessays, I see a big emphasis on process and the behaviors of a discipline, rather than necessarily the outcomes of something. So often in a research paper, we might assess on some of the polish of something like that, rather than really seeing always the process that goes into the thinking. But I feel like a lot of times with these projects, you end up knowing a lot more about a student’s thinking, because you’re talking with them about their projects in an ongoing way. Can you talk a little bit about that process piece with unessays?

Jessamyn: Well, one thing that jumped into my mind, Rebecca, when you were asking your question is writing a thesis statement for a research paper. Now, this happens to be something I’m incredibly good at helping students do, crafting their thesis statement. But, just like you described, it’s often so much about the academic writing skill that I’m helping them with, and when they have to write a thesis statement for the research paper they’re working on, that’s a great skill to have, if you’re going to be an academic. If you are engaging in scholarly writing, you have to know how to do that. And for a few students, that’s important. And that’s not like written communication skill. I’m talking about the highly academic scholarly skill of summarizing the argument you’re about to make in a paper. So for students who want to go on to be graduate students, I’m all in. We’re going to sit and we’re gonna go through this word by ever loving word to figure out the best way to state your argument. For a lot of my students, though, is that the best investment of their time, and the best way I can help them? There might be other ways to, just like you said, have them articulate and demonstrate their thinking, which, and I’ll just throw it out here in the age of generative AI and ChatGPT, this is at the heart of how we help students navigate is their original ideas really matter, their ideas, and their thinking matters. So if I can support a student being able to demonstrate their thinking and ideas in a way that matters to them, that they feel articulate doing, then, mission accomplished. That’s what I want. That’s what I want for students.

Maggie: Yeah, and I would say that, in my class, the 20- to 30-page research paper does serve students who are going to go on to graduate school. But like said, I don’t know if that is the best way to help them make the connection between what we’re doing in the classroom to what they are going to be doing on a regular basis in their various careers that they find themselves in. I wanted to make this project less about a means to an end for them, I wanted them to really think about how they start with an idea and how if they spend enough time thinking about that idea, and really focusing on how to communicate that expertise that they gained throughout the research on this idea, that they can create something that they’re proud of and they are hopefully less focused on the grade at the end of the semester and more focused on “Okay, I was actually able to start in one place, develop that project, develop this in a way that I can now go to my future employer or in an interview and say that I’ve developed these skills along the way that are mine and mine alone. They’re not ones that have been imposed on me by an instructor.”

John: We have increasingly diverse student bodies in terms of their prior preparation. Some have come through and had lots of practice writing throughout their high school careers and have developed those skills, others haven’t had as much preparation in writing. And we have lots of courses, though, that give them that but writing skills are not always one of the most important learning objectives for many of our classes. And it seems to me that perhaps using unessays can help provide a more equal playing field for students who may not have as strong of writing skills, but might be fairly comfortable creating videos or might be able to engage in some other creative activity that can demonstrate what they learned much more effectively than if they were constrained to having to do it in a written format.

Maggie: Well, I would say that was my experience for sure. I had a group of students make a series of TikTok videos and so they were quite excited about their ability to use something that they are on almost every day, if not every hour of their day, to use that as a platform to communicate the time topics that they were most interested in. And so it did mean that I had to learn a little bit about TikTok, I had to create a profile so I could follow my students and be able to see the videos that they had created. There’s an up voting system, too, I had to navigate [LAUGHTER] but yeah, in terms of equity, it does give students the ability to make decisions about how to present information in ways that they’re comfortable, but still challenging. I think that no matter what mediums students picked, it was challenging regardless. So it didn’t feel like students were just picking something that “Oh, well, I do this all the time.” It really was a strong motivator. And I think in a lot of the conversations we’ve been having in our reading groups about how to channel anxiety about something into a more direct way to accomplish a challenging task. I think it gave even students who are perhaps underprepared for academic writing, or find a lot of anxiety around that to shift their focus away from what they envision that they struggle with to then start in a place of, “Oh, I know I can do this, and I can communicate it in this way.” So I think it gave them some of that confidence back, that perhaps they find disappears when we impose a pretty lengthy paper or academic medium on them.

Jessamyn: There’s two aspects of the unessay and equity minded teaching I’ve been thinking of. One is the universal design for learning concept of providing some choice. It doesn’t have to be unlimited, it doesn’t have to be infinite choice. But providing some choice does increase accessibility. The second kind of key equity minded principle I have in mind with the unessay is that we should not be grading and assessing people’s life circumstances, we are grading and assessing their learning and their ability to show that they have reached certain benchmarks and outcomes. Just to put it in here as a caveat, I do think all kinds of writing is very, very important. Writing skills are very, very important. And a lot of the unessay assignment as I use it does include some clear written communication, because that is a skill we need in this world of ours. So the equity piece comes in though, that if I’m going to be assigning a grade assessing student writing, then it’s on me as the instructor to teach that and create the conditions in the classroom, the practice and the feedback, and more practice and making mistakes, and more feedback to do that writing piece. And if I’m taking into account the wide variety of academic backgrounds, what needs to happen in the course, for students to be able to demonstrate their learning accurately via a written essay, that’s a lot of writing work that I’m going to be doing to provide that equitable classroom. So the unessay as an option, that’s something a lot of people do offer the unessay as an option alongside a traditional essay option, the unessay as an option could increase equity in that way. I think it does convey the idea that our diversity is an academic asset. That all said, it’s interesting that the unessay could also exacerbate inequities without structure, without support. Students who have had very rich and varied past educational experiences may leap at the opportunity and see it just solely in terms of its benefits. Other students with less of that in their background might be extremely nervous about it as a whole new frontier for them. So without some structure, transparency, without all that prep work, Maggie, that you were describing, it could actually exacerbate some of those inequities.

John: And I think the scaffolding that you both described is really important in relieving some of that uncertainty, because I know some students when I’ve given similar types of assignments are really anxious about it and letting them do it a little step at a time and master that step seems to help relieve the pressure on them by just reducing the uncertainty.

Maggie: I know one of the things I incorporated in the project, and I think Jessamyn did this as well, that I gave students unlimited rewrites on any of the written work. So I did have a bibliography and I did have a proposal and a sort of artist’s statement reflection at the end of it. I think, again, I took that from geerkypedagogy[.com] and I gave students the opportunity to just keep rewriting and rewriting. And yes, it was a bit more work on my end. But it was so refreshing that students were actually taking my feedback into their work and they were making improvements. I think that whenever I’ve done drafts in the past, they might go through and make just the easy corrections and leave some of the harder things aside. But in this project, because we started a lot of those elements very early in the semester, we spend weeks and weeks just revising. And it really did give students, I think, a opportunity to make sure they fully were understanding and achieving those outcomes.

Jessamyn: Yeah, that point Maggie about your feedback actually being read and applied is so important for students and for faculty. It’s discouraging and disheartening to provide students a ton of feedback and then feel like it hasn’t been read. It’s up to us, though, to provide the opportunity for students to apply the feedback. If it can’t be applied, it’s very difficult to take it seriously [LAUGHTER] and to see it as meaningful and relevant. And I think another aspect of what you are describing that listeners might be interested in… if we haven’t totally convinced you yet [LAUGHTER] to use the unessay… is that it does get students’ attention, it cuts through the static. We get into a routine we’re just trying to get through, check that box for students who are overworked, overloaded, for whatever reason. I really feel like it kind of cuts through a fog that many of us, students and faculty, are in just by asking us to do something a little bit different.

Rebecca: Sometimes in those cases, and you guys have alluded to this before, that doing something different if they’ve not done it before, is risky and scary. And so all that scaffolding that you’ve built described as so important for students to be able to take that first risk and maybe take other academic risks in the future.

Jessamyn: Yeah, we can’t underestimate the impact of our traditional grading systems and traditional school systems where the stakes are sky high. You can’t overestimate them, financial aid, everything, is so tied to a student’s GPA, their families support, staying in school is often tied to GPA, their own sense of their selves as students, who they are, is defined by the grade they get. So asking them to, Rebecca, like you said, consider the process, not the end point. It is a big ask. So we can’t expect instant student buy-in, that they will immediately jump on board and with ease and joy, even if we are feeling that way about it.

John: So it sounds like it’s been a lot more fun, even though it may sometimes take more work for both of you. How have students responded? You’ve mentioned a little bit about student responses. But how do students generally respond at the end of the semester? Is it something that they find to be equally joyful?

Maggie: Jessamyn touched on this, but there was a bit of student buy-in that I had to get. And there were a couple of students who still wanted to write a traditional research paper. But in the end, they did a podcast element as well with it. So it was the sort of combination of the two, but it was the first time I had ever implemented an unessay in my classes. So I didn’t have a lot of student examples to show them. But I did spend a lot of time creating my own examples of what an unessay would look like. And I think for each of those scaffolded assignments I created a bibliography and a presentation and I tried to create an unessay myself so that they could see what it would look like. I think that gave them a little more confidence in knowing what was expected of them. But really, it took a lot of conversations with students on why I was doing this, what I thought the importance of shifting away from a traditional research paper, what gains they were going to have from that, and every student, at least to my knowledge, really enjoyed the process and much preferred the unessay over their 20- to 30-page research papers.

Jessamyn: The student resistance you just mentioned, Maggie, reminds me that I mentioned teaching context before, but it is important to underscore that any non-traditional teaching and learning practice and assessment, you can expect greater student resistance or reluctance when you quote unquote don’t look like a professor. So when you don’t fulfill the stereotype of what a professor looks like, if you’re navigating any kinds of intersectional biases, you may have to take into account the student resistance component and student biases. It’s a point that Chavella Pittman has emphasized for like an ungraded practice, that it’s very important to take those considerations into account. I will add that the biggest benefit besides my own grading joy is what I see… it’s extremely hard to measure… I couldn’t put it on my end-of-the-year file assessments of my own teaching, but students gain confidence, students gain some agency, some autonomy. I can see it in how they talk about it. If you can have a showcase or a gallery walk, you can see that they are proud of what they have achieved. When we’re doing senior presentations, that’s always very clear, like students’ sense of accomplishment is very notable. And it’s not that that doesn’t happen with the research papers. Well, it can, but the range of students who express and demonstrate to me that they’ve gained some confidence in themselves as students, as thinkers, as knowledge generators, as producers, it’s really heartening.

Rebecca: So we always wrap up by asking what’s next? Jessamyn, you want to go first?

Jessamyn: I’m headed to the POD Network Conference. I’m gonna do a session, with Chavella Pittman and Thomas Tobin, on faculty development that acknowledges teaching inequities. And I am working on a book on teaching and learning when things go wrong in the college classroom, and I just recently signed a contract for that book with the new series at University of Oklahoma press called Teaching, Engaging, and Thriving in Higher Education.

John: Maggie and I will both be at POD and will try to get to your session. And we’re looking forward to that book.

Maggie: I suppose what’s next for me feels like such a loaded question right now because I’m anticipating applying for a sabbatical. And so I’ve been really ruminating on this question of what is next for me. I’m entering into a mid-career stage, and so I feel like my answer is “I’m not quite sure yet.” But as far as the unessay goes, I do plan on bringing the unessay to my courses next semester. I’m teaching two elective courses on death penalty, and women and crime. And I think really any course, but particularly these courses, would be well suited for an unessay project.

Jessamyn: That reminds me, I am lucky enough, I’m going to be going to the American Historical Association Conference this spring and doing a workshop on the unessay, so any historians listening, I hope I see you there.

John: And we will include links to Teaching History, to that specific volume, as well as to the other resources that have been mentioned here. So check the show notes to find more of those resources. And thank you both for joining us again.

Maggie: Thank you so much.

Jessamyn: Thank you.

Rebecca: It’s always wonderful to talk to both of you

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

306. Gender Bias and Timing of SETs

 A number of studies demonstrate gender bias in course evaluations. In this episode Whitney Buser, Jill Hayter, and Cassondra Batz-Barbarich join us to discuss their research that looks at the timing of when these gender differences emerge and theories for why they exist.

Whitney is the Associate Director of Academic Programs in the School of Economics at Georgia Tech. Jill is an Associate Professor of Economics in the College of Business and Technology at East Tennessee State University. Cassondra is an Assistant Professor of Business at Lake Forest College. Whitney, Jill, and Cassondra are the authors of an article entitled “Evaluation of Women in Economics: Evidence of Gender Bias Following Behavioral Role Violations.”

Show Notes

Transcript

John: A number of studies demonstrate gender bias in course evaluations. In this episode we discuss research that looks at the timing of when these gender differences emerge and theories for why they exist.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guests today are Whitney Buser, Jill Hayter, and Cassondra Batz-Barbarich. Whitney is the Associate Director of Academic Programs in the School of Economics at Georgia Tech. Jill is an Associate Professor of Economics in the College of Business and Technology at East Tennessee State University. Cassondra is an Assistant Professor of Business at Lake Forest College. Whitney, Jill, and Cassondra are the authors of an article entitled “Evaluation of Women in Economics: Evidence of Gender Bias Following Behavioral Role Violations.” Welcome Whitney, Jill, and Cassandra,

Whitney: Thank you for having us.

Cassandra: Thank you so much.

Rebecca: Today’s teas are:… Whitney, are you drinking tea?

Whitney: I am. I have some jasmine tea.

Rebecca: Always a good choice. Jill. How about you?

Jill: Harney and Sons Hot Cinnamon Spice.

Rebecca: Oh, that’s such a good choice. I love that one. It’s a family favorite at my house. How about you, Cassandra?

Cassandra: Yesterday, we made a sun tea on the porch. So it’s sweet peach tea.

Rebecca: This is a good variety. How about you, John?

John: And I have ginger peach black tea from the Republic of Tea.

Rebecca: So we’re combining choices here [LAUGHTER]. And I have Awake tea, despite the fact that it is early afternoon here.

Jill: I also had three cups of coffee this morning.

Rebecca: It’s one of the most popular kinds of tea, Jill.

John: We’ve invited you here today to discuss your research on gender bias instudent evaluation of instructors. Could you tell us how the study came about?

Whitney: Jill and I have been working on this for about six years, believe it or not. It’s been a long process for us. And actually at the very beginning we had a different third working with us. And the original three of us, we met at the conference, and we had just attended a session that talked about teaching evaluations. And afterwards, we just naturally began talking about this, because we all had these really, really strong feelings about teaching evaluations. All three of us at the time were young, young in our careers, young age wise. We were female PhD economists. And we were all earning tenure, or I think Jill had just earned tenure. But we’re all in this similar experience of having what we felt like was a very positive class climate, and a lot of camaraderie between ourselves and the students until the grades were returned for the first time. And then we could feel a definite shift and it was upsetting to all of us. We all got into this because we love teaching and we want to do a good job in that. It was just something that we were picking up on. So that was our anecdotal experience, Jill had a little data on it herself, because she would do mid-semester evaluations herself, just to gauge the class climate and see what students were needing. And I had an experience where in my first position, they did a surprise midterm evaluation, just to kind of see how the new professor was doing, that I didn’t know about. And I got glowing reviews from the students, everything was very, very positive, wonderful and six weeks later, same students but grades returned, evaluations looked a little different. And the comments were a bit different. So we had a little data to backup this idea too, and one thing if the people listening today haven’t read the literature, there’s an extensive literature on course evaluations. And it consistently finds gender bias in those. But the thing about that literature is it only looks at evaluations, which are typically done on the very last day of class, maybe even after that, maybe a couple of days before, but at the end of the semester. And we really haven’t seen anyone look into how these opinions of students evolve over the semester, or how students feel at the beginning or the middle of the semester. So that’s what we wanted to do with that. And in my opinion, and this is just me speaking here, Jill can have her own other motivations, or our other co-author that has worked with us before could feel differently. But for me, it was really important to acknowledge that society has come a long way in the past several years with gender bias. And I don’t think that modern students are shocked by female faculty any longer, I don’t think they have an explicit distaste for female faculty. Anecdotally, I feel that my students are actually happy when they meet me. And they have expectations of me to be warm, comforting, approachable. But I do think that when you expect someone to be more comforting and approachable, and they give you a grade back, that’s not always an “A” in a difficult quantitative subject like economics, you can get a bit of a Grinch Who Stole Christmas effect. I thought it was going to be one way and now my expectations are taken down. We all know no one likes that dopamine depletion of having expectations not met. So, to me, if we’re going to talk about gender bias, we really have to talk about it in this nuanced way, so that it doesn’t get automatically dismissed by people who don’t see an explicit bias and then say, “Oh, hey, there’s nothing here.” And then the last thing that I think is really important here for the motivation for the paper is that we have this expectation that bias would grow over the semester. So if bias grows over the semester, that means the earlier in the semester you evaluate, the smaller the bias will be. And one thing that the literature is missing is a very concrete objective way to deal with bias. What we were hoping to find was: move the evaluations up in the semester a bit, and you minimize or eliminate bias and that’s a concrete objective. Towards the end today, we’ll talk about what we actually found and whether or not we knew that. But that was one of the motivations.

Jill: So that’s how the original paper found in terms of motivation, but then Cassandra, she is a PhD in Psychology until she had read and she was doing work in the area. And she had reached out to Whitney and I. She had read our paper, she had read the results of our paper. And so then a second paper with Cassandra takes a more psychology approach in terms of a lot of what Whitney is talking about and Cassandra is going to talk about it later, with respect to the role-incongruity theory, social role theory, and she’s going to talk more about that later. And Whitneys described the motivation of that first paper, the second paper takes a very different perspective and looking at it from a more psych perspective. Cassandra, you might want to chime in?

Cassandra: Absolutely. I think you summarized it well, I joined the paper, as Whitney and Jill were trying to find a home for it. And we thought that our interests, though coming from very different backgrounds ,would blend nicely for this particular topic, as there’s a lot of scholarship in psychology that looks at understanding reasons behind this bias. And so I was brought in to really help kind of think about how do we frame that in a way that might appeal to even a broader range of audiences.

Rebecca: At the beginning of the paper, and Whitney, you’ve kind of pointed to this today about being a young faculty member, you also noted in the paper that women are underrepresented among economics faculty, especially at the level of full professors. Can you tell us a little bit about the extent of this under-representation?

Jill: Women have earned more than half the doctoral degrees for over a decade. But particularly among tenure-track faculty are underrepresented. In the paper we cite 36% of full professors are females. In economics, that’s a smaller percentage, 17 and a half percent of full professors are females, in the area of economics, although 35% of PhDs in econs represent females. It’s a smaller percentage of female faculty receiving full professor rank in economics. That’s what we mean by that under representation. In terms of economics, specifically, it’s oftentimes left out of the STEM fields, and depending on which university or college that you’re out at, economics can sometimes could be found in the social sciences and in the arts and sciences, or it can be found in the business school. So at my institution, Whitney’s institution, I believe, and Cassandra’s I think we’re all represented in the business school. But sometimes, you know, economics wanted to put in there with the social science field, it’s not thought of as being this more quantitative, heavy subject, and it oftentimes is, it is by nature of it. And so females in those more math heavy classes, like the STEM classes. I think my students when I started off, and I think Whitney was getting at this, with us being more junior faculty members. I can considered by students peer, instead of the professor in the course. And that made it tough, because to Whitney’s point about that returning grade feedback and the perception that students had of me a day one versus midway through the course, I was now coming across as someone that was handing back maybe less than 100% or “A” grade. So in my business school, my principles of economics courses are required. They might not even want to be in there, but they have to be in there to get a business degree. Earlier on, that was a challenge I faced, I’m 13 years into my career. I’m going up for full professor this summer. But starting off was really a challenge. And I remember having female mentors in my graduate program. They tried to prepare me for this, they tried to say it’s going to be challenging early on, you’re going to have to go against some of these perceptions, alot of the perceptions that we measure in this paper..

John: To what extent is the underrepresentation of women faculty due to a cohort effect where women have become a larger share of PhD economists in the last few decades, but that was less true 20 or 30 years ago and how much of it might be due to the impact of gender bias on evaluations on career pathways for women?

Jill: Really what this paper looks at, the standard evaluations of teaching and the bias or potential for bias, that exists there. So I’ll just speak to that and that where I currently am, evaluations of teaching are weighted heavily for retention of faculty, promotion of faculty, tenure and promotion decisions. And then when we’re hiring new faculty, looking at any previous course evaluations and experience with teaching. At every level in academia, these are used as some gauge for teaching effectiveness. I think one of the questions that we’re looking at and accrediting bodies are looking at is whether or not this is the measure that should be used. And looking at different measures that might be options for measuring teaching effectiveness, we know that they’re flawed, that our study is showing that they’re flawed, but also previous literature has suggested that they’re flawed as well. And so the fact that for most schools, this is the single measure that’s being captured… and I know that it’s different depending on again, at my institution, some departments don’t give them a whole lot of weight in tenure and promotion decisions. But certainly, my experience in my College of Business and Technology that these are weighted heavily. And so in thinking about a junior faculty member starting off, when Whitney and I met at the conference, if my evaluations were lower, I’m putting a lot of time into my teaching and improving and bringing up those scores. My male colleagues, in discussion just with them, didn’t have the same experience that I was having with respect to these SETs. And so we think about allocation of time and resources as a tenure track junior faculty member, I’m putting more in what I would consider just catching up, getting those SET scores higher, so that it’s reflected in my tenure and promotion packet. And that’s less time that I’m allocating toward research or other things. That’s my view on it. I think Whitney has a couple other thoughts on that.

Whitney: One of the things we tried to make clear in the paper is that the literature is very clear that evaluations do have a gender bias. And if these evaluations are being used, and they are, in hiring decisions, annual evaluations, promotion, tenure evaluations, and merit pay raise decisions, then they’re being used at every single level of advancement. It’s not one small piece. It’s a piece that’s used throughout and very integrated late in the process.

Rebecca: You mentioned at the top of our interview that the second paper shifts more towards psychology, and specifically describes ways in which both social role theory and role-congruity theory may explain the bias against female faculty in student evaluations. Can you briefly summarize these arguments for our listeners?

Cassandra: So social role theory was a theory that has been put forth for decades by Alice Eagly, a very prominent scholar in the social psychology world, as well as her colleagues. And this has been used as a framework to really understand the complexities and origins of gender gaps in our workplace in particular, whether that be inequities and experiences, the expectations that are different for women, and of course, the outcomes such as promotion at work. Essentially, social role theory suggests that the reason we see these gender inequities today in society or that they originated from men and women being distributed into social roles based on physical sex differences, so that women biologically were able to have children, men, on average, were physically stronger, which those differences 1000s of years ago, had an evolutionary benefit to a well functioning society, people were supporting in the ways in which they were best equipped to do so. And the assignment of men and women into these roles led get them to adapt role-specific qualities and skills. So women who were bearing children were friendly, helpful, sensitive, concerned with others, kind, caring. We refer to these now as more communal qualities, and men and the provider, the protector, role led them to have attributes such as ambition, being assertive, authoritative, dominant. These are qualities that now we label as agentic. So while technology of course has since caught up and made these biologically driven role assignments unnecessary, society continues to see a division of labor along these lines in the modern world and society at large. And society at large still holds the belief that women do possess these traits, and should possess these traits, these more communal qualities, and men do and should possess more of these agentic. Relatedly, role-congruity theory helps us understand the consequences when men and women fail to fulfill these expectations. And we know the failure to fulfill these expectations are more consequential for women, this experience of bias driven from the failure to behave in communal ways. In other words, violating these cultural expectations can be seen in all areas of society, but particularly in traditionally male-dominated positions, like college professors, or in male-dominated fields like economics [LAUGHTER]. And so women that are in these roles are already going to experience some degree of backlash for being in gender-incongruent positions. But that is especially true if they are also going to behave in traditionally more agentic ways, being more assertive, demonstrating their power, which we argued was what was occurring when you give critical feedback back to students.

John: To approach this, you gave evaluations to students at two different points of the semester. Could you tell us a bit more about the study design, how large the sample was and how many faculty and institutions participated in the study?

Whitney: Sure, we had a really rich data set for this study. That’s one of the reasons we were able to get two different papers out of it, and maybe even some future research, because we took all of this data, and we collected it in person on paper and entered it, which was an arduous process. As I said, we had been working on this project for about six years, about a year and a half of that was just data collection. And we have a lot of people to thank that did that for us for no author credit on this paper, so we had males and females across the United States gathering that data for us, that we’re really appreciative to have. So in the end, we wound up with about 1200 students in total, we weren’t quite 50/50, we were 60/40, favoring men, which is typical for economics classrooms, even though it is required in a lot of majors (that’s where you’re getting a lot of the women taking it). And like you said, John, we surveyed them twice. We surveyed them on the second day of class, we wanted as close to a first impression as possible without having a major sample issue with drop/ad. And then we surveyed them the day after they got their first midterm grade back. So we got the first impression, and then we got the way that they felt after they had had their first grade returned. We did this at five different colleges and universities, we had three male professors contributing data and four female professors contributing data. One of the big questions that people have asked us over the time is “Well, how does race play into this?” And that’s something that’s beyond the scope of our research, I will say that we only had one underrepresented minority in our sample, again, typical of economics professors, it was one of our male instructors. So, we would expect a downward bias from race and maybe an upward bias from gender, or getting those two, at least watching one another out in the paper. And when we asked these students about how they felt after their grades were returned. This was about four weeks into the semester, so still pretty early in the semester. What we did was we really wanted to ask about the specific qualities that had been hypothesized in the literature as drivers of bias or drivers of differences. So we just asked students to rate their instructor on a bunch of different qualities. Cassie really helped us out here because she came in and she says, “Well, you know, we can categorize these qualities into communal qualities and agentic qualities and neutral qualities…” which was really the way to approach it because of course, we get different things in communal versus just qualities. So we asked our students things like: “How knowledgeable do you find your professor? How challenging? Do you find them to be approachable? Do you find them to be caring? Are they interesting?” And then we asked a couple of very general questions: “Would you recommend the course?” All of this set us up to have a really nice dataset where we could look between genders and across time as well.

Rebecca: So I think everyone’s probably dying to know exactly what you found. [LAUGHTER]

Jill: I’m just going to provide an overview of the results because we do a number of different specifications and use different econometric methods in the findings. And so you can get all of those results there in detail. But in general, on the second day of class, we find that women are receiving lower ratings across the five agentic and gender-neutral instructor characteristics that we measured. They were rated higher on that second day of class on those more communal characteristics. And not all of those differences were statistically significant. Immediately after the first exam grade was returned to students, women were receiving lower ratings for all seven measured characteristics. Each difference was significant except for those caring and approachable, more communal characteristics. And then men were now having higher ratings in all the different aspects relative to time, or the second day of class. Over time, what we see was that men’s evaluations were getting higher on all characteristics from the second day of class to the period after the first exam was returned. And then in contrast, women’s evaluations were not trending upward. So we had a couple that were staying the same, but overall, they were going down. So those are just some overview findings. Again, those more specific results, by specification, can be found in the paper.

John: We will include a link to both papers in the show notes too, so people can go back and review them. To summarize, what you found is there was relatively weak evidence of significant gender bias on the second day of class, but that gap increased fairly dramatically after the first graded exam. So what do you attribute that change to, was it because of the feedback students were getting from grades as Whitney had mentioned before?

Whitney: We were attributing, and Cassie can talk about this with more authority on the theoretical point, but we’re attributing that to backlash theory, this idea that if I expect one thing, and I don’t get it, there’s this need to back off so that things go in congruence.

Cassandra: Exactly, Whitney is spot on there. What we thought this was evidence of was women behaving in gender incongruent ways, women are supposed to be warm and caring and friendly. And when you get a perhaps grade that maybe wasn’t an “A,” that feels harsh and critical, and a woman is asserting their power and dominance in the classroom, which again, they already are in a male dominated field profession. And those two things together combined can result in this backlash.

Rebecca: So if we take these findings, and think institutionally, what are some things that institutions might want to think about moving forward?

Whitney: That’s a good question. If you remember, from the very beginning, we were saying, we’re really hoping to find this nice objective concrete solution, we anticipated finding it through timing. And that’s what I would really like to do with future research is to be able to find something concrete and objective to treat this with. We weren’t able to do that because we found bias from the beginning. And we found that it came so quickly in the semester that it’s not something that we can just move back evaluations to midterm or something like that. Since we can’t do that, we’ve talked about other ways for institutions to take this. And one takeaway really is just an awareness that these gender biases exist and that these evaluations are flawed. This is really well established in the literature, but not necessarily in the general sphere of knowledge. When we published this paper, Georgia Tech did a little feature in their daily digest, and I had two female engineering faculty email me and say, “I knew this in my gut for years, but nobody’s ever quantified it.” That to me, is just evidence that it’s not in the general sphere of knowledge, even though the literature defines it well. Some of the impact of the concrete solutions that we have seen is we’re seeing a lot of schools and accreditors, like AACSB, they’re starting to require multiple indicators of teaching effectiveness and evaluation. So evaluations and peer reviews, or maybe something else to see the observation, something to that effect to where we have more of a global and inclusive way to look at someone’s teaching effectiveness. So this is a great takeaway, hopefully that will reduce the weight of the impact of evaluation just by having other factors in there. And just one final point that I want to make. And this is just a really big sticking point to me for the paper is that all of us are researchers, we all deal with statistics and statistical significance, and robust research methods. And then when those of us in Chair and Dean roles go to look at evaluations, all the sudden, all that training completely goes out the window, and we look at the difference between a 4.2 and a 4.4. And I know those differences sound really small, they are that small. And we say, “Oh, well, this person does better than this person, this person deserves to be hired over this person.” Never in our research, or in a formal presentation, would we ever compare two means that small without significance testing, number one, and without making sure they’re actually comparable, and say, “Oh, there’s a difference.” It’s just something that I think we need to recognize, we would not recognize this as good research or good methodology in any other area of our work. It’s just something that we should keep in mind as we move forward with this.

John: Now, you mentioned the use of peer evaluations as another way of providing, perhaps, more balance, but might they be subject to the same type of bias?

Whitney: Yeah, all the things that we would see for student evaluations, I can imagine how you would see with peer evaluations as well.

Jill: But there are creative ways to do peer evaluations that I think here at ETSU, we have a Center for Teaching Excellence. And I’m confident Georgia Tech, and Lake Forest has their own version of that. And so there are creative ways. And again, not that SETs are necessarily bad, but knowing what we know about the flaws in them, that, coupled with an additional measure or two, can be a lot more insightful, I think, to the teaching effectiveness, like true teaching effectiveness of instructors.

John: And one thing I’m wondering is if the measured effect might be larger in economics, because at least at many institutions, grades and economics and STEM classes are often lower, which might magnify the effect of this difference. It would be interesting if there was to be a study that also included some classes, maybe in humanities, to see if perhaps there’s less of an effect because of that role-incongruity issue there. It may not appear to be as severe in disciplines where grades across the board tend to be higher.

Whitney: I think you’re right about that, most people when they take economics, it’s a required class and certainly the grades are a big factor, then the two things that showed the most significance outside of our key variable of interest was interest in economics, and expected grade. Those were the things that across the board… now we still found gender bias controlling for those things, but it mattered.

Rebecca: So we talked a little bit about things that institutions might want to start thinking about: institutional policy and things that might shift how we use teaching evaluations. Are there any other strategies that institutions or instructors can use, or adopt, to try to reduce this bias in the short term?

Cassandra: That’s really the million dollar question. Because this type of bias exists in a lot of different domains, whether we’re talking managers and their subordinates, teachers and their students. One thing that’s often suggested or recommended is simply making people aware that this bias exists, and providing training on how to better approach evaluations, whether that’s how to use a rating scale and ensuring that you aren’t engaging in a halo effect, for example. Another strategy is requiring that people justify their ratings that are provided with qualitative comments… that if you’re just asked to fill out on a scale, on how competent is this person? Well, bias may creep in more if you aren’t asking for a justification of why that particular rating was given for competence. A last recommendation that I’ll share here is making these evaluations more public. So if there are a couple of people, say peers, that are evaluating myself or Whitney or Jill in the classroom, well, they need to come together, share and publicly disseminate their evaluations that they had given to us. This social accountability can help to mitigate bias and for people to ensure that the ratings that you’re giving are, in fact justified.

John: So we’ve got a long ways to go with this. It’s a problem that’s been recognized for quite a while with a lot of studies. But there hasn’t been that much done to address that. And those are some good suggestions that institutions may want to try. We always end with the question: “What’s next?”

Cassandra: [LAUGHTER] That’s a good question. Of course, I think that the three of us collectively would say we do hope that administration and decision makers start asking questions about their use of student evaluations of teaching and how they might seek to mitigate this bias, based on the recommendations Whitney had already shared. But we also hope that women faculty perhaps feel more empowered to advocate for themselves when it comes time for promotion and tenure decisions to be made. My Institution, a part of the promotion process, is writing letters, and going through interviews. So speaking to this, bringing an awareness to the people who are making the decisions that this exists, and that it is not just an opinion, that there is empirical evidence of its existence. But we are really interested in exploring more fully how providing feedback, particularly critical feedback, like in our study, where the professors are giving back grades might impact the perceptions of men and women in other contexts as well. So is this a phenomenon we would see, for example, between a manager and their team? Do people respond differently to critical feedback from a manager because of their gender? And how much are these differences, perhaps, driven by perceptions of how communal or agentic they are in their delivery of that feedback? So in other words, are we seeing the same pattern in other contexts? Ultimately, we hope that by better understanding how perceptions of communion and agency impact interactions that women have at work, particularly women in male-dominated or gender-atypical roles, this greater understanding will allow us to also discover ways to alleviate some of that backlash through more targeted interventions and training and perhaps better timing. Because at a minimum, it’s important to highlight the various ways gender bias continues to persist in our society. Because without that awareness, nothing can be changed.

John: Whitney, Jill?

Jill: I think that was great. [LAUGHTER]

Whitney: Yeah, I think, Cassie, you did a great job. And Cassie certainly helped us out with bringing formal language and theory to things that we felt as intuitive and we felt in our gut as important. We don’t have a lot of language for that in the economic space. And so blending these two disciplines together has been very helpful for looking at the situation.

Rebecca: Well, thank you all for joining us. And the research that you’re doing is really important and impactful. So we hope our listeners will use it.

Whitney: Thank you so much.

Cassandra: Thank you.

Jill: Thank you so much.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

303. Higher Ed Then and Now

Teaching practices have gradually evolved as we’ve learned more about how humans learn. From one year to the next, these changes may appear small, but the cumulative effect is profound. In this episode, Todd Zakrajsek joins us to reflect back on the changes that have occurred in higher ed during our careers.

Todd is an Associate Research Professor and Associate Director of a Faculty Development Fellowship at the University of North Carolina at Chapel Hill. He is also the director of four Lilly conferences on evidence-based teaching and learning. Todd is the author of many superb books, and has published four books in the past four years. His most recent book is a fifth edition of Teaching at it’s Best, a book he co-authored with Linda Nilson.

Show Notes

  • Zakrajsek, T. and Nilson, L. B. (2023). Teaching at its best: A research-based resource for college instructors. 5th edition. Jossey-Bass.
  • Zakrajsek, T. D. (2022). The new science of learning: how to learn in harmony with your brain. Routledge.
  • Harrington, C., Bowen, J. A., & Zakrajsek, T. D. (2017). Dynamic lecturing: Research-based strategies to enhance lecture effectiveness. Routledge.
  • EdPuzzle
  • PlayPosit
  • ChatGPT
  • Wayback Machine

Transcript

John: Teaching practices have gradually evolved as we’ve learned more about how humans learn. From one year to the next, these changes may appear small, but the cumulative effect is profound. In this episode, we reflect back on the changes that have occurred in higher ed during our careers.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Todd Zakrajsek, and I am with Todd here in Durham, North Carolina. Todd is an Associate Research Professor and Associate Director of a Faculty Development Fellowship at the University of North Carolina at Chapel Hill. He is also the director of four Lilly conferences on evidence-based teaching and learning. Todd is the author of many superb books, and has published four books in the past four years. His most recent book is a fifth edition of Teaching at it’s Best, a book he co-authored with Linda Nilson. Welcome back, Todd.

Todd: Well, thank you, John. Well, this is exciting. And Rebecca may be a long ways away, but I have never been arm’s length from a person who interviewed me for a podcast before.

Rebecca: Isn’t that cool?

John: And we’ve really done that before either at a conference or at Oswego,

Todd: I feel very special.

Rebecca: Well, we can celebrate with our teas. So, today’s teas are:… [LAUGHTER]

Todd: I’m drinking a peach mango that I got from some teas that John brought, which are fantastic.

Rebecca: John, how about you?

John: I am drinking a Tea Forte black currant tea, which I brought from Oswego, in a new mug that was given to me by Claire McNally, when she visited this area last week.

Todd: Love Claire, she’s fantastic.

John: And it has kangaroos on it.

Todd: Yeah.

Rebecca: And I can’t see it. Let me see it, John. Oh, that’s a cool mug.

Todd: It’s a good mug. I got a mug from her university. But I didn’t realize I should have brought it. So I feel bad about that. But it is a podcast. So I didn’t think about what it would look like.

John: That’s true, we generally don’t do a lot of visuals on here.

Rebecca: And I have a blue sapphire tea in my Tea Rex mug.

Todd: Well, that’s a nice mug,

John: We’ve invited you back to talk a little bit about how some of the changes you’ve observed in college teaching across your career have impacted how you teach today. When did your work in higher ed begin?

Todd: Actually, it started when I was a graduate student. So back in 1987. So there’s no reason to try to figure out how old I am. Now I’ve basically specifically dated myself here. I started teaching, I got to teach an introduction to statistics course. And I had so much fun that I taught again the following year. And by the time I left my graduate program, I had taught more courses in that program than any other graduate student had ever taught in the psychology department there. I really loved teaching right from the beginning, when from the beginning, very concerned about student learning, and just getting rolling.

Rebecca: What was it about the teaching, Todd, that really got you hooked?

Todd: Just watching the studentsis. it’s the same thing as it is today, when you have an individual who’s struggling with something, and suddenly they get it and you realize that they may eventually get it on their own, but you realize how much you’ve helped them to move that along very quickly. And facilitating the learning process, I just really love that. That doesn’t mean I was fantastic at it. But I really did love it.

Rebecca: Sometimes the things we love the most are things that we’re not great at to start with.

Todd: That’s true.

John: My experience was similar, actually, I started in 1980, with a course where I had a fellowship, so I didn’t have to teach. But there was a sudden shortage in the department. And they asked me to fill in. And I was planning to go on into research. But it was just so much fun teaching that I’ve never stopped.

Rebecca: I taught as a graduate student too, and taught the whole time I was there. But I started a little bit later in 2003.

Todd: Alright, so that was a couple of years later.

Rebecca: Just a couple.

Todd: Yeah, I had kind of a funny start, I will mention that when I first started that after the first semester of teaching, my students got almost all As and Bs. And the department chair called me in and he said, “I’m not going to have you teach any more courses.” And I said, “why not?” And he says, “Well, you give grades away like candy, we have to have better standards than that.” And I said, “Well, how are you basing that?” And he says, “Well, you know, we looked at the grade point averages.” And I said, “Well, how about if I bring in my final exam, and just walk through it, and then you can tell me how it could change to be more rigorous.” And so it was great. I showed it to him at the beginning. And like the bottom of the first page, the students had to calculate a statistical value, then I had them explain how they came about that number. But if they had used a different test how might it been inappropriately found and what the interpretation might have been, based on the fact that they had done it wrong with a different test. I thought it was important for them to understand how these things can change. The Chair said, “I can’t believe you have your students in the first class actually talk about various tests like that.” And I said, “Yeah, I did. Then we turned the page he says “You did nonparametric tests?” I said, “Well, yeah, we did parametric tests, but then I thought they should know the equivalent.” And he said, “We never do that.” And then he turned the last page and he said “You had them do a two-way ANOVA? You’re only supposed to go through one-way ANOVA.” I said, “Yeah, but we’d finished everything and we still had a week left. And I figured I might as well introduce the next concept to them. And so I showed them how to do a two-way ANOVA and they ended up with all As and Bs. So if you could help me in how to push their grades down and give them lower grades, I’m perfectly happy to do that.” And he then set me up with two courses the next semester, but it’s that reliance on the teaching evaluations is always funny.

Rebecca: Todd, it’s just funny, as we’ve gotten to know you through the podcast [LAUGHTER] it sounds so perfect that that was your first experience. [LAUGHTER]

Todd: Yeah, I’ve lived my entire career on the edge. [LAUGHTER]

John: And those sorts of arguments are still occurring in a lot of classes today about rigor and the need to keep grades lower.

Todd: Yeah.

John: They’re less severe than they were a few years ago.

Todd: Yes, but also looking at how well a person’s teaching based on student evaluations. I mean, we should be looking at authentic assessment. Some things have changed through the years, some things have not changed through the years.

Rebecca: Well, technology is one of those things that has changed.

Todd: Woosh, yeah.

Rebecca: Can you talk a little bit about what tech was like in the classroom when you first started and how it’s evolved a bit?

Todd: Yeah, I know you have some listeners who have been teaching for a very long time. So those of you have been teaching for like 30 to 40 years, just stop and think back about what it was like when we first started. For those of you who have been teaching like Rebecca since 2003, let’s just mention that technology back then was mostly pens and chalk and chalkboards. So back then, of course, there’s technology, there’s always technology, but we were using overhead projectors. This was long before the internet came along to really be used in the classes. LCD projectors were not out yet. Canvas, Blackboard, Sakai, all those learning management systems were not around. We didn’t have any of the ways to email individuals, you couldn’t email your students back then. And there was no ChatGPT to write your papers for you.

Rebecca: But there were calculators that could do all the work for you.

Todd: Yes, but this is the cool part. Back when I started teaching statistics, I’m glad you mentioned the calculators, huge debate back then was whether or not the students should calculate the statistical values by hand using the calculator, because computers had just come onto the scene and we could punch the data into a computer and have a computer run an ANOVA for you. Should you calculate it by hand? Should you run it to the computer? And there was a huge camp that said you should do it by hand or you will never understand a statistical value. And I said, “You know, we’ve got the technology there. Why don’t we have the students use the computer to do the mundane stuff, and we’ll have more time to talk about the theoretical and the important implications.” But even back then we were having the discussions about whether to use the technology at hand or not. Oh, and by the way, we are also hanging grades on doors. So we would figure out the grades, we’d tack it to the door, and then the students who want to know what their grades were for the class would swing by and look at the door.

John: And they were sorted alphabetically, to make it easier for people to find where they were in the grade list.

Todd: Yeah, it was great. We listed them according to their social security number, [LAUGHTER] which was a little different back then. And yeah, we actually did that back then. But as John pointed out, they were listed by number so nobody knew whose number went with whom, except, surprisingly, they were alphabetical on the door. So not only could you figure out Armstrong’s exam score, you’d get Armstrong’s social security number as well. Yeah, times have changed.

John: And it was also back in the day of dittos and mineos as well, which was the only way of disseminating information on paper.

Todd: This is so much fun. We’ll get to some real meat of this thing. But that walk down memory lane has some fun stuff too. The dittos…

Rebecca: I remember dittos, just for the record, okay.

Todd: Yes. So you probably remember, if you dittoed just before class, and you handed it out in class, the students would all pull the ditto up to their face, so they could smell the ditto fluid. And they got that smell. I was running dittos one time in the graduate student office, and I noticed when I looked down because it ran out of fluid, and I had to put some more fluid in, and I looked down and I noticed that the floor was kind of eaten away by this ditto fluid. And then… this is the best part… About a month later, I was digging for something in the closet and I found extra tiles and I thought they should put these tiles down to replace the ones that are all eaten and on the side of the box it said these tiles were long lasting and durable, reinforced with asbestos. So that ditto fluid was eating through asbestos tiles. That’s some strong stuff.

John: …to make it a little bit more friable so that it would disseminate in the air nicely.

Todd: Well, there had to be something to help the faculty members who were running all their own dittos to not mind doing it, and one way of doing this is to have them use ditto fluid, because I’ll tell you, you may not have liked it when you started, but by the end, it was all right. [LAUGHTER]

Rebecca: It’s funny that we’re taking this walk down memory lane, because on our campus, I was in our historic lecture classroom today in Sheldon Hall.

John: What are some of the other changes that have occurred and how have they influenced how we teach?

Todd: Yeah, so it’s interesting, I did the walk down memory lane and we were chatting about this stuff. It’s all fun, but thinking about how the changes have taken place. I think that’s really important. So there have been massive changes. I think that we tend to forget, it’s so easy to communicate with students now. Heck, people are texting now so that you can text back and forth with students. But think about how that has transcended or gone through time. There was a time when I would have to call and leave a message for a student on an answering machine, and then they would call back and we would try to find a time that we could talk on the phone. If we wanted to have a conversation. I could either leave a note for the student or I could call and leave a message that says least come see me after class. So even having a conversation with a student was difficult, then it became easier with email because you could start emailing back and forth. And now we have Zoom. And the equity in the way that this has changed, just think about the difference of this, if I’m leaving a message for a student, they may not even have an answering machine, if they’re living off campus with limited means back then. So even getting in touch with a student would be challenging. Now I can have a Zoom conversation with a student who doesn’t have to hire a babysitter, who doesn’t have to find reliable transportation, who doesn’t have to drive across town and burn gas, and to do all of those things that it would take to have a 15-minute conversation that in the past would have been really hard, and even four or five years ago would have been challenging. The grades, why in the world would a person have to leave… and I was teaching in very northern Michigan, there were days that the wind chill was 75 degrees below zero… and students would leave their dorm rooms and walk across campus to see a grade on the door. It’s actually physically dangerous. And now we have learning management systems, we could post things for students. Interlibrary loan used to take weeks to get a document that you can now go on and get. People can lament all of these technological changes at times, but we’re actually creating more and more equity within the higher education system as we make certain things easier. Not saying that we’re anywhere near an equitable system yet, but we’re moving in a really good direction. And a lot of those changes are helping us to get there.

Rebecca: I’m thinking about all the times when I get to go to the door or meet after class, it really assumes that students are a certain kind of student, they’re full time, they have time. And our students now are working [LAUGHTER], and where they’re juggling a lot of different schedules and things.

Todd: Yeah, and I mean, we want to be careful too. And I agree with you 100%. But they were juggling back then too. But some of the things we were doing, for instance, I taught a night class. Now I would probably suggest if I was going to teach a class from 7 to 10pm that I would teach it through zoom, because there’s a lot of reasons that it’s good to do. But I had students that I noticed in class, would very quickly at the end of class would start talking to other students and I couldn’t figure out what it was doing because a lot of buzzing and stuff. And what I found was that there were certain students who were uncomfortable, and we were in a very safe campus, but they were uncomfortable walking to their car at 10 o’clock at night. So I started saying to the students, “Hey, I’m gonna park a car… and when we showed up, there were quite a few cars there… but I’ll be under the second light, I drive a little red Chevette, not a Corvette, a Chevette, but I’ll have my car there. If you want to park near me, we can walk out together.” And there were students that were not paying attention to almost any of the class because they were fearful of how they were going to get to their car safely. When you think about Zoom and stuff, it’s even safety factors, I would never have a review session now like I used to at 8 to 9 pm the night before the exam because I’m exposing people to potentially dangerous situations. Now we’d have zoom sessions. But I could tell you 40 years ago, there was no even concept of what zoom would be and how it would work. Even Star Trek didn’t have stuff like that.

John: And there was also, besides the inequity associated with people who were working, many campuses had a lot of commuting students who could not easily get back to campus for office hours. Or if they were just taking classes on Monday, Wednesday, Friday and your office hours was on a Tuesday, they’d have to come in that extra day, arranging childcare, or their work to be able to fit that into the schedule.

Todd: Yeah, it really did start to change that system. So we got a little bit more equity, and like you were saying too, the commuting students, the part-time students, the students taking distance courses. When I first started teaching, I was writing… oh my word, remember the correspondence courses? …and you mail away and get a packet of material, you take a test at a local library and, and they talk about distance education being not as good as on campus, but at least better than nothing. And now we’re finally getting to a system where we can stop assuming that those folks who are coming in for part-time courses and stuff are just getting something better than nothing. They’re actually getting something similar to full college courses, which some of those online courses are actually as good or better than college courses that are on campus. But all that’s changing with the technology. It’s crazy.

John: And there’s a lot of research that supports that in terms of the relative learning gains with online and face-to-face, as well as hybrid courses, which seemed to outperform others in a few meta studies that have been done. But those were options that just weren’t available back then. And the early online courses were often designed to be replicas of face-to-face classes, and they probably didn’t work quite as well. But we’ve learned since that, which brings us to the issue of research. During the time that you’ve been teaching, there’s been a lot of research on teaching and learning. While some of it was taking place, it wasn’t very widely disseminated to faculty.

Todd: Yeah, that is true, too. It’s so much easier to get technology out. It’s easier to gather data, it’s easier to write it up. It’s easier to edit it so all of those types of things that are happening now that couldn’t happen before. And as a result, we’re learning a lot more about how people learn, you know, the book I did on the New Science of Learning, looking at a lot of the ways that students learn. And part of it’s just the ease of getting to information. But also part of it’s just being able to investigate how people process information. I used to teach Introductory Psychology back then, we would talk about the stages of sleep. And nobody really knew, for instance, what REM sleep was about, we knew that you had to have it or else it caused some problems. Deep sleep we knew was important, we now have indications that deep sleep for consolidation is necessary for semantic memory. If your sleep is interrupted, you can get eight hours of sleep. But if you don’t get deep sleep, the information doesn’t get consolidated. Procedural memory, how to give shots and kick balls and do anything procedurally looks like it’s more solidified during REM sleep. So again, the different types of sleep are associated with us learning long term, different types of information. We never knew that before all this technology was running around. In fact, back then I gotta say, I remember from my intro psych class being told that you were born with a certain number of neurons, and as you live through life, neurons would die. And if you killed them by drinking or doing something like drugs or something, they were gone forever, and you would never get more. And if you broke a connection, it was broken forever. That’s just simply not true. But it’s what we thought back then. So technology has really allowed us to look better at how people learn, different ways of helping them to learn and different ways they can even study. By the way, before we move on, we now have this physiological demonstration that staying up all night and cramming the night before the test. Even though it gets you slightly higher grades on the test, we now know that because the information is not consolidated that it won’t be there a week later or two weeks later. So we’ve always told students, you shouldn’t do it, but now we can actually show them why it doesn’t work.

John: And the LMS itself has offered a lot of ways of giving more rapid feedback to students with some automated grading with some things to give them more low-stakes testing opportunities. And those were things that we just couldn’t easily do back when you started teaching.

Todd: No, John, that’s a really good one. And we know that one of the most consistent findings right now in all of learning and memory stuff is that the more often you do something, the easier it becomes, long-term potentiation. Which means the more frequently you retrieve information from your long-term memory, the easier it is to retrieve. And just like you’d mentioned, we can now do LMS systems that are set up so that you could do practice quizzes, you could do dozens or hundreds of practice quizzes and keep pulling that information out over and over and over again. That was just not possible before this. And so the LMS helps with that, it helps by giving feedback, really good feedback so that students know what they’re doing well, and what they’re not doing well. And it helps faculty members to design feedback specifically for certain types of projects, and so that I can more easily give more feedback without spending a lot more time on it. So LMSs have done a tremendous amount of work. And that’s not even mentioning the fact that you can have all of the LMS systems loaded with the content. So students can log in and get their information without leaving their house. If there’s fiscal challenges with your class, you can put in articles, the students may not have to buy a book, they could read the articles. And so we’ve got students who were able to come to classes because they can afford to be there. By the way, I remember being on a committee when I was a graduate student, and we were looking at financial aid and different financial systems. And I remembered asking the Chief Financial Officer, I said, “What increase in tuition does there need to be before you start to see students drop off because they can’t afford to be here?” And this was about 40 years ago, but he said $100 for a year, if they have to pay $100 this year more than last year, some students won’t come back. If we look at the price of textbooks now, textbooks can cost $400. So, a book like that is definitely going to make a difference between some students being able to take the class or not. So LMS systems make this possible.

John: And they also make it easier to share OER resources that don’t have any cost for students, or some less expensive adaptive learning platforms, giving all students that first-day access. I remember, not so long ago, when I was still using textbooks in some classes, students would wait several weeks before they got that book. And that put them at a severe disadvantage. And the people who were being put at a disadvantage. were generally the students who came in with the weakest backgrounds because they came from lower resourced school districts.

Todd: Yeah, if they had the resources, they would have the better background foundational material, but they’d be able to buy the books. And you mentioned OERs. So open educational resources are really another thing that are really valuable because back then, before the technology, you couldn’t produce something that would be readily available like throughout the world. And so this project that’s going on now where they’re doing introductory level books in all the different disciplines, you can get an OER introductory psychology textbook that students can log in and read. None of that was possible before the technology. So even the creation of OERs has changed so much.

Rebecca: Well, speaking of digital materials, libraries have changed significantly too over time from having completely physical collections and interlibrary loans and things that take a lot of time to having a lot of digital resources, which changes access to research and materials that you can populate into your classes, but also can aid students in the work that they’re doing. Can you talk a little bit about the change in libraries and how that’s impacted how you’ve taught?

Todd: Yeah, you know, libraries have been fascinating to watch over the last 40 years, because it used to be the biggest challenge librarians had before them was which books to put on the shelves because there was a finite amount of shelf space. And there were lots and lots of books. And so that was the big thing. We used to take out journals that weren’t used very much to make room for other journals. Through time, little by little, they started digitizing all that stuff. And I can remember chatting with librarians, one conversation I had was back around 2001. I said, gonna be interesting, because there’s gonna come a day where there’ll be no books in the library, and the Dean of Libraries said “Well, there’s always going to be books.” I said, “Not always, potentially.” But even if we reduce them, I said, “What is your foresight? How is the library going to change?” And so he had a couple of ideas. But what it basically boiled down to our conversation is, I always felt like a library was like the brain of the campus, it had the books, and it had all of the information that you could go and get. As the books left, and things were diversified in a way that you could find this stuff, you could get all the information right from your dorm room, or from your apartment, when the internet came along, you could get anything you needed, then the library was still a physical space that was in the middle of campus. And what it should become is a learning commons, a place where people go to share and to learn from one another. And I think that’s what’s really changed is individuals still just pile into libraries and use the space, but they use it in different ways. They go there to meet other individuals to work, which they did before. But they took away that aspect of going there for the book part. And it meant all of those shelves got emptied, and they started pushing them out. And you can go into libraries right now that have very few shelves. But they have webcams, they have smartboards, they have spaces where folks can plug in their computers and share with one another. They’ve got screens set up so that you can project and have students sitting around a table, they’ve got Google Glass set up, all of these types of things that bring students together to use technology to learn from one another.

John: And they have cafes to help support that to make it easier for people to gather.

Todd: Yeah, you could swing by and get a cup of tea.

Rebecca: It’s funny, even when I was in high school, my sister and I would rely on going to the library to have access to a computer so that we could even type of paper, because we didn’t have one at home. And that kind of place of having the technology started a long time ago, but it’s amped up quite a bit over the last 20 years.

Todd: Yeah, and I agree completely. And the computers that are there. I mean, even right now, with the books dissipating, there a’re still large numbers of computers. And oftentimes, they’ll even be an area in a library that’s carved out with really high-end computers. But it gives students an opportunity to go. We make this assumption that everybody has a computer and they don’t. But libraries give them that opportunity.

John: Yeah, for those students working on smartphones or Chromebooks, that gives them access to all the tools that students with $2000 or $3000 or $4,000 computers.

Todd: Yes, because smartphones can work for lots of things. But they’re a little tough to write a paper on

John: When I started teaching, and probably when you did too, the predominant mode of instruction, which actually still is often the predominant mode of instruction in many departments, was lecture. That’s changed quite a bit since then. Could you talk a little bit about the shift from lecture-based courses to courses that involve much more active learning activity?

Todd: Yeah, or they just involve a lot more of everything. The concept of flipped classrooms, which was almost impossible 30, 40 years ago, because you really couldn’t get the information to the students. Yes, it was kind of possible, but whoo, if it was hard now, it was really hard back then. But the ability to get information out to students that they can read it before they come to class. But coming back to the lectures… So I’m going to take this moment and those of you who know me know that I’m going to do this, is that we still have no evidence that lectures are bad, but there’s something that we need to really keep in mind. I think this is vital. I do think it’s important for us to be able to talk about buzz groups and jigsaws and fish bowls and lectures and Socratic lectures, discussion lectures, all those different methodologies out there so that we know what we’re talking about when we chat with one another. But I do think it’s time that we stop talking about lectures being more effective than one thing or fishbowls being more effective than something else and look at the components of what is valuable in a learning experience.

John: And a good reference for that is a book on Dynamic Lecturing, which you happen to be a co-author of.

Todd: That is true and in fact that there’s the Dynamic Lecturing. And then there’s a chunk in that about The New Science of Learning. And then there’s a whole chapter in that about Teaching at its Best, because that’s a good point, John, thank you.

Rebecca: It’s almost like you’re trying to slip it in everywhere you are.

Todd: Because the research… people keep talking about one methodology being better than another. Here it is, folks, you can be a hideous lecturer, you can be a phenomenal lecturer. And if you’re a hideous lecturer, you’re not going to learn anything. If you’re a phenomenal lecturer, students will learn from you but they won’t learn all the time, it depends on some student factors. I’ve actually been exposed to group work in flipped classrooms that were awful. And so that concept is we start thinking about and this is why it’s going to come back to the technology, we think about the elements that need to be there, that are necessary for learning to take place. I’m just going to do this, because it’s not the topic I’ll make it very brief, is let’s just go with three things. If you don’t have your attention, as a teacher, if my learners aren’t attending to what I’m saying, if they’re on their phone or thinking about bacon, then they can’t process what I’m presenting. And if you’re having a think-pair-share, if they’re not attending to the person they’re sitting next to, you have to have attention. Number two, they have to have some value. If I’m hearing somebody or I’m reading something, and this has no value to me, it’s really hard to get it into your long-term memory and to learn it. And number three, I have to have a clue of what’s happening, I got to understand some aspects. Now if we think about attention, value, and understanding, now we can flip back to the technology. This is why gaming works. Gaming draws the attention, it increases the value, because you want to win the game, and it has understanding. We have all played games. You open up the old board games, and now it’s digital, where you don’t have a clue what the game is. It’s like, if you advance a player four pieces and the opponent advances five pieces, you have to go back three spaces, unless it’s a Tuesday. When those instructions are that complicated, you don’t understand. So we can use technology to help with attention, we can use technology to help with the value of what’s going on. And we can use that technology to help with understanding. Those are things that were very difficult before. And they allow us to do things like a mini lecture and then shift over to an active learning exercise, and then say, take all this information and create a Zoom session tomorrow that will go over it again. So the technology has really helped us to be able to do all of these things to get at the core of learning, a topic I barely care about. [LAUGHTER]

John: That’s an important one, because people often see this as this binary issue where you lecture or you use active learning. And there are some really effective ways to combine them. And in fact, in that book on dynamic lecturing, it was suggested that lecture can be more important in introductory courses, when students don’t have as much of a knowledge base.

Todd: You’re absolutely right. Discovery learning is a really great way to learn if you’ve got a lot of time. I can just put you into a room with some other people and say, “Here’s some data, and here’s some things we need to know. Go.” And if you don’t have any foundational knowledge at all, it takes forever to figure it out, you go online, you know what to look for, I could do a five-minute lecture, and at the end of five minutes, set it up and say, “Now go and work with your neighbors. In fact, here’s what we’re going to do, we’re going to have you each work in small groups in class, I’m going to open up a Padlet. At each table, I want you to go in and add your information or put it into the column that corresponds with your group number.” As an instructor, I can watch everything develop in front of me. While I’m in the room, I can look at my laptop and see it and walk over to a table and say, “looks like you’re struggling a little bit.” I’ve lectured, I put them into small groups, I’ve had them use technology, I’ve created a little bit of competition on who can come up with what and I’ve had a way for me to monitor it and give them feedback. That is so different than what teaching used to look like. So pulling it all together, that’s what we do.

Rebecca: The tools to be able to monitor have been really helpful in my own teaching and being able to get a better pulse on what’s going on and get a nice overview and then be more targeted in how to interact with small groups rather than just kind of wandering around more aimlessly like I think I did initially. [LAUGHTER]

Todd: Yeah, and this is all going to be great until we get our cognitive load headbands that I’m waiting to be developed. So anybody who’s listening, take this idea, run with it, you can make a bazillion dollars and then take me out to dinner or something. I want a headband and the headband has a light and it measures brainwave activity. And then as I’m teaching, if you start to be a little bit like it’s a little bit too much, you’re moving out of that zone of proximal development, the light turns from green to a yellow. And then when it hits red is like when you’re trying to put together an Ikea bookcase and someone comes by and says “What do you think of this?” and you say, “Errr, I’m working on an Ikea bookcase right now.” …that shutting down with that red light. I’m telling ya, that’s going to be the technology we’ll want next.

Rebecca: It would be so helpful. [LAUGHTER]

Todd: You can actually look and see somebody else’s zones of proximal development and their cognitive load. Whoof. Which by the way, there’s a little party game that they’ll do periodically at parties. It’s like if you’re a superhero, what would you want your superpower to be? And I was in a room one time and one person said they wanted to fly and somebody else said that they wanted to be invisible, which real quickly in my head, I’m thinking, what could you possibly gain that wasn’t illegal or creepy if you’re invisible. So aside from that, transporting and everything else, and they got to me, and I said, “I want to be able to see people’s zones of proximal development. If that were my superpower, I’d be the best teacher.”

John: I bet that went over really well at those parties. [LAUGHTER]

Todd: Yeah, my friends all said “You are amazingly smart and quite insightful.” They used different words, but that’s what I heard. [LAUGHTER]

Rebecca: They didn’t start with what is that? [LAUGHTER]

Todd: As soon as I start talking, most of my friends just shake their head and drink whatever beverage they have near them. [LAUGHTER] So yeah, it’s good times, good times. They’re all impressed. They don’t say it all the time, but I know they are.

Rebecca: I think one of the things that often happens with technology is that it allows us to get things quickly and move through things quickly. But sometimes, as you just noted, learning doesn’t happen quickly.

Todd: Yeah.

Rebecca: Can you talk a little bit about speed and the difference between maybe not having all the technology and all the things really quick versus maybe now where we have it at our fingertips, but do we always want it at that speed?

Todd: So there’s another study that I’m waiting to see. This is an easy study, folks, somebody can run this one quickly. We all know that students are listening to any recorded lectures or recorded material that they have to watch, 1.7 is about the best speed that we tend to see people listening. 2.0 is a little bit fast for some folks. 1.0 is like normal speed, that’s no good, too slow. So what I’m curious about is the space between words and between sentences that our brains, because they move so fast, we can listen faster than somebody can talk. And we have all this other stuff going on is I can be thinking and processing while you’re talking to me. But if I bumped that up to one seven, I think we close the gaps. And I hear it a lot faster. But what I don’t think is happening is the cognitive processing while I’m listening. The active listening component to it. So I think technology can create concerns in those directions. And students who do try to process material too fast… we’ll wait and see.

John: And that’s especially important in flipped classrooms where students do watch these videos outside. One of the things I’ve been doing with those, though, is embedding questions in the video so they can watch them as quickly as they want. But then they get these knowledge checks every few minutes. And then if they find they’re not able to answer it, they may go back and get their attention back and watch that portion again.

Todd: Yeah, I think that’s a really good way to go. EdPuzzle’s kind of a fun technology to use. I don’t know if that’s the one you used.

John: I’m using Playposit, which is a bit more expensive, it works beautifully. I love it, they did just double the price this year, though, it was bought by a new company.

Todd: This is the tricky spot now as the prices are going up. You know, inflation is a terrible thing to waste. Anytime somebody can raise prices now it’s like, “ooh, inflation”. So you know, prices double, inflation is 8% with runaway, now it’s back down around three. But when inflation was 8%, they doubled the price and say, “Hey, we’ve got to,” but yes, it’s some of them are expensive. There’s lots of things that are less expensive. Oftentimes we pay for functionality that help us but the freemiums kind of thing. So stuff that’s inexpensive. I just wanna let everybody out there know just about anything you want to do in class or can think about doing it, there’s a way to do it for either free, or probably under $100 a year, which I know $100 can be expensive for some people, it’s about eight bucks a month. And so things like Padlet that I think might be up around 140 now, so maybe $12 a month, can change how much time you spend doing things, and how much time for students. But yeah, I love the embedded questions to help slow things down.

Rebecca: I think that the cognitive load can happen really quickly if we’re piling lots of information in but not always providing the time to process and use that information in some way in the kind of activities that you were talking about. Or knowing when everybody’s red light is going off in the class.

Todd: Or when people try to do multiple things. I mean, now you’ve got the technology around. So if students are trying to listen to an assignment while they’re texting their friend and have a TV on, I mean, we’re living in an age where there is a lot going on, and people believe they can process lots of things. Evolution doesn’t happen quite that fast. And so I think we have to be careful with that one.

John: One other thing that’s happened is back when you and I both started teaching, the only way students generally communicated their learning was either on typed pages or on handwritten notes. Now we have many more types of media that students can use. And also we’ve seen a bit of an expansion of open pedagogy. How does that help students or how does that affect student learning?

Todd: Wow, that’s really changed a lot as well. Blue Books. Remember the blue books? I think they still sell blue books in the library. They may cost more than the I think it was eight cents when I started, but the concept of writing things down, you turn them into the faculty member, the faculty member would grade them and turn them back. One of the big things that I caught years and years ago was so much wasted cognitive energy in terms of what they produced. I’d read a paper from a student and think this is amazing, and no one will ever see it. It was written for me, I graded it. And now it’s done. I think the technology has changed so many things. One of the biggest things, I would encourage all the listeners, any faculty member out there is, whenever possible, create something that will take the students’ work, the things that they’re doing, and use it to make society better. It’s not that hard. There’s assignments that you can do on Wikipedia. Anybody who wants to complain about Wikipedia, if you don’t like it, I’m gonna go back to Tim Sawyer, who is a faculty member of mine, my very first time I ever did TA work. I was complaining about some students. And he said, “You can complain three times. And after you’ve complained three times, either stop talking,” he was a little bit ruder about that, “or do something about it… just shut up or do something.” And so I complained about Wikipedia for a while, that it wasn’t all that effective. And I thought, well, if I don’t like the page on cognitive load on Wikipedia, I could give an assignment of my cognitive Psych class to go on to Wikipedia and fix it. And so you can have Wikipedia assignments, there’s so many things you could do. Here’s one for you. If you’re doing one on communication, you could have your students go and take pictures or short videos somewhere on campus of something that’s meaningful to them, and then jot down why it’s meaningful, take that compilation of stuff and send it over to the office on campus that does publicity. What better way of drawing students to campus than to have all of these students that have said, I love sitting by the pond because… and in the past, we would have had students write a paper about someplace on campus that you think is effective, put it in the blue book, we would grade it, we turn it back to the students. And that is a waste of possibilities. And so I think we do have lots of ways that we can get the students involved in helping through technology,

John: One of our colleagues in SUNY, Kathleen Gradel, had an assignment for a first-year course, where the students went out, took pictures, geocoded it and added it to a map layer that was then shared with other first-year students about useful resources on campus and their favorite spots on campus, which is another great example of that type of authentic learning.

Todd: Yes, for the authentic learning, there are just so many possibilities because of the technology. If anyone doesn’t have ideas, ask deans, ask the provost, ask the president on your campus, like what kind of information would be helpful, either for the next round of accreditation or for just helping the campus and we can design those things. Another one I did was we took students to the museum. We’d go to the museum, almost any class could kind of find some way to tie museums in, and through the museum, not only would they write stuff that the folks at the museum who did curation would help use, but also just helping the students to see how issues from the museum, how artifacts and things can be used in their own life, to better understand.

Rebecca: When I first started teaching, community-based learning was popular, in fad at the time, and I think having the experience of being a student in a class like that, but then also a faculty member teaching classes like that has really informed the kinds of projects that I do. Maybe they’re not always community-based learning, but they’re often community oriented, whether it’s the campus or even the surrounding community that the campus is situated in to help students get connected. There’s so many nonprofits that need partners and love, there’s always a project that can be done. [LAUGHTER]

Todd: There is. And I used to be a director for a service learning component of the campus. And yeah, there’s just so much out there that we can do to help others.

Rebecca: And students always had such a strong connection. And they didn’t want to fail because other people were depending on them. And so there was a real investment in the work that they did on projects like that.

Todd: I will admit that I’ve never experienced it myself. I’ve never even heard of anybody that if the students are doing some kind of authentic learning, that their authentic learning is then used to help somebody else. I have never heard students say “What a waste of time” or “I hate that class,” or “those assignments are just busy work.” They’ve never used those terms.

John: One common sort of project is to create resources that could be shared with elementary or secondary school students in the disciplines. And again, they can see the intrinsic value of that.

Todd: Yeah. Students could write short manuals on how to learn and then pass that on to the first-year students. And so upper-division students could be helping the lower-division students because not everybody can get a copy of The New Science of Learning, third edition.

John: …available from… [LAUGHTER]

Todd: Available at… used to be Stylus. Since Stylus was sold to Routledge, now it’s available at Routledge. [LAUGHTER]

Rebecca: Given the historical background that we’ve walked through today, what if we think about the future? Where do you see technological changes or learning theory changes impacting the future of higher ed?

Todd: Yeah, we’re living at an interesting time. I like to point out to folks that when you go back to Socrates, Plato kind of time there was a thought that if you wrote something down, it would weaken the mind so we shouldn’t write things down. Luckily, some individuals wrote things down or we never would have known. We’ve gone through several iterations of those kinds of things. Samuel Johnson, I believe it was, who said “With the ready availability of books, teachers are no longer needed. If you want to learn something, you could go get a book on it.” Well, that was a couple of 100 years ago. And we still have faculty members, we have students writing things down, we’re reading, I don’t imagine how you could teach without writing things down and having books. The internet came along, as we were discussing earlier, while we were teaching, we watched the internet show up. And there were people who said, “Well, with the internet, there’s going to be no need for teachers anymore, because students can get whatever they want.” I can’t imagine teaching without the internet right now. So as we’ve gone through each of these iterations, there’s been this fear that maybe we’d be supplanted by some technology followed by “I don’t know how I’d work without that,” it’s a little trickier now, because with generative AI, we’re talking about not just something being available, but actually creating something. I don’t know what that’s going to look like. But there’s some real possibilities that the generative AI ChatGPT, could do things like help students who have writer’s block, get started. And that’s an individual that maybe could produce something really cool, but just can’t get started. I didn’t publish my first book until about seven or eight years ago, because I’m one of those individuals who has a terrible time from a blank screen. I just have a terrible time with that. And so now, I don’t use ChatGPT to actually write anything significant. But I will tell you that I will use it for the first paragraph. That’s all, just one paragraph. And then I completely rewrite that. And there’s no actually trace of it. But it’s something that gets me going.

John: So can we count on more than a book a year going forward? [LAUGHTER]

Todd: No, no, no, no, you can’t. So exhausting. But the concepts that will help students that can do that, I think that’s going to be helpful for them. So there’ll be a type of student who couldn’t have produced before, but now can. We are definitely going to run into some challenges, though, with students who are going to just use generative AI and use artificial intelligence to actually create and to hand something in instead of doing the work. So I do think we’re in a challenging time right now. And I wouldn’t make light of that. There’s actually something that I find fascinating from this. Right now, more than ever before, we can actually have artificial intelligence create something for us, especially in higher education, this hasn’t been done before. The tricky thing is that we were the ones to be able to make that possible, because we learned things. If we let a machine do that work for us, we’re not going to be put into the situation or our students coming along, will not be put into a situation where they’re intelligent enough to do the things that need to be done when they need to be done. And so I do think we’re facing a real dilemma right now. If my students, for instance, always do use some artificial intelligence to create a paper and hand it in, if I can’t catch it, they may end up with an A in that portion of the class. But there’s going to come a day when they’re going to have to write something or be able to read something and tell if it’s written well. And so I’m a little bit nervous, we’re entering a phase where by bypassing some cognitive processing that needs to be done, we may be limiting what we’re able to do in the future. Wrapping this up, though, I don’t want to be the person who says if you use a calculator, you’ll never understand this statistical test. So I don’t know where the balance is. But I do think we’re going to have to have decisions coming up that we’ve never had before.

John: Generative AI is drawing on that wealth of knowledge that has been produced. And for that to continue to grow in the future, we do need to have some new materials being created. So that is an interesting challenge, unless it goes beyond unless….

Todd: …unless it creates it. So that was one I thought about, by the way, sometimes you’re sitting around just thinking about stuff and it’s interesting. I was thinking how do I acquire new information. And the way I acquire new information is I go read articles, I read books, I read a ton of stuff. And then I say I think this is valuable, I don’t think that’s valuable. And then I put it together and say here’s what I’m thinking. And now I’m looking at this generative AI who goes out and scans the environment and pulls these things and then creates something new. It doesn’t have the cognitive processing that I have at this point, but…

John: it’s in the early stages.

Todd: We have some folks who are very concerned out there, especially in European countries that are starting to put some guardrails out, because at the point that it keeps grabbing stuff, and then generating and then it grabs the stuff it generated, then it’s going to be interesting. But as of right now, I just read another article, I think it was yesterday, that they’re going out and grabbing the most popular or most frequently written things and then putting it down as if that is right.

Rebecca: The way that you might prioritize as a human with an expertise in something, is going to be really different than a system that’s prioritizing based on popularity, [LAUGHTER] or like how current something is like when it was last published. That’s a really different value system that really changes priorities.

Todd: Yeah, and I think it changes how we teach. I think the way we teach is going to fundamentally shift because we’re going to have to work with students with all these things being available and explain to them and talk to them about the learning process and the value of the learning process. And keep in mind, this isn’t just about ChatGPT writing papers, everybody’s freaked out about that right now. We shouldn’t lose sight of the fact that you could get fresh, cleanly written papers that have not been plagiarized at all, we’d be able to do that for 20 years. There are paper mills, I can either write away or contact somebody and say, “Please write me a 10 page paper on Descarte, and they would write it, I could turn that in. What actually has happened recently is that everybody can do it, even those who can’t afford to have a paper written at $10 a page or whatever it’s costing. And so equity comes back again. [LAUGHTER] Now we’re an equal opportunity cheater. So we have to be careful with that. But I think the way we teach is going to change because all that information is going to be available, kind of like the internet on hyperspeed. And then what do you do with that? It’s going to be really intriguing. I think it’s an exciting time.

Rebecca: So Todd, this episode’s gonna come out right at the beginning of this semester. So you’re saying we need to be thinking about how to change our teaching. ChatGPT’s here, what are you doing for the Fall differently?

Todd: Well, I think the biggest thing is what we were just talking about, looking more at the learning process, which has been a big thing for me for the longest time, is explaining and talking through the learning process, I can hand you all this information, but if I hand it to you, you don’t learn. In fact, one of my favorite examples came from a friend of mine, and it was the gym, if you want to get in better shape, I could pay somebody to go do sit ups for me. And then I could somehow log in the book at the gym that 100 Sit ups were done, use the passive voice there, and somebody else did them for me, I’m not going to get in better shape unless I do the situps. So I have to do the work, I have to run, lift weights, do the situps in order for me to be able to gain. We need to just turn that into a cognitive process for our students to really gain cognitively they have to do the work. And so I think more than ever, it’s how do we convince students of that? And for the faculty members who say, “Well, that’d be great, but my students just want the grade.” If that’s the case, we have a bigger problem than whether or not some technology can write a paper for them.

John: So how do we convince students that it is important for them to acquire the skills that we hope they get out of college?

Todd: I think this is probably going to come down to the community building, it’s been there forever. If you really want your students to do the work, the best thing you can do in my view, and that’s why I’m gonna say, Rebecca, I don’t think a lot for the way I teach, has changed. You build a community, you build relationships, you talk to the students about importance of things, if you’re sincere about that, and they get that then yes, there’s going to be some students that are going to mess with the system, they have always been there. But you’re also going to get a lot of students who will say, “Yeah, that’s a good point.” And then they’ll do the work. I don’t teach as many undergraduates as I used to, I’m teaching more faculty than ever because of being the faculty developer. But there were years that I would have to tell my students don’t put more time than this in on your paper, you have other classes, you need to do the work in the other classes. Because, and I’m telling you, I am very proud of this, my students would spend a ton of time on this stuff for my class, because they didn’t want to let me down. And I would say you’ve already got an A, I’m proud of what you’re doing, please go work on your other classes. That kind of scenario happens when you build community. And I’m not saying it’s easy, I would never say it’s easy. And it’s not going to happen for everybody. But it is the foundation of good teaching.

Rebecca: So we always wrap up by asking, what’s next?

Todd: There’s just so much going on right now. I think that what’s next for me is I am still in that headspace of coming kind of back from the pandemic, anybody who says, “Yeah, but the pandemic’s all over,” wait for November, we won’t know, we’re going to see. But I still think that’s next is kind of thinking about how we teach and learn in this environment. So moving in that space, it’s probably not surprising. I’m working on the next book here. One of the things I want to do now is the last couple of books that I’ve done had been pretty heavy books. And now I want to write something that’s a little bit lighter. So it’s going to be more of a quick guide with more narrative and having some fun, I love telling stories. I love having fun with people. So I’m going to try to create a book that’s kind of like a science of learning and teaching at its best but really accessible and more of a story-based kind of way of looking at things.

Rebecca: Who is your audience for that book?

Todd: Anybody who will read it? [LAUGHTER] Anytime I write anything, I have to have the audience firmly in mind and think about who am I talking to. And I really believe there is a pretty big overlap with students and faculty who don’t know specific things. And I’m not saying this in a mean way toward any of my faculty colleagues at all. But there’s a lot of people who aren’t taught about things like long-term potentiation and deep sleep in terms of semantic memory, and looking at depth of processing and those types of things. So the same type of thing we can say to a student, we know you shouldn’t cram, but here’s why you shouldn’t cram… faculty learn a lot from that as well. And so my audience for this book is going to be faculty and students, students, because I think it’ll be more fun to read about how to learn in a narrative form like that. And faculty because it’s more fun to learn when you read in that kind of a format for some people. we’ll see.

John: And if faculty design their courses to take advantage of what we know about learning, it can facilitate more learning.

Todd: Wouldn’t that be cool? We could just keep rolling, rolling. What a great amount of work. I mean, a huge amount of work that faculty do. They’re hard working folks that are just cranking away all the time. Number one, making their life a little bit easier by helping to understand things would be great. And just having a little bit more fun would be fun, would be nice way to go to0.

Rebecca: Hey, anytime you can save time, so that we can have more play in our lives is better.

Todd: Yeah, just to do whatever you want to do.

John: Yeah, ending on a note of fun is probably a great way to end this.

Rebecca: Well. It’s always great talking to you, Todd. Thanks for chatting with us and going on the Wayback Machine.

Todd: Oh, you know, I love the Wayback Machine.

Rebecca: I love it too.

Todd: For those of you who don’t know about that, you should check out the Wayback Machine

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

300. Episode 300 Reflection

This is episode 300 of the Tea for Teaching podcast. Whether you are a new listener or have been with us for all 300 episodes, we are very grateful that you’ve joined us on our podcasting journey. In this episode, we celebrate this milestone by reflecting on what we’ve learned and how the podcast has evolved.

Show Notes

Transcript

John: This is episode 300 of the Tea for Teaching podcast. Whether you are a new listener or have been with us for all 300 episodes, we are very grateful that you’ve joined us on our podcasting journey. In this episode, we celebrate this milestone by reflecting on what we’ve learned and how the podcast has evolved.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Now that we’ve reached Episode 300, we thought we’d take the opportunity to reflect on some of the changes that we’ve seen in higher education since we launched the podcast in 2017.

John: Today’s teas are:…

Rebecca: I have Blue Sapphire.

John: I heard you just stocked up on a trip to your favorite tea store.

Rebecca: Yes, I was really excited to stock up on my favorite and I have a couple new ones too. So maybe in some upcoming episodes, we can try those out.

John: And I have Bing Cherry Black tea from Harry and David’s which is made by the Republic of Tea. When we first got started on the podcast, much of the focus was on specific teaching practices and techniques and interesting projects. Most of our guests were people that we knew or guests who were within our professional networks.

Rebecca: in the spring of 2020, as we know, [LAUGHTER] the focus shifted to the challenges associated with remote and online teaching, and the challenges facing remote learners and instructors.

John: As we became accustomed to pandemic teaching, we focused a bit more on faculty concerns as we transitioned into the transformed higher ed landscape. Historically, higher ed had been designed to serve the elites of society, and while higher ed gradually became more open and students have become much more diverse, many residual practices have worked against serving the students that we have. During the pandemic, faculty became much more aware of the inequities facing our students as well as faculty and staff.

Rebecca: Yeah, so one of the things that we’ve been talking about quite a bit is this more holistic focus on the needs of our students and faculty as humans, and really generating and creating a much more inclusive higher ed environment. How do you see that moving forward, John?

John: One of the things we’ve talked about is addressing the needs caused by the increased demands on time for faculty, staff, and students. As we developed new teaching techniques and tried to build more structure into our courses, it put much more demands on faculty in terms of redesigning their courses, in terms of paying more attention to the needs of students, and providing students with more feedback. And that has led to issues with burnout, which we’ve addressed in a number of podcasts.

Rebecca: And you’ve never experienced that, have you, John?

John: The day is not over yet. [LAUGHTER]

Rebecca: Well, how do we think about supporting faculty as we move forward with all these demands on their time in trying to prevent burnout? We’ve talked about this in a couple of episodes, but as we enjoy summer and have a little bit of more downtime for some of us… maybe not you, John… and move into the fall, what are some things that we need to be thinking about for our own classes to prevent burnout?

John: One of the things that we’re trying to be careful with when we recommend new teaching techniques to faculty at the teaching center here, is that they change approaches gradually, that small changes, incremental changes, are much easier to accommodate than the type of rapid changes that people had to do when they first moved into remote teaching. And so I think we have to be careful in making sure that we maintain a balance and we don’t burn out ourselves, because we’re not going to be very effective in supporting our students if we’re struggling to get through each day ourselves.

Rebecca: Yeah, we need to be present, just like we want our students to be able to be present and have the supports around them to be present in their learning. I think one thing that we’re also talking about in grad studies in our office is really this increased stress on faculty, and how do we support faculty, but also how do we support graduate student populations through things like accountability groups, or ways where there’s another human for accountability, but also for support, and not necessarily a mentor model, where there’s a power dynamic, but really a peer-to-peer approach to connect people together.

John: And we’re running two reading groups this fall to address some of these needs. One of the reading groups is on Sarah Rose Cavanagh’s new book, Mind over Monsters. And the other one is the second edition of Jim Lang’s Small Teaching. We had done that a few years ago, but we’ve had a lot of new faculty since then. And while we try to reach as many faculty as we can in our workshops, there’s a lot of faculty who are still teaching in pretty much the same way as faculty were teaching a century or so ago. And we’re hoping that by encouraging small modifications in teaching approaches, it might encourage more faculty to participate in introducing active learning activities and evidence-based teaching approaches.

Rebecca: It’s really easy to slip back into past practices when we’re tired [LAUGHTER] and overworked. And it’s not surprising that people have kind of slipped back into assignments and stuff that they’re really familiar with to reduce the cognitive load around new stuff and the many stressors around. So having that added support to help faculty re-engage with some of those ideas is, I think, a really great idea at this juncture. And I love that Mind over Monsters is one of the reading groups as well, because mental health is such an increasing concern, not just for students, but also for faculty and staff.

John: And we’re very much looking forward to both of these reading groups. Among the things we’ve talked about more frequently since the start of the pandemic are the challenges faced by underrepresented and contingent faculty.

Rebecca: I think when we’re introducing new techniques, and we’re thinking about supporting students around mental health, or we’re thinking about evidence-based practices and engaging in active learning, we need to remember that contingent faculty or underrepresented faculty have different barriers or different obstacles in implementing these things… or even more pushback from students and implementing some of these techniques. So we really need to be cognizant of supporting each other and realizing that we don’t all have the same kind of supports in place. I think some populations of faculty are just overly criticized. And when they try something new, it’s not accepted in the same way that a more dominant group’s adoption of those same techniques might be.

John: And that’s true both by students as well as by their faculty peers. And one of the things that’s come up in many of the podcasts we’ve discussed are the biases in both student and faculty evaluation of teaching.

Rebecca: Yeah. One of the things that I think is on the minds of our faculty too, is, as we’ve seen increased diversity of our students, we’ve seen diversity in levels of preparation. And I think those inequities have always been there. But again, maybe it’s more visible now than it had been in the past. How do we work through that in our classrooms, especially in these more introductory classes as students transition into college?

John: Well, I think those inequities have always been there, but they certainly grew with remote teaching, because our students face very unequal resources in their school districts and in their households. And when people are physically in the classroom, they’re at least exposed to the same infrastructure within their institutions. But when students were taking classes from home, as we talked about in many, many episodes, during a pandemic, they had very unequal network access, they had very unequal computing facilities, they may have been sharing a computer with multiple family members, they may have been forced to work. And as a result, the inequities in prior education and prior learning became much more dramatic during the period of remote teaching. And that disproportionately affected students from low-income households and low-income school districts. And what we have to do is provide resources, I think, for all students to be successful. And while we always should have been teaching, or providing resources and support, for all students, those needs have become much greater now, because while we are bringing in a much more diverse student body, we’re also losing students who come in with less preparation at some of the highest rates we’ve ever seen before. And we have to make sure that we’re providing the students that we accept with the support they need to be successful. And there’s lots of ways of doing it, you can build in some additional resources, you can connect to YouTube videos, and such things and provide support to students, you can use mastery learning quiz systems, and many other techniques. But we have to work towards having more faculty building that in because while many faculty are doing these types of things, and trying to build more support and more structure into their classes, it’s not a universal phenomenon.

Rebecca: And maybe even acknowledging that some students in the class are quite literally working harder to get to the same level.

John: The last few years when I’ve been teaching my large intro class, that’s something I’ve mentioned explicitly. I said, everyone here has all the resources they need to be successful. But if you had taken an AP introductory microeconomics course, or something close to that, you’re not going to have to work as hard to attain mastery of many of the concepts. If you have not been exposed to these things, or if your background in working with math and using graphs is not as strong, you’re going to have to work a bit harder. And that’s not a message that a lot of students appreciate hearing. But if we want to get all of our students to the same level at the end, the students who do come in with a weaker background need additional support to get there. And using tutoring when available, encouraging students to come in and talk to their professors and use office hours, all of those things can help but we’ve got a ways to go. What are some of the things you do to try to provide support for the increasingly diverse student body?

Rebecca: Yeah, I think the reality is that what we give each student isn’t the same, because what they come in with is not the same. So I often am trying to assess where students are and then pushing them right at that moment where they’re at, rather than expecting everyone to be at the same point. And I can do that a little more efficiently in a small class than you can in a bigger class. But I think we need to use those smaller classroom spaces to be able to do that so that everyone feels challenged, but also has what they need.

John: My introductory course is a prerequisite for all upper-level economics classes, and most of my students will be moving on to upper-level classes, so they have to reach at least a minimum level of proficiency in the discipline in order to be successful in their future classes. In other classes, instructors can be more flexible, and just try to get the most learning gains in their students, no matter what their starting points were. In my introductory class, at least, I have to pretty much take the students where they are, and try to get them all to the same place, while making sure that they’re all challenged. And that’s a very challenging goal to reach.

Rebecca: …and the difference between teaching those introductory classes versus higher level classes within a discipline, for sure, I think one of the most efficient things we can do is making sure that all students know the most effective ways to learn, because they don’t necessarily know those things coming into college, or even into graduate school. What we need to just remember is learning isn’t something that we just magically know how to do, we need to learn strategies and techniques that are effective.

John: We’ve had a number of guests over the last year or two who’ve talked about books that they’ve provided, or resources they’ve created to help students be more successful. Because one of the things that’s been pretty obvious for quite a while is that the study techniques and the learning strategies that students use are not generally consistent with what evidence suggests is most effective. And as a result, students are not using their time as efficiently as they can, by engaging in strategies that they perceive as being useful, that really result in very little increase in long-term recall… strategies such as highlighting, repeated rereading, and so forth. And one of the things that might be helpful is if we all could shift students a little bit in the direction of using evidence-based learning strategies, and some of that could take place through course design, by building infrastructures that incentivize the use of these techniques.

Rebecca: Yeah, and I think the moment that students realize that they don’t have the most efficient way, or the moment that a student begins to struggle is different, depending on some of that background, that they have. Students that come in well prepared may have never really struggled in high school, and maybe eventually, maybe even in the first year of college, you don’t struggle, but maybe it hits a little later on in their education, maybe not until graduate school. And then other students might struggle the second they get to college, because there’s not as much structure in place as there was in high school. So I think we need to be underscoring these techniques at all levels, and not just in their first year.

John: And one other thing that’s been discussed in many podcast episodes, is the importance of making the hidden curriculum of higher ed transparent to students, so that we don’t expect students to know what a syllabus is or how it could be used, that we shouldn’t expect students to know what is expected on a term paper in a class without making those expectations explicit and transparent to students. Because in general, we see a lot of students coming in, and they see it as a game where they’re trying to guess at what instructors are asking. And many of those guesses, especially for students who have not been in college prep classes before, are wrong. And they wasted a lot of time and effort that could have been spent more productively developing their understanding of the subject matter.

Rebecca: And the reality is that there’s differences between disciplines and between courses. And so the more we can be explicit about expectations within our own discipline, and within our own courses, and beyond the classroom experience of higher ed, because there’s expectations in other spaces as well, like student clubs, athletics, and all of the rest of the co-curricular activities that support student learning are incredibly important. And those are also not obvious.

John: One of the things that we’ve talked about much more on the podcast, and higher ed in general has been addressing much more extensively since the pandemic, is alternative grading approaches. Because traditional grading approaches and traditional course structures generally incentivize students to cram and to focus on maximizing their grades, rather than maximizing learning, so that if we really want students to shift to evidence based learning strategies, it would be really helpful if we could shift students emphasis away from grades and faculty emphasis away from high-stakes assessed activity and shift it more to activities that result in deeper learning, more long-term learning. And we’ve talked to many guests who have shifted to using strategy such as specifications grading, mastery learning systems, portfolio assessments, and ungraving, which has become one of the most talked about topics in higher ed in the last few years.

Rebecca: Yeah. And I think one of the things that comes up in a lot of those conversations is concerns over students just wanting the right answer and not learning and not critically thinking about the subject matter and the knowing of why and how, and doing analysis. And I think every instructor [LAUGHTER] has a desire for some of those kinds of conversations to come out in their classes, rather than just regurgitation of things that they’ve said in class.

John: Part of the issue is that when we get students in college, they’ve already had 13 years of experience in K through 12, where grades were the primary area of focus. And as a result, it’s hard to shift that focus from grades to learning. Besides alternative grading, we might use some other strategies such as encouraging students to be more reflective on their work, to spend some time in reflection-based activities and metacognitive development type activities.

Rebecca: Yeah, I know, this is a space where I was maybe a little hesitant at first thinking like, “Oh, these are just quick assignments that have no meaning,” but quickly realizing actually the value in really good well designed reflective activities that challenge students to think through how and why they learned something and what it is that they actually got out of an activity. And I’m often very surprised about how much learning occurs that is not visible, despite the fact that I teach studio classes, so I’m with my students much more than the average instructor. So I actually do observe a lot of learning. But in the reflection activities, I’m hearing a lot about how students are spending their time or things that they really struggled with and worked through that I wasn’t aware of. It also helps me understand where they’re not aware [LAUGHTER] of their own learning, or where they’re using strategies that aren’t as effective and helps with interventions. I know you’ve done a lot around metacognition, especially in your lower-level classes, but also in your upper classes.

John: In at least a couple of my courses. I’ve been using the metacognitive cafe discussion forum, which was actually the topic of our second podcast, Judie Littlejohn and I jointly developed this quite a few years back. And it’s been remarkably effective. It’s basically a low-stakes discussion forum that I’m using in my online classes, where students will reflect on their learning and share their learning strategies and will also read a bit about retrieval practice and spaced practice and the benefits of sleep in learning. And every time I do it, even though it’s only a trivial portion of the grade, it’s 5% of their total grade for participating in that activity, the students report that it was the most valuable learning experience they had in the class. A large proportion of the students at the end of the terms say they wish that they had learned these things back in elementary school, that they had been using practices that were not efficient and they didn’t realize that because they’ve never been taught how to learn. And it’s something that students have found really valuable. And the other nice thing about it is because, in this particular case, it’s done in a discussion forum, it helps them build community and helps them get to know each other, because they’ll often talk about the challenges they face. In online classes, many of the students have families where they’re taking care of young children, they may be working different shifts, they may be faced with other challenges that normally wouldn’t come up in a content discussion forum in an online class. But when they share that, and they share those challenges, and they share their career expectations, and they talk about how what they’re learning might be useful in their expected careers, besides the sense of connection, it also helps students see the relevance of what they’re doing and sharing that with other students helps build a little bit more intrinsic motivation in learning.

Rebecca: It also seems like there’s a bit of an immediacy in that context as well, because the information can immediately be put into action in a real lived experience and not something that may feel abstract, which sometimes happens within a discipline when it feels like maybe it’s not a thing I’m going to do anytime soon, professionally. So I think this really highlights the reason why we need to help students hook into everything that we’re doing to make it feel like they have a personal, professional, or educational connection to their own goals.

John: One of the topics that I use in each class where I’ve done this, at a point where students face the first really challenging material in the class, is just asking them to discuss how they deal with challenges. They share useful strategies, but one of the main benefits of that is it normalizes the sense of struggle, that when students are struggling with concepts, they often feel that they’re alone on this, but when they hear that other people are struggling with exactly the same issues and exactly the same concepts, it normalizes it, and again, it helps them understand that challenge is an important part of learning, which is not the message that they’ve generally received throughout their prior educational experience before coming to college.

Rebecca: It seems to me like this is the same reason why our reading groups work so well for faculty development as well is this connection among peers, but also that the challenges we experience are not in isolation. [LAUGHTER]

John: One of the things I’ve always enjoyed about the reading group is when people will come up with a technique or describe something they’ve done in class and people in completely different disciplines who might never have considered that will make connections and see how they could do something similar in their classes. That understanding that we’re all facing the same challenges makes it much easier to deal with some of the day-to-day stresses that we might have in our classrooms.

Rebecca: I know that one of the things that has come up in our reading groups, and also in our conversations about the future of higher ed and where we’re going to be going over the next few years is student engagement, and then specifically, the role of AI tools like ChatGPT [LAUGHTER] in the conversation. So if students don’t feel motivated, and they’re relying heavily on these tools, how do we get students to re-engage with the idea of learning?

John: Well, going back even just a little before the introduction of ChatGPT, which kind of hit higher ed by storm in late November of 2022, we did see a dramatic increase in the use of sites such as chegg.com, and various other sites out there, where the use of those tools became normalized a little bit, which made it much more challenging to give online assessments. And I think that’s where most people are concerned right now about things like ChatGPT, because with other places, you could at least locate where answers were coming from. And you could address that with the students and attribute it to the specific sites where they got their answers, which was, again, a bit of a challenge. But ChatGPT is raising some challenges for assessment that are going to be difficult to deal with, because it’s much more difficult to determine who is the author of specific items submitted online for assessment. And a lot of people are struggling with that right now. I know I’ve been struggling with it. In my spring 2023 online class, the quality of student writing on essays improved fairly dramatically over the course of the semester. And that seemed to correlate with the spread of the use of ChatGPT a bit. AI tools are really powerful, and they can be really useful. And they have a lot of potential value in education and in providing support for personal and work productivity. Right now, I think, more people are focused on the challenges, but we’re going to have to start thinking about ways in which we can productively integrate this and prepare students for a world in which the availability of AI tools will be ubiquitous.

Rebecca: And you teach in some really challenging contexts, really large classes in person, a number of online sections, and I know ChatGPT is keeping you up at night. What are some things that you’re thinking about… maybe haven’t resolved… but that you’re really thinking about redesigning or rethinking or retooling in the fall to just respond to the moment that we are currently living in.

John: As of 2020, I had shifted all the quizzing to online quizzes and tests and midterm exams and so forth. I’m seriously thinking about in my large face-to-face class, moving back to at least in in-class midterm and an in-class final exam. I really appreciated the fact that I could let students do it at their own pace, and that it took some of the anxiety and stress away when students did not have this two-hour time limit to complete an exam in the classroom. But with the size of the class, a large proportion of the testing is done with multiple choice exams, or algorithmic questions, and those are types of things that ChatGPT answers really, really well. Not too long ago, someone posted that ChatGPT 4 received a score of a 99th percentile on the Test of Understanding in College Economics (the microeconomics version of that), and those are the same types of questions that I’d be giving students on these quizzes. And while I had 1000s of questions that I had created that students were selecting from, all of those questions now are vulnerable to the use of AI tools, which makes it much more difficult to assess in that large class. Right now, the only thing I’ve really thought about doing differently in my large class is moving back to at least a couple of in-class exams. Now some of the things I was doing, such as polling questions embedded in the class activities and working on problems in class, where students submit that in real time, are generally much less subject to that type of issue. I know there are tools where students can scan the questions and so forth, they get responses back a bit more quickly, but it wouldn’t be as easy for them to do in real time when they’re in a polling environment. One of the main benefits of that is when I use polling, it was always tied with peer-to-peer discussions. And those peer-to-peer discussions is where most of the learning actually occurred from those in-class problem-solving exercises. For my online class, I’m not sure what I’m going to do. One thing I have done in the past is I’ve had students do podcast projects. And again, it’s pretty easy for chat GPT to generate scripts, but these projects are pretty heavily scaffolded. Students submit a proposal and they go through a number of steps to get there. And projects that are scaffolded like that, are probably a little bit less sensitive to the use of AI tools to generate the entire project. What are you thinking about in terms of your classes, or in terms of the graduate program?

Rebecca: I think we’ve talked a lot about the concern over the validity of our assessments and wanting there to be accuracy, not just for our sakes, but for students’ stakes in the value of their degrees moving forward. Part of it, I think, is really engaging in conversations around ethics around these tools, and not necessarily discouraging the use of the tools entirely, or banning the tools. I think that just motivates people to want to use them more, but rather to use them in ways that are productive, or interesting, but are also well documented… [LAUGHTER] like students are disclosing what they’re doing. And we can analyze the use of the tools in particular ways because maybe it could save time in particular places and not take away from certain kinds of learning, as long as we keep the learning objectives [LAUGHTER] up front. And then we assess when we’re using particular tools to determine whether or not it’s taking away from the learning. But I think these are hard conversations to have, and certainly not things that I want to be policing.

John: And I’d much rather not be policing these things. Sometimes students haven’t given me much choice in that. One example that I’ve seen recently is students submitting exam responses that asked him to analyze recent data, where the response said something to the effect: “as an AI tool, I do not have access to this data.” And when a student submits work like that, it’s pretty clear that they haven’t even read the essay responses they’re submitting on that graded assessment activity. And we want to make sure that students do actually interact and engage with their learning materials. Perhaps we can also design assessments that are not as vulnerable to AI-generated text. This semester, with my online classes, one thing I have shifted to, instead of having them discuss general debates or issues in economics, I have them focus on interpreting videos online, for example, where economists are debating certain topics, or doing readings that are not in the training database for ChatGPT, which means it’s much harder for AI tools to generate responses when they don’t have access to the underlying content that’s the focus of the assessment activity.

Rebecca: Would hyperlocal situations or examples also be a strategy because there’d be less widely available information on something like that.

John: Definitely. Information on the local community or the campus community or other local things, information that would just not be part of the training database is a good place in which we can ask students to connect the materials their learning to real-world events so that you maintain that sense of relevance while ensuring that the students are actively engaging with the work themselves rather than using a tool.

Rebecca: One of the things that I’ve used historically in my design classes, and it’s a little easier again, because I teach studio classes and see students more often so I tend to have a hunch as to what they’re working on, because I’m seeing them working on things, is really documenting process and not just using language, but showing through a video and showing steps along the way that might not be as easy to capture as an end product using an AI tool.

John: In general, open pedagogy projects, too, could be less vulnerable to having work being done entirely by AI tools. So videos would be an example, wikis perhaps might be.

Rebecca: I think that things that combine text and image are more challenging to have an AI tool create, at this moment.

John: That may very well change…

Rebecca: …by the time this episode comes out. [LAUGHTER] I think one of the things that I’m hearing us say actually, is that a lot of the strategies to reduce intellectual integrity or academic integrity issues around ChatGPT are also the things that are more likely to engage students and foster their learning anyways because they’re more authentic assessments, they’re probably more project based, they’re probably more long term with milestones along the way. And these are things that students often deeply engage in. And I think when they can connect to their local community, whether that’s the campus or the community that campus is situated in, or even their own hometown, in different ways around the discipline, those are all ways that students get a hunger to want to learn more.

John: And going back to our earlier discussion of the importance of shifting students’ focus from grades to learning, students are using tools like ChatGPT to raise their grades, even though they recognize it does not support their learning. If we can shift students’ focus to recognize the value of learning as improving skills that they’re going to need later in life, that should reduce the incentive for students to use shortcuts to avoid learning material.

Rebecca: If we’re not just looking for the right answer, but the journey to an answer, and even if it’s an incorrect answer, being able to understand why it’s not correct, and allowing that to be the learning is a really different way than our education has historically worked. The future of higher ed seems really stressful, John. [LAUGHTER]

John: It does, but it always has. That’s nothing new. But certainly the last few years have seen a lot of rapid change that… I hate to use the word unprecedented… but that have been relatively unprecedented.

Rebecca: And I think it really does speak to this need to connect with other colleagues, where we can share some of the challenges that we’re facing and brainstorm together to improve our teaching, but also to improve the level of stress we’re experiencing. [LAUGHTER]

John: One of the other things that we’ve talked about, especially within the last year or so is growing faculty concerns over student engagement. When students first came back to the classroom, there was a lot of excitement about being back. But since then, faculty generally seem to be noting that the level of engagement of students has shifted or has changed somewhat. More students are not completing assignments. Students in some classes have been disappearing from class as the semester progresses. And there’s a lot of concern that students are not as fully engaged with their coursework as they had been prior to the pandemic. So Rebecca, how are we going to solve this?

Rebecca: That’s a good question, John. I think one of the things that this aligns with is the higher incidences of loneliness, and mental health. And so finding ways to connect students to each other, and establishing those peer networks, I think, is one of the most important things that we can do in our classes. And it’s something that I’ve maybe always done in some way. But I’m being much more intentional about moving forward, because I’m feeling like even if students are in the same room, they’re still feeling really isolated. And so we have to be intentional about creating those opportunities for students to experience connection and feeling like they want to show up for each other and for themselves,

John: …using more group activities in class where the work of each student depends on the contribution of the other members does help create that sort of pressure on students to be there for their peers, to be there for the rest of their team. And that could be very useful.

Rebecca: Yeah. And I think the key to that, though, is not just assuming that students know how to interact with one another, or how to depend on one another in a team context, but really scaffolding those learning opportunities that really start with making connections and establishing relationships, because it’s the relationship that’s going to cause the pressure to show up for someone. And I think when we’re seeing high incidence of like ghosting, for example, it’s because the individuals don’t feel connected to the people that they’re ghosting.

John: And there have been a lot of studies done recently that show the importance of a sense of belonging in student persistence. So helping students form those connections is really important, because we have so many students who go to college, build up a huge volume of debt, and then disappear without getting the degree which does serve as a signal that they’ve actually accomplished something as a result of their education. And they end up with more financial struggles than they would have had had they not started. So we do want to help students form those connections for their own sakes, for their own future success. And one of the books we used in a past reading group was Relationship-Rich Education by Leo Lambert and Peter Felton. And that summarizes a lot of the research on the importance of building community and building connections, and also provides some really nice examples of ways in which institutions can transform to help facilitate those connections.

Rebecca: As instructors, we have a lot of power in that space to help students feel a sense of belonging. We can do really simple things to make someone feel seen and if they feel seen, they’re more likely to feel like they belong. So personalized messages, getting to know your students a little bit, being approachable, calling students by name, all of those things help students feel like they’re a part of a particular community. There’s so much to still learn and to come together around. And so I know that we’re looking forward to having many more guests and many more conversations to help work through many of the questions and concerns and things that we’ve raised today and have been raised by our colleagues. Now, John, we always wrap up by asking what’s next?

John: Well, what’s next for me is I’m heading down to North Carolina to teach at Duke again next week. And I’m looking forward to this. And this time, I’m going to try avoiding getting run over by a car. So I can actually teach my classes down there and spend some time away from the hospital this summer,

Rebecca: #life_goals. [LAUGHTER]

John: Small goals are sometimes more achievable. And Rebecca, what’s next for you?

Rebecca: This summer, I’m looking forward to doing some more work on our graduate student online orientation, which we put together as we transition to our new course management system in the fall and also working with some colleagues on an accessibility online module.

John: And we’re looking forward to talking to more of our wonderful guests. I’ve really enjoyed the experience of interacting with so many great people doing some really good research and doing such good work in higher ed.

Rebecca: We’re grateful for all of our guests and all of our listeners. So thanks for listening

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

297. The Road Forward

The opening session of the 2023 SUNY Conference on Instruction and Technology, which took place at SUNY Oswego, included a keynote address in the form of a live podcast interview with Flower Darby. This podcast episode is a recording of this session, which included both a live and a remote audience. Flower is an Associate Director of the Teaching for Learning Center at the  University of Missouri at Columbia. She is the co-author, with James Lang, of Small Teaching Online: Applying Learning Science in Online Classes and a co-author of The Norton Guide to Equity-Minded Teaching.

Show Notes

Transcript

John: The opening session of the 2023 SUNY Conference on Instruction and Technology, which took place at SUNY Oswego included a keynote address in the form of a live podcast interview with Flower Darby. This podcast episode is a recording of this session, which included both a live and a remote audience.

When colleges shut down in the country in mid-March of 2020 we reached out to Flower Darby to provide some guidance for people who were moving to remote instruction, for the most part, for the first time. She joined us on a special episode… in fact, it was the only time we released two episodes in one week… and she provided advice to faculty on emergency remote instruction, resource sharing, and strategies to keep courses going. Today, we are pleased to have Flower back with us to reflect on the impact of the past three years and map a road forward for teaching and the academy.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Flower Darby. Flower is an Associate Director of the Teaching for Learning Center at the University of Missouri at Columbia. She is the co-author, with James Lang, of Small Teaching Online: Applying Learning Science in Online Classes and a co-author of The Norton Guide to Equity-Minded Teaching. Welcome back, Flower.

Flower: Thank you, John. Thank you, Rebecca. Thank you all for having me and for being here and focusing on how we can map that all important road forward. So good to be here with you all.

Rebecca: So it wouldn’t be an episode of tea for teaching if we didn’t ask about our teas. So our teas today are: … Flower, are you drinking tea?

Flower: I have my iced tea in here. And it is a Hawaiian Islands Passionfruit blend.

Rebecca: Nice.

John: And I have a Tea Forte black currant tea today.

Rebecca: And I brought out the Jasmine dragon pearls green tea for today’s episode.

John: When we last talked on March 17 2020, you provided some suggestions on how we could maintain instructional continuity during that two-week shutdown we were going to have to deal with [LAUGHTER] and one of the things you asked in the conversation was what are we going to reflect on looking back when we’re through this immediate crisis situation? So we’re going to turn this question back to you. What sticks in your mind the most from the period of pandemic teaching?

Flower: Yeah, thank you, John, it’s such a big question. And I have reflected very deeply on this over the past three years of ongoing research, conversations with 1000s of educators around the country and around the world. And really, there is one thing that has become crystal clear for me. And that is the centrality and the importance of holistic wellbeing for both ourselves, our faculty, our staff, and our students. I’m excited about how technology use has advanced as a result of the pandemic. But that’s not actually the central focus for me. It is about the importance of our wellbeing, of our students’ holistic wellbeing, and of how we need to center and highlight and forefront social connections and those kinds of relational aspects of teaching and learning with technology in person wherever we are. That extended period of isolation and loss and grief and challenge and distance in education really brought to the front for me the importance of connectedness, and being intentional in how we connect with our students and help them connect with each other as well.

Rebecca: I think you’ve started hinting at this already, Flower, but how has higher ed been transformed by this pandemic experience?

Flower: Yeah, thank you, Rebecca. So I do think that there has been a lot of work done to enhance technology implementations, to provide better support for faculty who are just in the trenches trying to figure this out, whether it’s using new features in Canvas or your learning management system that you may not have used before. Here at the University of Missouri all of our classrooms are now called Zoum rooms. And that’s Zoum, because we’re at Mizzou, which is spelled M-I-Z-Z-O-U. And it’s a challenge for faculty to be in these high-tech teaching spaces and it’s wonderful that the university is making this commitment. But for me again, it is not about the tech, we have seen good tech advancements. We just heard from the Chancellor about some really amazing innovations and that is wonderful because it is going to keep moving us forward. But it is true, I do believe the truth of transformation that is beginning, and that we need to continue, is focusing on this notion of holistic wellbeing and relational teaching and learning.

John: In 202o, one of the things we talked about in that last conversation was the insufficient systemic institutional support for teaching centers, instructional designers, and the effective use of technology in teaching and learning. Have leaders in higher education made long-term sustainable investments in this work.

Flower: Yeah, great question. I think some have, and of course, my answer is going to be, “And we could do more here.” Here again, I just mentioned that example locally here at the University of Missouri with all this investment in the Zoum rooms. What I’m hearing sometimes, though, is that the challenge in managing all the bells and whistles, especially if you do have students who are in the room in front of you, and also Zooming in, it is not something that we necessarily prepare college faculty to do in our graduate programs. I’ve had so many countless conversations over the last few years where the fact is, as a professor, I did not necessarily set out to be a tech whiz as well. So I’m seeing encouraging signs and improvements and a greater awareness of the potential for effective use of teaching with technology to enhance inclusive and accessible, equity-minded student success. And I’m going to say we can do more.

Rebecca: As you just mentioned, prior to the pandemic, many faculty and students were resistant to online instruction. And while this resistance has faded, in some cases, one of the concerns that you expressed in our earlier discussion was the physical isolation experienced in online learning and you mentioned this a bit earlier today. Has the pandemic helped us to develop new ways of encouraging that relationship building online?

Flower: I would say yes, and I would say greater awareness and receptivity to the importance of building relationships online. I think that once again, we still have work to do in this area. But I do believe that prior to the pandemic, there was less awareness on the part of faculty and no blame no shame, I would say it’s the way that institutions and graduate programs may or may not prepare faculty for effective online teaching. I would say there was kind of less institutional awareness of the importance of those relationships online. Now we have seen what happens, we felt it, we’ve lived it in our bodies, when we felt disconnected from our students, when we’ve tried to teach to black boxes with a name, or Anna’s iPad on the Zoom screen. We’ve kind of lived out that disconnect and that isolation. And yet, we know there was abundant research to show that we can have really engaging interactions in our online spaces. And we know that it increases access. I’m here with you today from beautiful Columbia, Missouri, because we have this option available, although I would love to be in the room, but we have other folks joining online as well. We see the value, we know the importance of those connections, those relationships. And one thing that I have really focused in on in the last couple of years is being intentional in the way that we create and structure those opportunities for rapport building and to close the distance because we know that it’s not going to happen by accident online, whether asynchronous or synchronous, intentionality is required. And I encourage faculty to rethink how they use their class time, what the activities are in asynchronous modules, maybe even the kinds of assessments that are in our syllabi, and whether we’re offering points for those kinds of activities. Basically, my argument is that we can do more to design for intentional social connections… that I would say would apply in all class modalities.

John: During the pandemic, the inequities that our students face became much more visible. When we were connecting to students who were zooming in from home and they had trouble accessing the one computer they had to share with four or five other people, or when they didn’t have good network access, or when they were struggling to try to work to pay some bills, and so forth, those inequities became really hard to ignore, for faculty. And campuses did a lot to mitigate that, by loaning computers, by loaning hotspots, and providing other resources. But now that we’ve moved back to more on-campus instruction, and with staffing shortages and budget cuts very common in higher ed, do we run the risk of falling back on some of the exclusionary practices that we had practiced in the past?

Flower: I would say yes, we run that risk. But I actually want to take a little tangent here and tell you about a conversation that I had just on Friday. This past Friday, I was at a conference in Portland, Oregon for teachers of accounting, and I had a very heartwarming and encouraging conversation with one individual faculty, and I think it’s highly representative of where our heads are, and more importantly, where our hearts are now. Of course, I was presenting on the importance of social and emotional connections… that’s what I do… and she shared a story…in fact, I have a couple of poignant stories from that event. This particular one said “You know, I used to be the hardline accountant, you follow the rules and you make the deadlines or you get out,” and then she said “until I was watching my students trying to take their exams via Zoom, and I saw one of my students, his little brother was like hitting him on the head with like a paddle while he’s trying to take his exam. And I saw all kinds of other things.” This experience, the pandemic did give us a view, a window into our students’ lived experiences. The other one, just very briefly, another faculty member, a caring, passionate, dedicated, instructor was talking about how she had one student in one particular semester who lost 13 members of her family to COVID. How much community was built as the entire class was caring deeply. So I do believe there is lasting change. The first accountant I was telling you about, she’s like, “I’ll never go back to that hardline approach. I have more empathy for my students now. I see what they’re dealing with to make this happen.” Now, that said, yes, we do run the risk of falling back into exclusionary practices. I’ve been thoughtful, reflective of how we want to go back to the way things have always been, and I get it, I’m back on a physical campus, I spent the entire time of the pandemic myself working remotely, and I hungered for a physical campus with real live embodied people and students on the pedway. And I’m loving this experience. So I get it that we want to come back to our tried and true, our comfort zones, our methods we’ve relied on. And if we slip back into, for example, less than equitable teaching methods like large lectures and high-stakes exams, we are absolutely sliding back into exclusionary practices. So I would encourage us to not waste this crisis, which is not my unique phrase, but I think it’s definitely apt in this time. Let’s keep pushing forward so that we can become more inclusive and equity focused as higher ed as a whole,

Rebecca: It can definitely be easy to slip back into habits, but I know many of us are really committed to that change and the equitable work that you’ve been talking about, Flower. What can we do together to redesign higher education to be more equitable? What do we need to do?

Flower: Yeah, great question, and sometimes I think, huge picture as in, it’s way too big to change, and other times, I really focus on the circle of control. So I definitely think that, if you haven’t seen it before, I think it’s Stephen Covey has these circles, the inner one is control, here’s what I have influence over, then there’s a broader circle, that’s influence, here’s what I have some influence about. And then the third circle is concern, there’s not a lot that I can do. And so I think we can focus primarily on our control circle. I do think, and we make this argument in the newly released Norton Guide to Equity-Minded Teaching, we make the argument that we do need to advocate for systemic change, and we need to do that in community. So we can work towards that. And then there are influences and aspects that we cannot really necessarily change. We can be concerned about them and mindful. So what can we do? Well, here’s what it comes down to for me, and I’ve thought a lot about this. I would argue, as I just mentioned a minute ago, we have to stop doing things the way we always have. So if you think about the history of higher education in the United States, it is based on centuries of tradition in Europe. And it was designed to be available to elite white men. It is exclusionary in its very nature. So we have this opportunity to say we know that our student body is diversifying. And we know that is so important because with diversity comes strength, comes creativity, comes new perspectives, comes better solutions. So let’s stop doing things the way we always have. Let’s stop with those large lectures. And I do sometimes think about things we can’t change, like, untenable work conditions where contingent faculty are going semester to semester, or we’re being asked to teach these large enrollment classes with very little, if any, TA support. Those are things that are challenging that are, for me, are in that circle of concern. But I think a general mindset to think about is, if I’m tempted to slip back into doing things the way I used to do, maybe that’s an opportunity to ask myself, whether there’s a more equity-minded way to do some things, a more inclusive way, a more active way to help students really process and interact with the materials that we’re teaching.

Rebecca: You’ve talked a little bit about burnout, stress, and mental health concerns that continue to challenge our students, faculty, and staff. And we’ve talked about needing to humanize the learning experience through the pandemic. What role… and you already hinted at this, [LAUGHTER] but I’m hoping you can dig into it… what role does holistic wellbeing play into the future of the academy?

Flower: You know, clearly by now, you know, I’m glad to say it needs to play a central role. And I don’t think as an academy, we are quite there yet. We do work and exist in an overworked culture. We absolutely do. And I would say we’re high-achieving individuals. If we choose to be here, we’re passionate, we’re focused, we work hard, but in general, we need to give grace to ourselves to take more opportunity to support our own wellbeing. We need to extend that grace to each other in community… to say “it’s okay, go ahead and take that weekend off. I don’t need the manuscript on Monday. It’s alright.” And then collectively, again, I think the more that we’re having these conversations, that can help. So just recently, my good friend and colleague, Sarah Rose Cavanaugh, had a piece come out in The Chronicle. And the headline was, “They Need Us to Be Well,” and it’s about how, if we want to support student success, if we want to advance equity and become even more inclusive than we already are, we actually have to start with ourselves. And I don’t think that we do this very well in this culture. I have had to work, to learn to give myself permission to take a weekend off. It’s something that we, again, for me, it’s about giving permission, it’s about supporting each other in these decisions as well. And then, broadly speaking, I hope that we are seeing the beginnings of a culture change. Questions about the validity and the feasibility of teaching these large-enrollment sections or teaching online classes with very little attention paid to interactions between people. I think we do have this opening for these conversations, and I’m doing everything I can to advance those conversations.

John: In response to the pandemic, faculty face unprecedented changes in the way in which they were teaching. And since then, we’ve had a number of other changes in our practices. Here at SUNY, we’ve had a transition to a new learning management system that came immediately after these transitions. And I know other campuses happen to be doing the same thing at the same time. But one of the things that’s happened recently is the introduction of new AI tools, such as ChatGPT and image generation tools. And one of the questions a lot of faculty have is how they might be able to accurately assess student learning in the presence of these tools, while also appreciating the affordances that these tools provide. And how will these AI tools transform instructional practices and the future of the Academy?

Flower: Yeah, great question. And sadly, I don’t have a crystal ball, [LAUGHTER]

Rebecca: Dang.

Flower: …however, I do have some thoughts [LAUGHTER] to share and some, again, recent research, there was a survey that I heard of… just yesterday, I saw a summary of it, it was run by the Washington Post. And it was essentially saying that many faculty are not really thinking about ChatGPT generative AI, all these new tools. We’re doing a little bit of the “I don’t want to deal with that quite yet.” And again, that’s an overgeneralization. But that’s what the survey results really did show. So how these tools will impact our work in education? My real answer is: “Yes, they absolutely will,” I have come to conclude that they are like the advent of the Internet. Remember, way back in the early to mid-90s, when it didn’t used to be possible to do an online search for something? I think this tool, this change,is along the same lines of the smartphone. Remember, when we didn’t always have a super powerful computer available to us in our pocket or our bag? For me, this is a seismic change, and it will change the way we do things. Now, that’s scary… and exciting. [LAUGHTER] Our world is changing, and we have to be willing to embrace it. Are we worried about whether students are going to do their own work? Absolutely. Do we know that we need to equip our students to use these tools in order to thrive in their careers? We know that too. Right now we’re in a very unique moment of trying to walk a middle ground here, trying to see what are the opportunities of these tools? How do we help to understand whether our students are actually doing their own work? I don’t have those answers. What I do know is that this is another big, and quite frankly, painful opportunity to think deeply again, about the way we do teaching and learning in higher education. The pandemic was this for me, ChatGPT, and Gen AI is this for me. We can think deeply about the way we do things. We’re gonna have to change some things. And that deep reflection and change process is undeniably painful, undeniably scary, and can be deeply meaningful and rewarding as well.

Rebecca: That’s a little too much seismic activity going on there. [LAUGHTER]

Flower: It is. It’s a tough moment. It’s a really tough moment in higher ed. I want to just be honest about that.

Rebecca: So at this moment, we’d like to move to some audience questions. And we do have a first audience question. And that first question, Flower, is moving forward, which pandemic modifications, or temporary adjustments, should we adopt as best practices to meet the needs of modern learners?

Flower: I have one that comes very easily to mind. And thankfully, it’s not a big huge effort or overhaul to our course design and pedagogy. And that is, let’s check in with our students more often. Let’s check in more frequently. During the pandemic, in an effort to engage those black boxes that were on our Zoom screens, many of us developed new ways of using Zoom polls, of asking quick questions in the chat box, assigning collaborative activities in Google Docs or Padlet, these kinds of things, and the students have unwaveringly told us that they appreciate us checking in more often. So, whether it is a matter of if you are lecturing in person, every 10 to 12 minutes or so ask your students a quick question, quiz them on the concept, or ask them “How are you doing? Are you with me?” …here again to think about the Zoom example, which I know not everybody is really doing as much of, and that’s probably good. But I know one instructor who would use to say, “Are you with me?” and her students knew that they could use the emojis in the chat box… one thumbs up was like, I’m not doing too good. Two thumbs up, pretty good, pretty good. Three thumbs up, I got it. And she told me that if she saw a range of those one thumbs ups coming in, she’d be like, “That’s it. We’re not going any further until we kind of talk this through a little bit more. What are your questions?” That’s the kind of informal checking in with our students that I’m encouraging us to do. Again, this can take the form of an activity that happens during class, a quick poll, it can be a show of hands, I saw a great example, just last week, those of you here in the room and watching the video will see this, for the audio recording, I’ll just describe it. I heard this great example of a biology instructor asking her students a very simple check your understanding question during a large lecture, and she had taught her students that they should answer the question based on a number of responses, the responses were numbered 1, 2, 3, 4, 5. And she said, choose the best answer and just put it right here, on your chest, so that you can hold up the number of fingers right against your chest. And what this does is it doesn’t let anybody have to feel really awkward or insecure about “I’m not sure if I’m holding up the number one, and maybe I’m wrong.” By holding it right here, we’re doing a couple of things. We’re providing safety, we’re building trust, we’re giving students an opportunity to retrieve the information that they have just been taught. And again, you can adapt this approach to anything: How are you doing? Are you with me? Hold up a one if you’re feeling terrible. So this idea of the informal check-ins with students… you can also do online anonymous surveys using Survey Monkey, Google form, whatever is in the learning management system. Ask your students: How are you? What do we need to do more of? The stop, start, continue, survey is a really great model. What should we stop doing? What should we start doing? What should we continue doing? And then very importantly, if you do those kinds of surveys, which are really powerful and equity minded, you want to circle back to your students and say, “Alright, here’s what you told me. No, we’re not going to stop having our weekly homework assignments. Those are important. But here are some changes that I can do.” So informal check ins with your students, it does a lot of different things… key for me is demonstrate pedagogical caring, that we do care about our students. And we want them to be successful. And it helps our students to communicate to us if we need to slow down or provide another explanation, those kinds of things.

Rebecca: So I’m wondering, Flower, if you can talk a little bit more about some of these same kinds of practices, but in an online environment, in an asynchronous online environment, where sometimes it’s a little more difficult to figure out how to adopt some of these practices?

Flower: Yeah, great question, Rebecca. And thank you for kind of bringing us back to online because I have another huge takeaway for me [LAUGHTER] from the pandemic is that online, asynchronous, I think, is one of the most challenging formats to teach in. And I myself still struggle to see the students in my classes as real embodied people. It is so easy to fall into the sense that they are names on a screen, that they are tasks on a to-do list. And we know that our students don’t think we’re real. They tell us repeatedly… well, they don’t tell us they tell each other, they tell the media. My own daughters have said to me online teachers aren’t real. I kid you not. [LAUGHTER] During the pandemic they’re like “My teachers aren’t real people.” So very important, asynchronous while recognizing the limitations, and I don’t actually mean of the format in this case. I mean, the demands on people’s busy lives, because we know students who choose asynchronous online frequently need the flexibility. And maybe they don’t necessarily see the value of all the discussion forums and those kinds of things. So how do we do this relationship building, this increasing interaction? Certainly, I would argue that, as instructors, we need to be communicating with our students more often than not, and that can be announcements, it can be interacting in the discussion boards, not a ton, not dominating, but posting a guiding question here, or “that’s a great point” kind of there. We can be responsive in our assignment feedback, we don’t have to write a tome of comments. But even using an emoji or a quick comment to say, “I see you. I appreciate your work.” Some learning management systems make it very easy to record assignment feedback. Now, all of these, we need to hold in balance with the point I was making earlier about self care and holistic wellbeing for ourselves. I am not saying that we should become 24/7 chatbots, who are always available to our online students. I am saying they need more than what we might do. And we can also foster these connections to support their wellbeing with each other. So here’s one very quick example. I love an activity called “share one photo” and what this is, you can create this in an asynchronous class as an individual assignment, or as a discussion forum getting to know you kind of opportunity and if you do it… well, in either format, you could do this more than once. It could be an ongoing or an every other week, something like this. It’s a great way to intentionally structure social connections and relationship building. And what you do is you ask your students to look in their photo library on their smartphone, don’t go out and take a new photo, look in your photo library, choose one photo that is meaningful to you, write a line or two about why you chose to show that and submit it. And it’s worth points. Because it’s not just that we only focus on the class content, we focus on building relationships to help our students thrive. This can be really powerful, you will get different responses. If it’s an individual assignment, you make it more vulnerable images, if it’s a discussion post, you’ll have opportunities for students to connect with each other, like I was just saying, it doesn’t always have to be just you. But this is a way for students to choose what they want to share. It demonstrates to them that you care about them as people and not just names on a screen. And it can be a really powerful and fun way to see a little bit more about who your students are as people. I would certainly encourage that we do the same. Let’s also share one photo, help our students see us as real people as well.

John: One of the questions that has come in is from someone who is in a nursing education program, and the instructor notes that they use a lot of high-stakes exams and assessments in that. Do you have any suggestions on how they can move away from that? And I’ll just add a little bit to it, given that they do have high- stakes assessments as a criteria for licensing.

Flower: Yeah, great point, I was gonna make the same point there, John, thank you. There are disciplinary considerations to all of the recommendations that people like me come in and make. [LAUGHTER] And if you do have those accreditation exams, then part of your curriculum needs to be preparing your students to be successful on those high-stakes accreditation exams. So for me, a lot of times it’s about keeping things in tension, or in balance. We know that they need practice, they need to develop a comfort level with higher stakes, higher pressure situations. And honestly, I’m thinking about on the job, when you’re dealing with a patient, there could be a healthcare crisis that you need to be able to respond to. So, for me, preparing future nurses to deal with the pressure is part of the learning outcomes. But maybe, while they’re students, maybe we can balance that just a little bit. Maybe it’s not just about those high-stakes exams, maybe we balance out the grading scheme to award more points, as an example, for a weekly written reflection, where students can explain how they’re thinking about the processes that they’re learning about. If we have to, and I’m going to qualify… if we have to, for disciplinary reasons, have those bigger exams, because I’m going to invite us to think about: “Do we have to have those exams in this case?” Yeah, maybe. But maybe what we can do too, in a very equity-minded way is to offer retakes, offer test corrections, and a critical part there is to again structure a way for students to articulate where they went wrong, what they learned through this process. So kind of explain, how do I get this wrong? What did I need to do differently. So for me, it’s about balancing the grading scheme, thinking about equity-minded grading in terms of maybe you could build in the drop one exam, drop your lowest test, there’s a lot more that we write about that in the Norton Guide, which by the way, I want to say is actually available for free as an ebook. And, of course, I don’t have the link right in front of me. But maybe in the podcast notes, you can place the link to finding out more about that book, because it is freely available and has lots more of these kinds of ideas in it.

John: It’s a great resource, and we will share a link to that in the show notes.

Rebecca: We have a question that came in from Kristin Croyle, who is one of our previous guests on Tea for Teaching, and also is our Dean of the College of Liberal Arts and Sciences here at SUNY Oswego. And she asked, “What do you recommend for campus leadership approaches to support student learning and faculty staff wellbeing and what should we institutionally start, stop, and continue doing?”

Flower: Oh, I love it. Thank you so much.

Rebecca: No small question there.

Flower: [LAUGHTER] I know, right? Well, first of all, I’m going to actually focus on faculty. When we support faculty wellbeing it can translate most effectively to student wellbeing and success and equity. But one thing we haven’t really talked about today is how our own identities as instructors impact our day-to-day experience. And that can be a big question. It can be related to identities, our social identities, involving our race, ethnicity, gender, sexual orientation, it can involve lots of things. It can even involve the work… and I did this for literally decades… being an adjunct faculty and teaching just wherever I could, mostly online, so at least I wasn’t a freeway flyer, but recognizing that our individual faculty have a lot of demands, a lot of needs, and one size does not fit all from a campus leadership perspective. So recognizing and elevating the importance of attending to our individual faculty to maybe working with them to adjust teaching loads. There’s a lot in the recent media and literature about how some instructors who hold some marginalized identities end up doing a lot of emotional labor that many other identities may not, in terms of supporting students who are underrepresented, extra demands on their time. So let’s stop treating all faculty the same. Pie in the sky, let’s also stop with these untenable working conditions. But that’s a big one. Let us start paying attention to the individual wellbeing of the individuals who are doing this hard and important work of supporting our students and helping them to learn and grow and graduate and make a better life. And let’s continue having these conversations. This is the way we’re going to enact change.

John: We have a question from Christine Miller. And she asks, “While respecting academic freedom, how do we spread the good news of equitable and inclusive practices to resistant faculty and support these practices with our adjunct faculty?

Flower: Yeah, this is a great question. And the opportunity to work on the Guide to Equity-Minded Teaching gave us as an author team, which I do want to give a shout out to my brilliant co authors Isis Artze-Vega, Bryan Dewsbury, and Mays Imad. It gave us lots of opportunity to wrestle with this. And here’s exactly where we landed. I used a phrase earlier that has served me quite well. And that is to not blame and not shame. Let’s recognize that our colleagues, maybe those whom we support, whether we’re perhaps in an instructional design role, whether we’re in a leadership position, let’s recognize that every person is on their own individual equity journey. And we don’t want to judge somebody for perhaps not being in the place that we are, for being a little bit more resistant. The way that I think about it is that maybe we haven’t given them an invitation to slow down and think about things from a different perspective. Maybe they haven’t had that opportunity to see their accounting student trying to take an exam while their little brother was hitting them on the head. So let’s meet our faculty colleagues where they are. We talk about this with our students, too. Let’s meet them where they are, let’s help them to find a way in to what we’re encouraging them to learn and think about. Let’s not blame. Let’s not shame. Let’s extend grace. Let’s support each other. Let’s ask questions. Let’s tell stories. Because, as I just mentioned, the one with the accounting student and the exam, these are things that get people to think about things differently. So it’s a really important question. I’m asked this a lot. And we think about polarized political situations, you think about legislation that is being enacted around the country or being debated. And yet, of course, I’m gonna say this work is worth doing. It’s all the more worth doing. Let’s be strategic, and let’s be supportive of each other and not get frustrated with somebody who isn’t quite where we want them to be yet. We’re all on a journey.

Rebecca: There’s another question. There’s actually a bunch of questions that we’re not going to get to because they all came at the same time. But there’s another question here that says, “You mentioned the different circles of control for advocating for equity and advocating in communities. How do you seek out or help build those communities on your campus, and then build consensus on what that community can influence on the campus?”

Flower: For me, it’s about being intentional to dedicate time and I will try to be brief in my answers, so hopefully, we can get to a few questions if possible. Let’s be intentional with our own personal time to create those communities and work together. One example that has a long history is a book club. So maybe a group of folks on the community, on the campus, want to choose our new book, or any range of other really great books and set aside time in your semester to connect with other colleagues, working with your centers for teaching excellence, working with your instructional designers. These are ways that we can individually choose within our own circle of control to establish community with our colleagues and support each other in this work.

John: We have an anonymous question, which is: “If you were to create or select an emoji to represent [LAUGHTER] the road forward in higher education, what would it be?”

Flower: Wow, that is a good one. The first image that flashed into my mind is the big mountain [LAUGHTER] with a path going up. And I kind of like that because it can represent a couple of different nuances. It can be: we have a long way to go, we have an uphill battle. But it can also be: we have this amazing opportunity and challenge ahead of us and we can ascend and climb this mountain together. I’m going to leave it at that.

Rebecca: Well, thank you CIT audience members for your questions and engagement. And also Flower, for all your answers to not the easiest questions. But we always wrap up with one last question, as you know, and that is: “What’s next?”

Flower: Yeah, thank you. You may have asked me this question in March of 2020. And I have the same answer. [LAUGHTER] I am resuming work, working hard on a manuscript on effective teaching, applying emotion science to teaching with technology. I was working on that manuscript. This amazing opportunity to join the author team for the Norton guide came along, So I had to pause on the emotion science book, but I am picking it up in earnest, and I think again, it holds a lot of keys for how we can enhance equitable higher education for ourselves and our students.

Rebecca: I know it’s something we’re definitely looking forward to here.

Flower: Thank you.

John: And thank you for joining us. We really appreciate it, and it’s great to talk to you again.

Flower: Yeah, very nice to be here with you all and I hope it’s a wonderful rest of the conference as well.

Rebecca: So let’s give Flower a warm thank you. [APPLAUSE]

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

296. ChatGPT Chat

Since its arrival in late November 2022, ChatGPT has been a popular topic of discussion in academic circles. In this episode, Betsy Barre joins us to discuss some of the ways in which generative AI tools such as ChatGPT can benefit faculty and students as well as some strategies that can be used to mitigate academic integrity concerns. Betsy is the Executive Director of the Center for Advancement of Teaching at Wake Forest University. In 2017 she won, with Justin Esarey, the Professional and Organizational Development Network in Higher Education’s Innovation Award for their Course Workload Estimator.

Show Notes

Transcript

John: Since its arrival in late November 2022, ChatGPT has been a popular topic of discussion in academic circles. In this episode, we discuss some of the ways in which generative AI tools such as ChatGPT can benefit faculty and students as well as some strategies that can be used to mitigate academic integrity concerns.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Betsy Barre. Betsy is the Executive Director of the Center for Advancement of Teaching at Wake Forest University. In 2017 she won, with Justin Esarey, the Professional and Organizational Development Network in Higher Education’s Innovation Award for their Course Workload Estimator. Welcome back, Betsy.

Betsy: Thanks. It’s so good to be back.

John: We’re really happy to talk to you again. Today’s teas are… Betsy, are you drinking tea?

Betsy: Yeah, actually, I was really excited. I’ve Chai spice tea. I was really excited when y’all invited me back because I’ve actually made a decision to stop drinking coffee as much as I have in the past. So I thought I’d be into all these exotic teas by the time that we recorded this, but nope, just a boring chai tea for today. But maybe next time when I come back, I’ll have some interesting teas for you.

Rebecca: We’ll make sure we ask you to level up next time, Betsy.

Betsy: Great.

Rebecca: I have a cup of cacao tea with cinnamon.

Betsy: Nice.

John: And I have a pineapple ginger green tea today.

Betsy: You all are inspiring me. I love it.

Rebecca: Did you say pineapple, John?

John: Pineapple.

Rebecca: Is this a new one?

John: No, it’s been in the CELT office for a while. It’s a new can of it, It’s a Republic of Tea tea.

Rebecca: I feel like it’s not one of your usual choices.

John: You said that the last time I had this. [LAUGHTER]

Rebecca: Yes, I just don’t associate this tea with you.

Betsy: You have a block.

John: I think I’ve only had it on the podcast two or three times.

Rebecca: Just a couple. [LAUGHTER] I just don’t remember. Clearly. Okay. [LAUGHTER] We’ll move on. We’ve invited you back, Betsy to talk about ChatGPT. We know you’ve been writing about it, you’ve been speaking about it, and everyone’s concerned about it. [LAUGHTER] But maybe we can start first by talking about ways that faculty might use tools such as this one to be productive in our work.

Betsy: When I discovered ChatGPT, the way that I discovered it, which was back in December, was that I had a colleague who sent a screenshot of asking them to draft a syllabus. And so my first encounter was actually with ChatGPT, doing something that would help teachers. It’s also the case that I’m a teaching center director, so, of course, I’m thinking of these things, but it has certainly shaped what was possible. And it blew my mind what it was capable of doing in a great degree of detail, actually. And then about a month later, I was working on a curriculum project where I was having to draft learning outcomes. And that’s a task that we do in the teaching center a lot, and always getting it precisely right and not really sure what’s the different ways that we can phrase this so that it’s actually measurable. And so I just started playing around with what was its capabilities in terms of learning outcomes, and I saw that it was actually pretty impressive and generative there. And then back then, when there was only GPT3, I kept trying to see if it could do curriculum maps for us. And I really had to force it and really think hard about my prompts to get it to actually map outcomes to courses and curriculum. But then when GPT4 came out, I tried it again. And I thought I was going to have to do it step by step. But this time, I tried with a philosophy curriculum, and I said, I want 15 courses, I want them to have three to five outcomes each, students need to take a certain number of courses, we want them to have each outcome three to five times and just sort of gave broad guidance. And it gave me a full curriculum as well as a map. And it was actually a very good philosophy curriculum. So it came up with the outcomes. It came up with the courses, I was floored, and it was my first request. So there are many other things I think we can use ChatGPT for in terms of our teaching, but the curriculum was really, I think, one of the most complex things that I’ve seen it do.

John: I saw you do that. And so I experimented to have it develop a whole major program, with course descriptions and learning outcomes for the program, as well as for each individual course. And it did a remarkably good job of it.

Betsy: Yeah, I was amazed because I didn’t really give it much of a prompt. And it had within the philosophy major, like comparative philosophy, issues of diversity, environmental philosophy. So it wasn’t the typical things that you would expect in a philosophy major, it was actually quite innovative in some ways. And I appreciated that. From the perspective of a teaching center consulting with administrators and faculty on curriculum, one of the things we often see is that the little blurbs in our handbooks or bulletins for students to see the descriptions of the courses, they’re about 150 words. And often they’re very much teacher centered. So here’s the topic of the course: in this course, you will study this, this, and this. And one of the biggest challenges is how do we turn those into outcomes. And so I actually tried to do that too, is I went through our bulletin and just threw in those 150-word descriptions of the topics, and had them develop three to five outcomes that were measurable. And it did pretty remarkably. And so I think that could be a useful starting place. Again, with a lot of this stuff, you don’t want to just take it as is, but a useful starting place to help our faculty and our curriculum committees brainstorm. And in about a week, we are going to do a course design institute at Wake Forest. We do it every summer, and I’m really eager to have my colleague Kristi Verbeke, and my other colleague, Anita McCauley, experiment with using ChatGPT as part of the process in the course design institute to see if it helps them speed up or get more ideas as they’re generating various aspects of design of their course, not just outcomes, but all the way down the line of the steps of course design.

Rebecca: Sometimes it can be really hard to get started, but as soon as you have a start, you know what you want.

Betsy: That’s right. And one response you might imagine to the fact that ChatGPT can draft learning outcomes is you might imagine someone saying, “Well, that’s a clear sign that it’s pretty easy and meaningless tasks to think to be able to draft the learning outcomes.” But what I have found is that when I, not just my colleagues, but when I have a really concrete learning outcome that’s measurable, it helps me design the course better, like it’s just so much easier to think immediately of an assignment. But when it’s vague, and it’s kind of like, I don’t really have it really clear, in my mind, it’s so much harder to do all the other steps. And so even if we think it’s a somewhat trivial task, having ChatGPT help our colleagues come up with really clear learning outcomes will help speed up everything else, at least that’s my hypothesis and we’re gonna see how that goes this summer.

Rebecca: We’ve played around a little bit of using like those course descriptions that might appear in a catalog and turning it into marketing language, which is very different.

Betsy: Oh, that’s so interesting. And has it worked well?

Rebecca: Yeah, I think it’s definitely a starting place to move it to a different kind of language.

Betsy: So I’m teaching a first-year seminar in the spring, and I’m an ethicist, so I teach a course on sexual ethics. And the last time I taught it, I had a pretty conservative title. And it was interesting, I only had women in the class, cis women in the class, there were no men that had signed up, which had not been the case before when I’ve taught that class. So I actually used it to say, I want to attract a diverse group of 18 year olds, or 20 year olds, first-year students to this class, what are some titles or some quick summaries that I might use, and it was really fun to see some of the ideas it gave me. I ended up mashing a bunch together, again, taking pieces of it as an expert and pulling it together. But it certainly got me thinking in a way that would have taken me much longer if I didn’t have that help.

John: I used ChatGPT to create an ad for the Tea for Teaching podcast just to see how it would work and I posted it on Facebook, and I got quite a few responses from people saying, “I use this all the time in my work.”

Betsy: Yeah.

John: This is a tool that’s out there and that came up really quickly, but it’s still a really early stage of this. And a lot of faculty are really concerned about issues of academic integrity, and so forth. And we can talk a little bit about those. But we have to prepare students for the world in which they’re living. And the world in which they’ll be living is one where AI tools are going to be ubiquitous. So you do a lot of work with ethics. How can we help students learn how to ethically use ChatGPT, in college and beyond?

Betsy: Yeah, I think it’s actually a fabulous question. And one of the things I’ve often said, a lot of folks come to me to talk about ChatGPT in terms of teaching and learning. And of course, I have lots of thoughts about that. But I actually have been particularly consumed with reading about the much bigger questions about what AI means for humanity, to be quite frank. There are really dramatic and important questions that we need to think about. And in fact, I think sometimes what I have seen is sometimes people will think that that’s just hype: “Oh, that AI might take over the world, or that it might have these dramatic effects.” But if you actually talk to people who are experts in artificial intelligence, they’re really worried. And when the experts are really worried, it makes me very worried. So when we think about preparing our students, on the one hand, you can think about it as preparing them to use a tool that they need to use for their career, kind of like, “I need to teach them how to use Excel, or I need to teach them how to do basic productivity tools.” And that’s really important. Don’t get me wrong. In fact, like a lot of students don’t learn how to use Excel, and they don’t learn how to use these productivity tools. I have colleagues that I’m teaching these things to where I’m like, “Oh, you didn’t realize you could use this, it makes your life a lot easier.” But I think the bigger issues are preparing them to think about the potential implications to really understand what the tool is doing and what that means for how we understand human intelligence, how we think about consciousness. I mean, what it means for whether we want to have a world in which there are artificial intelligences that we might have moral obligations to. I mean, all sorts of huge, huge questions. Now, I don’t think all teachers need to address those issues. Just like all teachers probably don’t need to teach the technical stuff. But I certainly think when we are thinking about curriculum, it’s essential that our institutions think about helping our students think critically and philosophically about what artificial intelligence means. And I think perhaps my guess is like some of our students or like, our faculty haven’t played around with it a lot or kind of like, “it’s just another thing like Grammarly, it’s not that big of a deal.” But we have found at Wake Forest that when we invite experts in, so linguists, or computer scientists, or machine learning folks, or ethicists to come and talk about these tools and how they really work. Folks have their eyes opened, and then realize, “Oh, this is a bigger deal than we thought it was and we might need to think about regulation [LAUGHTER] and what comes next.” So policy issues, not just ethics issues as well. So we don’t have an answer except for the fact that we need to be talking about it. I have some ideas myself about what I think regulation should be, et cetera. But I do think our students shouldn’t just be seeing it as a tool to make their lives easier, although it is, it also is important for them to think through the implications for society. And then I guess also as another ethical piece, obviously, is that, as we address the issue of academic honesty, helping our students think about their reasons for choosing to take liberties that they were not authorized to do and thinking about their own character. And that’s going to have to be an approach that is somewhat different than just punishment to help our students behave in ways that we wish them to.

Rebecca: I know that my colleagues and I have had some really interesting conversations around AI related to visual culture and creating visual items, because a lot of the libraries of images are copyright protected. And what does it mean when you’re taking something that has these legal protections and mash them up into something new? And then whose property is it? So they lead to really interesting conversations, and so you start thinking about it as a maker and your work being a part of like a library of something, and then also, when you’re using work that’s created, what does that mean? So one of the things that we’ve been talking about is there’s policy at all levels, like what’s our departmental policy around these things? And what kind of syllabus statements or things might we do to be consistent across courses?

Betsy: Yeah, and I think one of the most important things, and it’s gonna take some time, is for all of us to get clear on what we think our policies or our positions are going to be about what is appropriate and what’s not appropriate. And then once we do, to really communicate that to students, because I think they’re in a place right now where it’s all over the map. And many instructors aren’t actually sharing that with them. And so I think that gets us in a fuzzy situation where students assume “Well, if this professor said this, then this professor would be okay with it.” And often it’s very different. And so how do we at least have a conversation at the beginning of the semester with our students about what we think? And I actually think, as you point out, Rebecca, it’s a learning opportunity too for students to co-construct some of those positions. So let’s talk about the reasons why we might want to not just say it’s a free for all. We can talk about the value of art and the value of our work as artists, and what does it mean to just use somebody else’s work without acknowledging it? And maybe there are ways to acknowledge it. And unfortunately, one of the challenges of these image generators is that we don’t necessarily know what it’s drawing on. And so that’s one interesting regulation is: could there be a way? I mean, I don’t know. It’s tough. So one of the challenges with the science of this stuff is that often those who create it don’t know how it’s working. [LAUGHTER] And they will tell you that, that it’s a black box. And so to be able to get in there and say, “Well, I will reveal it to you.” I think sometimes folks assume they’re not telling us because they want it to be proprietary. But often, they’re not telling us because they don’t actually know how the algorithm was developed or is doing its work. And so that’s a really tricky situation. But when we did a number of series of workshops for our faculty this semester, and one of them was we brought in some experts, and we had some copyright experts and some lawyers that came in and talked about this, and really fascinating questions about copyright in our work that, again, is a great opportunity for students to learn that question in a real live way that they see happening.

John: Going back to the whole issue of copyright, in terms of human history, that whole concept is relatively new. And when artists created new work, they started by copying the work of others, and they added their own twist. And in general, in pretty much all academic disciplines, the work that people are doing now is built on the work that others have done before, this. Is what ChatGPT is doing, in part, just the same type of thing that humans were doing, except instead of spending years learning how to do this, and building on it slowly over centuries, it’s doing it in a few milliseconds.

Betsy: Yeah, and I’m not an expert on arts, and so I’m sure there are lots of experts, and Rebecca, you can jump in here as well. But I would say that there are certainly questions about: Is it harming? That’s the question, often with ethics, we’re asking. Is itt harming anyone to engage in this practice. And even if we don’t know we’re using somebody else’s work, we often are. Our ideas build on one another, etc. But of course, in a capitalist society where artists make money based on their work, there become new questions about how do I preserve my livelihood in this particular context? Now, again, if there was a different context in which we supported our artists, so that they didn’t need to make money off of their work, because we gave them a basic income, there may be a different question involved there. And so actually, I mean, I think the economic questions, so I’m tying you both together here. So economics and art, this is great. The economic questions are really interesting about what does this mean for the future of labor? And how do we think about work in the future? I mean, granted, now, it seems like it’s not going to be immediate, but there might be long-term implications for all of us that we need to rethink as well. So I don’t know, Rebecca, you have thoughts about that?

Rebecca: Yeah. I mean, I think it’s interesting. I mean, John’s pointing really to the printing press is when copyright came about, when there it was easier and less time consuming to make copies of things. And then in 1998 copyright law changed again, because of the ability of making digital files, copies, so easy.

Betsy: Napster. [LAUGHTER]

Rebecca: Yeah, copyright law hasn’t kept up with technology over time. So there’s constantly these conversations about technology and creative work and what is it mean? I come from computer art. So generative art is a thing that we do, and that’s algorithm-based and you would argue that the machine is collaborating, in some ways, you write the algorithm. So I think there’s a trajectory of this has been happening for a long time. But it does raise a lot of interesting questions. And I think it’s really important for our students to grapple with, and really critically think about, and for us to critically think about together. In some ways, it’s nice because it gives us something to have a good constructive conversation around and really sort through it together.

John: And then maybe a less positive note, in terms of the economics behind this, there have been a lot of stories of people taking two or three jobs on and using chatGPT, to do two or three times as much work as they did before. And one of the issues I’ve addressed with my students in my labor economics class is, if we have these tools that can do the work that college graduates used to do, will there still be a demand for college graduates to do these tasks. Most technological change in the past ended up replacing less skilled workers, and provided a really nice return to those who had college degrees. But this type of innovation might very well be hitting a little bit more heavily on college graduates than most previous innovations.

Betsy: Yeah, it’s hard to actually talk about this, because I feel like every week it gets better and better. And so I could say, “Well, currently, here’s the set of skills, if we’re an expert, we can use it to sort of level up a bit.” So as I shared with just the curriculum mapping, I’m able to ask it things, and then because I’m an expert, I’m able to do things with it and ask appropriate prompts that push it right in the direction I want it to go and then I produce this wonderful outcome, ehereas sometimes I tried just to show my faculty to put in questions from like physics or something and I couldn’t really assess whether it was a appropriate answer or not, or how I had to push it. And so there’s part of me that thinks that there will be roles for expertise. But then again, how good will it get? Who knows? Will it eventually out compete us? …which is somewhat of a worry… but I do think that, at least currently, there’s still a role for the expertise to play a role. But you’re right, it’s going to just make it more efficient so that we can do more. And then the question is, if we’re doing more will we need fewer workers? Or will we just be more productive? All sorts of interesting questions there. I will say just a funny little story about this point about computer art and economics is our office is called the Center for the Advancement of Teaching. And our acronym is CAT. [LAUGHTER] So we make lots of jokes about that. And we have a serious logo. But all along we’ve been thinking like, we should have a fun, funny cat logo, like with an actual cat, we just haven’t had the money for it. We have this wonderful designer we work with, she’s amazing, we got a quote, we’re going to do it if we have money left over at the end of the year, but I was just playing around with Midjourney and like, what can it do for me? …and I mean, it’s not as good as hers will be, I don’t think, but it was pretty remarkable, especially since this is just a fun logo, it’s not like our serious logo, that I could just use it instead of paying somebody to do it. So this is the real sort of challenge is that it’s really maybe just the most advanced things that we’re still going to rely on experts for but maybe some of the basic stuff that we would have paid, we’re no longer going to do and what does that mean, economically?

Rebecca: There are some existing sources prior to AI that were like people who didn’t have degrees or didn’t have a background in design, who would whip up something for five bucks. [LAUGHTER] And sometimes it looks like it was whipped up for five bucks.

Betsy: [LAUGHTER] You probably would think that about my Midjourney examples. I’m sure Rebecca, I’m sure. Yeah. It’s so funny. So, this is the other thing too, is the students will eventually get better at this, like googling prompts. I went to this website that was like, “Here are these professional designers who design logos, ask it to do it in that person’s style?” Or “Here’s some language that you can use for the prompt like: vector, flat,” like, well, this sort of thing, or a mascot logo, which I didn’t even know that was a thing. But I guess if I want a cat logo, it’s a mascot logo, learning those things, which I never would have prompted, it actually helped me get something that was a little bit better. But it is fascinating. Yeah. And I think that’s true, in my experience with the tool in general is that the more you use it, the more you learn what it’s capable of. And I do think that a lot of our faculty have not really spent a lot of time experimenting with it for a variety of reasons. They’re busy, et cetera. But I often encourage them to really spend as much time as possible with it to really understand what it’s capable of doing. I was sharing with John, before we started this podcast, that plugins are now possible with ChatGPT. And the plugins just take it to a whole next level beyond even GPT4. And I’m still starting to play around with that. And I think it’s just something that, again, faculty need to be prepared for, because right now they’re saying, “Oh, it can’t cite things, or it can’t search the web.” Well, now it can. And what do we do about that? How do we keep up with it if we aren’t paying attention to it?

Rebecca: I think one of the things that you said earlier and alluded to when you were talking about the logo is needing expert language and expert concepts to be able to curate the prompts. So if students want to use tools like this in a productive way, they then also have to have a certain level of expertise, presumably, to do a good job. If we want to encourage students to be productive and use a productive tool in a productive way, what can we do to coach students? Do we want to coach students in this way?

Betsy: The question about whether we want to coach students is a really interesting one. There are folks, I think, who are anxious that if you teach them how to use it, they’ll use it in inappropriate ways. And my sort of response to that is we’re gonna have to address their desire to violate norms in a different way. That’s a different issue. That’s an issue of character. It’s an issue of ethics, because I think they are likely to do it anyway. Now it’s true, if they don’t really know how to do it, we might find it easier to detect it. But I’m guessing that, in a year, it’ll be harder and harder to detect it, even if they don’t know how to do it. But as of right now, I would say I think it is useful to teach them. I wasn’t teaching the spring, but I am teaching in the fall. And I’m really excited to think about. I’m not going to totally redesign my course, some people have done that, I’m not going to do radical changes, but just to engage in the conversation with them in the ways that it can be used. And I think some of the most important, honestly, are using it to explain material that they didn’t understand or using it to interpret my prompts if they’re weird, or my expectations. So helping the students use it to help them with their learning. So giving me feedback on my work, and I have a whole list of things that I would recommend, which is somewhat different than what we immediately think about when we think about students using ChatGPT. We think about them using it to write their papers, or to start, brainstorm, or give an outline. And all of those things might be great. But I actually think, as a person who’s interested in pedagogy, and particularly in student learning, there are only so many hours in the day, I have so many students, I can’t be with them one on one for 15 hours a week. But if there’s a way in which they can have like a tutor, who’s there with them to say, here’s what I think might be the explanation of that thing you didn’t understand, or let me help you interpret this paragraph and put it in the words for a sixth grader, or I’ll give you an analogy related to sports, if that’s what you know. [LAUGHTER] All of those things are amazing opportunities for our students to accelerate their learning. And that’s what we want. So it is true that these tools can be a threat to learning if students are just using them to write their papers in a literally copy and paste kind of way. But I also think there’s real opportunity to help them accelerate their learning. And again, you have to be careful, because it’s not perfect. And that’s your point about expertise. But I think, frankly, sometimes the advice they get from their friends, or if they go to the internet and Google it or YouTube, they’re not getting great advice either. So it doesn’t have to be perfect to be better than what they’re currently doing, is I guess what I would say? So I think that’s important. And then we could talk if you wanted to about how they might use it as a writing tool. I think it’s trickier there, of how we could ultimately and I’m sure you’ve heard this before in the previous ChatGPT podcast you did, it ultimately depends on your learning goals. What are your goals for your course, how you want to use it, but I do think there are certainly legitimate ways in which we can help students use it to help them learn more.

John: And just following up a little bit on that. I’ve heard of a number of faculty who are encouraging students to use it to create tutorials on specific topics where they may have a weaker background. And that’s certainly a very good potential use of this.

Betsy: And I even have experimented with like, “Okay, so give me feedback on this and then give me a learning plan,” like, “give me an improvement plan,” like, “what should I do? What steps should I take to get better at this skill?” …and it’ll actually give you pretty good plans. And it also can help them with time management, you know, “I have this many things I need to do help me prioritize what I should work on next.” And that’s good for us, [LAUGHTER], but it’s also really good for our students who really struggle with time management, I think. So I really do think there are a number of things that students can use it for, that I would feel comfortable with, but I also think it’s a really useful exercise for everyone listening or for any instructor to think through the possibilities. And you may decide these things are okay, these things aren’t okay, and it may differ for each class. But that is really important to do before you can actually communicate to your students what is and is not okay. And if you want them to actually do what you ask them to do, you have to have good reasons, I think. So you can’t just give them a rule, you should justify that rule, like with kids a little bit, you got to say why you think it’s the case to hopefully bring them along of why they wouldn’t want to just use the tool straightforwardly.

John: One thing I’ve used with some students, especially when I’ve talked to him about some of their uses of ChatGPT is, if all they’re learning in the course is how to type a prompt into ChatGPT and copy and paste that in, what types of skills are they acquiring there that’s going to be useful when they leave, because they could be replaced by anyone typing in those prompts.

Betsy: Right? What makes them unique. So one frame for this is the things we’re teaching students in school are useful for them. We want them to learn so that they can be productive in the market. That’s one way we often frame the work that we’re doing. But I think this gives us an opportunity to open it up a little bit wider where we think about the purposes of education beyond just what is going to be useful in the market. And so I sometimes will use the example of pottery… we’re coming back to art… is that I took a pottery class, after COVID, but it was like the first thing I wanted to do after we were back in person and so I took a wheel throwing class, and I was absolutely terrible. But the idea that I would go to Target and just cheat by bringing in something from Target that was made by a machine. No, there’s a reason I’m doing it. I want to actually learn the craft and the craft has meaning in and of itself, apart from the fact that yes, I could get a much better bowl [LAUGHTER] from Target than anything I will be able to create, but I’m really glad I’m doing it. And I think that’s really what’s gonna start happening is we’re going to start to see that there’s actually intrinsic value to some of these tasks, apart from their value for the, you know, am I gonna make more money later, etc, that we actually think that learning and thinking and the creativity that comes with producing is a value in itself. And that’s going to take a while to turn our students in that direction again, because there’s so market driven right now. But if things start changing in the market, and there are fewer and fewer jobs, they may be open to that conversation.

John: And maybe with the growth of alternative grading systems that try to shift the focus away from extrinsic rewards to intrinsic rewards, this could be quite complimentary.

Betsy: Yeah, and I know that we don’t want to talk all about academic honesty, but it is a real question. And so I don’t want to dismiss the faculty who are anxious about this. I was sharing before the podcast was recorded as well that the news about Chegg losing so much money in the past few months, was a real indicator to me that perhaps my optimism [LAUGHTER] about students not using it was ill placed, that in fact, that’s pretty good indirect evidence that a lot of students are now using ChatGPT to do what Chegg used to do for them. And so it’s not good for us, but it’s not good for the students. And so we do need to think about it. But I do think there’s sort of two broad approaches. One is like the punishment and enforcement approach, and then the other is prevention. And I think focusing on prevention is really where we need to go. And so referencing focusing on the intrinsic value of the work, maybe pulling away from those high-stakes graded assessments is a way to think about motivational changes of how we prevent students from engaging in these and I sometimes will use the example again, of the pottery class, like the idea that I would be motivated to cheat in a pottery class is absurd, like, why would I cheat at that class, because I’m just doing it for my sake. Now, if I was doing it so that I could get more money or so I could get this grade so that I could get into something else I wanted, then I might be willing and tempted to cheat in the pottery class. We know that students cheat because of the grade, they don’t cheat just because they think that’s the fastest way to learn. [LAUGHTER] They know they’re not learning, but they’re like, “I need this grade, because I need this degree so that I can get this job.” And so really bringing them back, decreasing that external stuff, and taking them back to the value of learning may be the only way we’re really going to tackle this. Now, it’s easier said than done. We’re all in a system where grades matter, and students need to get degrees and so it’s a longer conversation. But I do think revisiting some of the literature on cheating, even before ChatGPT existed is going to be really valuable for all of us.

Rebecca: So you’ve talked about moving towards more low-stakes opportunities, and we’ve hinted towards alternative grading, what are some strategies that faculty can use to assess student learning? We’re concerned that we’re not able to see whether or not a student is learning if they’re using tools like that, those are the conversations that we’re having.

Betsy: Yeah, so there’s things you can do to hopefully try to prevent it. But those may not always work. So I have a lot of ideas for how to prevent it. You can give them extrinsic reasons for using the tool itself. Like for example, I mean, this is just a simple one, but let’s say you’re teaching a math class, and you have an in-person final, and you tell them, “you’re going to be preparing yourself for the in person final by doing the homework yourself.” So there’s a kind of extrinsic reward of the final that’s in person will hopefully motivate the students to do the practice problems themselves, because they need to actually learn the thing that will get them that reward. But I do think if they do it, so again, lots of motivational things to talk about. But if they do it, first of all, how do we know is a really interesting concern. And I think that one interesting point that I’ve raised when I’ve had some conversations with folks is that I think a lot of people think when we’re talking about we need accurate assessments of student learning. The first assumption is that what we’re talking about there is we need to have grades that are just, so when we pass them on to like jobs, or to future courses, that we have just grades. But I actually think there’s a real learning reason why we want accurate assessments, is that if I can’t accurately assess your skills, you’re not going to learn. I actually want to know where you are really struggling, so then I can adapt my teaching to better help you learn. And if it looks like you’re doing great, I’m moving on, I’m moving on, I’m not going to actually help you learn that thing. And so it’s really important for learning as well that we have really accurate assessments of their skills. And so if they are using it, so how do we detect it? Tough one, but I think that’s where multiple measures. So you might imagine you have some in-class things that are happening, you’re not just lecturing. So this is a good reason for active learning as well. Because you’re engaging your students in class, you actually hear them speak in class and explain things to you in class. And if they’re struggling there, and then all of a sudden, they have this beautifully written paper, I think that’s a useful comparison. It’s no guarantee that that’s the case because sometimes students need time to reflect, particularly English as a second language learners need time to build their arguments, etc, rather than just being on the fly in class, but it is interesting evidence and that there’s people talking about oral exams and other possibilities or at least having conferences with the students about their work. So it’s not an exam, but just like let’s meet to chat about this. Now, of course, if you’re teaching a huge class, that’s not possible and available to you, but those that are teaching smaller classes, it might be. So I think we’re gonna have to be creative. I have not found a silver bullet here, I have heard lots of great ideas of things that could be possible, but all of them have trade offs, all of them come with downsides. And this is kind of my mantra all the time, when I think about pedagogy issues is that we should not get too absolutist about this, all of us are going to make different choices. And they’re all gonna have different downsides, and they’re all pretty reasonable, because right now, there is no obvious solution of what we all should be doing. I think some may choose to do oral exams, some may choose to do in-person, others may choose to say, “I’m not gonna pay as much attention as some others are.” And all of those things I think are reasonable. They’re just different approaches. And we should keep paying attention and be open to changing our minds if it seems like it’s not working. But I don’t feel like it helps us to be in sort of like one strong camp or the other when we think about the issues of academic honesty, and ChatGPT. So again, I don’t have an answer. Just lots of questions for you. But did you find anything that was useful over the past semester for you?

Rebecca: We teach really different things so our approaches are going to be very different. In my classes, we’re doing creative work. And so historically, and we continue to do this, documenting your process is part of the project. And so we see a project evolve over time. And that maybe involves using the use of AI as part of an input during that time, but documenting that as something that makes that happen. And we do critiques, we show things in progress, and we talk about it, and there’s feedback that’s recorded at those moments. And then if we’re not responding to feedback, then we’re not growing. So we have some systematic ways of demonstrating some creative process there and having to discuss and determine decision making around design decisions or creative decisions, like “Why did you make that decision?” And if it’s just like a random choice, then let’s be intentional about it. And now you need to maybe rethink that choice and make it more intentional. So those kinds of authentic learning opportunities really do kind of push it in a direction where it’s a lot more difficult to use AI as the entire thing. [LAUGHTER] It might be a part of the process, but it wouldn’t be the final output.

Betsy: John, I want to let you respond too, but what you’ve done is that one of the things about that, because that is certainly like doing authentic learning and process-based stuff. As you put it, Rebecca, it’s more difficult. But that doesn’t mean, and this is important, some people will say is that like, ChatGPT will tell you it’s process too, or you can ask it to give me processes, etc. So I do think, actually, one of the things that I think is I appreciate about your example is there’s a lot going on in class, there’s a lot going on, and it’s harder for folks who are doing asynchronous online courses. But if there are ways in which we actually see the process, and that’s kind of the authentic too, is that we’re actually not assessing a product, we’re literally live with them watching the process, I think we might be more likely to get some accurate things. And then if we just said, “Okay, we want you to write about your process, we actually want to see the process as most important.” So John, what about you,

John: The classes I’m most worried about are my large class, which has up to 400 students in it, and an online class that’s on the same topic with generally 40 to 50 students in it. And there’s some challenges there. In the large class, one of the things I’ve done since the start of the pandemic, is to shift all the assessment to online activities. I used to have a midterm and a final that were cumulative, they weren’t a tremendously large portion of the grade, there were lots of low-stakes tests that they could do over and over again. But the validity of those I suspect is going to be a bit different now. Because ChatGPT can do quite well with multiple choice questions and short answer questions and even algorithmic questions. So I’m probably going to bring back at least a midterm and final in person in my large class, just for the reason you described, the motivational thing… that you can practice these things as much as you want to learn it, but you’re going to be tested on this. And the greater your ability to recall and apply these concepts, the better you’ll be able to do on these things. And I wish I didn’t have to do that, because there’s so much advantage of letting students do things over and over again until they master things. But I’ve looked at some of the times on some of the quizzes I used this time, and students were turning them in [LAUGHTER] much more quickly than would have been possible had they not been relying on some sort of assistance.

Rebecca: Well, John, they’re just learning it so much better.

Betsy: Yes, that’s right. That’s right. That’s right.

John: And a nice side effect is you no longer get any spelling or grammatical errors.

Betsy: Yeah, you can read it faster as well.

John: Yeah, it makes it easier. [LAUGHTER]

Betsy: Yeah, no, and I do think as much as I think that we should trust our students, and I don’t want to be overly alarmist. There’s a lot of evidence that our students are doing it and even our students who would prefer not to do it, I think are doing it because they perceive that all the other students are doing it. So this was the same problem in the pandemic with academic honesty is that you have some students who will never cheat for whatever reason, [LAUGHTER] a small number… you have some students who will always cheat, they’ll find ways, they’ll pay somebody, whatever… they’re gonna find ways, and then there’s just a whole bunch of students in the middle who If the context really matters, and if they assume that all the other students are doing it, it puts them at a disadvantage to not do it. And we shouldn’t put our heads in the sand or assume that all of our students are not doing it. We shouldn’t also assume that our students are these horrible people, because they’re doing it, we need to recognize they’re doing it, and how can we help them create the conditions where they would be motivated to not do it to get themselves in trouble. And I do think your point, John, about the 400 students, about teaching an async online course, and even Rebecca, some of your description of what you’re doing in class. One thing that occurs to me, and I don’t have any illusions that this is going to happen, but I do think what these push against is our traditional model of how higher education happens. So we assume for the longest time that it was a lecture that took place. So that’s why 400 didn’t matter versus 20, we also assume that most of the learning would take place outside of class, because you would just come to a lecture and then you would go read the book and learn and teach yourself, basically. It’s kind of this old school model of like, the professor is just there to give you information, you’re going to teach yourself before the exams. And I think I can imagine a world in which, if we really want to see process, we need to be with our students more than three hours a week, and we need fewer students in the course. But that would be such a radical change to the economic model of higher education. I can’t imagine how expensive that would be. But it is more similar to K through 12. And in some ways, I think K through 12 folks have more of an advantage because they’re with the students so much more that they can actually watch them. And homework is less important. One of the most important things I always tell my students and have for years is that most of your learning will take place outside of class, and to emphasize that to them. And I think maybe now that creates a challenge because we’re not with them. And so we can’t sort of see whether they’re doing what we want them to do. So we really have to lean into the intrinsic motivation pieces of what is it that motivates them to want to do well, but with 400 students, they don’t know you really well, John, so they don’t feel guilty about like I have this relationship with my professor. It is tough. And I guess I would say on this point about academic honesty, and maybe we don’t have to keep talking about academic honesty. But I’ve seen a lot of faculty feel really guilty about their approach to this on both sides, like either they’re too overly harsh, or they have ignored it too much. And they’re super anxious about whether they’ve taken the right approach to academic honesty. And I think the most important thing I would say to instructors is this is really hard. Don’t beat yourself up about it, like you’re trying your best. And none of us have a perfect system. If we did, we’d be able to sell that, and it would be great. [LAUGHTER] We don’t have a perfect system. Some of us are maybe leaning one direction, and others are leaning in the other direction. And it’s really demoralizing when our students cheat, and then that makes us depressed as well. But also know that you’re not the only one that all of us have students who cheat and that’s unfortunately, part of the educational process. So do your best. [LAUGHTER] Pay attention. But don’t worry if it’s not a perfect outcome.

John: One of the things I was struggling with just recently as I was grading exams is how do I evaluate the work which is clearly the student’s own work, versus one that probably wasn’t the student’s own work. I don’t want to penalize students for actually trying.

Betsy: I think some people say like, “Ah, let’s just ignore it. It’s not my job to be a cop.” But I think the reason we want to actually do that is an ethical reason, which is that I don’t want the students who actually put forth the effort to be disadvantaged. So I think that’s the right impulse, John, yeah, for sure.

John: One thing I hope that doesn’t happen, though, is that we move to proctored exams online, and that we don’t move to more use of high-stakes in-person exams and so forth, because that would go against so many other things that we’ve been arguing in terms of equity and inclusion and so forth.

Betsy: Yeah, and also, these detectors. So TurnItIn, which most folks are using now, because many schools have TurnItIn, attached to their LMS. And so even before schools have had an opportunity to make a choice it’s default turned on. So your institution has to choose collectively to turn off the AI detector in TurnItIn. And so I think that’s important, too, to think about, like, are we just going to move to these detectors as a way of punishing students? And are they reliable enough? We don’t know. So there are all sorts of good equity questions. Actually, there’s a paper that I read in preprints, about how the detectors seem to flag international students more than those who speak English as a native language, in part because their grammar is better. [LAUGHTER] And so it’s more formulaic, because we’re teaching them the formula of how to speak English. And we need to be mindful of like, how do we balance these things,our equity concerns… and really they both are equity concerns, as you point out, John… so there are equity concerns about more high-stakes testing and in-person testing, etc. But if we just ignore it, there are also equity concerns for the students who do the work versus the probably the privileged kids who are just going to be like, “Whatever, I’m going to pay my $20 a month for GPT4, and be able to get the better answer to be able to use it.” So how do we come up with some sort of solution that balances those and we probably won’t be able to have… at least I don’t think there’s one… where there aren’t some harms? And so it’s really about like, which harms are we willing to tolerate while we work for a better solution? And that’s the hard part of ethical reasoning is that there’s not a solution where no one is harmed usually in these dilemmas.

Rebecca: One interesting thing you said like spending more time with your students, which I have the luxury of doing in a studio art space, we spend twice as much time with students for the same credit hours…

BETSY. Interesting.

Rebecca: …which is valuable. We see process, we get to know our students really well, it’s a relational space [LAUGHTER] for forming relationships. And that really does change the dynamic. But that’s a really big time investment, while the cost of faculty in the spaces but also students of certain backgrounds, or if they have to work, it becomes much more difficult for them to take those kinds of classes, because they’re offered at particular times, and they’re longer, they’re harder to schedule their job around, and that kind of thing. So there’s equity issues in that space, too, as you’ve alluded to, about being in person.

Betsy: Yes, being in person, and then also the point about extra time. I was on talking about workload before. One interesting thing related to workload is that we know, from the research on student learning, that time on task increases learning. And so sometimes I think when we talk about making things accessible to students who are working 40, 50 hours a week, what we’re really doing is reducing the work that’s required of them, which is fine, if it’s just about getting the degree, which I think you can make interesting ethical policy arguments that that’s really important, because economically, it allows them to advance, etc. But if it’s about learning, we actually shouldn’t be reducing the amount of time they’re spending because they’re going to learn less. And so then there’s that tricky question of if we need students to spend 40 hours a week on school, what do we do? We have to compensate them so that they’re not having to work, there’s much larger policy issues at stake here beyond just like, well, we just got to expect them to buckle up and do it, they got to work 80 hours a week now instead. So these are all tough things. And in the context that we are in, where we don’t have those amazing, policy based governmental solutions in the United States, we have to make compromises. And we may say, “Well, maybe a little less work for the students who are working is the compromise we’re going to make for the greater good in this situation.” But recognizing it is true that they’re probably learning less if they’re not putting in the 40 hours. So but maybe with ChatGPT, we can speed it up, I don’t know. [LAUGHTER] So, interesting things about efficiency.

Rebecca: So, we always wrap up by asking “What’s next?”

Betsy: So I’ll speak to related to artificial intelligence a little bit. So I am, in July, going to the Council of Graduate School summer workshop, New Dean’s Institute. They’ve invited me out to share a little bit about ChatGPT, and I’m really excited to be thinking about what’s distinct about graduate education with respect to these tools, it kind of merges my interest in faculty use, as well as thinking about student use as well, for learning. In addition to that, we’ve been talking a lot about how to prepare for the fall, when the faculty come back. We were sort of… just like, COVID… sort of flying by the seat of our pants in the spring, like, here’s some things we’re gonna roll out for you, we’d like to be a little bit more intentional in the fall. And so as I’ve alluded to in this session, I really do think focusing on motivation for students is going to be really important instead of detection. And so we’re gonna do a reading group, we’re gonna go back to Jim Lang’s Cheating Lessons, which still holds up pretty well, actually. And we’re going to do a reading group of faculty on that. And then we’re also going to read the Grading for Growth book that’s just coming out in July, which we’re super excited about alternative grading. I’m teaching in the fall, as I said, so excited to actually try some of these things out and see if my ideas are actually practical [LAUGHTER] or not. And hopefully, I guess I just say, what’s next? I hope there’s some regulation. So we didn’t get into a lot of details about this, because we were focusing on teaching and learning. But I know Sam Altman, and Gary Marcus were before Congress. And I do hope that we actually see, unlike with social media, that we see some movement for some regulation about the development of these tools. So I think what we have now… fine, let’s figure out how to use them. But it’s really anxiety inducing to me that these tools will develop skills that nobody planned emergently like, it’ll just, “oh, now it has this new skill.” And the more that we build these tools out, we don’t actually know what we’re going to create. And I think [LAUGHTER] that is a little worrisome to me. And so I hope that what is next is more regulation on the tools.

John: We should note that we are recording this several weeks before it’s actually released. And we hope that at the time when this is released, [LAUGHTER] we haven’t reached that AI apocalypse that so many people have been worried about.

Betsy: That’s right. That’s good, John, thank you.

Rebecca: Well, thank you so much for joining us, Betsy. We always enjoy talking to you.

Betsy: Thanks for having me.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

286. Grading for Growth

Traditional grading systems provide incentives for students to focus on maximizing their grades, rather than their learning. In this episode, David Clark and Robert Talbert join us to discuss alternative grading systems that encourage students to recognize that learning from mistakes is a normal part of the learning process.

Robert is a Professor of Mathematics at Grand Valley State University and the author of Flipped Learning: A Guide for Higher Education Faculty. David is an Associate Professor of Mathematics, also at Grand Valley State University. Robert and David are co-authors of Grading for Growth: A Guide to Alternative Grading Practices that Promote Authentic Learning and Student Engagement in Higher Education, which will be published this summer by Stylus Publishing.

Show Notes

  • Talbert, R. (2017). Flipped learning: A guide for higher education faculty. Stylus Publishing, LLC.
  • Talbert, Robert and David Clark (2023, forthcoming). Grading for Growth: A Guide to Alternative Grading Practices that Promote Authentic Learning and Student Engagement in Higher Education, Stylus Publishing.
  • Nilson, L. B. (2015). Specifications grading: Restoring rigor, motivating students, and saving faculty time. Stylus Publishing, LLC.
  • Grading for Growth blog
  • Robert Talbert’s other blog

Transcript

John: Traditional grading systems provide incentives for students to focus on maximizing their grades, rather than their learning. In this episode, we discuss alternative grading systems that encourage students to recognize that learning from mistakes is a normal part of the learning process.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guests today are Robert Talbert and David Clark. Robert is a Professor of Mathematics at Grand Valley State University and the author of Flipped Learning: A Guide for Higher Education Faculty. David is an Associate Professor of Mathematics, also at Grand Valley State University. Robert and David are co-authors of Grading for Growth: A Guide to Alternative Grading Practices that Promote Authentic Learning and Student Engagement in Higher Education, which will be published later this year by Stylus Publishing. Welcome, Robert. And David.

David: Good to be here.

Robert: Thanks for having us.

John: Today’s teas are:… are either of you drinking tea?

David: I am.

Robert: I am drinking tea. I’m more of a coffee guy normally, but I figured for the occasion I would bust the tea out.

John: What type of tea are you drinking?

David: I have, because its afternoon, a really lovely almost white jasmine right here.

Rebecca: Nice.

David: …really delicate and anybody who cares about tea is going to be horrified that I sweetened it with honey,

Rebecca: But it is in a really nice polka dotted mug. It is a lovely mug. Thanks.

Robert: And I have cheap stuff from the grocery store, because that’s my brand. This is a Bengal Spice by Celestial Seasoning, and my wife and I are addicted to this tea. We drink probably four or five cups a day of it, though to be honest when it’s cold out, but it usually is [LAUGHTER] here in Michigan.

Rebecca: And I have Jasmine dragon pearls today.

David: Oh, nice choice. Both Jasmine.

John: And I have spring cherry green tea. It’s a very cold wintry day here as we approach spring in upstate New York. We’re recording this a bit before it’ll be released, so by the time you hear this, we should be having the beginning of spring both here and Michigan, I’m hoping.

David: We hope, yeah..

Rebecca: Your tea choice is definitely a big wish for spring. [LAUGHTER] So we’ve invited you here today to discuss Grading for Growth. Can you talk a little bit about how this book came to be?

David: I don’t remember, Robert, if we were in person, or on a Zoom call or something, but I remember you saying at some point, I got a phrase for you: academic book about alternative grading. And I said, “You know, I need a project for my sabbatical.” And then I think it just happened from there [LAUGHTER], and so…

Robert: Yeah, we were in person, David. David and I, we’re not on the same hallway, we’re kind of on opposite arms of a T-shaped hallway. And so we run into each other, sometimes literally, at the intersection of these two hallways, and that happened one day. It was pre-pandemic, I guess. And it was just like, “Hey, Dave, I have this idea, Somebody should write a book about alternative grading. Because David and I have been using various forms of alternative grading in our classes for a while. And he was like, “Yeah,” and that was it. [LAUGHTER] But I think we were also tapping into some stuff that we have been hearing and around our Math Department and elsewhere, our colleagues outside of Grand Valley that started growing even three years ago, just a growing interest or dissatisfaction with the way grading is working. And we’ve been trying some stuff and thought, don’t you know, the best way to make change is to just get your ideas out there. And so this seems like the right place, right time for us.

John: So what types of alternative grading systems do you discuss in this book?

David: A pretty wide variety. And actually, something I’ll say, I think, both Robert and I tend to try to avoid labels too much for these, like there’s useful names to describe different approaches. But we do things like standards-based grading, specifications grading, ungrading, standards-based assessment. standards-based testing, but we look at a really wide variety of alternative grading approaches. And we’ve actually tried to come up with a framework that sort of describes what their common elements are, so that we don’t have to worry as much about names as what the useful features of them are. We found that people can really get locked into an idea of what, for example, upgrading means, and it’s not always a super useful thing to argue about with them.

Robert: Yeah, I would echo that too. Being mathematicians, Dave and I are both really into abstraction and so we look at these specific things that we see, but we’re more interested in the big, general overarching unification principles like what are all these models that are all good, and all applicable, in different places, to different levels of success, and what do they all have in common? And we do discuss ungrading, we do discuss specifications grading, standards-based grading, and a whole lot of approaches that are kind of in the in-between interstitial space, mostly through other people’s stories. I think the heart of this book and David’s real amazing contribution, what you really spend your sabbatical doing, Dave, was interviewing dozens and dozens and dozens of actual real life frontline professors, nobody is in one camp exclusively, everybody’s using some kind of combination, some kind of mix of all these different ideas. And so I think, to me, what the real contribution that our book makes is showing how different things can look, you can start from these basic building blocks, but real people with all kinds of different classes and life situations and professional situations are making this work by listening to their students and adapting appropriately.

David: I can’t emphasize enough how much variety there is in the people we’ve interviewed and the disciplines that they’re in, the types of classes they’re teaching, like it was an amazing thing to talk with all these people and see, okay, they’re able to use different types of alternative grading but absolutely across the board: in labs, in huge classes and tiny classes, and upper-level classes, and absolute freshman-level intro classes. And so it’s been just fantastic to hear how everyone’s doing this and try to put it together into something that could work for anyone, that everyone will find something useful.

Robert: Yeah, no two of them are alike either. And what’s even more amazing to me is that we had to cut a lot of those case studies. And we almost have enough material for a second book just for the case studies. We’re going to keep it on the blog, I think, unless Stylus wants us to do it. But, I mean, there was a lot out there that we don’t talk about in the book. So there’s more where that stuff comes from.

Rebecca: You mentioned that these alternative methods have some common themes or common threads. And maybe it would be helpful to talk about those common threads in relationship to the problems with traditional grading that lead people to these other alternative methods. Can you talk a little bit about that?

Robert: Well, I think one of the places that you begin to see some of the shortcomings of traditional grading is just looking at the history of where traditional grading came from. And it’s sort of a weird and checkered, and very short, history. Many of your listeners might be surprised to know that the current system of points based A-B-C-D-E-F, 4.0 GPA type of grading system is only about 100 years old. It’s a relatively recent innovation in higher education. Higher education, formally, is about 1000 years old. 1088 was the first university and the first readily identifiable grading system that we know of now is like 1890s. So it showed up very, very late to the party. And immediately it was co-opted by Industrial Revolution era approaches to teaching and learning which treated students more or less as subjects. The word “grading” really comes from agriculture, when it comes to like grading Grade A beef and grading grain and flour and that kind of thing. And pretty soon it became entrenched. And we have a situation now where when you look at where grading has led us, it’s highly questionable whether grades really do what we want them to do. And it seems almost certain that they do some things that we don’t want them to do. They lead to issues with ranking and sorting students, pitting students against each other. It’s not clear to me that the statistical validity of points-based grading is even well established. I mean, we put points on things, but they’re not really numerical data in any sense. Computing an average of points across a system of exams does not necessarily tell you how much a student knows. And that, to me, in my view, is the fundamental issue that I have with traditional grading, why I moved away from it. I just didn’t feel like the data was telling me anything.

David: I’d like to jump in on that one, in particular. A thought experiment that I think is really helpful for anybody to do is, let’s say you give a big exam, and a student takes it and they get 60%. So, most systems, that’s basically failing. What does that 60% tell you? What did they know? What don’t they know? Why did they do that poorly? Did they actually do poorly? Do they know 60% of the things that you’ve covered on that exam really well, and the other 40% not at all? Do they have a mediocre level of understanding of everything? Maybe they understand absolutely everything great, and they had a terrible day, and they had to get the kids to Grandma’s house or their work had to keep them late. Maybe they’re sick. All those things are wrapped up together, in that 60% and you just don’t know what it means. And then to add to that, if that student learns, and they really show great effort, and they can tell you later on, “Hey, I’ve got all this stuff, and let me show you how, maybe on like a cumulative final, that 60% is still averaged in and it’s going to permanently weigh them down and their final grade won’t represent what they actually came to know.

Robert: Right. And so grading really cuts against the very process that humans engage in when they learn anything. When I’m learning how to play a song on my bass guitar, and I play it once and I do terribly at it, if I eventually learn how to play it, people should not be looking back at the first time I tried it, [LAUGHTER] they should be looking at the last time I tried or the maybe the best time I tried it. That’s not how recording artists record. It’s not how athletes are ranked, and so forth. And it’s all because of this sort of Industrial Revolution era routes where we have everything measured and sorted out and put together and it inhibits growth. It sort of poisons our relationship with students, it leads to all these extrinsic goals that students now have. Rather than focusing on learning and growth, students get the idea that it’s wrong to fail at things the first time, whereas it’s actually normal to fail at things the first time and then grow from it. And I guess that’s where the name of our book came from, I forget where that phrase “Grading for Growth” popped up. It was way before we were asked for a title for our book. But it’s like that’s what we really want. We want to have a system, even if we must call it grading, we want it to be a system evaluating student work that focuses on and encourages growth as you are learning because that’s one of the great things about being human is that we do grow and we do learn from our mistakes. So where is it in our assessment systems? That’s kind of the fundamental question we’re asking.

David: So it might be helpful if we talk a little bit about this four pillars framework that we have in terms of where we go with that. We kind of spent a while trashing traditional grading here, and I could do that all day. So what did you do instead? What are the things you want to do instead of these things you don’t? And so from my point of view, the most important thing I want to know out of a grade is what does the student actually know? What do they learn? And so, as I said, we have this four pillars model, we talked about four pillars that any good rating system should have and one of those is really a clearly defined description of what it is you’re assessing. So we call it clearly defined standards. I don’t want to catch on to the name standards too much there, but a description of what it is you’re assessing and what it is that matters in that assessment. So how do you know that the student has achieved it? And what is it that the student has achieved? So in that way, that takes care of this issue of what does that 60% mean? 60% of what? And if you’re grading based on a specific thing that you’re testing a student about, then you can say, okay, maybe they’re achieved that or they have not achieved that specific goal. And then we try to incorporate in our other pillars, this idea of feedback loops. So humans work on feedback, they work on trying things multiple times, they work on trying and failing, and having to come back again, and that it should be the ultimate level of what they know, that really matters. So focusing on feedback, rather than focusing on numerical rates. So focusing heavily on feedback, on what’s happened, and how that relates to the standards or the specifications, or whatever the description is that they were trying to reach, and then making that feedback actionable so the student has a chance to actually act on that, and either through a new attempt show that they’ve got that idea, or through revising previous work, show that they come to understand it in a way that counts fully, so that they’re not penalized for needing multiple attempts, just like Robert was talking about with his bass, we’re not going to look at well, the first time you tried, it didn’t work out, too bad. We want to know, ultimately, where were they, so we shouldn’t penalize multiple attempts at understanding something. And finally, it feels like a technical thing, but it’s actually a really big move, moving away from points or percentages and instead, if you’re gonna put a grade on work at all, to make that grade something that’s sort of a descriptor of the feedback, something that basically says, you’ve met this standard or you’ve met these requirements or you haven’t and gives the students an idea of where to go next: you need to revise this, you should try this again, you’ve made it, something like that.

John: I know you’ve experimented with a variety of alternative grading systems. Could you talk a little bit about how you view some alternative grading systems in your own classes?

Robert: Sure, I’ll jump in on that. So around 2017, I described this in the book in my origin story where I came from with this. I had just taught a calculus class and I had just a terrible experience with grades. One student in particular, a fantastic student, she was the epitome of what we’re discussing here. She was on a 10 day delay from the rest of the class and after those 10 days were up, she’d be at the top of the class, but the exam is today, and so her exam scores just went down, down, down, down, down. It was just an awful way for a student to experience my subject. And so I started casting about and I read this book that had just come out by Linda Nilson, who is a legend in the area of professional development, and my former boss at Vanderbilt University. And it’s called specifications grading, and I said “What is specifications grading?” So I read this book, and I was converted on the spot. And I’ve been using specifications grading in almost all of my classes, except for one instance of ungrading last year, ever since. And so, I’m in various forms, and always tweaking, always experimenting, and trying to change things up. But, specifications grading is exactly along the lines of these four pillars that David is mentioning. There are clear content standards that we call specifications. The idea is not to give like points, but marks, to use a sort of a non-American term for those, marks that indicate progress, like you’ve met the standard, that’s what you get instead of a 10. Or you’re progressing, that’s what you get instead of a five, and giving lots of helpful feedback and especially letting students retry things without penalizing them for retry. To me, that’s like the thing that drives the loops. That’s been my main sort of area ever since for the last several years,

David: I’ve used a pretty wide variety of different alternatives. It’s come to the point for me where I think about all these different types of alternative grading systems that have names like standards-based grading, or specifications, or ungrading as elements to put in and they may be appropriate in some classes and not in others, depending on a whole bunch of factors. For example, I’ve taught intro level classes where I use a lot of standards-based grading where that means I’ve sort of divided up the topics into fairly fine-grained standards describing what a specific skill is, and what it would look like for a student to achieve it. And then the grade is essentially based on have they shown me that they thoroughly understand that, they can do the thing described in each of these standards and grades are based on meeting or not meeting those standards. And that can look like pretty traditional assessments, quizzes or exams or homework or such things. But instead of getting an overall grade, they get a mark, like Robert was talking about, for each standard. Yup, you’ve achieved this. Nope, you haven’t yet. Maybe they need to do it a few times. But that’s one element. It’s really useful for sort of discrete skills, intro level things. I’ve used specifications in a similar way that Robert is talking about. One of the strengths of specifications is that you sort of look at a student’s work holistically and say, “Have they overall shown me they can put these ideas together, understand the concepts, use all the different things that I think matter within this assignment,” and that works really well on written work… We’re mathematicians where students write proofs, it’s a detailed explanations of why something’s true, or in a project or in a portfolio or something longer than that. It’s really useful, maybe in upper-level classes or in places where I want students to show synthesis. And I’ve gotten pretty deeply into ungrading, or at least as I use the word ungrading, meaning removing grades entirely, even marks, in the way we’ve been talking about as another element that can be useful either in an entire class or just as individual things to do within some assignment. So I’ve covered a lot of this, I continue to push on what’s most appropriate in different classroom situations and different student situations.

John: I’ve tried some of the same things too. But one concern from a lot of faculty who have tried mastery grading systems or mastery quizzing and those types of things, is that it can put a lot more work on the instructor to do the grading on multiple attempts. In Linda Nilsen book, she suggests giving students a certain number of attempts, but limiting those. How do you keep the work manageable so that you’re not spending all of your time grading additional attempts, as students are working towards mastery.

David: Yeah, the thing you mentioned from Linda Nilson’s book, attempts without penalty doesn’t mean attempts without limits, and that is really important. And yeah, limits like that are one way to do it. There can be limits on number of attempts, or on frequency of re-attempting something or revising something once per week, once total, something like that. Those sorts of limits can just be really useful. And I know, I always encourage new instructors or people just starting to use these systems to start out limited, and then add flexibility because that way, they will be able to do it if they need to, and not do it if they don’t want to.

Robert: Yeah, you know, another thing too is, not just in the reassessments, but in your overall design of your course, including the grading system, you got to keep things as simple as humanly possible. This is something David and I just hammer home constantly, like every other paragraph ends with keep it simple, because people who want to mess around with grading systems are people who like tinkering with systems, and I am one of those people, and I know that when you start tinkering, it’s very hard to stop. And you end up with this massive Rube Goldberg like device that is your class and to you, it looks beautiful, but when you face it towards students… I mean, the first time I did specs breeding, I had 68 learning objectives that students had to meet throughout the semester and it was a nightmare. At the first of the semester, I thought, I’m a genius. I mean, look at this beautiful grading system I’ve devised. It’s going to revolutionize everything. And the only thing it did was give me a grading jail for four months. Just keep it as simple as humanly possible, and you’ve got to cut the work off at the source, I think. David and I wrote a book about grading, but we don’t like grading. I mean, nobody really likes the process of it. But it can be made at least a fulfilling undertaking if you are orienting it towards growth. But you still don’t want to be doing it 8-10 hours a day. So keep things as simple as humanly possible and put some limits on that. It’s okay to create a little bit of scarcity when it comes to the reattempt side of things. The feedback needs to be helpful that you give to students, but it doesn’t have to be incredibly lengthy. It might just be a couple of sentences, it might just be: “You did this really well, and this needs work.” …to kind of keep it right to the point, and then that helps the students who are on the other end of this too also experiencing a workflow possibly overload. And I worry more about them than I worry about myself. And so this makes it more likely they’re going to read your feedback if it’s shorter, more concise, and it makes it shorter to give.

David: Yeah, I want to emphasize that it can be a lot of work for students as well. Something that I suggest a lot is, if you want to use a system that emphasizes these pillars, especially reattempts without penalty, you’ve got to then think about those re-attempts as part of the regular workload of your class. Really what it means is you’ve got to think about the process of learning, that whole process, is part of the time that students are going to have to invest into it, and that you need to value that in your timeline for the class. So I like to think of maybe if you expect a student to work, however many hours per week on your class, account for whatever time each assessment takes, add another half for how much they might need to do revising or reassessing or reworking on things. And that can lead to really difficult decisions. You’ve got to cut stuff out if that’s going to happen. I don’t know, basically, anybody who looks at a classroom teaching and says, you know, there’s not enough in here. And so you got to make those difficult decisions, but it is worth it. Because what comes out of it is a student knowing things that are still in there way better than they would have otherwise.

Rebecca: I think one other barrier that faculty sometimes face is learning management systems, and how they guide you towards particular kinds of grading systems and evaluation systems. I wonder if you can share some tips that you have from your own experience of dealing with a learning management system to help you and your process rather than getting in the way of implementing some of these techniques.

Robert: We’re a Blackboard campus, and we’re making a transition right now and I’m honestly not sure how the new system handles those. But in at least the next to most recent version of Blackboard there was a thing called a schema, which is basically a way of going into your gradebook and defining a way to map number inputs to text outputs. And so I can set an assignment up to be graded on zero or one point. And then I can only enter in zero or one. But I could tell Blackboard if I enter in a one put “meets expectations” in the gradebook, and if I’ve put a zero put “does not meet expectations” or a happy face emoji and a frowny face emoji or whatever I feel like doing. And I have zero experience with any other learning management systems over the last 15 years, so I can’t really speak to that. But I know that many memory management systems allow you to customize the way that your numerical inputs present themselves in the students’ gradebook. And if you can find out how to do that, that’s the way to go, as far as I’m concerned.

David: And even if you can’t, the thing Robert mentioned, that essentially everything is a zero or a one, these systems all want to use points. So just refusing to play that game by making everything a zero or one. Even if students are seeing the zero or the one, it’s a lot easier to interpret the zero or one as success or not, than it is if you have points showing up somewhere else, and you’re trying to convince students No, no, no, when I put in a five, that meant something that doesn’t mean five points, that’s not going to fly. So limiting it to just a zero or one, a complete or incomplete, something like that works pretty well. That’s also true for spreadsheets. So if you just want to keep your info in a spreadsheet, they still want to work with numbers for the most part, but you can think of everything as a zero or a one. And then you start to change your mind from averaging or totaling things to counting. So I’m counting how many standards a student has completed, I’m counting how many assignments they’ve met the specifications on. And that’s really the same as saying, how many ones do I see here? One last thing is, everybody seems to have a different LMS. Even those of us who use the same one don’t quite use the same version of it [LAUGHTER]. So the best thing to do is to find someone who knows it really well and talk with them and say, “How do I make this type of thing display?” …and they probably know a way,

Rebecca: I’m gonna have this conversation with John about our LMS.

John: We’re using Brightspace from Desire to Learn, and it does have those capabilities.

Robert: And one thing I would say is that these days, as the ideas about alternative grading get more and more airplay, I think the tech companies are starting to listen to these things. I mean, you’re actually starting to build these things in as a competitive device like “Ah, you should adopt our LMS, because we can let you do ungrading and you don’t have to deal with all the hassle of hacking your own LMS. So I feel like ed tech companies should be paying attention to all this great interest that’s swelling up, it’s like this is a way to earn customers, honestly.

David: Something I’lll say most LMS’s do seem to do pretty well is to allow you to get feedback in a variety of ways. And so if you can de-emphasize that grade portion, just 0-1 or hide it or something, especially like I accept all assignments through Blackboard nowadays, giving feedback’s pretty easy on that. So that, in my mind, is a benefit.

Robert: Yeah, Blackboard does a really well, actually, that if you submit a PDF into Blackboard as an assignment, it’s easy to leave comments on it, and it keeps all the versions of it. So you can go back and easily see the students trajectory from the very first draft that they do all the way to the present day. And I think that’s really powerful, actually.

Rebecca: I’ve used rubrics to set up essentially specifications as well, like it’s met or not met.

David: Absolutely, yeah. If you know what you’re doing setting up rubrics, I don’t, that’s the problem for me. But if you know what you’re doing, that’s fantastic and it can also save you time.

John: Since the pandemic, there’s been an explosion of interest in ungrading. Does this approach work as well in all contexts, and for all students?

Robert: People are starting to use ungrading to mean anything other than traditional grading. And I think that’s leading to a lot of confusion, honestly. I was working with some teachers recently who were saying that, “Oh, I’m using ungrading but don’t have time, I’m being overwhelmed by all these quests for reattempts.” And it turns out, they weren’t using ungrading at all, they were totally grading thing. When we say ungrading, we mean like a specific approach to evaluating student work where nothing gets a mark, literally ungrading. You get a letter grade at the end of the semester, because most places require that, but it’s all based on a term that’s come up recently, that I really prefer, is collaborative grading. You’re working together with the students throughout the semester to talk about the quality of work, but nothing is getting a mark on it. I have a comment for you and you can either choose to iterate on that comment with a feedback loop or leave it alone. At the end of the semester, you’re going to sit down together and collaboratively determine what your course grade is based on the body of work that you’ve accumulated in some sort of portfolio situation with some clear standards for what an A would look like, a B would look like, and so forth. So that’s what we mean by ungrading. The explosion of interest in “ungrading” may or may not be all about ungrading the way we’re referring to it. So I just want to be clear about the terms before we answer this question.

David: And just add even another thing, it’s both that sort of umbrella term and what Robert just said and the general philosophy and a buzzword that people attempt to apply to random things they use. It’s unclear what someone means when they say ungrading.

John: When we’ve been talking about it, we’ve been talking about it exactly as you described as an extreme form of alternative grading where there are no grades other than one that is decided in consultation with the student at the end of the semester. And sometimes at midterm if that’s required in the institution. From what we’ve seen, this is used quite a bit in humanities fields, but it tends not to be used very much in the STEM fields. What are some of the barriers or some of the concerns that might be raised for ungrading in terms of in what contexts it may not work as well.

Robert: I have tried to fully ungrade a course once, and I might use it again. But the issue that I was coming up with with my students, is what I say is that ungradiing works precisely as well as students’ ability to self assess. If you have students who are struggling with the ability to self assess, or they’ve never tried it, or they’re new students, or younger students who maybe are still emerging with that idea… the whole thing about ungraded is that it’s predicated on students looking at their own work and self evaluating. And if that’s an issue, then I’m not totally sure that ungrading, as we’re defining it, best serves that population. I know I struggled with it. And this can be more me than anything else. Maybe I just don’t know how to draw students out and I need to work on that. It’s an area of growth for me, certainly. But if you have a population of students, for whatever reason, whose ability to self regulate or self evaluate is questionable, or kind of low, we’re not going to say bad students, because we’re all growing… it’s the whole point of our book… if you deploy ungrading with that population, you might be sort of targeting the weakest point in your class. And so maybe, in that case, some marks wouldn’t be such a bad thing, like use a specifications grading approach where the marks are just like: you’re progressing or you’ve met the standard. Just some kind of simple mile marker that shows students where they are. When I used this, once, it was an upper-level class, it did have a lot of writing in it, a math class. I would leave comments on their paper and I would just get questions like, so does it meet the standard or not. And I didn’t like to sort of be telling students this, but I felt like this is the way I helped them. I said like, “hasn’t met our standard yet, here is what you need to do.” So I thought, if I’m going to do that, why don’t I just put a mark on it? It seems like I’m just beating around the bush and trying to be cool by not giving marks and it’s like I’m thinking more about myself than I am about the students at that point.

David: I think that a general thing that everybody needs to think about when using any kind of alternative grading is, this is something new for students… almost guaranteed. And like any other new thing, it needs time to learn, you need to encounter it a few ways, you need to try to make sense of and probably fail initially, and then come back and you’ve got to work to understand it. Ungrading is sort of an extreme form of that. There’s more that needs to be understood about how it works, there’s more skills that need to be built. And I think, as instructors, we need to think about that and think about teaching how our evaluation systems are working and how the grading is going to work. And think about what skills we need students to build up in order to successfully engage with those. And ungrading asks a large amount of that. And I say this, as I very much enjoy using ungrading also in some upper-level math classes and I think it’s worked pretty successfully for me. But this sounds funny to say about something called ungrading, it requires scaffolding, it requires helping students build up that ability to self evaluate, advocate for themselves, to be able to understand what it is that matters in that particular system. But what I just said is also equally true for standards-based grading or for specifications grading, but with different skills that they’re building up. It’s also true for traditional grading, although it feels more familiar to students, but it still requires some scaffolding for them to understand what exactly is going on in the evaluation in this class.

Rebecca: Can you talk a little bit about some of your own experiences with ungrading and how you have done some of that scaffolding, what some of those early stages of scaffolding might look like, to understand the system.

David: So initially, I was having I think it was three check in meetings per semester, where I would meet with every single student in my class, like a 10- or 15-minute discussion, and we would talk about where they’re at. And that inevitably brings out students’ questions, and they don’t understand this part of they don’t know what that is about. And so that was one thing that I did, right? Those were the collaborative aspects of ungrading, and it was overwhelming, it was too much to meet with every single student that often. I still love being able to meet with students. And I use that as one of the tools in the toolbox. But nowadays, to sort of help build that up, I have a system where… this is actually done through homeworks for me… it’s like periodic homeworks and there’s some mathematical content. And there’s also some little additional thing where I ask a question, and early on, it might be something like, “Okay, what is a specific goal related to… and then I might have some of the math related content in the class or as a specific goal you’d like to work on related to this.” And that’s a fairly small thing. I ask students to say something along the lines of “I really want to work on improving my understanding of this one thing” and I can either respond to that as “Okay, great. Here’s the way I can suggest that you work on that,” or I can respond to it as… well, I don’t say it this way, but… “I can see that you’re having trouble elucidating the goal and so let’s talk about that” instead. And then another week or two down the line, there’s another maybe slightly higher-level task having to do with assessing themselves or thinking about their progress in the class. And so they’re scaffolded and I can, at each stage, see if a student is succeeding, in sort of the way that I’m looking for them to be thinking about their progress. And if not, then I can pull in a, “Hey, let’s actually meet and talk about this. And then I’m gonna give you a task to practice with that.” It’s really individualized, which can be a tough thing. But for me, it’s really fun to actually see students grow in that particular way, in addition to growing in the mathematical content.

Rebecca: So faculty that want to move to less traditional methods, what are some small steps a faculty could take to get started?

Robert: Well, I really appreciate that question. Because we don’t ever want to give the impression that you have to go all in on one particular grading system in order to like, be cool, or be a good professor or whatever, because everybody’s in a different position. Some people may not be in a position to ungrade, and we are never going to come out and say, “If you really care about students, you will do ungrading or you’ll do standards-based grading or whatever.” It’s like people care about students all over the place and just can’t or have mitigating circumstances. So I would say we laid out these four pillars: clear content standards, helpful feedback, marks that indicate progress, and reattempts without penalty. If a professor takes one of those pillars, and kind of drills into it on just a handful of assignments, that’s definitely progress in the right direction. So for example, you could take your next test you’re gonna give, experiment with letting students reattempt it, or reattempt different versions of it. So go one test, one class, allow reattempts without penalty, or give feedback that really gets to the point, not gives points, but gets to the point of what’s being done well and what isn’t being done well. Just pick one of these four pillars and just go with it. There are some small scale methods you might think about, let’s say, instead of grading your final exam, how about ungrading your final exam. Just say you need to lay out some standards for what constitutes successful work on your final exam and maybe that’s like 70% on the content. And then you got to write some reflective essays, and say, if you don’t meet expectations on the final exam, that’s a minus on your course grade, or something like that. So you can roll in aspects of alternative grading systems, whatever seems to resonate with you on small-scale individual assignments. And that’s really good progress. It’s really good data for you as the instructor too. You run these experiments, you ask students how it went, and then you just make notes and you iterate on that. It’s exactly the same thing that we asked students to do in these grading systems. You try something, you get feedback on it from a trusted third party, you iterate on it and try again.

David: I want to add one thing, because this is something that I always see happen when people first start using some kinds of alternative grading. Just for yourself, write a really quick list of what you think the major topics are in your class, aim for 10 to 20 things that are the important things to get out of the class, and then go pick some of your exams or quizzes, or whatever, and match them up. “Oh, on this one I was addressing these things and on this one, I was addressing those things.” And that can help you actually think about, “Oh, you know, I’m not really addressing this thing in my assessments at all, that I said was really important.” Or “Holy Moly, I have hit this one thing over and over and over all the assessments at the cost of not covering a bunch of others.” The first time you do this, even if you’re not showing students what the standards are, it can be amazing. “Wow, I’m not assessing what I say matters.” And that can adjust just how your assessments are focused.

John: Sounds like you’re advocating a backwards-design process where you start out with clearly defined objectives, and then you make sure that there’s alignment. And also, I think it might be important to make sure that students see the connection between those things, and that it’s a transparent process, which I know is something you’ve advocated in terms of your work on assessment.

David: Absolutely. And sharing your reasoning with students I think is very valuable, bringing something in from above and saying we shall now do it this way, because I said so, doesn’t work and you’re gonna get a lot of pushback, but talking with students about why you’re doing things and how it’s good for them, that makes a huge difference.

Robert: And don’t call it an experiment, okay. [LAUGHTER]

David: Yeah.

Robert: I’ve read some syllabi lately. It says, I’m going to be experimenting with this experimental new experimental grading system. And of course, you know what that is going to sound like to students… that I’m the subject of an experiment. What am I doing here? And so you’ve instantly killed your buy-in.

David: I’ll actually say, I don’t even give names to what I’m doing. So I am ungrading a class this semester, I have never used the word ungrading or any other name for it. I find that giving a name to things like that can help people sort of reduce it down to like a one dimensional idea, rather than engaging with what it actually is. I’m just “Oh, this is what we’re doing, and here’s why we’re doing it this way.”

Robert: Yeah, I have to share this story. When I started doing specs grading I did actually put we are using a thing called specifications grading on my syllabus. So, I got a call from our research office on our campus, they had gotten a call from the parent of one of my students complaining to them that I was experimenting on their child without informed consent, that I needed to give an informed consent form to my students before this happened. And I thought, well, that’s a weird flex from a parent and they call up the Office of Research Compliance [LAUGHTER] and complain about the Professor, but as you can just see even just the barest mention… Just tell students what you’re doing, and why you’re doing it. If I have to name it, nobody cares what the name is, it may not even have a name. And all this we mentioned before, that most of the people we interviewed for the book are not using any sort of canonical form of anything. It’s just like a little bit of this, a little bit of that, like cooking in your kitchen, you don’t use just one spice, you combine them, that’s where you get your unique flavor of what you’re doing.

John: Would it be fair to say that, given the title of your book and focusing on grading for growth, that one of the things you’re addressing is how to shift students from focusing on trying to maximize their grades to maximizing their learning?

Robert: Yeah, absolutely, yeah. I think a lot of frustration that I know I feel and I hear from other faculty is students tend to spend an order of magnitude more time talking about what they have to get on exam X to get grade Y than they talk about the actual content in the course. And we teach math, and I think some of the students who struggle the most with our math are doing like these amazing statistical calculations to try to figure out what the average has to work out to be. It’s like, “where was this in my actual math lesson?” I remember riding the bus home one day, from our downtown campus back to where we live, and I overheard this conversation and I said “Oh, this is this has got to come to an end.” [LAUGHTER] And absolutely, we want students to focus on their growth and I think students want to focus on their growth, too. I mean, students really, in the end, don’t want to think about all this stuff. They want to think about, “How am I growing as a human being? Is when I’m doing really meaningful? Where am I as a learner? Do I have any value in this vast educational system that I’m entering into?” And so if we can even just orient one small thing, like our grading system, towards convincing students that they have value, and are human beings in a stage of development, I think that’s worth it.

David: And that means we need to believe it, too. So I like to tell people who are thinking of using an alternative grading system, think about why you’re doing it, and what your students are going to get out of it. But definitely approach it as like, “Okay, I care about my students, and I want them to succeed.” And we’ll sometimes talk about incentives… grading systems set incentives in a class, and that can feel sort of like you’re trying to mess around with people and then incentivize you to do things a certain way. Traditional grading systems set incentives that are really kind of perverse towards learning. And if we can change those incentives, or just remove some of the ones that aren’t as good, that’s really a lot of what we’re aiming for here. And yeah, just respecting how people naturally want to learn anyway, that just allows them to do what they are as human beings going to do anyhow, or what they would naturally do.

Rebecca: So everyone wants to know, when can we have your book in our hands?

Robert: Well, it looks like on the Stylus website, it says July. So that’s what we’re going with for now. [LAUGHTER] I guess it’s sort of out of our hands at this point. We have one more round of copy edits to do. But it says July, you can preorder it now through the Stylus website and should be in your hands this summer.

John: My preorder has already been sent in. [LAUGHTER] So I’m waiting for a copy.

David: Awesome.

Robert: Awesome. Thank you.

Rebecca: And you mentioned earlier something about a blog. Do you want to tell us a little bit about that?

David: Yeah, if you’re interested in some of our ideas, go check out our blog, it’s gratingforgrowth.com …all spelled out. So, Robert and I started this sort of as a way to workshop some of our ideas for the book. So you can see proto-ideas. And we’ve also posted some examples of some of the case studies of some of these interviews that I have done with people using a lot of different alternative grading systems there. Every week, we post something new, or we have guest posters. There’s a really huge variety of ideas that show up on there.

Robert: And if any listener wants to contribute a guest post, we are accepting applications at this time… not really applications, just reach out. And we’re looking to hear. Now that the book is kind of close to coming out, we’ve had this discussion, you and I, David about where does the blog go from here once the book is out, and I feel like a great use of our time is to elevate the voices of other people. I mean, there are so many people out there doing great work, who are not education rockstars, they’re not on the lecture circuit or whatever. They’re just rank and file heads down people doing great work in the classroom. I love those people getting their ideas out there and seeing what they’re doing. So to me, that’s been a really rewarding experience.

David: So gradingforgrowth.com.

Robert: Right. It’s actually a substack. You can subscribe to it. It is free. It’s never going to cost anything and it comes every Monday. Except for taking planned breaks for holidays, we haven’t missed a Monday in two years.

David: Well, now you’ve cursed us, Robert. [LAUGHTER]

Robert: No, I put the pressure on me because then I got to step up. I think I’m next, actually. No, you’re next.

David: Oh, crap. [LAUGHTER]

Robert: Sorry, Dave.

John: We will put a link to that in our show notes.

Robert: Great.

John: Are there any other topics that you’d like to emphasize?

Robert: Well, I think I would just re emphasize simplicity. I mean, simplicity is the ultimate sophistication. I think Leonardo da Vinci said that. And so, when you’re designing a class simplify as much as humanly possible, and no more. But I think your students are going to be well served by less, honestly. I think we tried to do way too much in our classes, and we will be well served by this too. I mean, I have another blog that deals with productivity and time management in academia. And that’s the key thing. I mean, a lot of faculty struggle with overwork and burnout or just doing too much and there’s a lot of stuff you can say no to and I think keep things very, very simple and that can be a whole lot. podcast about how to simplify your life in higher education, especially applyied to course design and grading systems. You don’t want to make choices in July when you’re planning your fall courses that you end up regretting by October.

David: I will say that something that did come up earlier, briefly, but there’s not one right way to do it. You should not feel like you must go all out ungrading, you shouldn’t feel like you have to do specifications grading exactly the right way. Find something that works for you, look for models, pick and choose the things. If you look at something and say, “How could that possibly work?” then don’t do that. And yeah, we’re not judging you. Find something that works well and it’s going to be good beer students.

Robert: Yeah, and especially the last thing you just said, David is so important. All this stuff is predicated on actually communicating with your students. Don’t just sort of wait for the course evaluations. You have to really get in and talk, actually talk with your students on a regular basis and get feedback and see how things are going. And that’s one of the great strengths of all these four pillars sort of oriented approaches is that it really does get students talking with each other and with their faculty members. And I think that’s, maybe in the end, the best thing about all this.

Rebecca: Well, we always wrap up by asking what’s next?

Robert: Well, for me, I know I’ve been spending the last two years not only as a faculty member, but working in our president’s office under what’s called a presidential fellowship. And I’ve been coordinating large-scale institutional cross-institutional teaching and learning initiatives, mostly focused on active learning spaces. And so that’s been a particular focus of mine for a few years. That is wrapping up now. But we’re looking at maybe some interesting and exciting extensions of that idea where we’re going to try to surface and looking for what our faculty are already doing in terms of instructional innovation. There’s a lot of stuff out there, like we said earlier, but even in our own institution, a lot of faculty are doing really innovative and creative things and effective things but are kind of working under the radar. So the President and I, and those around us, are kind of thinking how can we look and find these faculty, get them together, elevate what they’re doing, and sort of make Instructional Innovation a normative practice at our university. So that’s that’s kind of what’s next for me is figuring out how to make that work on a practical level.

John: Sounds like a wonderful plan. I know, we’ve been talking about some ways of doing the same thing at SUNY-Oswego. And it’s a challenge.

Rebecca: It’s no small task. [LAUGHTER]

Robert: It is, it is.

David: Something that I am getting more and more interested in is what helps instructors be successful in any kind of educational innovation, not just alternative grading and changes in their pedagogy, anything like that. But especially when it comes to grading, there’s so many variations. And in so many different situations where instructors are working, what are the things that help them best succeed? And what are the things they do that help their students buy in and succeed most? And so looking at those sort of things from a more fine grain perspective, I think it’s going to be somewhere that I’m going next.

Rebecca: That sounds exciting.

John: It does. And I hope you’re both come back and talk about the success of these initiatives in future podcasts.

Robert: We’d very much like to.

David: Absolutely.

Rebecca: Well, thank you so much for joining us and sharing your stories. And I know that many people are looking forward to your book.

Robert: Thanks a lot for having us.

David: Yeah, it was great to be here. Thank you

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

John: Editing assistance provided by Anna Croyle, Annalyn Smith, and Joshua Vega.

[MUSIC]

276. Teaching at its Best

New faculty often start their faculty roles without training in teaching. In this episode Linda Nilson and Todd Zakrajsek join us to talk about the evolving roles and expectations of faculty and explore the new edition of a classic teaching guide.

Now Director Emeritus, Linda was the Founding Director of the Office of Teaching Effectiveness and Innovation at Clemson University. Todd is an Associate Research Professor and Associate Director of the Faculty Development Fellowship in the Department of Family Medicine at the University of North Carolina at Chapel Hill. Linda and Todd are each individually the authors of many superb books on teaching and learning and now have jointly authored a new edition of a classic guide for faculty.

Shownotes

  • Zakrajsek, T. and Nilson, L. B. (2023). Teaching at its best: A research-based resource for college instructors. 5th edition. Jossey-Bass.
  • Nilson, L. B., & Goodson, L. A. (2021). Online teaching at its best: Merging instructional design with teaching and learning research. John Wiley & Sons.
  • Nilson, Linda (2021). Infusing Critical Thinking Into Your Course: A Concrete, Practical Guide. Stylus.
  • McKeachie, W. J. (1978). Teaching tips: A guidebook for the beginning college teacher. DC Heath.
  • POD
  • Betts, K., Miller, M., Tokuhama-Espinosa, T., Shewokis, P., Anderson, A., Borja, C., Galoyan, T., Delaney, B., Eigenauer, J., & Dekker, S. (2019). International report: Neuromyths and evidence-based practices in higher education. Online Learning Consortium: Newburyport, MA.’
  • Padlet
  • Jamboard
  • Eric Mazur
  • Dan Levy
  • Teaching with Zoom – Dan Levy – Tea for Teaching podcast – May 26, 2021

Transcript

John: New faculty often start their faculty roles without training in teaching. In this episode we talk about the evolving roles and expectations of faculty and explore the new edition of a classic teaching guide.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guests today are Linda Nilson and Todd Zakrajsek. Now Director Emeritus, Linda was the Founding Director of the Office of Teaching Effectiveness and Innovation at Clemson University. Todd is an Associate Research Professor and Associate Director of the Faculty Development Fellowship in the Department of Family Medicine at the University of North Carolina at Chapel Hill. Linda and Todd are each individually the authors of many superb books on teaching and learning and now jointly have authored another superb book. Welcome back, Linda and Todd.

Linda: Thank you very much.

Todd: Really appreciate the opportunity to be here.

Rebecca: Today’s teas are: … Linda, are you drinking tea?

Linda: I’m drinking a tea called water. It’s rather dull, but I enjoy it.

Rebecca: It’s very pure.

Linda: Yes, very pure. Very pure.

Rebecca: How about you Todd?

Todd: Oh, I’ve got myself a Lemon Detox because I’ve spent most of my day getting all toxed and now I’m getting detoxed. [LAUGHTER] Wait a minute, that sounds bad. [LAUGHTER] But that will be all right. [LAUGHTER]

John: Especially at Family Medicine.

Todd: Well, we can fix it. [LAUGHTER] In general, life is good.

John: I am drinking pineapple green tea.

Rebecca: Oh, that’s a new one for you, John.

John: I’ve had it before, just not recently.

Rebecca: Okay. I’m back to the very old favorite, English afternoon. Because I stopped by the Center for Excellence in Learning and Teaching and grabbed a cup before I came.

John: And we are recording together in the same room, which has been a fairly rare occurrence for the last several years. We’ve invited you here to discuss your joint endeavor on the fifth edition of Teaching at its Best: a Research-Based Resource for College Instructors, that Linda originally developed and now you’ve collaborated on this new edition. How did the collaboration on this edition come about?

Linda: Well, let me talk about that. Because it was pretty much my idea. Jossie-Bass contacted me and said “let’s put out a fifth edition” and I said “let’s not.” [LAUGHTER] I was not in the mood to do it. I’ve been retired six and a half years now and I’m loving it. I mean, I’m really loving it. And while retired, I was still writing the second edition of Online Teaching at its Best. And then I was writing a book, Infusing Critical Thinking Into Your Course, and I guess I had had it. I mean, I wanted to really make a change and I wanted to get specifically into working at an animal shelter. So I was all occupied with that. So I thought I remember Wilbert J. McKeachie, when he was doing Teaching Tips that he came to a certain point after I don’t know how many editions that he brought other people on to really do the revision work. And so I decided I’m going to do that. So Jossey-Bass said “Okay, fine.” They wanted three names. Okay, I gave him three names, but my first choice was Todd Zakrajsek, because 1. I knew he’d finish it. [LAUGHTER] I knew he’d finish it fast. I knew he do a great job. He knows the literature like the back of his hand, I wouldn’t have a worry in the world. And guess what? Todd accepted. Hip hip hurray. I was so happy. I couldn’t tell you.

Todd: Well, this is great because I said no when they asked me. [LAUGHTER]

Rebecca: Like any smart person would, right? [LAUGHTER]

Todd: Well, I did end up doing it, of course. But the reason I said no was I knew that book very well and I know Linda very well. And I said, “There is no way. I don’t know anybody who can step in and pick this thing up. She knows so much about so much that it’s just not possible.” And they said, “But she really wants you to do this.” So I went back and forth a couple times and I finally decided to do it. And I will tell you, Linda, because I haven’t mentioned this to you. The first three chapters, I had to go back and redo those when I got done with it, because I was so scared of the first three chapters [LAUGHTER] that it was really rough. And then finally it’s like, okay, I hit my rhythm and I walked into it with impostor syndrome a little bit, and I finally caught my footing, but it’s a good book to start with.

Linda: Thank you. Thank you very much. [LAUGHTER] Yeah, I know, the plot thickens, right? It becomes more interesting as you go from chapter to chapter, right. And before you know it, there’s a happy ending after all.

Rebecca: So Linda, Teaching at its Best has been around for a long time with a first edition published in 1998. Can you talk a little bit about how that first edition came about?

Linda: Yes, that was…I can’t believe… 1998. That’s 25 years ago. It’s almost scary how time flies. But anyway, the actual seed of the book came about in about 1994… 95. But I need to give you some background because I had been writing TA training books since like, the late 1970s when I was first given the task of putting together a TA training program. So back then, I was putting out weekly mimeos,[LAUGHTER] remember mimeograph machines. Some of you don’t know, what is she talking about? But anyway, that was technology then. But anyway, smetl great, though… it really did. [LAUGHTER]

Rebecca: That’s the second time today someone has made a reference about the smell of those.

Linda: Yeah, oh yeah.

John: The dittos are what I remember having the stronger smell

Todd: The ditto did, yeah. yeah, and I’ll tell you before we move on, when I was a graduate student, we had a ditto machine. I just have to say this, Linda, because you liked the smell and all there.

Linda: Yeah, Yeah.

Todd: But they had a ditto machine. And below the ditto machine, I noticed that the floor tiles were kind of eaten away by the ditto fluid. [LAUGHTER] And then here’s the best part is that one day I was rooting around in the closet looking for something and I found the extra tiles in a box and the side of the box said “reinforced with long-lasting asbestos.” [LAUGHTER] So the ditto fluid was eating through asbestos lined tile, but that’s how strong that stuff is. So yeah, we all enjoyed the smell of that stuff back in the day..

Linda: Yeah, yeah. I guess it’s a good thing for all of us they invented something else, like copying machines. So anyway, so I started doing that at UCLA. And then that turned into like a booklet of sorts. And then I was at UC Riverside, and I was writing books there. And I sort of revised it every couple of years. And I was also writing these with my master teaching fellows. So we were doing that. And then I came to Vanderbilt, and I decided, well, I’m going to do this, pretty much on my own, I’ll get some help from my master teaching fellows. But anyway, it turned into an actual book. I mean, it turned into a happy monster. And I was very pleased with it. Well, along about 94-95, my husband recommended that I turn it into a regular book, and talk to a publisher about it. So anyway, I said, “Oh, great idea. Great idea and just sort of didn’t think about it much. Then in 1996, he died. And I thought, “Well, how am I going to pull myself through?” I bet it would be a great idea and a great tribute to him if I took Teaching at its Best, the Vanderbilt edition, and turned that into a general book. And I decided to do that and kept my mind off of bad things. And it turned into Teaching at its Best, the first edition. That’s why I dedicated the book to him, by the way, because it really was his inspiration that got me to do it. And so anyway, tribute to him. So that’s where the first edition came from. I mean, it really grew out of tragedy. But it’s been a comedy ever since, right? [LAUGHTER] So anyway, it’s been a wonderful thing.

John: And it’s been a great resource.

Rebecca: It’s interesting that it pulled you through, but then has pulled many teachers through. [LAUGHTER]

Linda: And I’ve gotten such feedback from faculty members who said, “I saved their lunch,” you know, if they were really in big trouble, and some of them said, “I was in big trouble with my teaching and you got me tenure.” Yeah, like, right. But anyway, the book helped a lot of people. And I guess maybe something in me when I first published this book said, “Gee it would really be great to be the next Wilbert McKeachie, right, which is a very pretentious thing to think. But then they wanted the second edition, I was thinking, “Hey, maybe I’m on the road to something.” And then there was a third, and then there was the fourth. And it didn’t get any easier to write the subsequent editions really, it was just a matter of keeping up with the literature. And so right now, I’m off into another corner of the world. So I just didn’t want to immerse myself in that again.

John: So that brings us to the question of what is new in the fifth edition?

Todd: Well, that’s my question. I’ve known Linda for the longest time. By the way, I do want to mention before we go on, I can’t remember, Linda, if it’s been that long ago, but it might have been the second edition. When at POD, I said, “You need to do a second edition of this book” …or second or third. But I was using the book. I mean, I learned so much from it. So for the new edition. Number one, of course, the research has been updated only because the research is always changing. And it had been a few years. So that’s number one. In terms of changing the book, though, we only have a leeway of about 10,000 words. Now, for those out there listening 10,000 words sounds like a lot of words until you’ve got a 200,000 word book, it was about 190. And they said, you can’t go over 200 Because the book just gets too big then. So it is 10,000 words longer than it was in fact, I think it’s 10,003 words longer. So it’s right in there. [LAUGHTER]

Rebecca: So you snuck an extra 3 words in.

Todd: It could have been a squeeze to put three words in there. And it’s always hilarious because when they say there’s just a few too many words I just start hyphenating things so yeah, it kind of all works. [LAUGHTER] Yeah, just any words at all. So you can do “can you” as just a hyphenated word. It works. [LAUGHTER]K So is that terminology, the terminology does change and I find this fascinating. One of the things I love to write about books is learning. I mean, Linda, the same thing what as we write, we read a ton of stuff. And as we read stuff, we learn stuff. So this one in particular, for example, is that I grew up with PBL as problem based learning. And I had done workshops on it, I had worked on everything else, but I hadn’t looked at it for quite a while. And in this particular book, as I started looking at PBL, I couldn’t find anything on problem based learning. And it was fascinating because I was doing some digging, and then I called Claire Major, who was an early person who had a grant on problem based learning and everything I ran into was about 2002, it just started to drop off a little bit, and there was some, but it started to tail off. And when I talked to Claire, she says, “Oh, yeah, I used to do quite a bit about that, it was back around 2002-2003.” And now, and the reason I’m saying this is, every time I saw the letters PBL, it was project based learning. And project based learning sounds a lot like problem based learning, but they’re different concepts. And so anyway, going through and finding some of the terminology, so it was consistent with what’s being done right now has changed. There is now a chapter on inclusive teaching, because over the last three or four years, we finally realized that there’s a whole lot of individuals who haven’t been successful in higher education, partly because of the way we teach. And so I’ve been making an argument for a few years now that teaching and learning, the classroom situation has always really been based for fast-talking, risk-taking extroverts. And we’ve suddenly realized that if you’re not a fast-talking, risk-taking extrovert, you may not get a chance to participate, classroom and other things. So I looked at some different things with inclusive teaching. There’s a whole another chapter on that. And then just the language throughout, we talk a little differently now, just even over the last three or four years than we did five, six years ago, I was pretty surprised by that. But there’s some pretty significant changes in language. So the book has a slightly different tone in language, and those are the biggest changes. Oh, I should say, before we move on, one of the biggest other changes, and I did this one, Linda put a section in there that said learning styles had changed significantly from the previous edition. And so she had pointed out that there was no longer a section on learning styles. And I put the learning styles right back in there, I told Linda and she gasped just a little bit. And then I explained that I put it back in there, and then said exactly how terrible it was to basically teach according to learning styles, because it’s the myth that will not die. So that’s back in there.

Linda: People love it. I know. [LAUGHTER]

John: We have that issue all the time, students come in believing in them and say, “Well, I can’t learn from reading because I’m a visual learner.” And I say “Well, fortunately, you use your eyes to read,” and then I’ll get them some citations.

Todd: Well, I’ll tell you, and before we move on, these are the types of things we learned. I couldn’t figure out why the thing is so hard to die. What is it that’s really doing this because other myths we’ve been able to debunk. And part of the reason is licensing exams, when you are in pre-service and you want to become a teacher, the exams you take to become a teacher, a large portion of those exams, have learning styles questions on there. So you have to answer about visual learners and auditory learners and kinesthetic. And so until we get those out of teacher education programs, we’re teaching teachers to believe this. So anyway, there you go. Public service announcement. Be careful about meshing. And if you don’t know what meshing is, look it up and then stop it. [LAUGHTER]

John: We have had guests on the podcast who mentioned learning styles, and then we edit them out and explain to them later why we edit out any reference to that. And I think most of them were in education, either as instructors, or they’ve been working as secondary teachers. It is a pretty pervasive myth. In fact, Michelle Miller and Kristen Betts, together with some other people, did a survey. And that was the most commonly believed myth about teaching and learning. It was done through OLC a few years back, about three or four years ago. Yep,

Todd: Yeah, I saw that survey. Yes, it’s pretty amazing. Michelle’s an amazing person.

Rebecca: The experience of the pandemic has had a fairly large impact on how our classes are taught. Can you talk a little bit, Todd, about how this is reflected in this new edition?

Todd: Things have changed pretty significantly because of the pandemic. There’s a couple things going on. Again, the inclusive teaching and learning, which I’ve already commented on, is really different now. And it’s interesting, because it goes back to the 1960s. We’ve known that, for instance, African Americans tend to flunk at twice the rate of Caucasians, in large machine-scored multiple choice exams. So we know it’s not the teaching, and we know it’s not the grades, it has to be something else. And it turns out that it was you put students into groups and those differences start to disappear. So I mean, even more so the last couple of years, it’s a lot of engaged learning, active learning. I’m still going to pitch my stuff that I’ve been ranting and raving about for years. And there’s no data out there that says that lecturing is bad. What the data says is that if you add active and engaged learning to lecture, then you have much better outcomes than lecture alone. But we’re learning about those types of things in terms of active and engaged learning, how to pair it with and mix it with other strategies that work, looking at distance education in terms of systems and how we can use technology. So a quick example is I used to have a review session before exams. And oftentimes, it’s hard to find a place on campus to have that. And so you might be in a room off in one hall or the library or something. And if the exam was on Monday, I’d have the review session at like six o’clock, seven o’clock on a Sunday night. And there are students who couldn’t make it. I would simply say, you can get notes from someone else. And we’ve known for the longest time, if a student misses class, getting notes from somebody else doesn’t work. Well, now I do review sessions on Zoom, we don’t have to worry about finding a place to park, we don’t have to worry about some students finding babysitters, if they’re working, it’s recorded, so they get the exact same thing. So things like Zoom have really changed teaching in a sense that you can capture the essence in the experience of teaching and use it for others, and it has helped with some equity issues. You can’t do it all the time. And teaching over Zoom is different than face to face. But there are now ways of using different technologies and using different modalities to help to teach in ways that were not really used before the pandemic.

John: Speaking of that, during the pandemic, there was a period of rapid expansion in both the variety of edtech tools available and in terms of teaching modalities themselves. In the description of your book, it indicates that you address useful educational technology and what is a waste of time? Could you give us an example of both some useful technologies that could be used and some that are not so useful? And also perhaps a reaction to the spread of bichronous and HyFlex instruction?

Linda: Yeah, I’ll take this one. And I’m drawing a lot of stuff from another book that I co-authored, with Ludwika Goodman. We were writing about Online Teaching at its Best, okay. And she was an instructional designer. And I came from teaching and learning and we put our literature’s together. And we were talking about modalities a great deal, especially in the second edition with the pandemic. Well, one thing I found out, not only from reading, but also from watching this happen was that this Hyflex or bichronous, whatever you want to call it, is a bust, if there ever was a modality, that’s a bad idea it’s that one, even though administrators love it because students can choose whether to come to class and do the things they would do in class, or to attend class remotely? Well, yeah, it sounds like “oh, yeah, that could be good.” But the technological problems, and then the social problems, especially the in-class social problems are enormous. And in-class social problems, like small group work, how do you hear what’s going on in the classroom over this low roar of small groups? Okay, so how can you help? How can the students that are learning remotely, what can they do? Now, the way this was invented, by the way, was for a small graduate class, and then okay, like, makes sense, because you’re only dealing with six students in this room and six students who are remote. But other than that, it’s so bad, the logistics, the sound logistics, the coordination that the instructor has to maintain, the attempt at being fair to both groups, at bringing in both groups, when the groups can’t even hear each other well. Now, if we had Hollywood level equipment in our classrooms, we might be able to make this work a little better, but we don’t, and we’re never going to have that. So there are just a lot of technological and social reasons why HyFlex, that’s what I called it in Online Teaching at its Best, what it was called at the time is a complete bust. Now, not to be confused with hybrid or blended learning, which we found has worked exceedingly well. So bringing in some technology, but into a face-to-face environment and that being the base of the class. Now, remote’s nice, but you might not want to do remote all the time for all things. It’s not quite the next best thing to being there. But it’s something and as long as you don’t just stand there and stare at the camera and lecture for an hour. You’ll get complaints about that quickly. And particularly with students today when they really need to be actively involved, actively engaged. So yeah, sure, fine, talk for three minutes, maybe even push it for five, but then give them something to do and you really, really must in remote because otherwise, you’re just some talking head on television.

Todd: I agree completely. In fact, it was funny because I happen to have a digital copy of the book here. And so I typed in a ctrl F and I typed in HyFlex and there’s one comment to the preface that said there’s many different formats out there and then I will tell the listeners, if you’re expecting to learn about HyFlex, the word never shows up again in the book. [LAUGHTER] So, it’s not in there. I mean, you look at the literature that’s out there. And I think it’s fair to say that maybe there are people who can do it. I haven’t really seen it done well and I think Linda’s saying she hasn’t either. And it’s so difficult, especially for a book like this. That’s not what we’re all about. I mean, again, if it even works well, which I’d love to hear that it would be a very advanced book and that’s not what this is. So we do have a lot in there about technology in terms of edtech tools, though. There are those in there, I would just say real quickly, for instance, Padlet’s one of my favorites, I’ll throw that out there. I like Padlet a lot. But there are tools out there, if you want to do a gallery walk, which for instance, if you happen to be in a face-to-face course, you’d set up maybe four stations with big sheets of paper, you put your students into groups, and then they walk from sheet of paper to sheet of paper, and they move around the room. And they can do what’s called a gallery walk. You can do the same thing online with a jamboard, you can set up jamboards so that there’s different pages, and then each group is on a page. And then you just say it’s time to shift pages, they could shift pages. So I’ve done gallery walks, and it’s worked well. I’ve used Padlet for brainstorming. And one of the things I love about Padlet, I’ll have to say is if you are doing some digital teaching in a situation, you can watch what each group is developing on the page for all groups at the same time. I can’t hear all groups at the same time when I walk around the room. So there are certainly some technologies coming out that can really do things well. There’s also things that don’t work very well, though. And I think one of the things you want to keep in mind is just learning theory. Does the technology you’re using advance students, potentially, through learning theory? Does it help with repetition? Does it help with attention? Linda was just mentioning attention, if you lecture too long, you lose their attention. If you do something ridiculously simple or not… I was gonna say stupid, but that sounds rude. But if we do something as a small group that makes no sense, you don’t get their attention either. So using clickers, I have to say, I watched a faculty member one time because they were touted as a person who was very engaging. And this is at a medical school, so I really wanted to see this. And the person used clickers, but used it in a way that asked the students a question, they responded, and the instructor looked up at the board and said, “Here’s how you responded, let’s move on.” And then moved on to the next thing. And about five minutes later gave another question said, “How do you respond?” and they clicked the clicker, and then they moved on again. That had no value at all, and in fact, there was no actual interaction there. So afterwards, I say, can’t you just ask a rhetorical question and just move on? We got to be careful not to use technology just because it’s being used, it should advance the learning process.

John: However, clickers can be effective if it’s combined with peer discussion and some feedback and some just-in-time teaching. If it’s just used to get responses that are ignored, it really doesn’t align with any evidence-based practice or anything we know about teaching and learning. But those per discussions can be useful and there’s a lot of research that show that does result in longer-term knowledge retention when it’s used correctly, but often it’s not.

Todd: Right. And I think that’s a really good point. I’m glad you said that, because Eric Mazur, and his concept tests, for a large extent, that’s where active and engaged learning really took off. And that is a clicker questions. And they can be used as great tools. But again, if you’re using it for the right reason, which is what you just said, My comment is, there’s technology out there, that is a waste of time, and not a good thing to have, because it’s just not being used in a way that’s conducive to learning. So good point, that’s fair.

Rebecca: Can you talk a little bit about who the audience of the book is?

Linda: Sure. It’s actually for anybody who teaches students older than children, I suppose, because it isn’t really designed for teaching children. But other than that, it’s really for people who teach but don’t have the time to read a book. The nice thing about Teaching at its Best is you can go to the table of contents, you go to the index, you could find exactly what you need for your next class. And it’s very oriented towards how to, so it could be for beginners or for experienced people who simply haven’t tried something specific before, or want a twist on it, or just want some inspiration. Because there there are a lot of different teaching techniques in there. And they’re all oriented towards student engagement, every single one of them. But I wanted to comment too, on just how the job of instructor or professor has changed over the past, I don’t know, 40 years, I suppose. I know when I started teaching it was a completely different job. And I started teaching in 1975, when I was 12, of course, but no and I was young to start teaching because I was 25 and there I was 180 students in front of me. So oops, my goodness, what have I done? But that’s exactly what I wanted to do. But you’d go in there, you’d lecture and you’d walk out. You were in complete control of everything. Like, you might throw out a question and you might get a discussion going. But it wasn’t considered to be essential. In fact, there were two teaching techniques back then: there was lecture, and there was discussion. And nobody knew how to do discussion. Now, I had to find out a few things about it when I was doing TA training, because TAs were supposed to be running discussions. But there wasn’t a lot out there. Thank God for Wilbert McKeachie’s book Teaching Tips, because that was about the only source out there you could go to. So anyway, but now the job, I mean, oh, it’s mind boggling what faculty are now expected to do. And they are supposed to, like, learning outcomes. Okay, I love learning outcomes. They’re wonderful. But I didn’t have to do that when I started, I just had to talk about my subject, which I dearly loved. And so, that was nothing. But you’ve got learning outcomes. So you’ve got to be like, a course designer, you have to deal with a student’s mental health problems, right? It’s part of the job, and you’re expected to respond to them. You’re supposed to give them career counseling in careers that you might not know much about, and possibly for good reason, because you’re in your own career. It’s so time consuming, not to mention fair use, oh, yes, fair use has changed, fair use has changed radically. And when you’re dealing with anything online, the rules are totally different. And you’re highly restricted as to what you can use, what you could do. When you’re in a face-to-face classroom, it’s a little bit easier. So yeah, so you got to be a copyright lawyer to stay out of trouble. And then you get involved in accreditation, you get involved in that kind of assessment. So you have to all of a sudden be totally involved in what your program is doing, what your major is doing, where it’s headed. There’s just too much to do. And there are more and more committees and oh, there’s a lot of time wasted in committees. Of course, you’re supposed to publish at the same time and make presentations at conferences. It was like that back then, too. But now, the expectations are higher, and it’s on top of more time in teaching, and more courses. I was teaching four courses a year, and you can’t find that kind of job anymore.

Rebecca: So Linda, you’re saying the animal shelter is going really well now?

Linda: Yes. Yes. Yes. Yes.

Todd: That’s hilarious. Well, I want to point out too, and I think Linda’s said it very, very well is that we are expected to do things we never had to use before. Never worried about before. And I love the fair use is great, because when I first started teaching, and I’ve been teaching for 36 years, when I first started teaching, you’d videotape something off TV and show it in class and then put it on the shelf. And I knew people who showed the same video for 10 years. Right now you better be careful about showing the same video for 10 years. But these are things we need to know. I would say also, by the way, this is a really good book for administrators, anybody who would like to give guidance to faculty members, or better understand teaching and learning so that when promotion and tenure comes along, you get a sense of this. And so if you’re saying to the faculty, they should use a variety of teaching strategies. It’s not a bad idea to know a variety of teaching strategies. And so I think it’s good for administrators as well, and graduate students. But I want to take a second and tell you, one of the reviews of the book, I guess, came in just yesterday or the day before from Dan Levy. He’s a senior lecturer at Harvard University. And what he put was Teaching at it’s Best is an absolute gem. Whether you are new to teaching in higher education, or have been doing it for a while, you will find this book’s evidence-based advice on a wide range of teaching issues to be very helpful. The style is engaging and the breadth is impressive. If you want to teach at your best you should read Teaching at its Best. And I love what he put in there because it doesn’t matter if you’re a new teacher or you’ve been doing it for a while, this book’s got a lot of stuff in it.

John: And Dan has been a guest on our podcast, and he’s also an economist, which is another thing in his favor. [LAUGHTER]

Todd: That is good.

John: I do want to comment on lenders observation about how teaching has changed because I came in at a very similar type of experience. I was told by the chair of the department not to waste a lot of time on teaching and to focus primarily on research because that’s what’s most important, and that’s the only thing that’s really ultimately valued here or elsewhere in the job market. But then what happened is a few people started reading the literature on how we learn And then they started writing these books about it. [LAUGHTER] And these books encouraged us to do things like retrieval practice and low-stakes tests, and to provide lots of feedback to students. So those people…[LAUGHTER]

Rebecca: I don’t know any of them.

John: …but as a result of that many people started changing the way they teach in response to this. So some of it is you brought this on to all of us by sharing… [LAUGHTER]

Linda: I apologize.

Todd: Sorry about that.

Linda: I apologize.

Todd: We apologize and you know, I will say too is, so yeah, sorry. Sorry about doing that. But I’m glad you said that.

Linda: We made the job harder didn’t we?

Todd: We did, but you know to just be fair for Linda and I as well as I still remember a faculty member calling me, It must have been about 20 years ago, and I just started doing a little bit of Faculty Development, she was crying, she had given her first assignment in terms of a paper. And she said, I’m sitting here with a stack of papers, and I don’t know how to grade them. And it got me thinking a little bit, how many of the aspects of the job that we’re required to do, were we trained to do? And that’s the stuff that Linda was mentioning as well, is nobody taught me. I’m an industrial psychologist. And so nobody taught me the strategies for delivering information to a group of 200 people. Nobody taught me how to grade essay tests. Nobody taught me how to grade presentations, I didn’t know about fair use and how I could use things. I mean, you go through and list all of the things that you’re required to do. And then look at all the things you were trained to do. And this is tough. And that changed. So I have one quick one I’ll mention is I was hired as an adjunct faculty member before I got my first tenure-track job. And I was teaching 4-4. So I had four classes in the fall, four classes in the spring. And about halfway through the spring, I ran into the department chair, and I was interested to see if I was going to be able to come back and I said, “Hey, Mike, how am I doing?” And this was at Central Michigan University, a pretty good sized school. He said, “You were fantastic.” And I said, “Excellent. What have you heard?” He said, “absolutely nothing.” So when it comes to teaching, what I learned was: research, you had to do well, and teaching, you had to not do terribly. And that is what you were mentioning has changed is now you’re kind of expected to do teaching as well.

Rebecca: And there’s a lot more research in the area now too. So sometimes it’s hard to keep up on it. So books like this can be really helpful in providing a lot of that research in one place.

John: And both of you have written many good books that have guided many, many faculty in their careers, and eliminated that gap between what we’re trained to do and what we actually have to do.

Rebecca: So of course, we want to know when we can have this book in our hands.

Todd: Good news for this book, which is exciting because we really cranked away on this thing and it’s listed in Amazon as being due on April 25. But it actually went to press on January 23. So it’s already out and about three months ahead of schedule.

John: Excellent. We’re looking forward to it. I’ve had my copy on preorder since I saw a tweet about this. I think it was your tweet, Todd, a while back. And I’m very much looking forward to receiving a copy of it.

Todd: Excellent. We’re looking forward to people being able to benefit from copies of it.

Rebecca: So we always wrap up by asking what’s next.

Todd: It’s hard to tell what’s next because I’m exhausted from what’s been [LAUGHTER] ever moving forward, as I’m working on and just finishing a book right now that’s to help faculty in the first year of their teaching. So it’s basically off to a good start. It’s what specifically faculty should do in the first year of getting a teaching position. And aside from that, probably working on my next jigsaw puzzle, I like to do the great big jigsaw puzzles. And so I just finished one that had 33,600 pieces. It is five feet….

Rebecca: Did you say 33,000 pieces?

Todd: No, I said 33,600 pieces.It was the 600 that…

Rebecca: Oh, ok.

Todd: …was difficult. [LAUGHTER]

Rebecca: Yeah.

Todd: When the puzzle is done, it has standard sized pieces, and it is five feet by 20 feet. So I just enjoy massively putting something together. It’s very challenging. So quite frankly, for those about and listening to this is if you imagine 33,600 puzzle pieces, that’s about as many studies as Linda and I have read to put this book together. [LAUGHTER]

Linda: Nothing to it. [LAUGHTER]

Todd: So that’s it for me. [LAUGHTER] Linda, what are you up to these days?

Linda: Oh, well, I live in la la land. So I’m still doing workshops and webinars and things like that mostly on my books of various kinds, various teaching topics. But I think what I want to do is retake up pastels and charcoals. My father was a commercial artist. And so he got me into pastels and charcoals when I was in high school. Well and then I dropped it to go off to college. Well, I want to get back into it in addition to working at the animal shelter. I know. It’s la la land and I wish la la land on everybody that I like.[LAUGHTER] I hope you all go to la la land and enjoy being a four year old all over again, because that’s the way I feel. I adapted to retirement in about 24 hours. That’s pushing it… you know, it’s more like four. But anyway, I slept on it. [LAUGHTER] That was the end of it. But I know I eased into it. I eased into it. I was still writing. I was still doing, especially before the pandemic, a lot of speaking. So then the pandemic hit and it just turned into online everything. And now I’m back on the road again, to a certain extent. I love it. So anyway, it’s a nice balance. So yeah, I wish you all la la land too.

Todd: That’s great.

Rebecca: That’s something to aspire to.

Todd: Yeah, it is. But you know, since you mentioned the speaking things, I just have to do the quick plug here. Linda, I think you and I, years and years ago, were joking around at POD about who would be the first one to get to the 50 states and have done a presentation in every state. And so I gotta tell you, I’m not even sure where you’re at in the mix, but I am at 49 states. And if any of your listeners are in North Dakota, [LAUGHTER] I could certainly use a phone call from North Dakota.

Linda: Well, I want to go to Vermont. I have not been to Vermont…

Todd: Oh, you haven’t.

Linda: …to give a presentation. So I would enjoy that. But I’ll go to Hawaii. I’ll do anything in Hawaii for you. Absolutely anything. [LAUGHTER] I’ll do gardening, [LAUGHTER] I’ll do dishes, your laundry. I don’t care.

Todd: That is good. Yeah, Linda and I had this gig. It was a long, long time ago. And I don’t know, it must have been 20 years ago we talked about it even. And there was some rules too. You had to be invited. And there had to be some kind of an honorarium or just I mean, it didn’t have to be much, but the concept was you just couldn’t show up at a state and start talking. [LAUGHTER] Otherwise, we’d have both been done a long time ago. But yeah,

Linda: Yeah.

Todd: … it was fun. This is the way nerds have fun. [LAUGHTER]

John: Well, that’s a competition that’s benefited again, a lot of people over the years.

Rebecca: Well, thanks so much for joining us. It’s great to see both of you again, and we look forward to seeing your new book.

Linda: Thank you for this opportunity. It was a pleasure.

Todd: It was so much fun. Thank you

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

272. Mind Over Monsters

During the last few years, college students have been reporting mental health concerns at unprecedented levels, straining the resources provided by college and university counseling centers. In this episode, Sarah Rose Cavanagh joins us to discuss the role that faculty can play in addressing these concerns.

Sarah is a psychologist, professor and Senior Associate Director for Teaching and Learning at Simmons University. She is the author of The Spark of Learning: Energizing the College Classroom with the Science of Emotion and Hivemind: Thinking Alike in a Divided World as well as numerous academic articles and essays in The Chronicle of Higher Education, Lit Hub, Inside Higher Ed, and Vice. Her most recent book, Mind Over Monsters: Supporting Youth Mental Health with Compassionate Challenge will be released in spring 2023.

Show Notes

  • Cavanagh, S. R. (2016). The Spark of Learning: Energizing the college classroom with the science of emotion. West Virginia University Press.
  • Cavanagh, S. R. (2019). Hivemind: The new science of tribalism in our divided world. Grand Central Publishing.
  • Cavanagh, S. R. (forthcoming, 2023). Mind Over Monsters: Supporting Youth Mental Health with Compassionate Challenge. Beacon Press.
  • Elizabeth Romero
  • Ryan Glode
  • Reacting to the Past
  • Jasmin Veerapen
  • Gary Senecal
  • Miller, L. (2020). Why Fish Don’t Exist: a story of loss, love, and the hidden order of life. Simon & Schuster.
  • Robert Sapolsky’s Publications
  • Auel, J. M. (2002). The Clan of the Cave Bear. Bantam.
  • Kelly Leonard
  • Felten, P., & Lambert, L. M. (2020). Relationship-Rich Education: How human connections drive success in college. JHU Press.
  • Viji Sathy and Kelly Hogan
  • Michele Lemons
  • James Lang

Transcript

John: During the last few years, college students have been reporting mental health concerns at unprecedented levels, straining the resources provided by college and university counseling centers. In this episode, we discuss the role that faculty can play in addressing these concerns.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Sarah Rose Cavanagh. Sarah is a psychologist, professor and Senior Associate Director for Teaching and Learning at Simmons University. She is the author of The Spark of Learning: Energizing the College Classroom with the Science of Emotion and Hivemind: Thinking Alike in a Divided World as well as numerous academic articles and essays in The Chronicle of Higher Education, Lit Hub, Inside Higher Ed, and Vice. Her most recent book, Mind Over Monsters: Supporting Youth Mental Health with Compassionate Challenge will be released in spring 2023.

Welcome back, Sarah.

Sarah: Thank you. I’m delighted to be here.

John: Today’s teas are:… Sarah, are you drinking any tea?

Sarah: No, I always disappoint you. I am yet again drinking coffee.

Rebecca: Yet again, such a stable person in our lives with your coffee. [LAUGHTER] I have blue sapphire tea.

Sarah: That’s a pretty name.

Rebecca: Yeah, it’s tasty. And my new favorite.

John: And I am drinking spring cherry green tea here in the midst of winter in upstate New York. We’ve invited you here today to discuss Mind over Monsters. Could you talk a little bit about the origin of this project?

Sarah: For me, I think writing is more organic than it is planned, and so it felt a little bit like the book decided it needed to be written, rather than I decided to write the book. There was just such a groundswell of interest around young adult’s mental health, people talking about it, podcasts, books. And I am a college professor, I’m a psychologist, I am an educational developer. I’m the mom of an adolescent, and so I couldn’t help but be concerned and interested in this topic. And I also felt that, as someone who has struggled with anxiety my entire life, panic disorder in particular, that I had some small bits of wisdom from my lived experiences to share. And so it just all came together.

John: How prevalent are mental health issues among youth today?

Sarah: They’re pretty prevalent, unfortunately. Some people have even labeled it an epidemic. For instance, in 2021, three of the major American organizations dedicated to youth and adolescent mental health joined together and declared a national state of emergency, which was an unprecedented move. And they cited in particular the effects of the pandemic and the fact that already marginalized groups along lines of race and ethnicity, gender, and sexuality and income were bearing the brunt of the psychological effects of the pandemic. But also there’s a lot of complexities surrounding figuring out whether rates have truly changed or whether there’s also changes in stigma surrounding mental health, which are laudatory changes, we want people not to feel stigma, and to come out and reach out for treatment. There’s also changes in the thresholds of the diagnoses themselves, they shift every several years. And there’s also changes in people’s willingness to seek treatment, and also their decisions about the level at which they might need treatment. And so there’s some evidence that a lot of these complexities may be making epidemics seem worse than it is. But what is clear is that more young adults and especially college students are expressing more distress and asking for help with that distress. Counseling centers on campus are absolutely overwhelmed and students are expressing a lot of frustration with not receiving the level and the timing of care that they need in those settings, and so clearly, we need changes.

Rebecca: In a lot of public conversations, we’re hearing debates about needing to show compassion to adolescents who are struggling, but then also others who argue that youth is too coddled. Can you talk a little bit about what you would advocate for?

Sarah: And that’s a delightfully easy setup for me, [LAUGHTER] because in the subtitle of the book is “compassionate challenge and why we need to support youth mental health with compassionate challenge.” And I argue that this debate and tension between compassion and challenge is one of these false dichotomies that we human beings seem to adore. [LAUGHTER] Students clearly need compassion, and I think compassion has to come first. For me, what that looks like is establishing classroom communities and learning environments on campus that are characterized by safety and by a feeling of belongingness. You need to feel safe enough to take risks. And you need to feel that you’re supported not just by your instructor, but also your fellow students and the Student Success Office and all of the people on campus. But once we’ve established that grounding and that safe setting, then I think to truly learn and grow, we do need to take risks, we do need to step outside our comfort zones, and we need to be challenged. And I think that challenge can be very positive. I spend one of the last chapters of the book really digging into the science of play, and how play is all about being vulnerable and taking risks and play can be scary. And you can only play in settings where you, again, feel safe. And I think, finally, what I call compassionate challenge isn’t just important for teaching and learning. As I draw out in two interviews with clinical psychologists Ryan Glode and Elly Romero, compassionate challenge is also really key to addressing anxiety and symptoms of mental health. And I don’t think we’re going to be doing any therapy in the classroom, but learning environments marked by compassionate challenge are ones that are consistent with principles that help address and resolve anxiety, which again, involves facing your fears, and environments where you’re technically safe and there’s a facilitator there to help you manage those risks.

Rebecca: John and I were talking earlier about some of the things that I had observed in my own classroom in the last year with an increase in desire for perfection, like kind of perfectionism or anxiety around not being perfect and not being right and working with students in class and trying to find ways to help students work through that so that they could take risks or could show things in progress to get feedback so that they could continue to improve. Can you talk a little bit more about what that might look like in a classroom?

Sarah: Well, I think that a lot of that brings up assessment and grading. And I think why we see that perfectionism in the classroom is that students are very concerned about their grades, because they believe, to some extent rightly, that their grades are going to translate into future security, and to getting into the right graduate school or getting the right job. And we do this to students. In high school, we train them to be so focused on the grades in order to get into the correct college and I have a high schooler and her grades are constantly just streaming, coming in in real time to her phone. And then we’re surprised when students get to college and they’re too focused on their grades. [LAUGHTER] And so I think that helping students with that need for perfection is probably reforming our grading systems so that there isn’t that need, that that focus on perfectionism isn’t necessarily rewarded in the same way. And instead, we’re rewarding taking risks and doing something creative, and maybe failing and having multiple iterations of something and seeing that work can grow over time, which, I think, amplifies creativity

Rebecca: There’s a lot more focus on process than on the product, then.

Sarah: Yes.

John: You mentioned using play in classrooms, what would be an example of the use of play in the classroom?

Sarah: Well, I think you can directly play through using improv, and especially in the early parts of the semester when you’re all getting to know each other, a lot of icebreakers are very playful. And community building can be very playful. I think there are ways like the whole reacting to the past role playing approach in history. You can easily roleplay in literature classes. So I think you can directly play. I think that what play can also be is almost like a philosophy or a stance that you take, that what we’re doing in the classroom is not dire. And, related to the grading that we were just talking about, there aren’t large stakes, that what we’re doing here is this is kind of a sandbox, where we’re playing with intellectual ideas, we’re testing things out, we’re experimenting. And there’s a sense in which it’s lighthearted, even when the topics are not light hearted, I think that we can take this lighthearted stance with our students. And I think also mixing things up and not getting too into routines, can also be playful. And I feel like I have a lot of tricks in my teaching bag, different discussion techniques and ways of getting us up and moving and things like that. But there’s always a point, kind of through the three-quarter mark of the semester, where they’ve seen it all. And so I try to save one or two things for that point in the semester and kind of throw everything out the window and do something entirely different. And I think that that can be playful as well. And so I don’t think that play in the classroom is all about things that we think of as play proper, like improv and roleplay; it can also be all of these other techniques.

Rebecca: One of the things that I’ve studied in the past is play. And one of the things that’s interesting about play is that there’s rules and there’s structure. And so a lot of times we think that play is just chaos, but actually play almost always has rules. They might not be formal rules, they might be informal rules. But that’s a way that people can feel safe and able to play is that they understand what the structure is and what the rules are.

Sarah: Those are great points.

Rebecca: You think that it’s hard to facilitate because it might seem so foreign, but actually we’re all very familiar with play. And it is actually incredibly structured. We know that structured things can be really inclusive. And so you might be hesitant to try something that seems like it might be unstructured, but I think, lo and behold, play is actually structured.

Sarah: Yeah, and a lot of those classic improv activities have strict rules in fact and one of the rules is that there’s a kindness.So, even when animals play… you know, I watch dogs play a lot at dog parks, and it can get quite vicious looking, but the animals are safe, you don’t harm each other and that is a strict rule of play as well.

John: Some of this book is drawn from research you conducted as part of the Student Voices project. Could you tell us a little bit about that project?

Sarah: Absolutely. So this was a project that grew out of my last grant from the Davis Educational Foundation. I had done a quantitative study that I talked with you all about in the past. And we had some funds left. And I had an honor student, Jasmin Veerapen, who’s now at Columbia, getting her social work degree, and she needed an honors thesis project. And so we collaborated together and ran a qualitative follow up and interviewed students from 35 different very diverse types of institutions across the country. And it was not a project focused explicitly on mental health, but on emotions and learning. So for instance, the first two questions we asked of all of our participants was: What was the best learning experience you have had in college, and tell us all about it?” And the second was, “What was one of the worst learning experiences you had in college?” ..and their insights are all so rich, and I share a number of their wonderful stories in the book. It’s a great pleasure.

John: Would that be something that you’d encourage faculty to do in their own classes?

Sarah: Yes, it was very illustrative, a lot came out of that. And we actually had worked with a consultant, Gary Senecal, because this was my first qualitative research study, and so I didn’t really know what I was doing. And he’s done a lot of qualitative research, and so he was our consultant. And he helped us shape the questions. And I think he had a large role in shaping those first two questions, because they’re just open ended enough that students share very different things, but then they all coalesce, and so it was very informative. And I think many professors could learn a lot asking their students those questions.

Rebecca: You included many narratives throughout your book, some of your own personal stories and some of the stories of student voices from this project. Can you talk about why you decided to include narrative as a part of the book?

Sarah: Yes, when I think about the books that I most like to read, the nonfiction books that I most like to read, they have a really strong narrative component. So I recently read Why Fish Don’t Exist, which was one of my favorite reads out of the last few years. And I love Robert Sapolsky’s books, and I’m a story person. And I mostly read fiction. And so I really enjoy nonfiction that has a strong narrative component. So that was one of my motivations, that I wanted to write a book that was like the books that I like to read. I think that story, though, also is really compelling. I think that there are insights that are embedded in stories that things like quantitative data can’t always tap into in the same way. And I think in particular, for topics like this, and for emotions and for students’ perceptions of their own learning, I think that we need story.

John: In addition to narrative, which is really compelling in your book, you also bring in a number of other disciplinary studies. Could you talk a little bit about some of the other disciplines and some of the other research your book relies on

Sarah: That’s a little, maybe, too far into humanities, I’m a little worried. I am a social scientist by training. And I’m very aware of the fact that there is disciplinary expertise. But I do bring in a lot of humanity’s work, in particular monster theory. So I read quite a bit of monster theory, which wasn’t even something that I knew existed before then, but that’s in there. I do something that I get from my mother. I used to make fun of my mother for always citing literature and stories as evidence for things. I would take an anthropology class and come home from college, and we would talk about it. And she would shake her head at me and say, “Well, that’s not how it happened, in Clan of the Cave Bear. [LAUGHTER] But I do a little bit about that. So I bring in some stories from novels and short stories that I think illustrate the points that I’m trying to make as well. And then I think, most compellingly, I bring in actual experts from their disciplines. So I interview a sociologist about her research on trigger warnings. I interview a Latin American Studies scholar about his work on vocation, which I found so fascinating. And I also interviewed a couple of clinicians, as I said, and Kelly Leonard who is a Second City improv person, and so I bring in those other disciplines through the lens of the people I’m interviewing.

Rebecca: Sometimes it’s really helpful to have these illustrations because statistics can go only so far in helping us understand what that actually looks like and feels like in our classrooms or in the experience that students are having because we can feel really far removed… or I’m feeling farther and farther removed [LAUGHTER] from students and it helps to hear things in their own voices. And we don’t always ask them enough. I wish we asked more.

John: …which is something really troubling to those of us who focus mostly on statistical analyses, and so forth. [LAUGHTER] But it’s true, a compelling story can be much more effective in convincing people of some concept than any number of studies that you might present to them.

Sarah: But we do have lots of citations for people like you, John. But I tried to bring both sources to the table,

Rebecca: …which is good, because you got both of us here.

Sarah: Mm hmm.

Rebecca: So can you talk a little bit about the intended audience of your book?

Sarah: Absolutely. My primary audience, I think, is people who are doing the work of higher education, so college instructors, staff like me who work in teaching centers, and student success offices, administrators, and so it does have a strong higher ed thread throughout. That said, I don’t think there’s a super bright line between especially late high school and early college in some of these concerns. And I think it could be useful for high school educators, especially those who might be advising students about the college selection process. I think that there is some insight and some sections, maybe, that could be of interest to college students themselves, and possibly their parents. But I would want them to know that it’s not a parenting book. I don’t want anyone to pick it up thinking it’s a parenting book. There’s long sections, again, on trigger warnings and institutions needing to actually carry out their DE&I statements. And someone picking it up thinking they’re going to get some pithy advice about parenting is not going to be satisfied.

John: Would this be a good focus for faculty reading groups or book clubs?

Sarah: I think so. [LAUGHTER]

Rebecca: We think so too. [LAUGHTER] Yeah, it looks like, yeah, it looks like some really wonderful topics that you’re exploring to think about all of higher ed in a lot of ways, and perhaps some reimagining that needs to happen.

Sarah: Oh, thank you.

Rebecca: Can you talk a little bit about what we, as educators or people working in higher ed, can do to create a more compassionate and challenging environment for our students? What are some actions we can take?

Sarah: Well, I think you have to do the compassion piece first. And I think that colleges really need to be examining, and I think they are examining, there’s lots of other people sharing this message of compassion and relationship, rich education, thinking of Peter Felton and Leo Lambert’s book. And I think that we need to embed compassion in the atmosphere in the classroom and the dorms. I think that we need to pay a lot of attention to community. I think that we need to shore up resources in counseling centers. I’ve been attending, as part of the research for this book, lots of webinars with people who are looking at this topic from a lot of different frameworks. And there’s a lot of interesting work being done on peer support, which I’m both interested in and also wary of. I think that peers are our natural first source of support. And that peer support could be really life changing for a lot of college students. But just like we shouldn’t be doing therapy in the classroom, I don’t think it’s the responsibility of college students to do counseling for their fellow peers. And they’re trained to spot warning signs and to do the kind of heavy lifting that a lot of counseling involves. And so I think that we’re going to need to dedicate more resources to trained clinicians in our counseling centers. In my interview with Ryan Glode in the book, who is, again, a clinical counseling psychologist, he really feels that counseling centers provide just sort of venting sorts of therapy, and that he’s a strong advocate of cognitive behavioral therapy and exposure therapy, and that students need much more individualized treatment and approaches. And so I think that that’s an interesting thing to explore. And the last thing I would say is, I always say this, but faculty need more support and time, because there’s been a lot of great essays coming out, the last couple of weeks even I’ve seen, about the fact that student success is really faculty success, and faculty are where students get more of their support than anywhere else. And we can try to reach out to them in many different ways, but they land in our classrooms, we know that we’ll see them in their classrooms, even if they’re not leaving their dorm much, they usually come to class. And so it’s an entry point. Mentoring is such a strong part of the college experience and so wonderful for growth and mental health. And so I think that for faculty to really apply all of this and have really close student relationships and really rich classrooms and all of these things, they need more time and more support. And so I think that the two places I would put my support is in the counseling center and then in supporting faculty, giving them the kinds of time and the kinds of support that will allow them to be the teachers that they can be when they have the time to do so.

Rebecca: Are there specific places where you found compassion to be lacking that surprised you in your research? We know that there’s a [LAUGHTER] strain on counseling centers, but were there some other places that really rose to really needing some attention,

Sarah: None of the students we talked to had trouble coming up with either a best or worst learning experience. And the good ones are really, really good. And the poor ones were pretty poor. And so there’s a lot of unevenness, I think, and I think that that, when I talk as I just did about, if you just give faculty more time, then they’ll blossom, and then the students will blossom, and sometimes when I have conversations with administrators about that, or see policies being enacted on different campuses, I can tell that there’s a wariness that if you give faculty time, they’ll just either do more research, or they will check out and that there’s a danger there and we need to work faculty harder. And I do see in talking to the students about their best and worst learning experiences, that the people teaching those worst learning experiences really need to step up their game a little bit. And so I think that there are those pockets out there that still don’t apply themselves to their teaching or look at it as an onerous responsibility. But the good teachers are really fantastic. And so maybe leveling that out a little bit, bringing the worst learning experiences up to the best learning experiences might be somewhere I recommend some attention.

John: One of the areas where people often see a dichotomy between compassion and challenge is in terms of deadlines in courses where material later in the course build on material earlier in the course, it’s really easy for students who are struggling to get further and further behind when they don’t have at least some sort of a deadline. Do you have any strategies for addressing that, besides focusing on the learning rather than on grades? What can we do to help ensure that students make regular progress while still maintaining compassion?

Sarah: Um hmm. I think this is the question of the moment. [LAUGHTER] And I can tell you, I just had a conversation with a reporter at The Chronicle who was writing a whole big piece on just this issue. And we at Simmons just met with our advisory council, who are a group of about 12 faculty who we check in with about what faculty needs are. And this was their number one answer, like clearly. So we’re going to do a panel in the spring at Simmons, where we have some faculty with very different perspectives. We’re hoping to draw out some of these tensions and have this discussion. And so I do think it’s an excellent question. And I think that a deadline is a good example of where compassionate challenge needs to be. I think that all of us need the structure of deadlines. I myself benefit [LAUGHTER] greatly from the structure of deadlines and schedules. And I think especially for college students in the early years, if they’re so-called traditionally aged students, some of the process of those first year or two of college is learning time management and in scaffolding them into good time management. And so I think that structure is very important. As Rebecca was saying earlier, it’s also an inclusive teaching strategy, Viji Sathy and Kelly Hogan have written extensively about that. But I think without compassion, deadlines are going to worsen student anxiety, and also it doesn’t make a lot of sense for contemporary life. And so some techniques that I’ve seen are things like using frequent tokens instead of just no deadlines or 100% flexibility with deadlines and things kind of pile up toward the end. You can have tokens where students can have a set number of missed assignments, or dropped assignments, or I need an extra week or two. I think that it’s important in whatever you do, if you are going to be flexible to be transparent with all of the students about it, because I think that some students will ask for flexibility and the other students won’t know that they can ask for flexibility. And a lot of that falls out along the lines where everything falls out and creates inequities. So I think that having some structure, but with some flexibility built in is probably the best way to go. I was interviewing a biology instructor for a different project. And she was telling me what she did is she had pretty close to unlimited flexibility within modules. So she had her whole semester set up in modules, but then you had to submit things within that module, because as you say, especially some fields, the information builds, and if you miss part, you’re going to be in trouble. And so I thought that was another interesting approach. But I agree that in particular when we’re thinking about mental health, that structure is better. And the last thing I’ll say is that at my previous campus, we had a panel of the Dean of first-year students, it was the head of our accessibility office, the head of our counseling center, and then a clinical counseling psychologist from our psychology department about issues surrounding student mental health. And one of the instructors asked about deadlines, and they were all unanimous, they said, deadlines are necessary. The worst thing you can do for a student high in anxiety is allow no deadlines or submissions whenever they like, because that will quickly get them into a negative place, and that they need that structure. So I think it’s a great example of the need for both compassion and challenge.

Rebecca: One of the things that I think about when I hear structure or certain kinds of support is routine. And you talked a little earlier about having some routine, but then disruptions to that routine. Can you talk about why some of the disruptions to the routine might be important, or why not having a routine all the time could be helpful for students?

Sarah: Well, I think the positives of routine are that they’re reassuring, for one thing. I think we all as human beings, it’s relaxing to settle into a routine, and it’s also lower in cognitive load. If you just know, okay, every Thursday, I have a homework assignment, every Tuesday I have a quiz, you don’t have to constantly be scrambling and figuring things out every week. And so I think that routines can be reassuring, and they can also be more transparent and easier to follow along. I think where the disruption is great is it re-energizes. So it’s great to be reassured and calm things down. But then that can get boring and kind of stultifying after a little while. And so once you have established the routine to mix things up once in a while, I think, can be re-energizing. And so I think that’s where a blend of the two can be really powerful.

Rebecca: You mentioned that you do this in your own classes. Can you share an example of one of the ways you mix things up in your own class,

Sarah: it’s not terribly exciting. But the one that I do this most clearly is in my motivation and emotion class. And in that class, we’re covering different topics and we’re reading research articles and doing presentations. And again, I try to mix things up, but I have a set number of things that I mix things up. And then usually right after Thanksgiving, I throw everything out the window and we just spend a week doing something different. And so we used to watch a movie together. And then we would write an essay about the motivation and emotion aspects and the themes that we’ve talked about all semester long, how it played out in those characters lives. And I was showing Lars and the Real Girl, I don’t know if it’s kind of an older movie now and stopped doing that for a while for a number of reasons. But then more recently, in this activity called “making the world a better place.” And I had a selection of psychological science articles, each one that tackled a societal problem, like climate change, or misinformation, and how we could use principles from recent psychological science research and to help improve this societal conundrum. And then we did small group work with snacks. And they would work on little group presentations all together that were very low stakes, and then present them to each other. And we would have a grant competition among them. But it was just this week where the routine was very different.

Rebecca: It sounds like almost a culminating point of the semester, instead of ramping up stress with a big project, it’s ramping down the stress with something that’s applied, but in a more low key way.

John: …but also valuable and fun.

Rebecca: Yeah, definitely. To me, it sounds like: “[LOUD EXHALE]”

John: We always end with the question: “What’s next?”

Sarah: Well, I have a new grant. Well, a semi-new grant. And it’s a National Science Foundation Incubator Grant with my co-PI, Michele Lemons of Assumption University. And it is examining assessment, feedback, and grading in undergraduate bio education in particular. And so we had a qualitative portion, we had a survey portion, and we had student interviews, and we’ve just wrapped data collection, So I have a lot of writing and meaning-making and analysis, and then a full proposal grant [LAUGHTER] to write. So on the research side, that’s what’s going on. And on the writing side, I don’t know yet. I have a few possible ideas. I’m in a writers group with Jim Lang, who I know you both know, and his new book, which is going to be fantastic… and you have to have him on the show… is all about how academics can successfully write trade books for a wider audience. And I’ve been enjoying the chapters as he’s been writing them. And I was reading his chapter on where to get your book idea, and I realized that I’ve written a couple of books now from my expertise, but I don’t have to stick with my expertise. I could do something super fun. And so I don’t know.

John: Not that your expertise isn’t fun or interesting. [LAUGHTER]

Sarah: Well, thank you. And anything I write will obviously have a strong psychology component, it’s just like in my bones at this point. But yeah, so stay tuned. We’ll see.

Rebecca: Sounds like some exciting things down the pike for sure.

John: We look forward to hearing more about that when you’re ready to share that.

Sarah: Oh, thanks.

John: Well, thank you. It’s great talking to you.

Sarah: Thank you. Always a pleasure.

Rebecca: Yeah, I always learn stuff from our conversations, so I’m looking forward to having you on again in the future.

Sarah: Oh, thanks. Same.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

264. Collaborative Rubric Construction

Students may not immediately trust faculty who they perceive as being different from themselves. In this episode, Dr. Fen Kennedy joins us to discuss how collaborative rubric construction can be used as a strategy for building and maintaining trust. Fen is an assistant professor of dance at the University of Alabama and the author of a chapter in Picture a Professor, edited by Jessamyn Neuhaus.

Show Notes

John: Students may not immediately trust faculty who they perceive as being different from themselves. In this episode, we explore how collaborative rubric construction can be used as a strategy for building and maintaining trust.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Dr. Fen Kennedy. Fen is an assistant professor of dance at the University of Alabama. They are also the author of a chapter in Picture a Professor, edited by Jessamyn Neuhaus. Welcome, Fen.

Fen: Hi both of you, it’s good to be here.

Rebecca: Our teas today are:… Fen, are you drinking tea?

Fen: I am because I saw that there was a tea list, so I am drinking one of my favorite teas, which is a Lapsang Souchong. And because of the theme of my chapter, I have it in my wonderful mug that says, “What a beautiful day to respect other people’s pronouns.” Cheers.

Rebecca: Cheers. That sounds wonderful.

John: It does and you know, I’ve wanted to drink that tea on here, but I was never quite sure how to pronounce it. [LAUGHTER] I do drink it fairly often, it’s a really nice tea. I keep it separate from the others so the smoke flavor doesn’t infuse the other teas.

Rebecca: See, unlike you, I just embarrass myself by trying to say things I don’t know how to say [LAUGHTER].

Fen: I have a wonderful tea from Plum Tea Company, which is the Picard tea, which is a variant of Earl Grey, which is wonderful.

Rebecca: Nice.

John: And a nice nerdy thing to do too. Many of our guests would appreciate that aspect of it, and we would too. I’m drinking a wild blueberry black tea today.

Rebecca: Oh, That sounds nice, John.

John: It’s very good.

Rebecca: A little different than your normal. I just have Earl Grey today.

John: But not the Picard variant.

Rebecca: Yeah, unfortunately, I didn’t know that that was an option.

Fen: It’s wonderful, I think there’s kind of sweet orange notes in it. I’m a big fan.

Rebecca: That sounds really good. We might have to look, John.

John: So we invited you here, today, to discuss your chapter in Picture a Professor entitled “Collaborative Rubric Creation as a Queer Transgender Professor’s Tactic for Building Trust in The Classroom.” You begin the chapter by noting that transgender and non-binary faculty are rarities in higher education. Could you describe some of the challenges that you face as a non- binary transgender faculty member, who’s also a first-gen student and an immigrant?

Fen: Well, that’s a mouthful. [LAUGHTER] My chapter title is a mouthful and then the question is a mouthful, and well, I will do my best. And so well, I thought about this in advance. And I could give you some of the easiest figures and more objective measures of those obstacles. For example, I worked out quite recently, as an immigrant on an H1 visa, which is a work visa, but not a citizenship or residence visa, you are not allowed to work outside of the contract that you’re hired for. So any work that I’ve done outside of the university, I have had to donate my income to someone else, or just refuse payments. And I worked out that with the money I have lost being an immigrant, I could have put down a second deposit on a house.

Rebecca: …not insignificant.

Fen: No, so it’s not insignificant. The other thing that I think a lot of people don’t realize is that as an immigrant, you can’t really buy your books unless you absolutely know you’re staying in the country. So during my PhD, when you want to look up something, you can’t turn to your wonderful bookshelf and pull down the book that you own, it’s write to the library and see if it’s in stock and see when you can get it. So it’s this little logistical things. And I know we’ll get to gender because the chapter is about gender. But on the first-gen student, something that comes to my mind is: I was in a teacher training and the person giving this training said, “Well, you’re first-generation students, they’re really going to struggle in the classroom, you’re going to know who they are, they’re going to have a hard time knowing how to do things.” And I sat there getting my PhD, getting ready to teach and thinking, I’m not sure I like how I’m being described as someone who’s going to struggle who’s going to have these challenges, and no one has ever said, What advantages does a first-generation student have? What do they bring that other students lack? And so I think sometimes one of the big things is that you’re perceived as a challenge, you’re perceived as someone who’s going to struggle, which means that when you do something that’s original, or creative, or critical, often the response is to say, “Oh, that’s because you don’t understand” rather than, “Oh, this could be a productive direction that other people might want to take also.”

Rebecca: Those are some really good points. I think many of our students are labeled in all kinds of ways that prevent us from seeing all that they have to offer, and how much they can move our classrooms forward and how much we can learn from our students and not have this expectation that they’re going to fail. I really appreciate that you put that right out front.

Fen: I think also, when you follow that line of thinking, a lot of teachers… and I think the book is getting towards this point as a whole… a lot of teachers plan to teach to the students they want rather than planning to teach the students they have. So when they design syllabi, when they design policies, when they design their standards for the course, they picture an ideal student and say how would that student fit in? Rather than saying, “Okay, who is coming into my classroom? What do they need when they get out of it? And how do I take them on that journey in a way that makes them feel engaged, delighted, enthusiastic, valued.” And so we’re talking about Picture a Professor, but maybe not picturing our students is another thing that we could work on.

John: That could be a sequel, Picture a Student.

Fen: Absolutely.

John: I think when we all start teaching, we often have some assumptions about what our students are going to be like. But the reality of our students is often quite different. And that can lead to some challenges for both students and faculty. Following up on that a little bit, what do you do to try to find out more about who your students are.

Fen: So one of the things I tried to do is, think of the people that I hung out with, in my day-to-day life. I hung out with other immigrants, I hang out with first-gen students, I hang out with queer people. And I know about their barriers to coming into education. I hear a lot of people who’ve had really, really awful experiences. And I think about myself, and I was like, “What is the kind of classroom environment that I would have enjoyed? What is the kind of classroom environment that they would have felt happy in and at home in.” So I start with trying to make the door to the classroom as wide as possible, rather than keeping it narrow and forcing students to fit their way through. And then the other thing, I think, what I do is, I started university teaching when I was 23 and I was younger than some of the people in the room with me. And so I didn’t feel like I could step into a classroom and have authority from any degree that I had, or any age that I had, or any status that I had. And so really, if I wanted my students to do what I wanted them to do, I felt like the other end of the deal was I had to know more and teach it really well. And so coming from that perspective, I think, and not thinking of myself as entitled to teach and not thinking of myself as entitled to be at the front of the room, but having to work to be at the front of the room. And part of that work is making a space for the students who are in the room with me. And so I don’t have particular always things that I do. But I try and improve my classroom every semester and make it better for more people.

Rebecca: One of the things that I really appreciated about what you’ve said, Fen, is an underscoring of the term “delightful” multiple times, so that it’s not just something that a group of students can deal with, or it’s survivable, [LAUGHTER] which I think is maybe the bar that is often set, but actually, that you set the bar at delightful. Can you talk a little bit more about that?

Fen: Well, it helps that I’ve always really liked being in classrooms. And school for a while was my safe space. Which means that I, in some ways, have in my past, lacked empathy with people who have not found that and who have not liked learning. And it took some hard experiences for me to realize, “Okay, this is something I’m going to have to step away from, because we’re taught often, if you don’t like learning, you’re lazy and it’s something of a personal failure, and you could be doing better.” And then realizing how many people are in a situation where they are taught that academia hates, and why would you want to constantly be in a space that hates you, for things that you have no control over? But when I start to teach things, I think, “How can I share this subject that I find really cool? How can I share it in a way that conveys my enthusiasm to the people I’m teaching it to.” And that’s fairly easy in a dance technique class, because dance is great fun, and also hard work. It is more difficult when you are teaching graduate critical theory. It’s more difficult when you’re teaching the required history course. But I love critical theory and I love history. And I find them really fun. And I think part of the way that you get people to enjoy the classroom is to give them ownership of the material and allow them to not step back at a distance and see the knowledge that is far off that they must aspire to, but put them in the middle of it and say this is work that we’re doing together. I say that I try and teach history, not to teach students history, but to teach the historians of the future, which means we’ve got to have debates and we’ve got to have conversations and we’ve got to have feelings and opinions that are legitimately ours rather than the ones we think we ought to have. [LAUGHTER]

John: That brings into the topic of your article, which is collaborative rubric creation with students. Could you talk a little bit about how you started doing that and how it’s been working?

Fen: Yes. So I really came to this idea of collaborative rubric creation because I was assigned a choreography course to teach for the first time and that gave me the opportunity to think philosophically about how does one grade choreography? [LAUGHTER] How do you grade someone making art? Because that is always… and I talked about this a little bit in the chapter… that’s always a big problem of a question in creative disciplines. There’s not a qualitative answer. There’s not a specific right or wrong. So how do you start to design that. And I must here, give a shout out to Jessica Zeller, who is a phenomenal dance teacher and also a really important voice in the conversation around what we call ungrading, and thinking about how to take down some of these structures of ranking students in boxes. And so looking through her ideas and trying to work out myself, and I thought, “Oh, what if we start the semester by talking about what art means to my students and what they want to do as choreographers,” because not every student wants to be a high-art experimental installation, interdisciplinary maker, even I kind of wish that more people were that thing. I don’t want to make them into me, I want to make them into the best version of them, which means I’ve got to understand what they want And also sometimes knowing that they don’t have exposure to all the things that they might want to be. So what’s the balance there? And I remember the first time I did it, I kind of structured it into their creative process, their self-directed learning and their citizenship. And what happened when we talked about the three different categories is they ran into all their assumptions about what they thought dance was. And so somebody had put down that an excellent choreographer uses partnering. They’ve done these wonderful, like written out on paper, and I said, “Well, do you think all expert choreographers use partnering? Do you think a piece is less if it doesn’t?” And they were, “Oh, wait, no, that doesn’t work.” And I said, “Okay, so what is the skill that’s being used? And we boil down, and so we got past these things that use partnering, like use motif and repetition, and started to realize what was underpinning those ideas, not the ingredients of what choreography had to include, but how you went about making choreography. And one of the big moments for the class was actually when we talked about citizenship, because they talked about “Oh, show up on time and answer all the questions.” And I said, “Well, with that in mind, how can you be a good citizen on a bad day? How can you be a good citizen when you are sick, or stressed out or having a panic attack?” And they went “Oh,” and so rather than, again, these indicators of good behavior and good practice, what is underpinning that or with a sense of being responsible for the space and yourselves and others, which sometimes is going to look different? It might be, “you have to email me and let me know if you’re not being there so I can shuffle the group’s around.” It might look like, “I’m going to take it notes for my friends and catch them up,” it might be “I’m going to zoom into class on a day that I can’t make it to class.” And that is a professional way of being a good citizen. And so it became a really generative conversation. And I went, “Okay, I’m going to do this every time I can.”

Rebecca: Sounds like a really productive conversation, and probably really pushing students to embody what it means to be a choreographer in a way that they wouldn’t otherwise approach the class.

Fen: I think it also gets them past the answers that they’ve just kind of learned by rote. And when I do this in technique classes, I start off by asking them, “What do you want to learn?” And usually, there’s a whole range from people who want to do their situps and their push ups at the start of class every day and get strong, there’s the people who would absolutely not like to do that. There’s the people who want to improvise, there’s the people who do not want to improvise. And when we only kind of pull it together, we see where the biggest priorities are and where, and what’s actually falling off the edges. And then I say, “Well, how do you want to be assessed on learning those things?” And so then, rather than their assessment criteria,being their straight knees and their wonderful athletic posture, we get things coming out, like “my problem solving,” “my adaptability,” “my ability to set a goal for myself and meet it within the range of my body.” And I really enjoy getting them to set goals that they’re invested in, so they understand that they have reasons behind them that they can then work towards, because they’re what they want to be working on anywhere.

Rebecca: One of the things you said a minute ago, in two different contexts was the students don’t always know where they want to be, or who they might want to be, or what kind of choreography they might want to make. How do you help students down that journey to discover and explore? Because that seems very tied to your rubric and your strategies here.

Fen: Yes, it is. And actually, it’s this process of creating trust. And I say that the rubric helps create trust, because they know that they’re not going to have a surprise. But if we’re all invested in the same goals, then we’re going on a path that we all kind of want to be on, which means that I get to say, “Look, I’m going to try something with you might seem really silly, and I want you to try it, I want you to try it for 15 minutes, and then we’ll talk about it, will you trust me enough to be really silly with me for 15 minutes?” And usually the answer is yes, because we’ve already agreed that we’re on the same page with what we want to get out of the experience. And I’m not going to suddenly swerve off into a different direction on my own agenda. So I think this idea of creating trust and buy-in allows me to expose students to a lot of different things, and a lot of different ideas, not because I’m saying this is right and this is where I want you to go even if you don’t understand why. But in the service of these goals that we’ve agreed upon, that we share, I think this will be helpful.

John: So it sounds like this process of rubric creation is not just creating this sense of trust, but you’re also breaking down some of their preconceptions about what the class is going to be about. Do you ever have trouble getting students to converge on a rubric? You mentioned that students come in with very different expectations, How do you resolve some of the differences in those expectations as a class?

Fen: Well, sometimes we just do all of them, if we have time to take different approaches, and we say, we’re going to compromise here, we’re going to do this some days, and not this other days, like I’ll do your situps, a nice, stretchy, soft, warm up, and we’ll see which one we like better. And at the midterm, we’ll check in and we’ll decide which one we like. And if we want to shift things. So, I think that’s how we’re resolving. And sometimes we sit down, we talk about it until we find out what we actually want and where the middle ground is. And on occasion, I say “There are limits what I can provide, and I cannot provide this experience for you. It is out of my skill set. Sorry, this is where you can go and get it.” And I think that two threads that I’m hearing myself say that I want to pull out the idea that things can change, that what you decided at the beginning can shift if it’s not working, and that I am willing to have limits in front of them and say, “This is what I can do and this is what I can’t.” And I think that’s really useful for them as well, because it helps them understand. If I’m there modeling that I get to set limits around my own workload, maybe they do too.

Rebecca: How often do you check in about the rubrics that you designed collectively,

Fen: Formally, not very often. And I think informally a lot, depending on the class. I think the first time I did it, I didn’t check in enough. And there was some confusion about how it would work out at the end of the semester. And it caused more stress than it needed to. And so the next time I followed the same pattern for a quarter of the class, I had regular check-ins throughout the semester, and I would look at like, “How is this working for you? And are you going in the directions that you want to and are you working your way towards these goals and targets,” rather than showing up at the end and going “Okay, now you’re going to be assessed on these things.” So I’ve learned to check in more. But depending on the class, sometimes I check in just as I chat to the students, and sometimes I have scheduled time,

John: How have students responded to the process, have they found it very helpful? Has it helped build that climate of trust?

Fen: Well, especially during the pandemic, thinking about what was reasonable to expect of students was really useful. And I think, because I already had this kind of system in place, I sent out things to my classes saying like, “What can I expect from you in terms of WiFi? Can you make it to classes? If you can’t make it to classes, would you prefer a podcast style or blog style? Or would you want me to just put up a lot of stuff and ask questions? This is the range of my flexibility, what would you like within it.” And so I think that was really, really useful. And I think it helps people who have obstacles to being in the classroom stay in the classroom. And I think that’s the big thing. Every semester, I have to submit my own benchmarks for what I want the students to do and how well they’ve done. But I am allowed to set my own benchmarks. And recently I shifted from what percentage of students are getting an A to, I would rather that a broader perspective of students were getting Bs across a wide range of material. When I submitted that benchmark, I said, “I don’t want to disregard the work of all the people who fought super, super hard to stay in the classroom and get a B in the course, because for some students, that is a huge amount of work. And they put in hours and hours and hours of time and effort and growth to get Cs and Bs in a course and I want the assessment of my teaching to show that I’m recognizing that and I’m trying to make it possible for them to do that. And I am proud of them when they do. A thing I hear a lot from my students is “You genuinely care about us. We know that you care about us,” and I’m really happy hearing that.

Rebecca: A thread that we’ve heard a lot lately is that the methods and things that are meant to be inclusive usually also involve methods that show care.

Fen: And I want to point out the other thing that I remember that a student said to me recently is, “You made me work harder in that class than I’ve ever worked in any class in my life. And I did it.” And so when we’re talking about these inclusive teaching methods and caring teaching, it’s not that we lack rigor, and it’s not that we asked for less. In fact, after we end up asking for more, because you can’t follow a known system, you can’t go to essaydownloads.com, which is not a real website… but I know things like it exist… because it’s not going to work for the kinds of work I’m asking my students to do. And so they’re being asked to meet really, really high standards, but they’re ones that will be genuinely professionally helpful to them as individuals.

Rebecca: You mentioned ungrading earlier and talked about students’ individual growth. Do you have students use the rubric to essentially self-evaluate or are you using the rubric to evaluate?

Fen: That depends on the class. In a choreography class I have the students come to me with a portfolio and a pitch for the grade they think they ought to get based on rubric, and we talk about whether that’s realistic or not. Actually, I’ve never had anybody over pitch, I’ve always had people under pitch on what they think they deserve, which is kind of sad, really. And then in some classes I use the rubrics more as a more conventional grading tool.

John: I think we’ve also heard that quite a bit from people who’ve used ungrading, that they’re more likely to find people who underestimate how much they’ve learned during the course, which is something that surprised me when I first heard it. But now we’re starting to hear that a lot. You mentioned teaching during a pandemic, and I would imagine that that’s especially challenging in a class like dance or choreography. Could you tell us how you manage your classes during a period of pandemic teaching?

Fen: I kind of had a great time. Like, obviously, there’s a lot that was not a great time. But I really admire the work my students did during those times. The commitment it takes to show up on Zoom and dance in your dorm room and keep being an artist is so much harder than it is to be when you’re in a studio among other artists. And they held themselves to that standard. I did talk with students about the reality of how do you give your best attention, which for some people is sitting looking at the computer and for some people is walking around, pottering, while they listen to a lecture and thinking about like, “Okay, what does it take for you to give your best attention today? because I’d rather you gave me your best attention than sat here, not being able to listen.” And I think that was useful. I was very lucky that I got to go completely remote for a semester. And I taught theory classes initially. And then I came back to a mix of theory and practical classes, one of which was choreography. And just like, as I said before, with the students it’s not planning for the class you want to have, it’s planning for the class you’ve got, and I had to do a hybrid class. And so rather than go “Okay, how do I make Zoom get as close as possible to an in-person class,” I said, “Okay, the first five weeks are going to be completely over Zoom, and at the end of it, we’re going to make a film about closeups. And we’re going to think of the dimensions of the Zoom screen and what it takes to be an artist within the tiny box. And so using the restrictions of the pandemic to shape how his class was going to be structured. And in history, again… I’m not sure if either of you have given lectures… but sitting on Zoom and watching a row of empty black boxes with a couple of faces while you try and give a lecture is a special kind of hell. [LAUGHTER] And I talked to my students, and they said, “We really do need lecture content.” I said, “Okay, so one class a week, I will just give you content over a lecture. And the other class of the week, you’re going into breakout rooms, and you’re going to do solo space self-directed learning. I’ll have questions for you.” I had a GTA, who was also in the rooms and they just talked their way through the history and the evidence and the questions and it was wonderful. And when I came back live, it completely reshaped my pedagogy. Because knowing that people were willing to get really deep into conversation further then I could take them to a kind of a guided discussion. And so not everybody wants to learn that way. Some people really do not want to sit and get into a really active lively discussion. And so finding a balance as I’m in the classroom, and there’s more opportunities. I call it “choose your own adventure,” but letting people have flexibility in how they’re learning. There’s lots of different ways to get through the course and that was shaped by Zoom and the necessities of how we teach dance during a pandemic.

Rebecca: So we talked at the top of the conversation about how few transgender and non-binary faculty members there are. And representation, as we know, is very important for our students and for our colleagues and to have a nice, wonderful learning environment. Could you talk about some of the challenges that you faced, as a faculty member who identifies as transgender and non-binary?

Fen: We are in a moment in America, and the world, where we don’t have a cultural consensus that transphobia is wrong, we don’t have a cultural consensus that homophobia is wrong, which means that putting myself out in the classroom is in itself a political statement. And that’s not one that every school wants to get behind. And it’s not one that every student feels necessarily confident about when they encounter me. We’ve got people coming in as undergrads, often I’m the first non-binary person they’ve met. And here I am grading them, and are they going to get into trouble if they get it wrong? And oh, my goodness, it’s a non-binary person at last. Let me ask them all my gender questions. Let me come out to you. There’s a spectrum of responses. But always, there’s a certain necessary caution around what I am allowed to say and who I am allowed to be. So that if somebody does say, “You’re grooming our children, you are putting our students in danger, you are sexualizing people and you are teaching children things that are against their religion.” And there are all things that could come up, how am I going to respond? And what is the record of my pedagogy and my actions going to say in response to those accusations? and that is a lot of weight to carry on your shoulders on a day-to-day basis. To know that the record of your actions might have to answer those questions. And so that’s something I think about a lot. And something I try and be very careful around. I have become more and more known for speaking about these interviews. I have been interviewed by Dance Teacher magazine, a couple of times, I keep my own blog about it. I’m someone that people go to when they want someone to talk about dance and gender now, which again means having a practice and how I shape my words and my presence. But on a practical level, I live in a small city, and even things like going out in the evening… is a student going to be in a restaurant? Or is a student going to be waiting on me and my partner? If someone takes a photo of me out in public with a glass of alcohol in my hand, is that going to come back to haunt me? And so it’s not just my professional life that gets shaped by these issues. But it’s every aspect of my life, where I have to be conscious of, again, what my actions may be held up as evidence for.

Rebecca: That’s a lot of emotional and cognitive energy that goes into all of that, and I imagine a great deal of planning, as you’re thinking about your courses.

Fen: Yes, there’s a lot of thinking, and I want to expose my students to a lot of very diverse material. And also, how do I give them the language of opting out? I don’t want to force anyone to watch things. And I’m actually a big believer in giving everybody the right of refusal in the classroom, most of the time, I work a lot with touch, which means you have to work really hard about consent. I definitely grew up in an era where your body was just picked up and moved around. And so thinking about my students’ right to say no to things, which often results in people feeling more comfortable saying yes to things. And I think in the same way that I sit down with my students and I say my pronouns are they and them, if you have a strong conviction that you can’t use that, you can use something else, I do prefer not to be called Mam, which I think is partly gender and partly British. But given that I’m out in the world, when I’m talking to my peers, and there’s not that level of force and power imbalance, I use they/them pronouns, and that’s what I expect people to use for me. But when it is someone over whom I have a certain amount of power, I think I have to give that little bit of space for them to go, “Okay, I need to think about my beliefs and my feelings and my desires and the power in the situation and know that I’m not going to mess up my entire academic career if I don’t get this right first time.”

Rebecca: Sounds like a lot of grace is extended. [LAUGHTER[

Fen: A lots of people weren’t sure about me coming down to Alabama. I chose to take the job here and I think it’s really important I say I had choices and I chose Alabama, in part because of how hungry the students were to learn, they really threw themselves enthusiastically at new challenging things. And I went, that’s where I want to be.

John: I was going to ask about that. While this could be challenging anywhere, I would think being in the south in general would make it much more challenging, especially given the level of religiosity of many of the students there.

Fen: Well, I think sometimes there’s a stereotype that the South is just an extra level of awfulness than anywhere else. And there’s a certain baseline of awful that you’re going to find absolutely anywhere where you’re a transgender professor. One of the places that I interviewed for a tenure-track position, they kind of grilled me for a long time trying not to say gender, but would I be willing to teach students with different beliefs? How would I manage students in the classroom who might have different ideas than me about how history worked? Which are valid questions, but really not the right question to ask when what you’re trying to say is, “How is your gender going to impact the classroom?” …which they can’t legally asked. And I walked into the interview at Alabama, and the head of dance said: “Just to check before we start the interview, you take they/them pronouns?” I’m like, “Yep.” And he went “Great.” And I was like, “Okay.” So in some ways, academia is a little blue bubble. But there are lots of things about being where I am in a situation that I am that I very much love and I also think that if people maintain this idea that the South is bad and awful, it’s often used as an excuse to stop people looking at their own behavior… we’re much better than the South, they need to change, they need to do things differently. People who are let’s get out of the south, let’s all move up north, whereas the activism down here is very powerful, like really incredible the work that people are doing to try and make the south a more livable place for everybody in it. And that should be respected and recognized, and it doesn’t do people justice to wrap the entire South up in this label of awful. That answer got a little tangled, but I think the summary of it is that there’s a lot of work to be done everywhere, and I’m happy to be doing the kind of work I want to do here.

Rebecca: That’s a very nice, succinct way of summarizing the tangle. [LAUGHTER] But it also always gets tangled, because there’s so many things that pull and push in different directions, and probably really worth acknowledging how much time you probably spend mentoring students who come to you based on your identity, and self-disclose because they’re looking for an advocate and they’re looking for a role model. And that labor is often incredibly invisible.

Fen: Yes. And I think, interestingly, I’m in a department where there’s a number of faculty members who collect… I call them goslings sometimes, [LAUGHTER] but students who, by virtue of identity or life situation, need extra love and support. And I think that every student at some point in their undergrad career needs a little extra love and support. And we are a large department. It’s hard to build those relationships with all the students, but I try not to just be there on the virtue of identity, like I do try and make time for anyone who asks for the time, often because I don’t get to know all the students very well, especially those with LGBTQ identities, you often can’t tell by looking. And so it helps me check my own judgment and make sure that I’m not unintentionally creating favoritism or groups. If somebody needs the help and the time, I want to be able to give it to them to the extent that I can. And I have had to learn how to say “I have X amount of time and then I have to have you leave my office.”

Rebecca: Boundaries, so helpful, so healthy.

Fen: Because if your professor is a person that your professor gets to be a person, just like you.

Rebecca: I feel like that’s such a powerful thing to end on. [LAUGHTER]

John: It is, yes. And humanizing the professor creates a much more positive environment where they do feel more connected to you.

Rebecca: Picture a professor, they are a person. [LAUGHTER]

Fen: Yes.

John: Okay. Well, we always end with the question: “What’s next?”

Fen: Well, I’m on sabbatical right now.

Rebecca: Woo hoo.

Fen: I have just gotten back from three weeks at the Hambidghe Arts Residency Center, which is just absolutely incredible… off the grid in the wilderness of the Georgia and North Carolina mountains. Fresh air. I got back yesterday.

Rebecca: Wow.

Fen: I leave on the 13th of October to go to Philly. I’m helping organize a partner dance event. And I am meandering up the East Coast, different cities ending in Ann Arbor where I am teaching a series of master classes and I’m presenting at a conference, and then I will come home and I’ll see what the next adventure is. But what’s next really is five cities in just under a month.

John: Sounds like a busy but productive schedule.

Fen: I’m really looking forward to it.

Rebecca: I hope you have wonderful travels.

Fen: Thank you

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

Transcript