276. Teaching at its Best

New faculty often start their faculty roles without training in teaching. In this episode Linda Nilson and Todd Zakrajsek join us to talk about the evolving roles and expectations of faculty and explore the new edition of a classic teaching guide.

Now Director Emeritus, Linda was the Founding Director of the Office of Teaching Effectiveness and Innovation at Clemson University. Todd is an Associate Research Professor and Associate Director of the Faculty Development Fellowship in the Department of Family Medicine at the University of North Carolina at Chapel Hill. Linda and Todd are each individually the authors of many superb books on teaching and learning and now have jointly authored a new edition of a classic guide for faculty.

Shownotes

  • Zakrajsek, T. and Nilson, L. B. (2023). Teaching at its best: A research-based resource for college instructors. 5th edition. Jossey-Bass.
  • Nilson, L. B., & Goodson, L. A. (2021). Online teaching at its best: Merging instructional design with teaching and learning research. John Wiley & Sons.
  • Nilson, Linda (2021). Infusing Critical Thinking Into Your Course: A Concrete, Practical Guide. Stylus.
  • McKeachie, W. J. (1978). Teaching tips: A guidebook for the beginning college teacher. DC Heath.
  • POD
  • Betts, K., Miller, M., Tokuhama-Espinosa, T., Shewokis, P., Anderson, A., Borja, C., Galoyan, T., Delaney, B., Eigenauer, J., & Dekker, S. (2019). International report: Neuromyths and evidence-based practices in higher education. Online Learning Consortium: Newburyport, MA.’
  • Padlet
  • Jamboard
  • Eric Mazur
  • Dan Levy
  • Teaching with Zoom – Dan Levy – Tea for Teaching podcast – May 26, 2021

Transcript

John: New faculty often start their faculty roles without training in teaching. In this episode we talk about the evolving roles and expectations of faculty and explore the new edition of a classic teaching guide.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guests today are Linda Nilson and Todd Zakrajsek. Now Director Emeritus, Linda was the Founding Director of the Office of Teaching Effectiveness and Innovation at Clemson University. Todd is an Associate Research Professor and Associate Director of the Faculty Development Fellowship in the Department of Family Medicine at the University of North Carolina at Chapel Hill. Linda and Todd are each individually the authors of many superb books on teaching and learning and now jointly have authored another superb book. Welcome back, Linda and Todd.

Linda: Thank you very much.

Todd: Really appreciate the opportunity to be here.

Rebecca: Today’s teas are: … Linda, are you drinking tea?

Linda: I’m drinking a tea called water. It’s rather dull, but I enjoy it.

Rebecca: It’s very pure.

Linda: Yes, very pure. Very pure.

Rebecca: How about you Todd?

Todd: Oh, I’ve got myself a Lemon Detox because I’ve spent most of my day getting all toxed and now I’m getting detoxed. [LAUGHTER] Wait a minute, that sounds bad. [LAUGHTER] But that will be all right. [LAUGHTER]

John: Especially at Family Medicine.

Todd: Well, we can fix it. [LAUGHTER] In general, life is good.

John: I am drinking pineapple green tea.

Rebecca: Oh, that’s a new one for you, John.

John: I’ve had it before, just not recently.

Rebecca: Okay. I’m back to the very old favorite, English afternoon. Because I stopped by the Center for Excellence in Learning and Teaching and grabbed a cup before I came.

John: And we are recording together in the same room, which has been a fairly rare occurrence for the last several years. We’ve invited you here to discuss your joint endeavor on the fifth edition of Teaching at its Best: a Research-Based Resource for College Instructors, that Linda originally developed and now you’ve collaborated on this new edition. How did the collaboration on this edition come about?

Linda: Well, let me talk about that. Because it was pretty much my idea. Jossie-Bass contacted me and said “let’s put out a fifth edition” and I said “let’s not.” [LAUGHTER] I was not in the mood to do it. I’ve been retired six and a half years now and I’m loving it. I mean, I’m really loving it. And while retired, I was still writing the second edition of Online Teaching at its Best. And then I was writing a book, Infusing Critical Thinking Into Your Course, and I guess I had had it. I mean, I wanted to really make a change and I wanted to get specifically into working at an animal shelter. So I was all occupied with that. So I thought I remember Wilbert J. McKeachie, when he was doing Teaching Tips that he came to a certain point after I don’t know how many editions that he brought other people on to really do the revision work. And so I decided I’m going to do that. So Jossey-Bass said “Okay, fine.” They wanted three names. Okay, I gave him three names, but my first choice was Todd Zakrajsek, because 1. I knew he’d finish it. [LAUGHTER] I knew he’d finish it fast. I knew he do a great job. He knows the literature like the back of his hand, I wouldn’t have a worry in the world. And guess what? Todd accepted. Hip hip hurray. I was so happy. I couldn’t tell you.

Todd: Well, this is great because I said no when they asked me. [LAUGHTER]

Rebecca: Like any smart person would, right? [LAUGHTER]

Todd: Well, I did end up doing it, of course. But the reason I said no was I knew that book very well and I know Linda very well. And I said, “There is no way. I don’t know anybody who can step in and pick this thing up. She knows so much about so much that it’s just not possible.” And they said, “But she really wants you to do this.” So I went back and forth a couple times and I finally decided to do it. And I will tell you, Linda, because I haven’t mentioned this to you. The first three chapters, I had to go back and redo those when I got done with it, because I was so scared of the first three chapters [LAUGHTER] that it was really rough. And then finally it’s like, okay, I hit my rhythm and I walked into it with impostor syndrome a little bit, and I finally caught my footing, but it’s a good book to start with.

Linda: Thank you. Thank you very much. [LAUGHTER] Yeah, I know, the plot thickens, right? It becomes more interesting as you go from chapter to chapter, right. And before you know it, there’s a happy ending after all.

Rebecca: So Linda, Teaching at its Best has been around for a long time with a first edition published in 1998. Can you talk a little bit about how that first edition came about?

Linda: Yes, that was…I can’t believe… 1998. That’s 25 years ago. It’s almost scary how time flies. But anyway, the actual seed of the book came about in about 1994… 95. But I need to give you some background because I had been writing TA training books since like, the late 1970s when I was first given the task of putting together a TA training program. So back then, I was putting out weekly mimeos,[LAUGHTER] remember mimeograph machines. Some of you don’t know, what is she talking about? But anyway, that was technology then. But anyway, smetl great, though… it really did. [LAUGHTER]

Rebecca: That’s the second time today someone has made a reference about the smell of those.

Linda: Yeah, oh yeah.

John: The dittos are what I remember having the stronger smell

Todd: The ditto did, yeah. yeah, and I’ll tell you before we move on, when I was a graduate student, we had a ditto machine. I just have to say this, Linda, because you liked the smell and all there.

Linda: Yeah, Yeah.

Todd: But they had a ditto machine. And below the ditto machine, I noticed that the floor tiles were kind of eaten away by the ditto fluid. [LAUGHTER] And then here’s the best part is that one day I was rooting around in the closet looking for something and I found the extra tiles in a box and the side of the box said “reinforced with long-lasting asbestos.” [LAUGHTER] So the ditto fluid was eating through asbestos lined tile, but that’s how strong that stuff is. So yeah, we all enjoyed the smell of that stuff back in the day..

Linda: Yeah, yeah. I guess it’s a good thing for all of us they invented something else, like copying machines. So anyway, so I started doing that at UCLA. And then that turned into like a booklet of sorts. And then I was at UC Riverside, and I was writing books there. And I sort of revised it every couple of years. And I was also writing these with my master teaching fellows. So we were doing that. And then I came to Vanderbilt, and I decided, well, I’m going to do this, pretty much on my own, I’ll get some help from my master teaching fellows. But anyway, it turned into an actual book. I mean, it turned into a happy monster. And I was very pleased with it. Well, along about 94-95, my husband recommended that I turn it into a regular book, and talk to a publisher about it. So anyway, I said, “Oh, great idea. Great idea and just sort of didn’t think about it much. Then in 1996, he died. And I thought, “Well, how am I going to pull myself through?” I bet it would be a great idea and a great tribute to him if I took Teaching at its Best, the Vanderbilt edition, and turned that into a general book. And I decided to do that and kept my mind off of bad things. And it turned into Teaching at its Best, the first edition. That’s why I dedicated the book to him, by the way, because it really was his inspiration that got me to do it. And so anyway, tribute to him. So that’s where the first edition came from. I mean, it really grew out of tragedy. But it’s been a comedy ever since, right? [LAUGHTER] So anyway, it’s been a wonderful thing.

John: And it’s been a great resource.

Rebecca: It’s interesting that it pulled you through, but then has pulled many teachers through. [LAUGHTER]

Linda: And I’ve gotten such feedback from faculty members who said, “I saved their lunch,” you know, if they were really in big trouble, and some of them said, “I was in big trouble with my teaching and you got me tenure.” Yeah, like, right. But anyway, the book helped a lot of people. And I guess maybe something in me when I first published this book said, “Gee it would really be great to be the next Wilbert McKeachie, right, which is a very pretentious thing to think. But then they wanted the second edition, I was thinking, “Hey, maybe I’m on the road to something.” And then there was a third, and then there was the fourth. And it didn’t get any easier to write the subsequent editions really, it was just a matter of keeping up with the literature. And so right now, I’m off into another corner of the world. So I just didn’t want to immerse myself in that again.

John: So that brings us to the question of what is new in the fifth edition?

Todd: Well, that’s my question. I’ve known Linda for the longest time. By the way, I do want to mention before we go on, I can’t remember, Linda, if it’s been that long ago, but it might have been the second edition. When at POD, I said, “You need to do a second edition of this book” …or second or third. But I was using the book. I mean, I learned so much from it. So for the new edition. Number one, of course, the research has been updated only because the research is always changing. And it had been a few years. So that’s number one. In terms of changing the book, though, we only have a leeway of about 10,000 words. Now, for those out there listening 10,000 words sounds like a lot of words until you’ve got a 200,000 word book, it was about 190. And they said, you can’t go over 200 Because the book just gets too big then. So it is 10,000 words longer than it was in fact, I think it’s 10,003 words longer. So it’s right in there. [LAUGHTER]

Rebecca: So you snuck an extra 3 words in.

Todd: It could have been a squeeze to put three words in there. And it’s always hilarious because when they say there’s just a few too many words I just start hyphenating things so yeah, it kind of all works. [LAUGHTER] Yeah, just any words at all. So you can do “can you” as just a hyphenated word. It works. [LAUGHTER]K So is that terminology, the terminology does change and I find this fascinating. One of the things I love to write about books is learning. I mean, Linda, the same thing what as we write, we read a ton of stuff. And as we read stuff, we learn stuff. So this one in particular, for example, is that I grew up with PBL as problem based learning. And I had done workshops on it, I had worked on everything else, but I hadn’t looked at it for quite a while. And in this particular book, as I started looking at PBL, I couldn’t find anything on problem based learning. And it was fascinating because I was doing some digging, and then I called Claire Major, who was an early person who had a grant on problem based learning and everything I ran into was about 2002, it just started to drop off a little bit, and there was some, but it started to tail off. And when I talked to Claire, she says, “Oh, yeah, I used to do quite a bit about that, it was back around 2002-2003.” And now, and the reason I’m saying this is, every time I saw the letters PBL, it was project based learning. And project based learning sounds a lot like problem based learning, but they’re different concepts. And so anyway, going through and finding some of the terminology, so it was consistent with what’s being done right now has changed. There is now a chapter on inclusive teaching, because over the last three or four years, we finally realized that there’s a whole lot of individuals who haven’t been successful in higher education, partly because of the way we teach. And so I’ve been making an argument for a few years now that teaching and learning, the classroom situation has always really been based for fast-talking, risk-taking extroverts. And we’ve suddenly realized that if you’re not a fast-talking, risk-taking extrovert, you may not get a chance to participate, classroom and other things. So I looked at some different things with inclusive teaching. There’s a whole another chapter on that. And then just the language throughout, we talk a little differently now, just even over the last three or four years than we did five, six years ago, I was pretty surprised by that. But there’s some pretty significant changes in language. So the book has a slightly different tone in language, and those are the biggest changes. Oh, I should say, before we move on, one of the biggest other changes, and I did this one, Linda put a section in there that said learning styles had changed significantly from the previous edition. And so she had pointed out that there was no longer a section on learning styles. And I put the learning styles right back in there, I told Linda and she gasped just a little bit. And then I explained that I put it back in there, and then said exactly how terrible it was to basically teach according to learning styles, because it’s the myth that will not die. So that’s back in there.

Linda: People love it. I know. [LAUGHTER]

John: We have that issue all the time, students come in believing in them and say, “Well, I can’t learn from reading because I’m a visual learner.” And I say “Well, fortunately, you use your eyes to read,” and then I’ll get them some citations.

Todd: Well, I’ll tell you, and before we move on, these are the types of things we learned. I couldn’t figure out why the thing is so hard to die. What is it that’s really doing this because other myths we’ve been able to debunk. And part of the reason is licensing exams, when you are in pre-service and you want to become a teacher, the exams you take to become a teacher, a large portion of those exams, have learning styles questions on there. So you have to answer about visual learners and auditory learners and kinesthetic. And so until we get those out of teacher education programs, we’re teaching teachers to believe this. So anyway, there you go. Public service announcement. Be careful about meshing. And if you don’t know what meshing is, look it up and then stop it. [LAUGHTER]

John: We have had guests on the podcast who mentioned learning styles, and then we edit them out and explain to them later why we edit out any reference to that. And I think most of them were in education, either as instructors, or they’ve been working as secondary teachers. It is a pretty pervasive myth. In fact, Michelle Miller and Kristen Betts, together with some other people, did a survey. And that was the most commonly believed myth about teaching and learning. It was done through OLC a few years back, about three or four years ago. Yep,

Todd: Yeah, I saw that survey. Yes, it’s pretty amazing. Michelle’s an amazing person.

Rebecca: The experience of the pandemic has had a fairly large impact on how our classes are taught. Can you talk a little bit, Todd, about how this is reflected in this new edition?

Todd: Things have changed pretty significantly because of the pandemic. There’s a couple things going on. Again, the inclusive teaching and learning, which I’ve already commented on, is really different now. And it’s interesting, because it goes back to the 1960s. We’ve known that, for instance, African Americans tend to flunk at twice the rate of Caucasians, in large machine-scored multiple choice exams. So we know it’s not the teaching, and we know it’s not the grades, it has to be something else. And it turns out that it was you put students into groups and those differences start to disappear. So I mean, even more so the last couple of years, it’s a lot of engaged learning, active learning. I’m still going to pitch my stuff that I’ve been ranting and raving about for years. And there’s no data out there that says that lecturing is bad. What the data says is that if you add active and engaged learning to lecture, then you have much better outcomes than lecture alone. But we’re learning about those types of things in terms of active and engaged learning, how to pair it with and mix it with other strategies that work, looking at distance education in terms of systems and how we can use technology. So a quick example is I used to have a review session before exams. And oftentimes, it’s hard to find a place on campus to have that. And so you might be in a room off in one hall or the library or something. And if the exam was on Monday, I’d have the review session at like six o’clock, seven o’clock on a Sunday night. And there are students who couldn’t make it. I would simply say, you can get notes from someone else. And we’ve known for the longest time, if a student misses class, getting notes from somebody else doesn’t work. Well, now I do review sessions on Zoom, we don’t have to worry about finding a place to park, we don’t have to worry about some students finding babysitters, if they’re working, it’s recorded, so they get the exact same thing. So things like Zoom have really changed teaching in a sense that you can capture the essence in the experience of teaching and use it for others, and it has helped with some equity issues. You can’t do it all the time. And teaching over Zoom is different than face to face. But there are now ways of using different technologies and using different modalities to help to teach in ways that were not really used before the pandemic.

John: Speaking of that, during the pandemic, there was a period of rapid expansion in both the variety of edtech tools available and in terms of teaching modalities themselves. In the description of your book, it indicates that you address useful educational technology and what is a waste of time? Could you give us an example of both some useful technologies that could be used and some that are not so useful? And also perhaps a reaction to the spread of bichronous and HyFlex instruction?

Linda: Yeah, I’ll take this one. And I’m drawing a lot of stuff from another book that I co-authored, with Ludwika Goodman. We were writing about Online Teaching at its Best, okay. And she was an instructional designer. And I came from teaching and learning and we put our literature’s together. And we were talking about modalities a great deal, especially in the second edition with the pandemic. Well, one thing I found out, not only from reading, but also from watching this happen was that this Hyflex or bichronous, whatever you want to call it, is a bust, if there ever was a modality, that’s a bad idea it’s that one, even though administrators love it because students can choose whether to come to class and do the things they would do in class, or to attend class remotely? Well, yeah, it sounds like “oh, yeah, that could be good.” But the technological problems, and then the social problems, especially the in-class social problems are enormous. And in-class social problems, like small group work, how do you hear what’s going on in the classroom over this low roar of small groups? Okay, so how can you help? How can the students that are learning remotely, what can they do? Now, the way this was invented, by the way, was for a small graduate class, and then okay, like, makes sense, because you’re only dealing with six students in this room and six students who are remote. But other than that, it’s so bad, the logistics, the sound logistics, the coordination that the instructor has to maintain, the attempt at being fair to both groups, at bringing in both groups, when the groups can’t even hear each other well. Now, if we had Hollywood level equipment in our classrooms, we might be able to make this work a little better, but we don’t, and we’re never going to have that. So there are just a lot of technological and social reasons why HyFlex, that’s what I called it in Online Teaching at its Best, what it was called at the time is a complete bust. Now, not to be confused with hybrid or blended learning, which we found has worked exceedingly well. So bringing in some technology, but into a face-to-face environment and that being the base of the class. Now, remote’s nice, but you might not want to do remote all the time for all things. It’s not quite the next best thing to being there. But it’s something and as long as you don’t just stand there and stare at the camera and lecture for an hour. You’ll get complaints about that quickly. And particularly with students today when they really need to be actively involved, actively engaged. So yeah, sure, fine, talk for three minutes, maybe even push it for five, but then give them something to do and you really, really must in remote because otherwise, you’re just some talking head on television.

Todd: I agree completely. In fact, it was funny because I happen to have a digital copy of the book here. And so I typed in a ctrl F and I typed in HyFlex and there’s one comment to the preface that said there’s many different formats out there and then I will tell the listeners, if you’re expecting to learn about HyFlex, the word never shows up again in the book. [LAUGHTER] So, it’s not in there. I mean, you look at the literature that’s out there. And I think it’s fair to say that maybe there are people who can do it. I haven’t really seen it done well and I think Linda’s saying she hasn’t either. And it’s so difficult, especially for a book like this. That’s not what we’re all about. I mean, again, if it even works well, which I’d love to hear that it would be a very advanced book and that’s not what this is. So we do have a lot in there about technology in terms of edtech tools, though. There are those in there, I would just say real quickly, for instance, Padlet’s one of my favorites, I’ll throw that out there. I like Padlet a lot. But there are tools out there, if you want to do a gallery walk, which for instance, if you happen to be in a face-to-face course, you’d set up maybe four stations with big sheets of paper, you put your students into groups, and then they walk from sheet of paper to sheet of paper, and they move around the room. And they can do what’s called a gallery walk. You can do the same thing online with a jamboard, you can set up jamboards so that there’s different pages, and then each group is on a page. And then you just say it’s time to shift pages, they could shift pages. So I’ve done gallery walks, and it’s worked well. I’ve used Padlet for brainstorming. And one of the things I love about Padlet, I’ll have to say is if you are doing some digital teaching in a situation, you can watch what each group is developing on the page for all groups at the same time. I can’t hear all groups at the same time when I walk around the room. So there are certainly some technologies coming out that can really do things well. There’s also things that don’t work very well, though. And I think one of the things you want to keep in mind is just learning theory. Does the technology you’re using advance students, potentially, through learning theory? Does it help with repetition? Does it help with attention? Linda was just mentioning attention, if you lecture too long, you lose their attention. If you do something ridiculously simple or not… I was gonna say stupid, but that sounds rude. But if we do something as a small group that makes no sense, you don’t get their attention either. So using clickers, I have to say, I watched a faculty member one time because they were touted as a person who was very engaging. And this is at a medical school, so I really wanted to see this. And the person used clickers, but used it in a way that asked the students a question, they responded, and the instructor looked up at the board and said, “Here’s how you responded, let’s move on.” And then moved on to the next thing. And about five minutes later gave another question said, “How do you respond?” and they clicked the clicker, and then they moved on again. That had no value at all, and in fact, there was no actual interaction there. So afterwards, I say, can’t you just ask a rhetorical question and just move on? We got to be careful not to use technology just because it’s being used, it should advance the learning process.

John: However, clickers can be effective if it’s combined with peer discussion and some feedback and some just-in-time teaching. If it’s just used to get responses that are ignored, it really doesn’t align with any evidence-based practice or anything we know about teaching and learning. But those per discussions can be useful and there’s a lot of research that show that does result in longer-term knowledge retention when it’s used correctly, but often it’s not.

Todd: Right. And I think that’s a really good point. I’m glad you said that, because Eric Mazur, and his concept tests, for a large extent, that’s where active and engaged learning really took off. And that is a clicker questions. And they can be used as great tools. But again, if you’re using it for the right reason, which is what you just said, My comment is, there’s technology out there, that is a waste of time, and not a good thing to have, because it’s just not being used in a way that’s conducive to learning. So good point, that’s fair.

Rebecca: Can you talk a little bit about who the audience of the book is?

Linda: Sure. It’s actually for anybody who teaches students older than children, I suppose, because it isn’t really designed for teaching children. But other than that, it’s really for people who teach but don’t have the time to read a book. The nice thing about Teaching at its Best is you can go to the table of contents, you go to the index, you could find exactly what you need for your next class. And it’s very oriented towards how to, so it could be for beginners or for experienced people who simply haven’t tried something specific before, or want a twist on it, or just want some inspiration. Because there there are a lot of different teaching techniques in there. And they’re all oriented towards student engagement, every single one of them. But I wanted to comment too, on just how the job of instructor or professor has changed over the past, I don’t know, 40 years, I suppose. I know when I started teaching it was a completely different job. And I started teaching in 1975, when I was 12, of course, but no and I was young to start teaching because I was 25 and there I was 180 students in front of me. So oops, my goodness, what have I done? But that’s exactly what I wanted to do. But you’d go in there, you’d lecture and you’d walk out. You were in complete control of everything. Like, you might throw out a question and you might get a discussion going. But it wasn’t considered to be essential. In fact, there were two teaching techniques back then: there was lecture, and there was discussion. And nobody knew how to do discussion. Now, I had to find out a few things about it when I was doing TA training, because TAs were supposed to be running discussions. But there wasn’t a lot out there. Thank God for Wilbert McKeachie’s book Teaching Tips, because that was about the only source out there you could go to. So anyway, but now the job, I mean, oh, it’s mind boggling what faculty are now expected to do. And they are supposed to, like, learning outcomes. Okay, I love learning outcomes. They’re wonderful. But I didn’t have to do that when I started, I just had to talk about my subject, which I dearly loved. And so, that was nothing. But you’ve got learning outcomes. So you’ve got to be like, a course designer, you have to deal with a student’s mental health problems, right? It’s part of the job, and you’re expected to respond to them. You’re supposed to give them career counseling in careers that you might not know much about, and possibly for good reason, because you’re in your own career. It’s so time consuming, not to mention fair use, oh, yes, fair use has changed, fair use has changed radically. And when you’re dealing with anything online, the rules are totally different. And you’re highly restricted as to what you can use, what you could do. When you’re in a face-to-face classroom, it’s a little bit easier. So yeah, so you got to be a copyright lawyer to stay out of trouble. And then you get involved in accreditation, you get involved in that kind of assessment. So you have to all of a sudden be totally involved in what your program is doing, what your major is doing, where it’s headed. There’s just too much to do. And there are more and more committees and oh, there’s a lot of time wasted in committees. Of course, you’re supposed to publish at the same time and make presentations at conferences. It was like that back then, too. But now, the expectations are higher, and it’s on top of more time in teaching, and more courses. I was teaching four courses a year, and you can’t find that kind of job anymore.

Rebecca: So Linda, you’re saying the animal shelter is going really well now?

Linda: Yes. Yes. Yes. Yes.

Todd: That’s hilarious. Well, I want to point out too, and I think Linda’s said it very, very well is that we are expected to do things we never had to use before. Never worried about before. And I love the fair use is great, because when I first started teaching, and I’ve been teaching for 36 years, when I first started teaching, you’d videotape something off TV and show it in class and then put it on the shelf. And I knew people who showed the same video for 10 years. Right now you better be careful about showing the same video for 10 years. But these are things we need to know. I would say also, by the way, this is a really good book for administrators, anybody who would like to give guidance to faculty members, or better understand teaching and learning so that when promotion and tenure comes along, you get a sense of this. And so if you’re saying to the faculty, they should use a variety of teaching strategies. It’s not a bad idea to know a variety of teaching strategies. And so I think it’s good for administrators as well, and graduate students. But I want to take a second and tell you, one of the reviews of the book, I guess, came in just yesterday or the day before from Dan Levy. He’s a senior lecturer at Harvard University. And what he put was Teaching at it’s Best is an absolute gem. Whether you are new to teaching in higher education, or have been doing it for a while, you will find this book’s evidence-based advice on a wide range of teaching issues to be very helpful. The style is engaging and the breadth is impressive. If you want to teach at your best you should read Teaching at its Best. And I love what he put in there because it doesn’t matter if you’re a new teacher or you’ve been doing it for a while, this book’s got a lot of stuff in it.

John: And Dan has been a guest on our podcast, and he’s also an economist, which is another thing in his favor. [LAUGHTER]

Todd: That is good.

John: I do want to comment on lenders observation about how teaching has changed because I came in at a very similar type of experience. I was told by the chair of the department not to waste a lot of time on teaching and to focus primarily on research because that’s what’s most important, and that’s the only thing that’s really ultimately valued here or elsewhere in the job market. But then what happened is a few people started reading the literature on how we learn And then they started writing these books about it. [LAUGHTER] And these books encouraged us to do things like retrieval practice and low-stakes tests, and to provide lots of feedback to students. So those people…[LAUGHTER]

Rebecca: I don’t know any of them.

John: …but as a result of that many people started changing the way they teach in response to this. So some of it is you brought this on to all of us by sharing… [LAUGHTER]

Linda: I apologize.

Todd: Sorry about that.

Linda: I apologize.

Todd: We apologize and you know, I will say too is, so yeah, sorry. Sorry about doing that. But I’m glad you said that.

Linda: We made the job harder didn’t we?

Todd: We did, but you know to just be fair for Linda and I as well as I still remember a faculty member calling me, It must have been about 20 years ago, and I just started doing a little bit of Faculty Development, she was crying, she had given her first assignment in terms of a paper. And she said, I’m sitting here with a stack of papers, and I don’t know how to grade them. And it got me thinking a little bit, how many of the aspects of the job that we’re required to do, were we trained to do? And that’s the stuff that Linda was mentioning as well, is nobody taught me. I’m an industrial psychologist. And so nobody taught me the strategies for delivering information to a group of 200 people. Nobody taught me how to grade essay tests. Nobody taught me how to grade presentations, I didn’t know about fair use and how I could use things. I mean, you go through and list all of the things that you’re required to do. And then look at all the things you were trained to do. And this is tough. And that changed. So I have one quick one I’ll mention is I was hired as an adjunct faculty member before I got my first tenure-track job. And I was teaching 4-4. So I had four classes in the fall, four classes in the spring. And about halfway through the spring, I ran into the department chair, and I was interested to see if I was going to be able to come back and I said, “Hey, Mike, how am I doing?” And this was at Central Michigan University, a pretty good sized school. He said, “You were fantastic.” And I said, “Excellent. What have you heard?” He said, “absolutely nothing.” So when it comes to teaching, what I learned was: research, you had to do well, and teaching, you had to not do terribly. And that is what you were mentioning has changed is now you’re kind of expected to do teaching as well.

Rebecca: And there’s a lot more research in the area now too. So sometimes it’s hard to keep up on it. So books like this can be really helpful in providing a lot of that research in one place.

John: And both of you have written many good books that have guided many, many faculty in their careers, and eliminated that gap between what we’re trained to do and what we actually have to do.

Rebecca: So of course, we want to know when we can have this book in our hands.

Todd: Good news for this book, which is exciting because we really cranked away on this thing and it’s listed in Amazon as being due on April 25. But it actually went to press on January 23. So it’s already out and about three months ahead of schedule.

John: Excellent. We’re looking forward to it. I’ve had my copy on preorder since I saw a tweet about this. I think it was your tweet, Todd, a while back. And I’m very much looking forward to receiving a copy of it.

Todd: Excellent. We’re looking forward to people being able to benefit from copies of it.

Rebecca: So we always wrap up by asking what’s next.

Todd: It’s hard to tell what’s next because I’m exhausted from what’s been [LAUGHTER] ever moving forward, as I’m working on and just finishing a book right now that’s to help faculty in the first year of their teaching. So it’s basically off to a good start. It’s what specifically faculty should do in the first year of getting a teaching position. And aside from that, probably working on my next jigsaw puzzle, I like to do the great big jigsaw puzzles. And so I just finished one that had 33,600 pieces. It is five feet….

Rebecca: Did you say 33,000 pieces?

Todd: No, I said 33,600 pieces.It was the 600 that…

Rebecca: Oh, ok.

Todd: …was difficult. [LAUGHTER]

Rebecca: Yeah.

Todd: When the puzzle is done, it has standard sized pieces, and it is five feet by 20 feet. So I just enjoy massively putting something together. It’s very challenging. So quite frankly, for those about and listening to this is if you imagine 33,600 puzzle pieces, that’s about as many studies as Linda and I have read to put this book together. [LAUGHTER]

Linda: Nothing to it. [LAUGHTER]

Todd: So that’s it for me. [LAUGHTER] Linda, what are you up to these days?

Linda: Oh, well, I live in la la land. So I’m still doing workshops and webinars and things like that mostly on my books of various kinds, various teaching topics. But I think what I want to do is retake up pastels and charcoals. My father was a commercial artist. And so he got me into pastels and charcoals when I was in high school. Well and then I dropped it to go off to college. Well, I want to get back into it in addition to working at the animal shelter. I know. It’s la la land and I wish la la land on everybody that I like.[LAUGHTER] I hope you all go to la la land and enjoy being a four year old all over again, because that’s the way I feel. I adapted to retirement in about 24 hours. That’s pushing it… you know, it’s more like four. But anyway, I slept on it. [LAUGHTER] That was the end of it. But I know I eased into it. I eased into it. I was still writing. I was still doing, especially before the pandemic, a lot of speaking. So then the pandemic hit and it just turned into online everything. And now I’m back on the road again, to a certain extent. I love it. So anyway, it’s a nice balance. So yeah, I wish you all la la land too.

Todd: That’s great.

Rebecca: That’s something to aspire to.

Todd: Yeah, it is. But you know, since you mentioned the speaking things, I just have to do the quick plug here. Linda, I think you and I, years and years ago, were joking around at POD about who would be the first one to get to the 50 states and have done a presentation in every state. And so I gotta tell you, I’m not even sure where you’re at in the mix, but I am at 49 states. And if any of your listeners are in North Dakota, [LAUGHTER] I could certainly use a phone call from North Dakota.

Linda: Well, I want to go to Vermont. I have not been to Vermont…

Todd: Oh, you haven’t.

Linda: …to give a presentation. So I would enjoy that. But I’ll go to Hawaii. I’ll do anything in Hawaii for you. Absolutely anything. [LAUGHTER] I’ll do gardening, [LAUGHTER] I’ll do dishes, your laundry. I don’t care.

Todd: That is good. Yeah, Linda and I had this gig. It was a long, long time ago. And I don’t know, it must have been 20 years ago we talked about it even. And there was some rules too. You had to be invited. And there had to be some kind of an honorarium or just I mean, it didn’t have to be much, but the concept was you just couldn’t show up at a state and start talking. [LAUGHTER] Otherwise, we’d have both been done a long time ago. But yeah,

Linda: Yeah.

Todd: … it was fun. This is the way nerds have fun. [LAUGHTER]

John: Well, that’s a competition that’s benefited again, a lot of people over the years.

Rebecca: Well, thanks so much for joining us. It’s great to see both of you again, and we look forward to seeing your new book.

Linda: Thank you for this opportunity. It was a pleasure.

Todd: It was so much fun. Thank you

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

263. Reflect to Deflect

Students experiencing difficulty in challenging courses will sometimes blame their professor, especially when their professor’s identity does not align with the student’s cultural stereotype of who is a professor. In this episode, Melissa Eblen-Zayas joins us to discuss how she uses metacognitive reflection exercises to address student biases.

Melissa is a Professor of Physics in the Department of Astronomy and Physics at Carleton College. Melissa has served as a Director of a teaching center, and has published extensively on a wide variety of topics such as STEM education, student metacognition, and diversity, equity and inclusion. One of her most recent publications is a chapter in Picture a Professor, edited by Jessamyn Neuhaus.

Show Notes

Transcript

John: Students experiencing difficulty in challenging courses will sometimes blame their professor, especially when their professor’s identity does not align with the student’s cultural stereotype of who is a professor. In this episode, we examine how one professor uses metacognitive reflection exercises to address student biases

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Melissa Eblen-Zayas. Melissa is a Professor of Physics in the Department of Astronomy and Physics at Carleton College. Melissa has served as a Director of a teaching center, and has published extensively on a wide variety of topics such as STEM education, student metacognition, and diversity, equity and inclusion. One of her most recent publications is a chapter in Picture a Professor, edited by Jessamyn Neuhaus. Welcome, Melissa.

Melissa: Hi, great to be here.

John: Today’s teas are:… Melissa, are you drinking tea?

Melissa: I am. I’m drinking a black tea with cranberry orange.

Rebecca: Oh, that sounds really good.

Melissa: It is, and it’s finally cool enough that it’s tea weather.

Rebecca: Oh, it’s tea weather year-round.

Melissa: I am a cold weather tea drinker.

Rebecca: Okay, well, it’s definitely cold today, and empty [LAUGHTER]. I just finished a pot of eight at the fort. Eight, the number eight, once again. It’s a black blend. I don’t know what’s in it still. We’re recording an episode a couple days ago, I was drinking the same thing. I still don’t know what’s in it.

John: And I am drinking ginger peach black tea today.

Rebecca: So we invited you here today, Melissa, to discuss your chapter in Picture a Professor. The title of your chapter is “Reflect to Deflect: Using Metacognitive Activities to Address Student Perceptions of Instructor Competence and Caring.” Could you tell us a bit about why you started using metacognitive activities in your classes?

Melissa: Yeah, so when I was a junior faculty member, just starting out teaching physics, I found that I would get a lot of pushback from students. When students didn’t understand a topic right away or do as well as they had hoped on an assignment or an exam, they’d often be disappointed or frustrated. And some of those students would then come to my office, and the implication underneath their visit to my office was that if I was a better teacher, or if I just did things differently, they wouldn’t be in the situation that they were in. And of course, there’s always room to grow as a teacher, but that wasn’t the primary issue. I think the research literature shows that for younger women faculty members, they often encounter challenges from students as a persistent problem. And particularly as a woman in physics, where there aren’t many women, I think a lot of what I was seeing was there were some students who just had trouble seeing that this young woman in front of the class was actually a competent physicist and in a position to be able to effectively teach them. And in reality, there’s some additional research, Madeline Heilman and colleagues have found that women in male-dominated fields face this double bind in terms of expectations, and they can either be seen as competent or likable, but not both. And in some follow up research that they did, they found that women can try to mitigate this double bind by displaying a caring and nurturing demeanor. But my natural demeanor… I tend to be a sort of reserved person, I’m not a super outgoing, cheerful kind of person, I tend to just be sort of quieter. And so I was looking for a way to demonstrate to students that I cared deeply about them and I cared deeply about their success in this class, but to also demonstrate that maybe I could help them do this, as opposed to having them just pin their lack of success on my failure as a teacher. And so I found that introducing metacognitive activities was a way for me to navigate some of the pushback that I got from students, and to help them take responsibility for their learning, but also to demonstrate to students that I cared deeply about their success. And I wanted to help them learn how to navigate the ways of thinking, studying, and learning that are important to my discipline. And so I found that this is a way that I could demonstrate a caring that is what students expect from female faculty members, but in a way that felt more natural to me, as opposed to trying to pretend that I was a caregiver or a cheerleader in a way that just didn’t feel natural to me. And so the place where I introduced these metacognitive activities were actually on two very different ends of the spectrum in terms of course level. I found that one place where I got a lot of pushback from students was in my intro course. And then the other place where I actually got a fair amount of pushback from students was also in the advanced lab course that I taught. And both of these classes are classes where there was the opportunity for students to be frustrated a lot, and I find that when student frustration is high, finding ways to try to mitigate that frustration is important. And so the metacognitive activities are a way that I have now incorporated into my teaching in an effort to both help students succeed, but also mitigate some of the pushback that I would get from students.

John: Could you describe these metacognitive activities? How do you get students become more aware of what they know and what they don’t know?

Melissa: Yeah, so this has been a long evolutionary process over which I’ve developed these activities. And so I’ll start by describing the first activity that I introduced, which was really in my first or second year of teaching, when I was getting a lot of this pushback from students. And in particular, in intro physics classes, I’d hand back any item of student work, and students would always come in and challenge me about the grades that I had given them. And I would say now, I’ve moved away from grading in a traditional manner. So this isn’t quite as much of an issue, but at the time, I was using traditional point- based systems. So I started by instituting a policy that if you had concerns about homework or exams, before you could come in and see me at office hours, you had to send me via email, a summary of how you approached the problem that you wanted to talk to me about, you had to write down why you think I might not have given you full credit for your work. And then you had to talk to me about your rationale for why you think there was a discrepancy between your understanding of the material, how you did the work, how I viewed the work, and what I was hoping to see in terms of learning, and then why you thought there was this discrepancy. And that ended up being really interesting, because first off, it limited the number of students who just came charging in without having really looked at or thought about the work that they had done and the feedback that I had given. But the other thing is that then it started as a discussion about the learning that the students were doing, and how the students were perceiving their learning, and how I was perceiving their learning. And so that’s really where I started as a way to directly respond to the student challenges that I was facing. But then I really liked the opportunities that this provided for conversations with students about how they were thinking about their work in the course. And so the next activity that I started to include was homework wrappers. And so when students would submit problem sets, I would also ask them to submit a cover sheet to their problem set. And it will be questions about “who did you work with on this problem set?” “Where did you work on this problem set?” “How long did it take you?” “Did you ask people for help?” And that was a great way for students to monitor not just: did they get the answers, but sort of how were they engaging with the homework that they were working on. And it was also a great way for me to get some insight into what students were doing, so I could see if there were students who never listed that they worked with anyone, never listed that they reached out for help, I could then proactively reach out to those students and say, “I see you’re doing this alone, that’s fine. But that’s really not my expectation, I’m expecting that this is a community, we’re learning together, and I’m expecting that people will talk with each other about this work.” Or I could also report back to the class and give some summary statistics of saying like, “Oh, I saw that most people are spending this many hours on the problem set, but here’s the distribution. And so if you’re either way on the short end or way on the long end, just be aware, and maybe come in and talk with me.” And so that was the next step of including metacognitive activities that I introduced. And I think since then it’s just taken off in terms of the ways in which I include those activities. And so I’ll give you one example of more in depth metacognitive activities that I do in my intro physics class, and one example of some of the more metacognitive activities that I do in my advanced lab course. And both of these actually have to do with the idea of what is the error climate of the classroom? And how much room is there? And how acceptable is it for people to make mistakes. And I first really started thinking about this actually in the advanced lab course that I was teaching. And so this is a required course for all physics majors. But the focus in this course is really having students design an experiment, and then carry out their experiment. But the focus being more on the design of the experiment and in the confines of a term, they may not actually get to a completed project or a result. And so things fail, things don’t go according to plan, and students are inevitably frustrated by that. And so the first time I taught this course with this focus on lots of independent projects, I just didn’t address the frustration that accompanies the failure and the uncertainty and the confusion that inevitably occurs in a course like this where students are doing these independent projects. And so the next year when I taught this course, before the first day of class, I asked students to write down in two sentences, what their definition of a successful experiment was. And I would say the answers fell into two distinct categories. There was one subset of answers of students who said, “a successful experiment is where I get a high precision result with little error that closely matches theoretical predictions.” And indeed, I think sometimes how we set up laboratory work in early courses, what students are doing is they’re trying to get a result that will match a particular theory. But in these open-ended projects, they were designing things they were asking questions that maybe there weren’t clear answers for. And so if that’s your definition of success, you’re going to have trouble when you deal with the messiness that inevitably exists. But the other group of students in defining what their successful experiment was, there were students who would say, “oh, any experiment is a success, if I keep a good record of what I’m doing, and I learned something from the process.” And so I would start the first day of class and pick out some of these different definitions of successful experiments from students in their own words. And we begin by having this conversation about what are our own expectations for what learning and experimenting looks like. And then, throughout the course, I continued to normalize that things wouldn’t work, that things would fail, by having opportunities, both for individual reflections. And so about every two weeks, I would ask them questions that just reflected, “how did you approach work in the lab?” “When you ran into problems, what was the strategy you employed in trying to troubleshoot those problems?” And I didn’t ask if you ran into problems, I started the question “when you ran into problems” with the assumption that everyone is going to run into problems. And I’d ask “when you sought help, who did you seek help from?” “What kinds of questions did you ask?” And then I’d always say, “and what’s one thing you would do differently as you move forward in tackling this kind of work?” And so it was really getting students to articulate how they thought about this process and how they dealt with setbacks. And sometimes it was individual reflections, but sometimes we’d actually spend a class period with students talking about their approaches, so that they could see how different individuals had different approaches. And so the whole idea about learning is an iterative process. And when things don’t go according to plan, you need to reflect on how you dealt with those setbacks, and then how you might deal with setbacks differently going forward was really important. And so I’ve taken this focus on error climate and making mistakes, and translated that a lot into my introductory course. And one of the ways I’ve changed my introductory course, which is also consistent with the pushback I would get from students about grades, was problem sets and homework and physics are really designed to be practice. It’s your chance to practice that you know how to apply these concepts to solve problems. And yet we grade those, or traditionally, I had graded those. And so that was part of what contributed to the course grade. But that’s sort of against the idea of practice. And it makes it high stakes in that you can’t make mistakes, or you’re worried about making mistakes because you’re worried that that will then reflect in your grade. And so I took this idea of “okay, if I really am serious about changing the error climate in my classroom, and making sure that it’s okay to make mistakes, not just in the lab, things won’t go according to plan. But also, when you’re working on problems, you might hit roadblocks that you don’t know how to deal with, and that’s okay.” And so one of the things I did is I now have an approach to problem sets that in some ways mirrors what my colleagues who teach writing do. And so in writing, of course, you submit a draft, you get feedback on that draft, and then you respond to that feedback, and you revise to submit a next version. And so I’ve started doing that actually, with problem sets in my introductory courses. And so I give students an initial set of problems. I asked them not to consult with each other, but just to try on their own to see how far they can get, submit whatever they have, get feedback on that. And so that’s a way for them to check how much do I understand on my own, they get some feedback, and then they can come back, they can consult with peers in their class, they can consult with me, they can make revisions, and they can resubmit that problem set. And so that really helped address this idea of it’s okay to make mistakes, that learning is a process and you can learn from your mistakes as you go forward. And I think accompanying that, I also have started giving students these prompts for weekly reflections. And so I call them learning reflections and in intro physics, they submit them once a week, and they’re asking students about lots of different aspects of the class. So it might be asking them, “where did you read the textbook?” “How did you read the textbook?” “How many times did you revisit particular parts of the reading?” I might ask students, “how do you think about translating the concepts that you’re learning and connecting it to the visuals that you’re seeing in the chapter?” The weekly reflection might be asking students about “what’s one topic that you found confusing?” And “how did you try to deal with that confusion?” And so in addition to the physics work they’re doing, I also asked them to do this reflective work. And then I can once again use that reflective work as the basis for either individual or whole class conversations about how students are thinking about engaging with the material. So that’s a big range. But it gives you sort of a sense of the variety of types of metacognitive activities I include.

Rebecca: I know one thing that I’ve experienced when I do metacognitive, or reflective activities with my students is that if they don’t have experience doing it before, and many of them don’t, they think, “Well, this is a waste of time, I’m gonna spend two seconds on it,” unless you really take the time to set it up, and help them understand the why, so I’m curious what some of the setup looks like for you and what some of the conversations have been, or the kinds of negotiations you’ve had with students about the importance of reflective activities.

Melissa: Yeah, so I actually have begun being really intentional, both about talking about it during class time, and I think talking about why I’m asking them to do this before I ask them to do it, but also making sure that when I ask them metacognitive questions, or these reflections, then I bring some of their responses back into the discussion during class time, so that they don’t feel like this is just an extra thing, but I weave this into how we are doing things in class. So for example, the reflection about how do you navigate making connections between visual representations and the physics concepts that we’re doing? The next time I come to class, and I’m giving a short lecture on a topic or something, and there’s a visual component, I might actually bring in the response that one of the students said about, well, I really have trouble doing this, or I find this helpful, if it’s relevant to the problem that we’re doing. So then it’s not as if it’s an extra thing that I’m asking them to do busy work on. I try to then also model a little bit during class time, how some of the responses might be relevant to our approaches to engaging in problems or things like that. The other thing that I’ve done, in addition to bringing this in in class time, is it used to be when I gave out problem sets in physics, my problem sets were: here’s the deadline, here are the problems. And that was it. But once again, taking a page from the folks who teach writing, when I see the assignments that my folks who teach writing-rich courses teach, there’s often quite a bit of prose that provides some background for the expectations for the written work that’s going to be done. And so I actually will include some background to my problem sets about, “okay, here’s how I want you to tackle this. First go through and do this; second, go through and do this.” And “here is why I am asking you to do this.” And I think that’s helpful. The other thing that I would say is I also give students feedback, particularly in the advanced lab course, where these reflections are sort of a central part of the course. And I’ll explicitly write to students, “I’m disappointed. This seems like it’s not really getting at how you tackle this.” And I’ll just let them know that and usually, I will then use that as a conversation starter when I’m interacting with the students to talk about ways that other students have thought about it, or why I’m asking them these questions. But you’re right, you can’t just ask students to do this, you have to build this into the fabric of the course, so it’s relevant and make sure you explain why you’re doing this.

Rebecca: One of the things that you’re describing, this worth probably noting, or talking about, is that if you start building in more reflective activity, that takes time, that then has to take priority over other things, which means other things have to be deprioritized. So what are some of the things that you allowed to let go to allow this to come in?

Melissa: I think there’s a couple of things that I have allowed to let go. One is I have just come to realize that covering lots of topics in physics is not that important. It’s really more important that they understand how to solve problems or how to take concepts and really try to dig into their understanding. Because to some extent, this is teaching students how to learn on their own, which is what’s important. I do cover less content. I will say the other thing, though, is, I think, because I don’t have as much grading that is like, let me figure out the points that I am going to give you for these problems, and it’s much more holistic feedback, I spend less time on the grading in terms of points. And I’m actually grading in terms of you’re on track here, you’re not on track here. So I’m not sure it actually requires that much more of my time. And I will say, some of these weekly learning reflections, I just go through and check if students have done them. And then I fold that into other conversations that I will have with students either during office hours or during class time. So it’s not as if I have to give lots of individualized feedback on every reflection. Maybe the best way to say it is a lot of these activities I use to enrich my interactions with students during class time, because I have this little bit of insight into how they’re thinking about approaching the material. And so when I see them working in class or working in the lab, I can talk with them not only about the physics, but I can also talk with them about what are the strategies they’re using, and maybe they might want to try using a different strategy.

John: In our very second podcast, we talked about a technique that Judie Littlejohn and I had been using, and I think we’re both still using it. It’s an online discussion forum, we call it a Metacognitive Cafe. And it’s addressing many of the same types of issues with these types of reflections. But one of the things that’s really jumped out at me over the years is just how much students have enjoyed hearing about successful learning strategies that they picked up from other people. Because students generally don’t talk very much or think very much about how they learn, and they generally don’t share it. Most years, I have one person who says, “I don’t understand why we’re doing this, because it’s not part of the course.” But everyone else has talked about in a reflection on the use of that, how beneficial that was. How have students responded to these metacognitive reflections?

Melissa: My sense is that students are quite positive about this. I think you’re right in that oftentimes, this is something that we take for granted in our students, that they know how to learn, or they know how to engage in material. And I think some of our students have sort of figured things out on their own without necessarily knowing that they’ve figured it out. And so I think just providing students the opportunity to really think about what they’re doing and hear what their classmates are doing is useful because it normalizes that there is not one way to do this, it normalizes that different strategies are going to work for different people. I think oftentimes, if you don’t talk about this, the minute students feel confused, or the minute students hit a block, they see it as a reflection on like, “Oh, my goodness,” and particularly in a subject like physics, which has a reputation or a stereotype, they immediately think, “oh, physics is not for me, I’m not cut out to do this.” But if they hear that everyone in the class faces confusion or runs into things that don’t work according to plan. I think that can be really liberating for students. And I will say, one of my favorite comments right after I started doing this, in my advanced lab course on student evaluation, at the end of the course, someone said, “I have never failed so much and felt so good about failing so much as I did in this class.” And they didn’t fail the course, but they just realized that experimental physics is about experiments not working out the first time you do them, and then you’ve got to figure out how to make them work better. And so I do think there’s something that reduces a little bit of students feeling that they need to keep up their barrier of “I understand this, and this is going well,” by having these conversations.

John: Going back to those discussions that I’ve been using. One of them is at a point in the class where students face some really challenging material that they all struggle with. And the question I give them that week is, “How do they deal with challenging material?” …and it helps to normalize that type of failure and the benefits of working through it.

Rebecca: As you’ve been talking about your advanced physics class, I’m thinking about an activity I do in my Advanced Design class, which is have students keep a process log. So as a project develops, their constantly reflecting and documenting what they’ve been doing. And part of what the students have indicated as helpful about that is that sometimes they feel like they have nothing to show for hours of time.

Melissa: Yes, [LAUGHTER] that also happens. Yes.

Rebecca: But actually a lot was happening. They were researching something, they were trying something, they were experimenting with, they were troubleshooting. But now there’s a place for them to make that visible to themselves as well as to me, and that’s been really useful to also help them figure out more efficient ways of doing some things.

Melissa: And I think that’s exactly right. In our advanced lab course, what it is, is they’re keeping a lab notebook. And I think in previous courses, where students are working on more structured labs, where it’s sort of laid out, “here’s the first goal, here’s the second goal.” They’re used to lab notebooks just sort of saying that they followed what was laid out in the lab handout, whereas here, we look at actually some lab notebooks of famous scientists, where it’s like, “Well, I’m thinking about doing this, but I don’t know.” And there’s room for emotion and some “I’m gonna go down this way.” And then like, “Ph, this didn’t work for this, so now we’re going to go back to the idea that we talked about a couple of days ago.” And so having that all recorded, I think you’re right, it makes them feel like they can see that they are moving forward, even if they don’t have anything to necessarily show in terms of nice plots of data that they have collected.

Rebecca: Yeah, it makes all that decision making visible because there’s many decision points. And sometimes they just make a decision, and they don’t really know why they made it, but, reinforcing the idea that like, “Well, you had to have made it based on something.”

Melissa: Right.

Rebecca: What was it?

Melissa: As experts, we have sort of hidden that we’re doing all of this. And so for these advanced students, they’re not at the introductory level, and they see experts, but they don’t really see all of the things that are internal to us that it’s helpful to actually make visible to them.

John: So have other people at Carleton adopted similar strategies?

Melissa: Yeah. So one of the things that I love about Carleton is that this is a place where we have a lot of conversations about teaching. And so I would say that I’m not unique in using these kinds of activities. And I think one of the beautiful things about metacognitive activities is that, although the details of some of the questions you might ask students might be specific to your discipline, really, anyone who is teaching in any discipline can actually work with students on metacognition, and so ot’s a topic where I can talk with colleagues really in any field, and we can share ideas and hear from each other. I would say that one of my reflective prompts that I ask students is about who has assisted in their learning, so it’s called the learning assist prompt. And this is actually something that I got from a colleague in Classics, Chico Zimmermann. And he asked students to reflect: “In this past week in the course, who has assisted in your learning?” and he explicitly talks to and gives examples of what assistance might look like to assistance could be, they made a mistake that helped you understand something that you didn’t understand before, or they were confused about the same topic as you were confused about and in discussing it together, you began to make sense of a topic. So he very clearly articulates the way that individuals can learn from each other in confusion, or in making mistakes. And I really just loved his framing of that. And so that’s something where we don’t share very much content between classics and physics, but we can share ideas about how are we going to help our students learn. And I think the other thing that’s really nice is, I do feel, Rebecca, you mentioned students don’t necessarily know how to engage in metacognition. And so I do feel like the more students are asked to do this in different disciplines across campus, the better they become at it, because it is something that you need to practice and get a sense of. And so I’m excited when I hear about colleagues who are using similar approaches, and we share ideas about how we’re using it in our classes, because then I know that students who have thought about this in a colleague’s class in American Studies might bring some skills to my class that would be useful.

Rebecca: It kind of goes back to that same idea of normalizing failures, normalizing this reflective behavior as well. We know that you have a forthcoming publication, addressing student mental health and moving toward UDL. I’m wondering if you can talk a little bit about how that work connects to this work around metacognition.

Melissa: Yeah, so it actually, I would say, builds quite nicely on some of this work. So this is a piece that’s written with two of my colleagues, one, Kristen Burson is a physicist at Grinnell College, and the other Danielle McDermott is now at Los Alamos, but was teaching before. And one of the things that we found is that physics is one of those fields that because of the stereotypes, students just get really stressed and anxious sometimes in their physics courses in a way that sometimes they don’t in other courses. And so one of the things the three of us spend a lot of time talking about is what are ways that we can actively try to reduce the stress and anxiety that we seem to see in students who are coming to us in physics courses. I think, these days, stress and anxiety are rampant on campus in general. So I don’t think anything is unique to physics. But Universal Design for Learning has some suggestions about how to make courses accessible to folks. It also, though, is quite overwhelming. And so we were thinking about the students who we see in our courses who come with a lot of stress and anxiety, sometimes clinically diagnosed depression or anxiety, what are ways we could take some of the UDL principles and take what we know about physics education research and use it to modify our courses to try to make them places that students feel like they’re supported in being their whole selves and doing their best work and not having to be overly anxious about it. And so one of the pieces is what I’ve already discussed with you, this idea of increasing mastery oriented feedback and assignments. And so some of the ways that I’ve changed problem sets where I make problem sets, not really about right or wrong, about the process of: you practice, you learn and you can revise until you get it right. And that’s really consistent with some of the UDL principles around organizing courses towards mastery oriented assessments and feedback. And so that’s one of the modifications that we pointed out as something that’s valuable. Another thing that we’ve done a lot with is thinking about the social aspects of physics courses. And as physics has moved away from being lots of lecture to a lot more small-group activities, we’ve seen that for students with anxiety and depression, some of those small group activities can actually be a source of significant challenge. And so they really can find that difficult. And so they’re thinking about how you design group work, and thinking about when you provide students choices not to engage in group work, and how you help students interact with each other, if they aren’t normally comfortable interacting with each other is something that we explore as a second way that physicists, or really anyone who’s doing active learning that involves small-group work, can think about, and this is something that I’ll say I’ve evolved a lot in terms of how I do this. I used to have when students walked into the room, every class, they would get a number and then they would sit with the other students with the same number. And that would be their group for the day. And research by Katie Cooper at Arizona State University has really shown that constantly mixing up small groups is a significant source of anxiety for a lot of students. And it doesn’t give students who need help learning how to interact, learning to trust their groups, to develop a rapport so that they can work effectively together. And so now, when I have students work in small groups, I still have them work in small groups just as much, but I really structure how those groups interact. And I have them interact for a long time so that they can begin to develop approaches and rapport that will help reduce some of the anxiety of that small group work. And then the last element that we talk about is providing students with more choices, that’s UDL all the way… is about providing choices. And so we talk a little bit about what does choice look like? For example, I ask students to turn in written problem sets. But there’s no reason why, even before the pandemic I would invite students if they wanted to, you could actually record yourself talking through a problem set instead of writing down a problem set. And so that’s one example of how you might provide choice for students in a physics class, but also explicitly bringing up the importance of student well being and help seeking in a class. And so some of this normalizing the expectation that students will ask questions, asking students to keep a record of where do they seek help, and how do they seek help is important. And my colleague, Kristen Burson, she even has on her problem sets occasionally, an activity… it’s a problem where students must choose one activity for the week that they think will make them feel physically, mentally or emotionally better. And so it’s like, are you going to take a nap? Or are you going to go out and hang out with friends? She actually has that as a like, what’s one thing you did this week that you did to promote your health as a person who is in this physics class. And so just bringing that element of the whole person, and that the instructor is encouraging the student to be a whole person and make choices that support their wellness in that holistic manner. So those are some of the examples that we talk about in this forthcoming paper. And indeed, some of it is very similar, it’s built on some of these ideas from the metacognitive element. But just generally trying to focus on there’s a lot more to creating a classroom environment where students can succeed than just giving them the content.

John: We always end with the question, “what’s next?”

Melissa: One thing that I’m working on right now is I’m working with colleagues at Luther College and St. Olaf College, on a program that’s designed to foster a more robust and thoughtful culture of peer observation of teaching. And this is thinking about peer observation for formative development. We have peer observation for evaluation. But I’m not sure even in that context, we’ve necessarily done a great job of talking with each other as colleagues about what that looks like and what that means to make it the best possible experience for everyone involved. And so having the opportunity to get folks together from these three colleges to talk about how we can create cultures that foster teachers observing each other’s teaching has been really fun. And it’s fun to think about how we might also learn across campuses and from teachers across campuses. And this project also ties in a little bit with the Picture a Professor anthology, because one of the things we’ve been thinking about in this peer observation is thinking about how we can encourage colleagues when they’re observing each other to be mindful of how embodied authority might be in play in terms of the choices that people make, and how they observe other people in the classroom. And so we just started this program at the end of August. And so it’s going to be a trial for this year. And so I’m curious to see where it goes, and I think it’ll be a fun opportunity to engage in conversations about teaching with colleagues on some other campuses.

Rebecca: Sounds like a meaningful activity and endeavor for sure.

Melissa: So it’s fun.

John: Well, thank you for joining us, and we’re looking forward to sharing this with our listeners.

Melissa: It was great, thank you.

Rebecca: Yeah, thank you so much.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

261. Social Justice Assessments

Traditional methods of assessing student learning favor those students that reside in well-resourced school districts while leaving low-income students at a substantial disadvantage. These grading systems also encourage students to focus on their grades rather than on their learning. In this episode, Judith Littlejohn, Meghanne Freivald, and Katelyn Prager join us to discuss a variety of social justice assessment techniques that can help to create a more equitable environment in which all students can be successful.

Judie is the Director of Online Learning at SUNY Genesee Community College, Meghanne is an Instructional Technology Specialist at Alfred University, and Katelyn is an Assistant Professor in the English Department at the Fashion Institute of Technology.  Judie, Meghan, and Katelyn worked together on a SUNY Faculty Advisory Council on Teaching and Technology committee on social justice assessments.

Show Notes

Transcript

John: Traditional methods of assessing student learning favor those students that reside in well-resourced school districts while leaving low-income students at a substantial disadvantage. These grading systems also encourage students to focus on their grades rather than on their learning. In this episode, we explore a variety of social justice assessment techniques that can create a more equitable environment in which all students can be successful.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guests today are Judith Littlejohn, Meghanne Freivald, and Katelyn Prager. Judie is the Director of Online Learning at SUNY Genesee Community College, Meghanne is an Instructional Technology Specialist at Alfred University, and Katelyn is an Assistant Professor in the English Department at the Fashion Institute of Technology. Judie, Meghan, and Katelyn worked together on a SUNY Faculty Advisory Council on Teaching and Technology committee on social justice assessments. Welcome Meghanne and Katelyn and welcome back, Judie.

Meghanne: Thank you.

Katelyn: Thank you.

Judie: Thank you.

John: Today’s teas are:

Judie: …I have Lady Grey.

Rebecca: That’s a good one…

Judie: …In my DTL mug.

John: …a nice Desire to Learn mug.

Meghanne: I have iced green.

Rebecca: And Katelyn, how about you?

Katelyn: Mine’s water right now, if it were the evening, I would have one bag of peppermint and one bag of chamomile together, delicious.

Rebecca: Sounds nice and calming.

Rebecca: I have hot cinnamon spice tea.

John: And I have black raspberry green tea.

Rebecca: We’ve invited you here today to discuss your work on social justice assessment. Perhaps, we can start with a discussion on what you mean by social justice assessment.

Judie: So social justice assessment considers factors such as race, culture, language proficiency, socioeconomic status, and ability while working to dismantle systems of power, bias, and oppression in evaluation of student learning. So various approaches including equitable assessment, labor based grading, and ungrading, as they relate to the purpose, process, wording, and structure of student learning assessments are included. So we’re trying to focus on the learning that our diverse students achieve as it relates to specific learning outcomes just to mitigate the influence of dominant norms on our students’ grades. So we’ve all been working together for the last couple of years on a SUNY task group that was part of the Faculty Advisory Council on Teaching and Technology, which I chair. So we’re a subcommittee of an Innovations in Assessment group, and there’s a couple more of us who couldn’t make it today, but we’ve been a really close-knit group, I think, working together for over two years. And we really enjoyed the project, which resulted in a website with all these artifacts on it that people will be able to access. And we’re hoping down the road that we can continue our work, but we’ll get to that later on in this conversation.

John: And we’ll share a link to the overall website as well as your group-specific component of that in the show notes. So this was partly implied in your response defining social justice assessment, but, what are some of the shortcomings of traditional grading systems in terms of equity?

Meghanne: When we were doing our research on this topic, we encountered many drawbacks of the traditional types of assessments that we all experienced all the way up through school and into college, and I’ll share a few of them. One is that the focus is often on the grade rather than the actual learning process and what the student will actually be able to do, and be able to learn as a result of engaging in the education process. They just focus on the grade, “what’s my grade?” and that sort of misses the point. It creates a system where students are compared to each other rather than having the focus be on individual growth and achievement. It also can put students at an advantage or disadvantage based on characteristics such as race, ethnicity, socioeconomic status, disability status, language proficiency, and lots of other characteristics that students themselves don’t have any control over. We found in our research that traditional assessments tend to favor white, affluent, high-achieving students, and that really isn’t who most of our students are anymore. So we really need to remove barriers and create a way for students to accurately represent the learning that has taken place.

Rebecca: So you hinted to this in your response about traditional grading systems comparing students to one another. So thinking about that, what role should students play in determining how their learning is assessed?

Katelyn: I’ll tackle that one, and I want to answer it with a disclaimer to start because social justice assessment is an umbrella term that has all of these different strategies that are wrapped up in it, and each of those approaches, whether it’s ungrading, or labor-based grading, might have a slightly different response to that question. They all share the same goal, that students should not be systematically disadvantaged by the assessment mechanisms, and that we want to increase student agency in the classroom. We want students to be active participants in their own learning, but the actual question of how students might participate in determining their own assessments might look very different depending on who you’re talking to and what approach they use. Maybe it’s literally helping design the assessment mechanisms, the grading contract, grading rubric, maybe it’s creating flexible assignments that allow students to determine what learning is being assessed, or in the case of ungrading, maybe it’s just deprioritizing the assessment entirely in order to emphasize the individual student’s learning journey through the course. So I guess my answer, tentatively to your question, is yes, students should be participants in determining how they’re learning is assessed by the big how, and why is going to differ.

John: As you noted, there’s a wide continuum of alternative grading policies that can fit under this category of social justice assessment. Some of them are not that much different than traditional practices, and others are quite a bit different. One approach, which is much closer to the traditional grading systems that people are already using is a system of mastery learning. Could you talk a little bit about what mastery learning is and how that could be used in the classroom to provide a bit more equity.

Judie: So mastery learning is, instead of assessing a student or evaluating a student with one assessment, and giving them that grade, the students are able to go back and revisit the content and work again on any material that they didn’t understand or try things over again. So it’s an iterative process, and they should get some sort of formative feedback in between attempts so that they can understand what it is they need to work on and focus on. And this way, it’s more equitable, because the students are able to take the amount of time that they need to work on the assessment, they can access any review materials that they need to establish their foundational knowledge and continue on. And it just really helps the students learn and grow. And I think it’s a great way to establish foundational knowledge. I use it myself in all the history courses that I teach, and I just think it’s a great process. If you think about it, any athlete, that’s what they do. So if you’re learning how to play baseball, how many hours are spent in a batting cage, or like on the pitcher’s mound, how many times do you try again, and again, and then again, until you are able to do it correctly, or do things accurately? So I always liken it to use that sports analogy, because I really think that helps people understand that students’ learning… you have to practice and you can’t tell somebody something once and expect them to integrate it into all the knowledge they already have, and be able to recall it instantly. So I just think it’s a great way to level the playing field of students so that when you move on to the next part of your content, they all have the same foundation, and they’re ready to go forward.

John: And by explaining it to the students that way, in terms of a sports metaphor, it’s something that they can pretty easily connect to, and I think it also would help to promote a growth mindset, which we know is effective in increasing learning as well.

Rebecca: Another assessment strategy one might use is minimal or light grading that falls under this social justice umbrella, and is a bit different than mastery learning. Can you describe what minimal or light grading is?

Meghanne: Yeah, I’ve seen this described in a couple of different ways. This isn’t something that we really included in a lot of our research, so I kind of looked this up just a little while ago and it’s very interesting. And one approach is more on like the whole course level. And there’s another approach that can be taken on an assignment level. So for an entire course, what an instructor may do is that they would assign assignments throughout the semester, but most of them would not be graded, they would be used as like a conversation piece. And they would be discussed and gone over during class, which would then provide opportunities for the students to seek clarification and for the instructor to provide feedback in the moment. So then the assessment then becomes part of the learning process. So then when there are a small number of assessments that are given for a grade, then when the students get to those assessments, they’re not as intimidating. They’re things that they’ve done with their classmates, they’ve done them with their instructors, they’ve done them in class. So I think it’s a very interesting strategy because it removes a lot of the anxiety that students may have around assessment, because it’s just something that they’ve done in their class. Another take on this that I’ve seen is, on an assignment level, something like a paper, something that may require a lot of revision, where when the professor is grading that assessment, they would maybe not take the time to go through and mark all of the grammar and spelling and mechanical errors, but maybe they would look at a section of that, maybe point out some things the students are doing over and over again, but not mark up the entire paper, but just say, “Okay, these are the things you need to pay attention to that are recurring through your paper.” And then as they read and grade that student’s paper, they focus more on the message that the student is trying to convey and the ideas that they’re sharing, rather than the mechanics and the grammar and the spelling.

John: And one common thing I think, to both mastery learning and minimal light grading is that the goal is to provide students with feedback. In some cases that can be automated. Mastery learning systems involve some degree of automation, sometimes by textbook providers, or perhaps adaptive learning systems, or it could be questions that you put together. But if you’re going to provide feedback on writing, it can require a lot more time. And a minimal light grading approach allows faculty to provide feedback on the most important things without taking up as much time to allow faculty to provide feedback on a wider range of topics, which, again, is I think, to some extent in the same sort of spirit.

Rebecca: Light grading can help not intimidate a student with too much feedback. If you see just a paper completely marked up, it might feel like there’s no possibility for moving forward or revising. But emphasizing what’s most important to change, or most important to focus on can help a student prioritize. And this can be really important to someone new to a discipline who might not know what’s most important.

Katelyn: I’m so glad you said that.

Meghanne: There’s an element of trust there as well, because if we point out what a student needs to focus on mechanically or grammar wise in a small part of that paper, then they can be trusted to then use their judgment to go through it and read it more carefully, and then make those edits based on the feedback that they had received. So it is visually much less intimidating. Plus, it might be a motivating factor for some students too that their professor is trusting them to be in charge of that revision.

John: Another type of social justice assessment involves contract grading. Could one of you talk a little bit about how contract grading fits into this category of social justice assessment?

Katelyn: Sure, I think contract grading is one of those terms that’s gaining some broader popularity and recognition. So it’s probably a term that may be pretty familiar to a lot of instructors at this point. So maybe it doesn’t need a lot of explanation. I’ll just say there’s a couple of different models of contract grading. In some cases, the instructor might provide that contract at the start of the term. In other cases, the instructor and students would be able to negotiate that contract collaboratively together at the start of the term so that students have more of that active stake in the contract itself. Generally, the grading contract would lay out certain requirements which students would need to fulfill to receive their desired grade. And that might include requirements related to attending class or conferences, completing low-stakes assignments, completing major assignments, maybe some page- or process-based requirements. But the bottom line is that the contract gives students a clear picture from day one of the work required by the class so students can look at that contract and know exactly how much work they’re going to need to complete from day one, to get the grade that they really want to receive in the course. I think the additional benefit of contract grading for our conversation is that it decouples grades from assessment so students have more space to take risks in their work rather than aiming for correctness. And on the faculty side, faculty can respond to the content and spirit of the students work as opposed to justifying a grade. I think most important, though, because this system privileges students who are investing the time and effort into their learning, all students have the same potential to earn a high grade in the course regardless of their knowledge or ability with the subject matter prior to the start of the course. So to use another sports metaphor, it works to level the playing field on day one for students who may have very different levels of preparedness and experience with the subject matter.

Rebecca: Another strategy that folks might use, which we’ve certainly talked about quite a bit on this podcast at various times is peer assessment. Can you talk a little bit about what that looks like and how that fits into this social justice model?

Judie: So peer assessment, or I tend to call it peer review, helps to build student investment in writing, and helps the students understand the relationship between their writing and their coursework by helping them engage with the writing in a way that encourages more self reflection and works to help them build their critical thinking skills about their own work. And I think it also helps the students learn from one another, because they’re sort of trying to evaluate their peers’ work against the requirements for the course. But then you also look at your own writing in a new perspective, and you learn from what you’re seeing your peers write and from the feedback that you’re receiving from your peers.

John: Might students perhaps take feedback from their fellow classmates a bit more seriously than they do feedback from their instructors.

Judie: A lot of students self-report that they learn more from this peer review activity, because they’re trying to identify and articulate weaknesses that they’re seeing in their peers’ papers, and also in their own. And I think trying to incorporate feedback from both their peers and their instructor into their own work, I think, just helps raise that awareness and any kind of feedback that’s constructive, as they think about it and reiterate it and rewrite their work. It just helps with their critical thinking. And I think just raise awareness of how they write, and maybe they can be more thoughtful about what they’re writing going forward. I think they also, if they question their peers, say “How did you come up with this?I love this idea,” then they can apply some of this, that they’re learning from their peers to their own work, too. So perhaps that’s what you were getting at John, when you asked that question was, they may benefit more from their classmates telling them how they came up with their ideas than from their instructor just dictating what the expectations are.

Rebecca: I would expand the model to include not just writing but also other creative projects and things. It’s certainly a practice that’s pretty common in the arts, for example, to do peer review of student work.

John: And they also get to see what their peers are doing, which can serve as a positive role model. When students see that other people are doing something that they hadn’t considered doing, it could serve as a way of improving their work.

Katelyn: I think a lot of students come into the classroom thinking of their teacher as the sole reader or audience for their creations throughout the course of this semester. So anytime we can expand those audiences and have students thinking rhetorically about who else might be the consumer of their work. I think that that can benefit our students in really important ways.

Rebecca: It also seems like it’s a good opportunity to formulate community around an activity like that.

Katelyn: Absolutely.

John: One of the other areas you address with this group was the topic of labor-based grading, could you talk a little bit about that?

Meghanne: Yeah, labor-based grading removes the focus from the end product assignment and shifts it to the process of creating that piece of work. So students are provided with feedback throughout the process regarding their labor or the work that they put in. And they’re given opportunities to continue working to improve what they’re producing, and to achieve a desired grade based on a contract sometimes, so there is some overlap with contract grading, but not always. There typically aren’t penalties for students who revise and update their work, because that’s part of the learning process. And it really helps students determine what their end grade may be and how much effort they want to put in, because often, they will be given some sort of guideline for what different grades may be achieved based on certain levels of effort, or certain levels of work that are completed. And also there may be opportunities to grade based on completion rather than more of a subjective sort of qualitative grade.

John: So do you mean like using a light grading or minimal grading where you either completed satisfactorily or you haven’t, and as long as you complete a certain number of assignments or activities, you achieve that grade,

Meghanne: That or also if there’s criteria, like a rubric, and they hit all of the criteria, then they receive full credit.

John: Which becomes, actually, I think, a form of specifications grading.

Rebecca: And then one other model that you’ve talked a little bit about already today is ungrading. Can you expand upon that a little bit more?

Katelyn: Yeah, so ungrading works to deprioritize numerical grades or even attempt to eliminate them entirely. So I hope I’m not speaking out of turn when I say, I think that this is the most controversial of the approaches that we have been researching, it tends to get the most pushback from faculty because it is so different from what we have often been taught or trained to do. So instead of focusing on those numerical grades, instructors are encouraged to focus on providing learner feedback that encourages growth. Okay, I have a quote that is from an ungrading expert I’d like to share. This from Sean Michael Morris and he says, quote, “at the foundation of ungrading, lies something that could change school entirely. A suggestion that ranking and evaluation and the concomitant expertise of the ranker or evaluator is entirely an optional way of viewing things.” And I’m going to end the quote there because I think that that important kernel is that ungrading works to dismantle the hierarchy of the classroom and refocus the attention on individual student learning is an approach that requires a lot of trust between student and instructor, and a lot of student buy-in as well. Students have to be invested in the learning that’s going to happen throughout the course itself. And in a completely ungraded classroom, student grades might be based simply on a final student reflection, or even a one-on-one conversation between teacher and student about the grade that the student has earned. But because ungrading really rejects transactional grading systems, the final grade is more of an afterthought than an important outcome of the course, much less important than learning that’s occurred throughout the semester.

Rebecca: So today, we’re recording on August 9, James Lang posted on Twitter about how deep the system of creating actually is that there’s even things like discounts for insurance, for good students, or good grades. And that it’s really challenging to overcome a system that’s so ingrained beyond just our education system, but into many other systems as well. So I think that that, in part, is why there’s such a strong pushback on this particular method.

John: And we’ve always done it that way, at least for the last century or so.

Rebecca: Change is hard.

Katelyn: Yeah, I think that the traditional grading system is really embedded into not only academia but outside of academia as well. And even within a class that takes an ungrading approach, we still face that question at the end of the semester of “Well, what’s the grade going to be in the system?” because we don’t really have the option, at least at most institutions, to say, “No grade, job well done.” At least at my institution, I still have to put in a letter grade for the student. So we can work to reject that system as much as we can. But at the end of the day, we’re still operating within that same structure. And maybe that’s a question of what’s next, right? Like, are we going to see one day a future where more universities embrace this idea of learning for the sake of learning as opposed to learning for the grade? I don’t know.

John: One of the other things you address on the website is how perhaps the use of authentic assessment or UDL types of assessments might improve equity by providing a more equal playing field for students. Could you talk a little bit about how going beyond the traditional term papers and tests might provide a more equitable way of assessing students’ learning.

Judie: I think anytime you use authentic assessment that helps, or generally it allows the students the opportunity to demonstrate their learning in the way that works best for them. The students are writing a term paper, for example, they can write the paper the traditional way, or they can give a presentation or record a presentation, and still provide their citations and so forth at the end. Or they can do something visual, some sort of a PowerPoint or a nice visual display of the topic and again, cite their sources and explain their images to the group so that people understand how they’re meeting the learning outcome. And I feel like that’s just a good way if people are struggling with language, if people are just struggling with writing in general, I think that this levels the playing field, because it gives everybody an opportunity to really show their knowledge and shine and not just pigeonhole themselves into one more paper or one more multiple choice test, if they have test anxiety. Some of our traditional forms of testing or final assessment just set students up to fail. And allowing students to choose to demonstrate their learning in a way that they’re good at sets them up to succeed. And I think that’s what we really want at the end of the day. And of course UDL principles, those are Universal Design for Learning, and that does include equity in its heart. So that would definitely help to keep things equitable in the classroom. If you’re following UDL.

Rebecca: The multiple forms you were just talking about is a great example. [LAUGHTER]

Judie: Last semester, I had a student who, they’re supposed to do a blog post, and the student instead of writing a blog post, he made a video and he did it three different times. So one is on World War One, one’s on World War Two, and the third one was on revolutions, and so, this student stood in front of a whiteboard, and he had his camera set up so he could film himself. And he had his iPad in his hand. So he talked about a battle, say, for example, and he would draw it out on the board. And then he would show his citation on his iPad. And then he had other citations typed up and taped to the whiteboard. And he went on for 15 minutes, and just was making sure he explained things again, and drew little examples. And he was so animated, and so excited about his topic. And you’re not going to capture that on a written exam, or even in somebody’s written paper. It was just tremendous the way he was able to show all that he had learned and all that he was interested in, and the extra research that he had done, because he felt the freedom to pursue this topic, because he knew he was able to express it the way that suited him the past. And it was just amazing. So I think anytime we can incorporate these things, and I understand that there are times when, according to your creditor, or people have to sometimes sit for a specific certification, it doesn’t always fit, but I think if you can fit this type of assessment in, it is definitely worth it. Because just to see the joy in students when they can explore and expand their knowledge, and then feel confident in demonstrating that to you, it’s just tremendous.

Rebecca: I love the flexibility in demonstrating knowledge and understanding and skill sets because in some of our traditional methods, we are arbitrarily assessing something else. So we may be arbitrarily testing how well you can take a multiple choice test or how well you can take a test within a certain timeframe, or how well you can write, whether or not that’s actually the topic. So if I’m learning about history, there’s some learning objectives I’m trying to meet related to history that may or may not include writing. And if writing is not one of those outcomes that we’re hoping for, then we don’t need to be assessing it.

Judie: Exactly. He did this thing on medical advancements in World War One, it was just tremendous and he was so charming, because he just was so wrapped up in it that you just had to root for the guy. It was good.

Rebecca: I love that. So for those of us who may want to move towards equitable grading systems, what are some initial steps we might take? Because it could feel really daunting if you haven’t ventured down this path before.

Meghanne: Yeah, if you are not interested in overhauling your entire grading system, just to try this out, a nd to make your assessments more socially just, there are some adjustments that can be made to existing assignments. And really, the important thing is to consider the learning objectives and really think about what needs to be graded. So one of the things that we’ve talked about a lot in all of our different presentations that we’ve done is whether or not to grade for things like grammar and spelling, and mechanics, and English language proficiency. So in an example, like a discussion board, when you’re really interested in what the students have to say, and their interaction with each other, and the questions that they asked, does it really matter if their grammar and spelling is perfect in that instance, if they’re having a great conversation on a topic, and they’re learning from each other. So that’s one thing that we could suggest. Another is thinking about just the fact that sometimes students have challenges in their lives. They’re human beings, they have families, they have jobs, many of our students are athletes, and they have to travel and they have games and something like flexible due dates is very, very helpful for students because then they’re able to complete their work, certainly within a reasonable timeframe. But if those dates are a little bit more flexible, and they have access to those assignments in the learning management system beyond the actual due date, for instance, then that gives them the ability to complete that work without being penalized. So another mechanism would be in the learning management system, when students are taking quizzes, would be allowing backtracking, allowing students to go back and check their answers, that sometimes is a setting that a lot of professors really rely on, to try to avoid cheating. And as an LMS administrator, that is something that I see a lot. And I think that that can really be harmful to students, because many of our students are told to always go back and check your work. And if they’re not allowed to go back and check their work, that can be very frustrating. And also forcing completion is something that I would recommend turning off because again, that can create test anxiety. And often I think when completion is forced, there’s also a timer. So I think if any timers can be removed as well, then that does a couple of things. It can help remove testing anxiety. But then also, if there are students who require extra time due to a disability accommodation, then the professor at that point doesn’t have to go in and adjust all of the LMS settings for those students, because it’s already open ended and everyone can have as much time as they need to complete that assessment. So it really is just important to look at what the learning objectives are and what actually needs to be assessed. And the goal is always to remove barriers. So another thing that can be done is to just ask students, have a conversation about it, and find out what barriers they’ve experienced.

John: At the start of this. You mentioned the website that you were creating, could you talk a little bit more about what resources are there and how that might evolve over time?

Katelyn: Yeah, so the website, we have been slowly adding resources to over the past two years. And at this point, it’s becoming a pretty robust little outlet for people interested in social justice assessment. So, you go to the website, you can find an overview of the big picture theory of social justice assessment, as well as the various approaches that we’ve discussed today. We also have a really pretty large bibliography of resources for further reading for people who want to learn more about any one of these topics. And we’ve been working to develop a collection of sample assignments from faculty across SUNY. So we’re still working to collect additional sample assignments from faculty who might already be implementing some of these strategies within their classrooms. I think the more we can share those assignments with one another, the better off we’ll all be. I think a lot of us are doing social justice assessment in small ways in our classroom without realizing it. So the more we can share those resources and that knowledge, the more hopefully we can get people on board. So, hopefully, we’ll be able to share that link in the show notes. And people will be able to check that out.

Rebecca: So we always wrap up by asking: “What’s next?”

Judie: So for our little group, one thing that I think might be next for us is SUNY is updating the SUNY general education requirements that are mandated with the completion of any SUNY degree. And they’ve added a requirement for equity, inclusion, and diversity. So I’m hoping that our group can help contribute resources to that effort, and our website could be one more place where people go to for information on social justice assessment so that they can incorporate those into their courses that are designed to meet the DEI requirement.

Katelyn: Well, I’m gonna go take my one-year old to the pool. [LAUGHTER]

Judie: Nice.

Katelyn: I think, big picture, though, the “what’s next” I want to just give is, I hope that we’ll start to see more institutional support for some of these approaches. I think that there are still a lot of barriers, particularly for contingent faculty who want to embrace some of these practices. So I hope what’s next will be more departmental institutional support for this: more time, more resources, etc. But yeah, my personal what’s next is I’m gonna go enjoy this beautiful day.

Rebecca: Meghanne, do you want to add anything?

Meghanne: Sure yeah, at my institution, I am sharing this information, pretty much any chance I get, I’m meeting with our new incoming faculty in a couple of weeks. And this will be one of the topics that we discuss. And I’m also co-chair of our universal design for learning task force. And we have a few events and projects that we’re working on to spread the word on UDL, and also innovative assessments and social justice assessments as well.

Rebecca: Lots of great things coming and some really wonderful resources that you’ve shared today. Thank you so much for joining us.

Katelyn: Thank you.

Judie: Thank you for having us.

Meghanne: Yeah, thank you.

John: And thank you for all the great work you’ve done on this over the last couple of years and the resources you’re sharing.

Judie: I would just like to say that Shena Salvato is also in our group. She’s at Cortland, I believe. And Chris Price from SUNY is in our group, and they are missed today. They’ve been with us for all our other presentations. I know that Shana in particular wants to get the band back together and have some more meetings going forward so we can keep working together. And it was really good to see you guys again.

Katelyn: Likewise.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

259. Experiential Learning

Course content and instructors are often forgotten once a  semester concludes. In this episode, Breanna Boppre joins us to discuss how experiential learning can humanize course content and provide meaningful and rich experiences that stick with learners for many years. Bree is an Assistant Professor at Sam Houston State University’s Department of Victim Studies. She is also the author of a chapter in Picture a Professor, edited by Jessamyn Neuhaus.

Show Notes

Transcript

John: Course content and instructors are often forgotten once a semester concludes. In this episode, we discuss how experiential learning provides meaningful and rich experiences that stick with learners for many years.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Breanna Boppre. Bree is an Assistant Professor at Sam Houston State University’s Department of Victim Studies. She is also the author of a chapter in Picture a Professor, edited by our friend, Jessamyn Neuhaus. Welcome, Bree.

Bree: Thanks for having me.

John: We’re very happy you can join us.

Rebecca: Today’s teas are… Bree, are you drinking tea?

Bree: I sure am. I am drinking a tea given to me by my close friend and department chair, Shelley Clevenger. She gifted me this tea. It says, “you’re magic” on the front. And one of the ingredients is “luster dust.” So the tea is actually blue with glitter.

John: That is a first, I believe.

Bree: It’s very unique, and it’s herbal tea. It tastes great.

Rebecca: Does it taste sparkly?

Bree: Mmmm, if sparkly had a taste, this would be it. [LAUGHTER]

John: So, we’re having a sparkle party.

Bree: Yes, definitely a sparkle party. [LAUGHTER]

John: I’m drinking a black raspberry green tea.

Bree: Ooh, yum.

Rebecca: And I have a jasmine black today.

Bree: Nice. That sounds good too. Not quite as sparkly as mine, but… [LAUGHTER]

Rebecca: Definitely not, and not as blue, either. [LAUGHTER]

John: So we’ve invited you here today to discuss your chapter in Picture a Professor. Before we discuss your chapter, could you tell us a little bit about your department and the classes that you teach? Because we have not run across a Department of Victim Studies before, and I think it would be helpful to learn a little bit more about that.

Bree: Yes, I would love to talk about our department. It’s actually the first and only Victim Studies Department in the nation, and so this is really unique for us to have this opportunity. We’re housed in the College of Criminal Justice. So we’re a subset of criminal justice but we like to think of ourselves as different, both in what we study and teach about, but also the way that we do things. So we are very much community engaged. We emphasize caring and kind pedagogy, and we emphasize things that engage with the community to help survivors. And so, we have a lot of campus events. We have a lot of events dedicated to building awareness, but also donations and things for organizations in our community that helps survivors. And so, it’s really a great opportunity. I’m really excited to be here in the Department of Victim Studies. I’ve been here just over a year now. And the classes that I teach… violence against women, and I teach it more as gendered victimization. So we talk a lot about how gender and stereotypes shape victimization and harm. I also teach a brand new class that I created called “transformative justice,” which is a survivor-led movement aimed to address harm and violence without relying on systems that cause additional harm and trauma. And so, preventing harm and crime in the community before people end up in prisons and involved in the system. So that’s a really cool class that I’ve enjoyed teaching. I also teach family violence, and I teach research methods at the grad level, and that’s what I was prepping right before the podcast. So those are the classes I teach. I’m really excited about them. It’s heavy content, for sure, but I enjoy it.

Rebecca: I can imagine that teaching such topics really often includes students who are also victims and there’s some challenges in that arena as well. Can you talk a little bit about some strategies that your department uses to support survivors who are in your classes?

Bree: Yeah, so I can talk about what I do personally. So I’ve done a lot of research beyond teaching about the impacts of trauma, and I actually have a background in cognitive behavioral therapy and counseling techniques. And so, I interned as a grad student with community corrections and would engage in these counseling type classes for men who are on probation and parole. And one thing that I noticed was that the amount of trauma that these individuals have experienced, you can’t treat someone separate of that trauma. And so, that’s very much how I teach in the classroom as well. I’ve relied a lot on other scholars, like Karen Costa, who’s done a lot on trauma-aware teaching, who I know was a guest on the podcast multiple times, and others who, instead of teaching business as usual, we have to center the experiences of survivors and recognize that the vast majority of students have survived something traumatic at some point in their lives, whether it’s victimization, sexual assault, things like that, but even the adversity that they’ve encountered throughout their lives. That has has an impact on their experience in our classrooms. And so, I have used Nicole Bedera’s method of survivor-centered teaching, she has an amazing article in Teaching Sociology that really centers survivors in how we teach. And so, oftentimes, and even myself, when I first started teaching, and a student would disclose to me something related to victimization, because a lot of students feel close to me, they see me as that caring empathetic person. And so, I have had a lot of disclosures throughout my teaching. And at first, I wasn’t exactly sure how to handle it, because we know Title IX, we know that we are mandatory reporters of certain victimization and of certain things that we’re told, but not everything. And so my role as a professor, I’m very aware that I am not a licensed counselor, and I take that very seriously in referring out, as Karen Costa says. And so, I’ve done a lot of work to understand the role of Title IX and my role as a mandatory reporter, and that has really helped me know effective boundaries to myself and my teaching while also supporting students. And so, Nicole Bedera recommends really understanding each institution’s Title IX office requirements, because they can differ across institution. So one of the first things I did when I came to Sam Houston State was reach out to the Title IX office, and really try to understand what I am mandated to report. And now in every victimization related class, I have a module about survivor-centered teaching and self care. And so, in that module, I explain to students what they disclose to me, how that could potentially trigger a report, because I want them to be empowered and informed. I want them to know that if they disclose specifics, that if it occurs on campus, or a campus event, that’s something that I have to report, and if they don’t want me to report, they can disclose those things in a different way. And so, that takes more of the ownership on students and the power and agency to them, rather than to me, and it’s made me a lot more comfortable when students do disclose because I have a lot of assignments where they reflect, and that’s where the experiential learning background comes in. I’m very much about reflection, and so a lot of the students, I prompt them to reflect on the material and that prompts them to often disclose that they have survived something in their life that’s similar. And so, being empowered and informed, both as the students and me as the professor, having those survivor-centered and trauma-aware tools have made me a lot better able to address it in a supportive and empathetic way.

John: That transparency should make students feel much more comfortable and as you said, empowers them to make decisions that are best for them, which I think provides a much better relationship.

Rebecca: So it’s worth mentioning, if you’re interested in Nicole Bedera’s work, she was on episode 201, “Beyond Trigger Warnings.”

Bree: Highly recommend her article. Seriously, this changed my teaching for the better in many ways, and I’m a huge fan of her work.

John: We’ll include a link to that in the show notes. So the title of your chapter is “Using Experiential Learning to Humanize Course Content and Connect with Students,” and you’ve already addressed a little bit about how you use experiential learning. Could you expand on that just a little bit in terms of how you do this in your classes?

Bree: Yeah, so I actually started engaging with experiential learning as a doctoral student. Our PhD program is actually unique in that it had a required teaching and pedagogy class, which is shockingly rare for academic PhD programs, especially in criminology and criminal justice. So I was really fortunate to have that experience where we learned about teaching and pedagogy before we even entered the classroom. And so, we had to explore different approaches and write up what we envision our teaching approach to be, and one of those approaches that always stood out to me was experiential learning, and part of that interest in experiential learning was my own experience as an undergrad student. When I think back to my classes, one of the most vivid memories I have is in a corrections class, we toured a local prison, and I can still remember the weather that day, how it felt being in that prison. It was very dank and dark, which is similar to most prisons. [LAUGHTER] And so, that feeling of being there, I can close my eyes and still envision that day of touring that prison that really stuck with me. And the power of experiential learning to have that impact, to engage with multiple senses, your sight, your hearing, your smelling, you’re feeling the temperature, all of that has an impact, and I especially think it’s important for criminal justice in teaching classes related to prisons, which is what I taught for many years at Wichita State before coming to Sam Houston State, and those experiences are really what stand out with students and have that high impact. So that’s part of why I decided to focus on experiential learning for my pedagogy, especially early on, and we would do things like go on prison tours, or we would go on tours of local domestic violence shelters. I would take the students to these locations, and as I’ll talk about later on, when we discuss experiential learning online, there’s potential issues related to accessibility there. But if the students are able, it really is an immersive experience, and it’s really beneficial for them to go to these sites with the support of their instructor to gain that experience… that hands-on, what would a job in this area be like… but also to connect with people who work in the field. Because often my students have gained internships or jobs from going on these tours, the agencies also view it as a potential hiring or recruitment opportunity. So it’s really beneficial for me as the instructor, but also for the students and for the agencies in the field to connect directly with often juniors and seniors who I teach, and they’re going to be graduating soon and want to do something with that degree. So that’s really the “why” for me. It’s also very humanizing, and I talk about it in the chapter as a method of inclusive teaching. Because for me, I was never one of those people who wanted to be the sage on the stage, I’m much more into collaborative learning, and being more of the guide on the side. And so, I found with experiential learning, it really helped us build community and experiences together. Every time, I swear, when we would go visit the prison, something would happen. So one time we went and it was chow time, which is food time, and they offered to let us try the food. So that was a big experience for many students that we still talked about after and that’s, again, a big part of experiential learning is the reflection piece. So we would reflect on that experience together in class, we would talk about it, but also students would reflect on it on their own through reflection papers. And so, as I’ve evolved these approaches, one of my favorite parts of experiential learning is service learning. And so, service learning is really taking experiential learning to a next level, where we’re incorporating real-world experience, learning and applying concepts to helping actual agencies or a community of need that is identified by the students in the class and using that volunteer work to help and engage in civic engagement.

Rebecca: Those shared experiences are really powerful. We’ve seen these in many different situations, whether it’s service learning, or field trips, or study-abroad opportunities where groups of students are together, and they have this shared moment. It helps them connect, but also it’s a place to relate content back to that they all know, because they were all there, which has a lot of power. So you hinted at this already, Bree, but we know that you’re teaching entirely online now. So how do you go from visiting prisons to your current circumstance of teaching online and how do you bring these experiential components in that modality?

Bree: Yes, so I’m not gonna lie. In spring 2020, when the pandemic hit and we were told, “You’re going remote for two weeks,” and then that two weeks turned into the rest of the semester, I freaked out a little because I relied so heavily on the in-person, and the experiential learning is a big part of that. I did freak out. And so, I had never really taught online before. I taught one summer class online previously, it was a, quote, “canned class” that I couldn’t really change or adapt from. And so, I freaked out a bit. And then I remember the last class before we went online, I got a text from my colleagues saying, “the provost is about to announce, we’re going online.” I was like, alright, we’re going to stop what we’re doing: “What has worked for you as students online and what has not worked?” and we workshopped together, what the rest of the term was going to look like. And so, a lot of them mentioned, “we love these aspects of the in person, that community building, the humanization.” And so, I really had to think carefully and critically about, okay, how do I accomplish that online? And so, like I mentioned, the way I teach, I don’t like lecturing. I will lecture for like 10 minutes at a time, but you will never see a class where I’m just lecturing for an hour, that’s not enjoyable for me. And so, I tried to think about how to translate that to the online platform. Because often, I would pepper in my lecturing with other videos, with activities, we would do Kahoots, we would do group breakouts, we would do all these things,“oh, my gosh, how do I do this online?” So I came up with this approach, in our activities, where I would really think through how we did this in person, and try to modify it for online. So even though we can’t be in the classroom physically, at the same place, the same time together, how can we still achieve this community remotely. And so, I would do things like the Kahoots, the quizzes, the community sorts of activities to try and accomplish that, and with experiential learning, I’ve taken a lot of aspects of experiential learning, especially the reflection piece that has become very important to my pedagogy. And so, it may not be the traditional experiential learning anymore for me online. There’s parts that I incorporate, but I’ve really have had to adapt. And so, some of that includes being more creative about these big project-based assignments that I have. So I read Susan Blum’s, edited book, Ungrading, which is awesome. And so, inspired by that, I started assigning eportfolios, where students will experientially go through these modules, and they have reflection questions guiding them, and they write up kind of like this blog-style summary of the content, like they’re explaining it to someone who has no background in criminal justice victim studies, they have no idea what any of this is, and they’re explaining it to someone else. So it is very much like a blog. But then the second piece of those module reflections are reflecting on their learning, and that’s where they really think about their experience during the module, even though it’s online, even though they may be sitting watching TV or they may be having childcare during while they’re trying to learn. A lot of my students are single moms or in caretaking roles, they have a lot of other things going on. And so, they’re reflecting on that learning experience, despite all the other things that are going on in their lives. And so, that has been really key for me, that reflecting not just on the content, but their learning experience. So that’s been a way that I’ve adapted experiential learning. I still incorporate service learning as much as I can. So there’s four main types of service learning and direct service learning is the one that we often think of, when students go to a physical location and volunteer. Now, during the pandemic, that was not possible. So a lot of the agencies that I worked with, especially prisons, they shut down access, students were not allowed to come there. So I had to think differently about creating opportunities for civic engagement and advocacy. And so, some of the things that I’ve done are infographics and public service announcements to build awareness about social issues and taking that a step further to create those specifically for campus organizations. Or even now I’m partnering with local agencies, nonprofits, who may not have the resources to devote to social media and branding, and my students are actually helping with that by creating social media campaigns and things like that. And so, I’ve just tried to be creative. We have unlimited technology, we have so much available to us that is web based, or internet based, that students have access to, like Canva. Oh, my gosh, Canva is the best tool that I’ve incorporated, and they make these data visuals and public service announcements through Canva and they can even do it on their mobile phone. So it makes it really accessible for them, and it gives them a way to make an impact, even though we can’t have that direct service learning experience.

John: Could you tell us a little bit more about some of the service learning activities that your students have been engaged in?

Bree: Yes. So, I again, teach research methods, which often is not the favorite class, both from students and instructors. It’s often seen as a more boring content area, which is fair. There’s a lot of jargon, there’s a lot of complex concepts for students to learn. But I have found that experiential learning is even more important for teaching research methods. And the way that I do it is through research-based service learning. Well, because of the pandemic and because of agencies shutting down and not having direct access, I’ve been focused more on helping our campus community because that is an organization that I have access to and that I’m directly involved with. And so, some of the things that we’ve done in the past is we had students and I create surveys together for their fellow students in the university to fill out and then students, they create the survey questions. They think through research questions, how to create measures and concepts related to those questions. I facilitate this process, but they’re doing a lot of it firsthand, and then we distribute the survey online to students across the campus, they see how many students respond to the survey, which is often 10 to 20%, and they see the implications of that, and then they work through the data themselves. I’ll compile it in an Excel file for them, and then they create data visuals. They interpret the results, and then together, we compile a report that we give to university stakeholders. And so, that has been a really rewarding, and accessible version of service learning for me… is that research-based service learning, and it’s also beneficial for me. As pre-tenure, 40% of my position is research, 40% is teaching, and then the 20% is service. So I find that research-based service learning really combines all aspects of my scholarship together, and it makes it this really rewarding aspect of my teaching that has been successful both in person and online. And so, that has been a really cool avenue that I also have gone on to publish the results, and that has led to peer-reviewed articles and things that are important towards my tenure. So I wanted to bring that up, because I know a lot of fellow instructors, they see service learning or experiential learning and are like, “Oh, that all sounds great, but the amount of time that goes into it is a lot, especially when you’re working with external agencies.” And so, I really promote research-based service learning as this accessible alternative that can also benefit those faculty and instructors that are expected to do research as well.

Rebecca: Finding those connections between service, teaching, and research can always be really challenging. But when you can find those connections, definitely a worthwhile endeavor. I know that I’ve had similar experiences. Can you talk a little bit about students’ response to service learning, as well as your community partner? And I guess in this case, it would be your campus stakeholders?

Bree: Yeah. So I’ll back up a little. When I taught in person, one of the first service- learning projects I did was for the local drug court. And so, the drug court manager would actually come to our class, and we presented the results to her. And so, that experience of being live, us handing her the results, talking about the results together as a class, that made it really rewarding for both me and the students. And so, as a result of that drug court partnership, one of my students actually got an internship at drug court, which was super cool. That may not have happened organically otherwise. And so, students’ responses have been very positive to both service learning and experiential learning broadly. I think that both teaching and learning online can be very isolating. That was my fear of teaching online, was losing that connection, and that connection from what I’ve learned from Michelle Pacansky-Brock and Fabiola Torres on Twitter, I’ve taken trainings with them on humanizing course content. They are amazing. What I’ve learned from them and doing trainings about online teaching is that really the connection matters, and there are still ways that we can get that connection through humanization. And so, I think building those connections for students’ research shows, especially for underserved students, first-generation college students like myself… I was a first-gen student… those sorts of efforts to build that community and build that connection between student and instructor but also among students is really key towards their success and retention. So I have noticed, just taking the extra effort to send out personal check ins to students to get to know them as human beings, has greatly increased my student evaluations, but also my fulfillment and enjoyment as an instructor, because I read Kevin Gannon’s work, Radical Hope, it’s on my bookshelf over here, and he mentions this tension, often between this authoritative type of instruction where often instructors are seen as adversaries, and instead, there’s things that we can do to connect with students. So we go into this role of being allies to students, and that’s really where I see my role as empowering and supporting students rather than enforcing rules and teaching during the pandemic really, really brought that to light for me, that often these rules, especially around late work, and imposing late penalties, and strict rules around that, that’s not sustainable. And so, it’s also not inclusive, especially for our students, who many of them, again, are mothers, they’re in caretaking roles, they’re parents, they have full-time jobs already outside of their class that they’re taking with me. I think that instructors maybe forget that students have these full lives outside of this one class that they’re taking with you, and I try to be really mindful of that. And so, students’ responses to experiential learning have been great. My response has been great. The stakeholders have also really appreciated being able to connect with students. When we sent out the report to stakeholders for the campus survey, one of the interesting findings was there’s this care center on campus that offers free mental health referrals and academic assistance to students in crisis, and based on our survey with criminal justice students, only 25% even knew that the care team existed. And so, I shared this with the care team. I’m like, “Look, I know the amazing work you do. I’ve referred various students to you but largely, students don’t know you exist, which might be impacting self referral.” And so, students in that class gave recommendations for how to build awareness of the care team, and the following semester that I taught this class, we partnered with care team and created a social media campaign to build student awareness about who the care team is and what they do. And so, that was a really cool way of legacy teaching where we built upon what one class did in a semester, which was Spring 2020, where everything was wild, and it took a lot to get done in one semester, with the beginning of a pandemic, we built upon that in a second semester, to really create actionable things that the care team could use to build awareness about what they do for the campus.

John: You mentioned a focus on inclusive teaching, could you talk a little bit more about some strategies that you use to create an inclusive environment in your classes? You’ve talked about some of these, but do you have any other suggestions? Because I think everyone’s trying to make their classes more inclusive now and any tips you could provide would be helpful.

Bree: Yeah. So I think for me, a big part of it has been educating myself. I’ve taken a lot of trainings, I’ve had trainings specifically on Universal Design for Learning, inclusive teaching. So some of those trainings that I took actually had us listen to interviews from students about their experiences as first-generation students, as students who English is not their first language, as students who are full time working and caretakers. Listening to their stories really helped me design my classes in a way that is more accessible. I design my classes being very empathetic and mindful of the students who enter our class. So SHSU is a Hispanic-serving Institution, more than 50% of my students are first-generation college students, so I automatically design my classes for that population, and in turn, like we see from Universal Design for Learning, that has benefits for everybody. So if you design a building with a ramp for individuals who can’t walk, that ultimately can benefit other individuals. The ramp makes it easier for them to get to the building to get inside. So I really embrace that approach in my teaching, and I try to be inclusive from the start. Again, educating yourself is a big part. I’ve done a lot of work on anti-racist pedagogy and just in everyday life, so that has been really helpful for me as well. And then I’m not perfect by any means. I try really hard, and there have been times where things have come up and students have felt safe enough to bring it up to me that there was potentially issue with how something was presented or delivered in the class, and I think my biggest advice is, when that happens, take a step back, take a pause, and really use empathy to listen. This student took time out of their everyday life to come to you and explain how this content or how the delivery made them feel. So I know that the first instinct might be to be defensive. But I think it’s really important to take a step back and try to really understand where the student is coming from. And actually I have this situation in the fall and it ended up turning out to be a really informative and transformative experience for me, but also for the student and now the student still keeps in touch with me and emails me often about updates in her life. And so, I think that’s a really big part of teaching in a way that’s empowering and supportive, rather than being authoritative and the sage on the stage when you share that power, and that’s important for me teaching in victim studies, because I teach in our victim services management program, which is the master’s degree. The students who come into this program are rock stars, they have worked in the field for years, they are running nonprofits, they are doing all this amazing work already. And so by sharing the power, and by me recognizing I have this degree, and I have some experience, but their experience is just as valuable and important as mine. I think that is really setting the stage for inclusive teaching and that’s what I embrace.

John: You mentioned a collaborative environment in your classes. What role do students play in creating content for your classes?

Bree: Yeah, so that’s actually my ultimate goal for students. In a lot of the effective online teaching trainings I’ve took, a lot of what we give to students is stuck on the learning management system. If you give a student an assignment or a quiz, they submit it, and they may never have access again. So a lot of the assignments I give them are getting off the learning management system and giving them tools and things that they can have beyond the semester. And so, some examples of that are, again, creating eportfolios. So they create these eportfolios that they use throughout the class, they create their intro background page where they talk about themselves, as much as they want to share or not, they can keep it anonymous if they want to. But they create this front page, which is personalized to them. And then they have different sections where they have module reflections. They have a course glossary, where they define key terms for each module and put the term and the definition there. And so, I started this approach… again, after reading Ungrading. But also, when I think back to classes, I had this really cool class about serial killers. And we created a portfolio with case studies about each serial killer, and I hung onto that thing for like a decade. I even gave it to my grandma who was super into crime shows and she wanted to read it. And so, I was like, this is something that is missing when we teach on the learning management system, and it’s something that I want to facilitate for students. Online, I think the eportfolio fits best rather than a paper portfolio. And so, it’s something that they can take with them and,it was funny, I was at a campus event, it was a campus ally training, and there was a staff member there who said, “Oh, you’re Dr. Boppre, one of our student workers is taking your class and she showed me her eportfolio that she made in your class and was so proud of it, and it looks so cool.” I’m like “That is gold. If that is what happens as a result of my teaching, I have achieved what I wanted to.” I want students to end my classes with some creative item that they develop throughout the class, and that they’re so proud of and so excited about that they’re sharing it with others. And so, the eportfolios, I definitely love those. I also assign infographics, which I think I mentioned earlier. So students create these visually appealing flyers with information about controversial issues in our field. So for victimization related classes, they’ll talk about intimate partner violence, violence against women, and they’ll summarize the research. They will do what they would typically do for a research paper, but in this visually appealing, accessible format. Honestly, I can’t tell you that I’ve ever shared a paper from class with anybody from undergrad, but I would share an infographic. I would show someone and say, “Look at what I’ve done,” and that’s what students tell me, they’re really proud of that infographic that they’ve created. And so, that has been really rewarding for me is to help facilitate these students’ creations. I’m not gonna lie, it does take a lot of tutorials and working through students to develop these skills, but I tell them, I’m very purposeful about the technology that I choose for classes and I’ve honestly had to ditch some approaches for some that are more useful and relevant to their future careers. But I really focus on the tools and technology that I think will best serve them in their future careers no matter what they do. And so, that’s why I emphasize these eportfolios, because you’re developing a website, and I have a personal website for all my scholarship, but I’ve used Google Sites to create community exhibits, I’ve used them to present research presentations. I’ve used these web design skills for so many other things that I can envision for other students and the same with the infographics and getting used to using Canva. We live in an ever growing society that wants information quickly and visually, especially like TikTok, Instagram… that is the reality that we live in today. And so, these approaches really fit with where we’re going in our society. And so, learning Canva, you might make an infographic for class, but then you have those skills to make a flyer for an event at work, or you have those skills to create an infographic for something else related to your class or for your career. And so, that’s really what I emphasize, these creative, project-based finales is what I call them, because they help students create something and cultivate skills that will benefit them far beyond the end of the semester.

John: David wildly refers to those assignments that end up in the LMS and disappear at the end of the semester as “disposable assignments.” And the type of thing you’re describing are the non-disposable, open pedagogy type things that students often find much more engaging, because they have much more meaning to them, and I think you’ve described that quite nicely. So we always end with a question, what’s next?

Bree: So I’m entering my fifth year on the tenure track. So, I’m still very much focused on research. But this upcoming semester, I’m actually putting all of the trauma awareness and the survivor centered teaching into my research-based service-learning project with students. And so, we are actually going to ask students about survivor-centered teaching and trauma-aware teaching and we’re going to do a survey and focus group with students. So I’m really excited to test students’ reactions to these approaches and the need. That’s ultimately what I want to demonstrate, the need for these approaches from an empirical standpoint, and involving students in that process. I think that’s going to be really powerful. One of my students in my summer class actually inspired me to do this because we were having a zoom session, and we talked about survivor-centered teaching, and she’s just like, this is the first time I’ve ever felt empowered to tell my story, because in every other class, I have felt silenced by these Title IX and mandatory reporting warnings, I just have not felt comfortable or able to share. And so that is a big part of my future in what’s next, is continuing to empower students to tell their stories and to view students as the whole student, and how these life experiences shaped their interactions in the classroom and the eportfolios is a way that I get to do that. They do get to share their stories and reflect on it. But I’m always looking for what more we can do, and that’s really what I want to focus on. Because these life experiences, even my own life experiences. Both my parents were incarcerated throughout my life, I grew up visiting my dad in prisons for 15 plus years. Every weekend, I was at the prison. To say that experience has no impact on my teaching or learning would just be ridiculous to say. That had a huge impact on who I am, how I learned, how I teach. And so, I’m very upfront about that with students, and I also want to empower them to have their own stories and reflect on how it impacts their experiences, because education truly can be transformative. It was for me as a first-generation college student, as someone with those life experiences in my childhood. Being able to go to college transformed my life, and if I can play a small role in that for my students, that’s my ultimate life goal and that’s why I’m here.

Rebecca: Thank you so much Bree for sharing your really great techniques and providing us with a lot of things to think about as more of us are teaching online and thinking about experiential learning and service learning in those contexts.

John: And we noted on your website, you have a word cloud that lists some words that students have used to describe your teaching, and the most frequent words were fun and creative. But right behind those were unique, amazing, informative, thorough, and awesome. And that would be a nice aspirational goal for many of us, to see those types of responses for students, because I suspect that those wouldn’t be the most common words that students generally use for most of their classes. So thank you for joining us, and I hope you’ll be back again in the near future.

Bree: Yes, I was so excited to come. A lot of my pedagogical heroes have been on this show. So I’m very honored to be here and thanks so much for having me.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

John: Editing assistance provided by Anna Croyle, Annalyn Smith, and Joshua Vega.

[MUSIC]

256. Sharing Our Stories

Students do not always recognize the expertise of faculty who do not match their cultural stereotype of what a professor looks like. In this episode, Sarah Mayes-Tang joins us to discuss how she has used personal narratives to address these student biases. Sarah is an Assistant Professor in the Mathematics Department at the St. George Campus of the University of Toronto. She is also the author of a chapter in the Picture a Professor project, edited by Jessamyn Neuhaus.

Show Notes

  • Neuhaus, Jessamyn (forthcoming, 2022). Picture a Professor: Interrupting Biases about Faculty and Increasing Student Learning. West Virginia University Press.
  • Peterson, D. A., Biederman, L. A., Andersen, D., Ditonto, T. M., & Roe, K. (2019). Mitigating gender bias in student evaluations of teaching. PloS one, 14(5), e0216241. (A study that suggests that reminding students of bias in course evaluations may reduce bias.)
  • Perusall
  • Ogawa, Y. (2009). The Housekeeper and the Professor: A Novel. Picador.
  • Borges, J. L. (1998). The library of Babel. Collect

Transcript

John: Students do not always recognize the expertise of faculty who do not match their cultural stereotype of what a professor looks like. In this episode, we examine one professor’s strategies to address these student biases.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Sarah Mayes-Tang. Sarah is an Assistant Professor in the Mathematics Department at the St. George Campus of the University of Toronto. She is also the author of a chapter in the Picture a Professor project, edited by Jessamyn Neuhaus.
Welcome, Sarah.

Sarah: Thank you so much. It’s wonderful to be here and to see both of you. [LAUGHTER]

John: Thanks for joining us. Our teas today are… Are you drinking tea?

Sarah: I am drinking tea. I have a…

Rebecca: Yay!

Sarah: …I wouldn’t miss it. …it’s a chocolate mint black tea by Sloane tea. They’re a Toronto tea company.

Rebecca: Awesome.

John: Very nice.

Rebecca: I have a very standard [LAUGHTER] English breakfast today.

John: And I have a Prince of Wales tea today.

Rebecca: Oh, I haven’t had that in a while. John. We’ve invited you here today to discuss your chapter in Picture a Professor. Your chapter’s entitled “Sharing Our Stories to Build Community, Highlight Bias, and Address Challenges to Authority.” Can you tell us a little bit about this chapter?

Sarah: Yeah, sure. I think that my chapter might be the most obvious kind of strategy in this book. So a lot of the authors are sharing really inventive, or new strategies that I hadn’t thought of. Mine is all about just talking to other people about the challenges that we face when we don’t look like other professors in the academy, or at least what students might picture as their idea of a professor, what might you picture when you Google a professor? So my strategy is all about talking to people. First of all, starting by talking to colleagues, in particular, colleagues that might face similar challenges. So first of all, I should say, I’m a white woman, so I can’t speak to the full challenges that, for example, people of color might face, but I’m a math professor, and I present pretty feminine, and I teach mathematics in I guess, like a pretty serious math department. And so I certainly don’t look like what students expect when they come into a big math class. So for me, and I think for a lot of other people that I work with, it really came as a huge shock, when students started to question even my basic mathematical ability, 18 year olds dealing with probably their own insecurities about mathematics, but it was coming out as like, she doesn’t know what she’s doing. And then the reaction from my superiors who are mainly white men, would be to act more authoritative, basically act ways that were more like them. And the way that I felt was just like, there was something very, very wrong with me. I felt very ashamed. And even though I sensed that it had something to do with my identity, I knew they wouldn’t question me in the same way, if I was a typical looking professor, I also thought I did have to change something about myself. And there’s such tremendous shame in that. And it wasn’t until I, at the end of the year, whispered a little bit about it. And then another colleague said this exact same thing happened to me, the exact same thing. And the whole year, we were going through parallel experiences. And knowing that changed my life, it changed my profession. I would have left the academy if it hadn’t been for that. And then over time developing a group of cheerleaders who I could go to, and then kind of gain more confidence. My chapter also addresses being able to speak to colleagues and being able to speak to our students, because it’s important that they understand the challenges that we face, because we don’t just have white men who we teach, we teach a variety of students. And I think if we can talk about our personal challenges, and they can see that we also have faced challenges that they might be facing, then that can really be very transformative. So that’s kind of a brief summary of some of the things that I talk about.

Rebecca: Can you talk a little bit about how that unfolds in a classroom when you’re having those kinds of conversations with students in a math class?

Sarah: Yeah, so sometimes it unfolds very naturally, by some prompt that might happen. Yeah, there might be an extreme example. This past semester, I had another professor, he came in, and it was like, clear gender issue. And so I used that, in the next day actually, it took me a little while to react to it. And then the next day, we had a very deep conversation about gender in the classroom. But it might be before student evaluations, that has taken me a long time to come to, but how do you address the research about what students do in evaluations? Sometimes I assign reading about mathematicians’ experiences, I try to assign readings of biographies of diverse mathematicians, and then we relate it to their own experiences. And then if it’s appropriate, I don’t want to be all about me. But if it’s appropriate, I sometimes talk about what I’ve experienced. So those are some of the ways that it comes out. But I try to make my classrooms not just about the mathematics, because that’s really where the transformative stuff happens.

John: In terms of the teaching evaluations, have you addressed that issue specifically with students in terms of gender bias on evaluations before the evaluations? And has that helped? …because there is some research that making students aware of biases tends to reduce the amount of bias that shows up in the actual evaluations.

Sarah: It’s really hard for me to say if it helps.

John: …there’s no control group.

Sarah: Exactly. So even though I teach gigantic classes, you’d think that I’d be able to do some sort of like statistical thing, I have no idea if it really helps. I do get comments, after, if I do address it. I know that some students will say, “I’m not just saying this because she’s a woman.” So there is some backlash in that. So it’s unclear. I try not to do it right before the student evaluations, but like a few weeks before. I also do evaluations throughout the semester. And yes, it’s difficult to see if it impacts the evaluations or not. However, what is meaningful to me is not whether it impacts my evaluations, I think, but again, reaching the students who might not fall into those majority groups and helping them see that some bias stuff may be going on and it’s not all in my head and that is impacting my experience, and there’s actual research behind that.

Rebecca: I can imagine that students in a math class don’t expect to talk about identity. Can you talk a little bit about the student response to some of these conversations that you’ve had with students.

Sarah: It varies. I find that students are more and more open to it. I’ve taught a lot of first-year classes. So as they go through first year, they’re more open to it. Because at first, they’re like, “I just need all the math and they find a big change between high school and university in terms of the contact hours. So like you’re wasting our time talking about this stuff. But by upper-year classes, they find it such a refreshing change, because they’ve been in so many math classes, where it’s just all content, content, content. A lot of lectures. And so I really didn’t react to any of that backlash. And it’s almost like a breath of fresh air. And another aspect of identity that I think has been meaningful, like, has maybe come very naturally, the idea of like, “Are you a math person?” …because that’s another type of identity that’s really common in our society. And even that, it certainly linked gender and race, but it’s something that isn’t directly gender or race. And so talking about how that fits into their identity has also been a key to unlocking more personal conversation and getting them to really reflect on themselves in a mathematics classroom. Yeah, and I think one of the keys is like having them watch a mathematician talk about their work and how their identity is linked to their work. And then they comment, for example, Perusall or something where they can annotate the text, and then they start to get involved in some conversations, I can bring those comments into class and then we can have some pretty dynamic conversations.

Rebecca: I can imagine teaching first-year students in math with a societal “I’m not a math person” problem. I know, I teach in art and design, so we have a lot of students that claim that identity, “I’m not a math person, I don’t do math,” and are afraid. Can you talk about some of the ways that you have reduced the fear, allowed people to see themselves as being math people, even though they’ve never seen themselves in that way? I know you’ve had some really interesting things that you’ve done.

Sarah: Yeah, I love reaching those people. And it’s a lot more difficult now in my job at a big university than it was when I was teaching at a liberal arts school, where all students are required to take a math course. So maybe I’ll talk a little bit about my experiences at the liberal arts school to start. So I was at Quest University Canada, a small school, about 500 to 700 students. It kind of started as an experiment. And so we are encouraged to do all sorts of things. And we had a lot of students who were so afraid, just as you describe, of their mathematics course. And they were putting it off, putting it off, putting it off. And I think one of the things that really traps them is the idea that everything has to build on the thing before and a lot of them got lost somewhere in early elementary school and they never recovered. And it was some sort of threat to their identity, probably some like quick quiz or something. Someone said something, and they were lost, forever. So it’s trying to show them that well, there’s actually parts of mathematics that math majors don’t see until their fourth year that you can do right now. And that’s usually how I try to approach it. So I think one of the things is just addressing that head on, talking about their experiences in mathematics and telling them we’re going to do something different. You’re not going to see numbers, you’re not going to see arithmetic even, this is going to be about shapes and space and ideas, and maybe even accessing points of connection with individual students. So I can give examples of particular projects if you’d like or particular courses.

Rebecca: I’d love to hear an example of a project.

Sarah: Sure. I’m a firm believer that the things that you think are going to be total train wrecks can either turn out to be the best things you’ve ever done or they could be trainwrecks. But definitely my best things have been the wild ideas. So I was teaching a course on mathematical creativity. And it was going to attract a lot of students that were totally afraid of math because they had to take it as part of a series of courses on creativity. So they got to take a social science course on creativity and a chemistry course on creativity. But they also had to take this, in their minds, terrible math course on creativity. So I was really excited to teach it. But how would you describe the feeling of creating something new in mathematics. And for me, and for most mathematicians, if you hear like these quotes about mathematics, they’re like mathematicians will say “math is like poetry. Math is like…” …they give all these analogies with very creative analogies. But most students don’t access that until graduate school, because there’s not this freedom of exploration. So I spend a lot of time just wondering, how do I feel creative? How do students feel creative? And it was really only on research that I felt really creative? So, how can I model research for students? So what I ultimately did was, I asked them, first of all, I didn’t tell them where we were going, cause there’s going to be a two-stage project centerpiece of this course. And first stage is you have to define something from geometry, but it can’t be like anything you’ve ever defined before. So one group defined, they called it like an ice cream cone shape. So it was a triangle with like a circle in it. And then we really worked on making their definition mathematically. So how does the triangle touch the circle, another group to defined a caterpillar shape in a precise way. And then the second part of the project, after they have their definition they couldn’t change was to discover as much about that object as they could. And they were only graded on how, on their journals, how much time they spent thinking about it, and how much they talk to other people. And I’m telling you, the ideas that these students had, and the level of mathematics that these totally math-phobic students did, was incredible. It was what I would expect from fourth-year students. And they were starting to use the word theorems and proofs. I said, you don’t have to prove anything, I just want you to like discover things, but they were coming to it naturally. And it was amazing. I could just gush about all the things that they did forever, like all of the discoveries that they made for themselves. And I still hear from these students about the impact that this project had from them, I don’t know, six or seven years ago now. So yeah, that’s one of my favorites. But at the time, I thought, Oh, this might go really poorly.

Rebecca: It’s amazing how the freedom to explore and discover can really open up the freedom to see yourself in a new way, or to be a researcher in a different way. As you were talking, I’m remembering an opportunity I had as an early faculty member workshop. And it was a multi-day workshop with mathematicians, and I was the non-mathematician, to help develop curriculum. And I had never hung out with math folks that much before. But it was really interesting. And we had really interesting conversations about creativity and the overlaps of our work that neither of us had recognized before. So it’s really interesting how those opportunities to have those conversations, whether with students or with colleagues can open up so many possibilities.

Sarah: Yeah, there’s so much and I’ve learned so much from my first year-students who are interested in some very diverse things, and they brought a lot to, like I was gonna say, my teaching, but like, also, just me personally, [LAUGHTER] I think they really enrich my life.

John: And you have taught some interesting classes, including a first-year seminar course in math and literature and poetry. And another one was women’s mathematics. Could you tell us a little bit about each of those classes and how you’ve used that to get students more engaged with math?

Sarah: Sure. So both of them are at the University of Toronto, I will probably do it as U of T at some point, which is not University of Texas for American listeners. And in part they were written to try to attract students who might not traditionally sign up for a math course, all of our first-year courses are massive at U of T, except for these first-year seminars, which are capped at, I think, 25. So really, students’ opportunity for a small class experience. So the math of literature and poetry, I think some of the seeds were planted, actually, by one of the students in that math creativity class. She was a poet, and she identified herself as a poet as a first-year student, and she was also very afraid of math, but she kept finding linkages. And she said, “You know, I think this can help me with my poetry.” And I am totally not a poetry person at all, or I certainly wasn’t, I’m maybe more now. And so that started to get me thinking about like, maybe if I combine math with like a poetry course, I could engage some other students. And she’s one of those students that I still talk to you and she just got her MFA in poetry and still using her math. So I talked to her actually, in developing this course. She helped me a little bit on the poetry side, also a key part in the math and literature and poetry is I had a TA from English because, again, I’m not a specialist. So I needed someone to help me and she was wonderful, a PhD student in literature. So I think another source of inspiration that was also integrated into it was that I had taught novels previously and seen how novels helped students relate to mathematicians or see themselves as mathematicians. I was just amazed at like how much empathy they had for the characters. So we read novels like about mathematicians, like the Housekeeper and the Professor, a really great Japanese novel in translation. And then there was mathematics from novels. So for example, one of our key novels, or a story, of the Library of Babel by Borges and you can actually ask, what is the shape of this library? What could the topology of it be in mathematical language? So then that was a key for investigating topology.

John: Was a library closed or open?

Sarah: Yeah, [LAUGHTER], exactly, that sort of question. We can start to narrow it down. So that was the math in literature and poetry course, in terms of content. The woman’s mathematics course is still kind of growing in my mind. It’s been in the works for a really long time. I just like us to center it almost like an experiential learning course, where the object of study was the university or like the mathematics in our university itself. And so as a result of both history and modern mathematics, and all sorts of things, I decided one of our units was going to be on data visualization, which is a little bit more number focus than I often have in first-year seminars, but people are often surprised that like Florence Nightingale was not just a friendly nurse, she was [LAUGHTER] an amazing data scientist. And she was really one of the first people to bring some of these amazing data visualizations, and she’s an amazing statistician, all these things. And there’s also a lot of women in this space currently. So their project was like, well take some data about the math department, maybe, or students in the math department and find an appropriate visualization for it. And they generated stuff that we really haven’t seen, like, what does it look like in our departments to have 13% woman faculty. You can say it all you want, but to actually see it with like the people, it is actually pretty startling to me. And then another project with that course, was we worked with a university archivist, and went into the university archives. So our university has a long and storied history, we hold ourselves up as a great research university. So we have many illustrious women in the past who have studied here, but people don’t know about them. And since I would say, we have a pretty bad situation with women in our department now, people kind of assume, after this archives project, I would go around and I would ask people, “When do you think the first woman president of the math student union was?” and people would say, “Oh, there’s never been a woman president. Like, are you kidding?” Because that’s the way it looks like now. But the answer is actually 1910 or something. And there were strong women, like way back when. And so students went to the University Archives, they looked at student records, they looked at faculty records, they looked at photos, and they told some stories from that. So that’s a project that’s gonna continue for a future class.

Rebecca: Sounds really interesting, and a great way to get students engaged with many different mathematical ideas, but also really engaged with this idea of identity related to disciplines.

Sarah: Yeah. And another thing that it did is it also helped them see themselves as part of the university because it was the first semester of the academic year, they were first-year students, and so it helped them see themselves as part of the community.

Rebecca: We don’t, in our curricula, look at the history of our university as part of what’s informing our work or informing the students. And so I can imagine that that’s a really unique kind of experience that could happen in any discipline, that would be a really interesting opportunity for students to just better understand their traditions that they’re coming out of.

Sarah: And I think our university archivist wants to work with classes, like they’re so excited to see, especially first year classes, get us to coming there and being part of that aspect of the university. I’m always a big fan of all of our librarians and I know that you guys are too,

Rebecca: You should see my notepad right now. It actually says “go see our archivist” because him and I had a conversation about a project we could do with my class. [LAUGHTER]

Sarah: Yeah, they’re wonderful.

John: Often, archivists are working in rooms all alone by themselves. And in fact, ours do work in the basement. And the opportunity to engage with students is good for them, as well as for students. That sounds like a really engaging project.

Rebecca: I’m ready to sign up for all of these classes. So I hope you have room.

Sarah: You are welcome to come and even speak and spread your wisdom, I would love that. [LAUGHTER]

John: Speaking of room… you also have taught some introductory calculus classes with up to 3000 students in them and you transformed them into an online environment along with a colleague during COVID. Could you tell us a little bit about how that course was structured and how it changed when you went to remote teaching?

Rebecca: It sounds so daunting.

Sarah: Oh, okay. So COVID for everyone has been really, really tough. And especially that I always have to go back and think what year was that? 2020 to 21 academic year…, everyone had it really, really tough. So we all like deserve, like hero badges or something, and I’m ready for a break. So I think we all need to catch up on our rest still from that. But I was fortunate because before the pandemic was on anyone’s radar, we had already arranged kind of a transition point in my job where I was going to be going from coordinating this gigantic introductory calculus class to not coordinating it. And the new coordinator, my colleague, Bernardo Galvao-Sousa, he was going to take over it. We were going to have a one year overlap, so he could kind of see how I did it and just like everything was gonna go normal and then he was gonna take over. So that overlap year was to be the 2020 to 21 academic year. So it was fortunate that we were both able to work on it, I don’t know how it would have happened otherwise. I had already been in a period of transforming this class, it had been basically the same from no one really knows, like, as far as anyone could remember, it had been the same. And I was basically brought on and hired at University of Toronto, to bring it to the 21st-century. So over the past three years before that, I had been changing it completely. And then, of course, we went online, which required it to be rethought because you can’t teach a course for 1000s of students the same way. So what was the course like before? Well, we have a lot of rules in our university for first-year courses, in that they have to have a midterm, they have to have a final exam worth a certain weight, there were three one-hour lectures a week, one one-hour tutorial, kind of the whole structure was pretty traditional. But I had been introducing some innovative projects, we were shaking things up in how we did them in tutorials. And the whole curriculum was really modernized. So I’ll give an example of one aspect of the course, the applied communication task, and how we transformed that aspect of the course, to put it online and still give students hopefully as good of an experiences as they could online. So applied communication tasks were this word project. So first semester, they were three separate projects, second semester it was one project, they were applied, and they were about mathematical communication. And I’m a big believer that I don’t really invent many new ideas, I just kind of like look at the needs of my students in my place and try to adapt things from elsewhere. So I had talked to every department that took my students after so this was like a calculus course for science students. And so they were going, the majority to life sciences, but they were also going to chemistry, they were going to physics, some are going to earth sciences. And then some are going to psychology and some at some other smaller departments, not smaller departments, but smaller portions are going to other departments. I guess economics was another big one. And I talked to them about like, what skills don’t students have that they should have from calculus? And one of the big themes was that students were afraid, they were just afraid to approach math in new context. So they could solve all the problems that were traditional, but they couldn’t if they saw a scientific paper, and there’s math, they were like, “I’m not familiar with this math, what do I do?” So I really took that as inspiration like, well, we should have students do that very thing. So as an aside, I put questions like that in exams, like, you know, take problems from scientific papers, give them information and put them on exams. But then also, in the second semester, have them find a scientific paper that has a mathematical model. And ultimately, the goal is to communicate something about that scientific model. Now, what form should that communication be in? Well, one common form that scientists use is a scientific poster. And the advantage of that is that it could be kind of an event, it can be kind of a grand finale for the course in tutorials. So we had a bunch of mini-poster sessions with about 100 students each. And so each of the posters presented models. They got into groups, kind of halfway through the semester, they combined some of their papers, but that took them through the experience of talking to a librarian and having to deal with databases. It got them through finding what’s important and what’s not. Well, I don’t understand… really this is way over my head in terms of math… what can I say from this model, and so all those skills like that, and then also the kind of communication. And it also combined oral communication where they have to talk about their poster and written communication, they had to write about their poster and they really worked on different drafts of different parts of their poster, and they have to read. First semester, the projects prepare them for that. They had a project that was focused on written communication, that was writing a proposal to their city council based on population projections from their hometown. They had a reading task and that’s changed a little bit over the years. So that’s what it was. What we did online is we basically kept the same projects, except instead of having the sprinkled in the tutorial, like every second or third tutorial was about the project, now we knew that they’re at home, they do not have any resources, any people around, we really need to make these be focused tutorial and make the structure very, very, very clear. Because otherwise, this really complex project is just gonna get completely confusing. We structured the first semester in that the first three tutorials were focused on writing. And the second three tutorials were focused on reading. And the third three tutorials were focused on oral communication. And then within that, the first tutorial had the same structure, the second tutorial had the same structure. And the third tutorial had the same structure. So they kind of had something much more predictable. And there was like a lot more evenness, and we didn’t try to give them as many skills as we did in the in-person, we cut down the expectations, we trimmed as much as possible. And then something similar in the second semester, we trimmed a lot, we focused a lot, we didn’t aim as high on the exams, in terms of all of those questions from scientific papers. We didn’t have exams, instead of exams, we had three different types of quizzes, the fun type was reflection quizzes, which had them reflect on their learning sometimes, or maybe conduct some sort of experiment at home, and then use that and make a model or something to like, go on a walk, this was in the deep COVID In the fall of 2020. And so like go on a walk, if you can’t go on a walk outside, go on a walk around your house and find something to model. So some people are modeling bird chirps or whatever. And then you create your own scientific models. And if you have two to three thousand students spread around the world, obviously, cheating is a huge concern. So we tried as much as possible to make it interesting. And for me, like, yes, academic integrity is big, but it was the perception of academic integrity amongst the students. Like we really wanted to keep them engaged.

John: So how did you assess and evaluate all those quizzes? Did you have a large team of TAs?

Sarah: We had very limited TA hours actually. So I think that’s another part of big course stuff that we don’t talk about a lot. It’s actually something I’ve been writing about, I’m just not sure where to send it because we don’t talk about it. It’s like management, like how do you manage a large organization? So we have about 50 people. How do you distribute your resources, and we have very limited resources. So we wanted to do these quizzes, we want to them very well, we have very few TAs and we still wanted TAs to teach tutorials. What are we gonna do? So what we ended up doing is redistributed our instructor resources. And normally students would be in classes of 200 in person. And we had them in classes of 400 online, because we figured the difference between an online class of 200 and an online class of 400 was not going to make a big difference. And technology, I can go into all the technological challenges. Now, the technology is all there. But August 2020, breakout rooms for this large of groups, impossible. So we had to do all these Zoom, and it’s crazy stuff. That’s how we managed is we had instructors who were like just in charge of quizzes. And that’s how we did it. And then every third quiz was kind of the automatically graded kind.

Rebecca: I think it’s important to bring up some of these logistics or project management skills the faculty have to have, especially when coordinating such big courses. And I appreciate that you’re sharing some of those things, because you’re right, we don’t talk about it. Just like we don’t talk about those same experiences that we have as young female faculty in the classroom or whatever kind of identities that impact our experiences.

Sarah: Exactly. Yeah. And both of these are the things that really keep me awake at night. It’s not the actual teaching, it’s the “How am I going to possibly grade?” [LAUGHTER] Or like, “How can I negotiate with my chair for more hours per students?” Or “What are you going to do with that one TA who’s behaving inappropriately with students?” It’s all of these extra things. Very, very, very different if you’re doing even a class to 500 versus a class of a few 1000 is quite different because you can’t see it all.

Rebecca: Yeah, managing an equitable experience is a really different kind of thing. It just keeps scaling up. So finding that equity piece is a challenge.

John: But it is impressive that you did those reflection quizzes at that scale, because that’s something I’ve wanted to do, but have been a little reluctant to do in a class of 400 that I teach in the fall. And now this is suggesting maybe I should do some of that. [LAUGHTER] Providing the feedback is the main concern that I have.

Sarah: Yeah, well, I think for gigantic classes. I don’t know however, we defined gigantic, like I guess gigantic versus the thing that you want to do. It’s often like what’s really the priority here and then what can you sacrifice, like, there’s always going to have to be a sacrifice. So I can’t provide the same feedback on a quiz to a group of 2,000 students as I can for a group of 20 students, or the classes that I had this year were in the low hundreds. And I can’t provide them the level of feedback that I had like on everything. But using peer feedback can be helpful, or just explaining to them, I can’t provide you feedback on this. If you want more feedback, you’re going to have to seek it, which is hard I know and not ideal. However, these are the things that we face, or just like deciding that the grading scale is going to be really generous and loose. I experimented this last semester in class of like 300-ish students with not ungrading, but more this [LAUGHTER] direction, letting them determine a lot more of their achievement levels, trusting them to say, “Oh, yes, I have mastered this actually.”

Rebecca: Well, now you’ve piqued our interest and we need to know more about it.

Sarah: Yeah, like, I’m still kind of thinking about how to describe it or characterize it because I started off with a structure. And then I really let the semester go on and adjusted as I saw my students change and as I changed myself. So I don’t have a lot of eloquent ways to discuss it. This is a upper-year course for group theory. And I wanted to do a lot of things that I just didn’t have the resources for. So I had to make a lot of tough decisions. And also, we are in a super grade-intensive university. And by the time they’re in like, third year, this is so ingrained in their mind. And this particular course has a very high percentage of international students, probably over 80% international students. And in my university, I think that they tend to be more concerned about grades because they have to be and somehow, just like not giving them grades on anything. [LAUGHTER] Like saying, “Okay, you’ve either mastered this, or you’re excellent on this, or you’re not there yet” was really difficult at first, a lot of them dropped the course immediately, because they didn’t understand it. They were like, “what percentage is this?” And I’m like, “Well, there is no percent.” “Well, is it 100?” I think they did not understand the concept of it at all. So I wanted to focus on oral skills, and oral skills are so hard to assess. But I want to give them the opportunity to develop their oral skills, I didn’t really want to assess them as much as I wanted to make sure that they were speaking about math and they were talking about math to other people. They could reattempt any assignment they wanted. So, they did a test, they could show me that they had actually learned the material on the test. But they had to talk to other people about it, they had to demonstrate they had spoken to other people, a lot of the main things like videos, and one group organized a mini conference on the topics for the weekend. They did a lot of amazing thing as a result of this. And the TAs provided very targeted feedback. So we’ve provided feedback on the skills that we knew students needed feedback on. So, they needed feedback on particular cognitive skills that they were not able to assess, like research has shown that they are not able to assess their own proofs, or students are not able to provide that same feedback. That’s what we assess. But we didn’t bother assessing things we didn’t care about.

Rebecca: It’s an interesting way of thinking about it. I know that I also was experimenting a little bit with ungrading this past semester, and also found that international students are the most like, “I don’t know what this means.”

Sarah: [LAUGHTER] Yeah, you have to just admit, sometimes, you don’t really understand it. Also a good opportunity for discussion for students, and talking about what that means when we don’t really understand.

Rebecca: Yeah, I think it’s good to model that.

John: We always end with the question, what’s next?

Sarah: Well, I just submitted my tenure file two days ago.

Rebecca: YAY!

Sarah: So I need to catch up on a couple of things, but then rest. I have not had a good opportunity since the beginning [LAUGHTER] of the pandemic, so I think that that’s going to be my answer. Yeah. [LAUGHTER]

John: That sounds like a wonderful plan. [LAUGHTER]

Rebecca: And great advice for everybody listening. [LAUGHTER] We can all use a little rest.

Sarah: We all need that reminder.

John: And we should note that this is the first time that Rebecca and I have recorded in the same room since March of 2020. So this is sort of a return to normalcy for us.

Rebecca: Yeah. So it was nice to share this experience with you, Sarah.

Sarah: Yeah, it was so nice to talk to both of you and to see you together. [LAUGHTER] So, I know that listeners can’t see you, but I have enjoyed seeing you and speaking with you.

Rebecca: Well, thanks so much for joining us. Thank you

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

254. Teaching Up

Creating an environment where members of the learning community can be taken seriously as their own authentic selves requires planning. In this episode, Celeste Atkins joins us to discuss how shifts in context, like reframing an assignment, can impact the way people engage with each other and the content.

Show Notes

Transcript

John: Creating an environment where members of the learning community can be taken seriously as their own authentic selves requires planning. In this episode we discuss how shifts in context like reframing an assignment can impact the way people engage with each other and the content.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Celeste Atkins. Celeste is a Sociologist, the Assistant Director of Faculty Mentoring Initiatives, and a Lecturer in the College of Agriculture and Life Sciences at the University of Arizona. She is also the author of a chapter in the Picture a Professor collection, edited by Jessamyn Neuhaus. Welcome, Celeste.

Celeste: Thank you.

John: Today’s teas are:… Celeste, are you drinking tea?

Celeste: I am an iced coffee person. So I actually drink Jot and I make my own vanilla lattes every day.

Rebecca: Wow, that sounds fancy.

Celeste: It’s really easy. Jot is a coffee concentrate, you use a tablespoon full of it and then I use a tablespoon full of vanilla sugar and eight ounces of milk. And it’s delicious and easy and quick.

Rebecca: and caffeinated. [LAUGHTER] I have Jasmine black tea today.

John: And I have ginger tea today.

Rebecca: The title of your chapter in Picture a Professor is “Teaching Up: Bringing my Blackness into the Classroom.” In addition to your chapter in Picture a Professor, you’ve also published other chapters that grew out of your dissertation: Teaching Up: Developing an Intersectional Andragogy. Can you tell us a bit about your dissertation research?

Celeste: Well, I have a background in sociology, but my PhD is in higher education. And so I spent close to a decade teaching at the community college level. And my dissertation grew out of my own experiences as a Black woman in a conservative Arizona town teaching about racial privilege, heterosexual privilege, and those types of things. So what I wanted to do was take an intersectional approach, because there’s literature on faculty of color, there’s literature on women, there’s literature on queer faculty, but not much takes an intersectional approach to see what we have in common and what we don’t. And so I interviewed, I believe, 18 sociology faculty from across the nation at different levels, in different types of institutions, about their experiences as part of a traditionally marginalized group teaching up, so teaching about privilege when they themselves are oppressed in some area. And so we had women, we had queer faculty, we had a couple of faculty who identified as disabled, and quite a few faculty of color.

John: On your website, you note that the chapter in Picture a Professor is based on some unexpected findings from the research in your dissertation. Could you tell us a little bit about the unexpected findings that you talked about in this chapter?

Celeste: Sure. So actually, this chapter is about the part of my dissertation that spoke the most to me, but surprised me the most, which is, when I started to look at differences intersectionally, I found that Black women, in particular, focused on bringing their authentic selves to the classroom. And for some of them it was after they got tenure, for some of them, it was after they felt they had sort of sold their soul in a way. And for me, what I found in my teaching, and why this resonated with me was: I started teaching, I got a lot of feedback, “you’re too aggressive,” “you’re too assertive,” “you’re too scary,” blah, blah, blah. And so then I tried to be like a Disney princess and be really, you know, flowers and butterflies, and very welcoming and soft, and it was fake. And my students didn’t like it, because it wasn’t me. And they could tell it wasn’t authentically me. So after a year or two of that not going well, I decided to just be me. I found a different book that was more intersectional and I started talking about what it’s like being a fluffy Black woman and how it affects how I live in the world. And I would make jokes about it, and I would address it. And then students really responded to it because it was who I am, and my authentic self. And so what these other sociology faculty were doing that’s so important, is modeling different ways of being professional. Because one of the things that’s so hard about hegemonic academia is it’s very heteronormative, it’s very white, it’s very male, it’s very middle class. And so a lot of us do a lot of code switching. And I used to joke about my best friend in college, she worked for a talent agency and I worked in HR and so we would call each other and like, “Good afternoon, may I speak with Michelle, please?” And she’d go, “Who’s calling?” And I’d go, “This is Celeste. What’s up girl? Hey, what are we gonna do this weekend?” As soon as we knew it was each other on the phone, then we would be our authentic self. And a lot of us spend time code switching. But what that does is reinforce the idea that our authentic selves is not okay in academia. And so this chapter about bringing our Blackness to the classroom is about when we show our true selves not only do we find different ways to connect to our students, but we also expand for many their ideas about what faculty are, about what professional is, about what an academic does. I can be an academic and not talk in $5 words, I can be an academic and be very gesture-y and very outspoken and out there and still do quality academic work, and in some ways, reach students that a lot of others who are so concerned at fitting in this rigid box of what is considered proper academia miss.

Rebecca: Can you talk a little bit about the kinds of classes that you teach that we can start talking about what that looks like for you and how your chapter addresses being in those classes?

Celeste: Well, I’ve gone through a lot of changes during my dissertation journey. And I actually have another chapter coming out about how I felt like I was kind of pushed out of teaching. It is very challenging to be a woman of color, the only Black woman faculty at my institution for part of my tenure, and teaching about these topics in a place that not everyone agrees with. And so I have actually transitioned out of full-time teaching, but I spent my career teaching intro to sociology, human sexuality (which is very fun), race, and gender. And now for the College of Agriculture and Life Sciences, I teach a diversity class. It’s fully online, but what I’ve done, based on what I’ve learned from my teaching experiences, is I’ve created it in a totally different way. So there’s no book, and it is the closest I could get to a series of guest lectures. So it’s based completely on YouTube videos and I give a little introductory video explaining the concepts. And then I find people who are either experts in the field, or who are personally oppressed in that way to share their stories. Because what I learned is, it’s one thing to hear about the concept, it’s another thing to humanize the people who are going through it. And so we’re actually doing some research on that to see if that approach is more effective. And so that’s currently what I’m working on.

John: And there’s a lot of research that shows the power of narrative. And when they’re personal stories, it has much more resonance with people than when they read about something in a book that seems a bit more distant. So, that sounds like a wonderful approach.

Celeste: I really found that especially when I was teaching human sexuality, I would bring in queer folks, I would bring in trans* folks, I would bring in polyamorous folks. And it went from “Ooh, that weird stuff”or “all those ‘those’ people” to “Wow, they remind me of…” and “They’re just like…,” and that I found was so important in breaking down stereotypes and really making a change.

Rebecca: You talked a little bit about negotiating your identity in the classroom at the beginning and making adjustments and not feeling authentic. How do you feel like you’ve been able to really be your authentic self [LAUGHTER] now? How are you able to arrive at that moment? And what does that look like?

Celeste: Well, when I was teaching face to face, what I would do is literally address the elephant in the room, we would do those, you know, the things that students love so much: come up and talk about yourself. But I would say “Look, I’m a big Black lady. And we’re gonna talk about stereotypes and those types of things”. But people say that I’m intimidating and people say these things, but my students who know me know that I’m here to help you. I’m not here for the money. If you knew what I made, you’d know that. And so I use a lot of humor. I make a point to break stereotypes, especially with my images. And then I make a point to be humorous about the images. So we’ll be talking about deviance, and I’ll say “So not holding a knife to a white lady’s throat is that… what kind of deviance [LAUGHTER] is that?” But I’m also very careful to never show single mothers that are Black. I’m also very careful when I do gangs. I have memes that I use and one is this white guy with a really long beard, riding a pink bike talking about biker gangs, or I have one meme of Sesame Street when I talk about gangs. And so I’m really, really careful to break stereotypes. And I also make sure that when I’m choosing my test questions, I’m choosing the ones that, again, reinforce breaking those stereotypes.

John: So you’ve talked a little bit about bringing your own identity into the classroom and how that evolved over time. How do you help students express their identities in class?

Celeste: I’m really, really careful about how I do examples. I very deliberately find diversity for my images. And again, I try to find things that people don’t think about. So when I’m doing, let’s say, relationships, I’ll show like an older lesbian couple, nobody thinks about old people still being in love [LAUGHTER] oftentimes, when you’re talking to young students. And another thing that I do is I bring in stories of my friends who are very diverse, and the people that I’ve known. And I feel like if you create a safe learning environment, and I do a lot of steps to do that in the beginning, that then students will feel safe sharing. One time, we were talking about border patrol, and we were talking about racial profiling. And I was trying to get across to one student who was either in border patrol or headed to be in border patrol that if you only focus on Latinos, then yes, you will only find drugs on Latinos. If you’re not stopping white people. If you’re not stopping Black people, then you’re not going to find drugs on them. And the argument was, “Well, it’s the cartels. And it’s this, and it’s that.” And finally, another student of mine, who is Latino, and whose father is Latino, but a border patrol officer, talked about being stopped, talked about being afraid, talked about this dynamic of “Yes, there are good officers who aren’t, and yet still, this happened to me, even though my dad is.” And so I tried to create that kind of space where students can shift each other’s ideas by sharing their own narratives.

Rebecca: You mentioned just a moment ago about setting yourself up to be able to have that space for students. Can you talk about some of the steps that you do take to create that environment?

Celeste: Yes, when I was teaching face to face, it was basically the first week, and usually these were two day a week classes, were centered upon creating a safe learning environment. So we would talk about community agreements, and then I would take it further. And I use some things that I learned at WRITCHE and don’t ask me what that acronym is for, but it was something about teaching about sexuality. And so what we did when we went to that workshop was we anonymously answered all of these questions on a survey. And so what I did was I create a survey about: Have you ever had or helped create an unwanted pregnancy? Have you ever used a food bank? Have you or anyone you know ever been to prison? Or Is anyone you know, undocumented? We lived on the border. And so what I would do is I would have my students take this, and I would go to great pains to make it truly anonymous. So I made everybody do a checkmark and not a big X and not a square, and everybody used pencil, and then we would go outside, and we would shuffle all the papers and pass them out. And then we would step in, step out to show who did it. So how many people have been part of an unwanted pregnancy? And we’d have… so I’d say then when we’re talking about reproductive rights, remember, it’s not those people, it’s people in this class. How many people have a family member who’s undocumented? Okay, when we’re talking about this, you need to keep it in mind. So it makes it really personal without outing people that, in this classroom, there are queer people. In this classroom, there are parents. In this classroom, there are people who have been to prison. And so we do that. And then I did a version of the opportunity walk. I know that there are mixed responses to the opportunity walk, but the version that I use starts with basically what we call ascribed statuses in sociology, so the things you can’t control. And so when they get to a certain point, I say “Now stop, look around, these are the things you had no control over.” And I talk about, as a Black woman, I’d be kind of back there in the back as well. And then we talk about the things that they have control over: education, those types of things, speaking up, being an ally, that’s an important one, because that starts to push you back again. And so we look at that. And we end that, and I say, “I want you to think about, again, where you were, it has nothing to do with you. So therefore, when we’re talking about privilege, it’s not about you, you didn’t tell the stork, ‘please bring me down to a rich white family,’ we have no control over any of these social categories that we’re born into. And so when we’re talking about that, then we’re trying to understand.” And then later on in class, I do another exercise called the “oops exercise,” again, talking about intersectionality. And pointing out that even if you’ve got privilege, if you’re white, male, heterosexual, well educated, at some point you were young, and therefore you were oppressed by age, and we like you enough that we want you to live long enough to be oppressed again by age, right? So even the most privileged people experience oppression in at least one category. And so those are the ways that I tried to make it a space where both we can share our own stories, and where we understand that privilege. While it’s challenging, and while we want to think the world is fair, it really isn’t. And we have to look at how we have privilege without it being a personal failing.

John: What other suggestions do you have for creating a more inclusive classroom environment where everyone is part of the class and where everyone’s voice is taken seriously and is heard by the class?

Celeste: I think it’s a balancing act. And I think it depends a lot on the identities or the perceptions of the faculty person themselves. So as a Black person, as a big Black woman, I find it necessary (and luckily, it’s part of my typical approach anyway) to use a lot of humor to make myself seem approachable. And it’s very frustrating because I used to co-teach with a guy who called himself my token old white guy, and he was an English professor. And I would say something about sociologically sound principles that are from my discipline that are scientifically proven, and students would go “well, I don’t …:.” and then he would say the same thing as a frickin English professor, and they would go “Yes, you’re right.” And it’s frustrating. But [LAUGHTER] the reality is, that’s the way it works. So sometimes I do that, sometimes I use my colleagues that way. And sometimes I’m that way, as a cisgender, straight woman, then I provide that added, “It’s not the chip on my shoulder” when I’m talking about issues affecting the queer community. So I think that’s important. I also think it’s really important to listen to your students. I have yet to find a school that has student surveys that address what I want to learn. So I create my own. And then I have students give them back, I have them give them back on the last day of school where I like to be done. So their grades are done on the last day of school. And so this won’t affect your grades. I’m going to give you your grades in a minute. And you can be completely honest, and what would make this class more comfortable for you? And I change my classes based on that feedback. And when you work for a while in one institution, then students tell them and so the feedback at my former institution, students either loved me or hated me. And the ones that loved me were like, “She’s awesome. She’s funny. She does really cool stuff. But she don’t take no crap. So don’t go in there and try to BS her and don’t be late, because she won’t take it.” And then the other ones are like, “Oh, she’s so hard.” Yeah, because I don’t take late work, because I’m trying to also prepare you for real life.

Rebecca: Can you talk a little bit about some of the ways that you design assignments to make them more personally relevant to students?

Celeste: Oh, yes. One of the things that was really interesting when I started graduate school was I started a minor in a certificate for college teaching. And I was like, “Oh, this will be an easy minor. I’ve been teaching college for quite a while now, so I’m good.” But part that really helped me was designing effective writing assignments. And I saw such a difference when I stopped having students write a paper and started having them do things like write a letter. So in my race class, I would have students, instead of writing a paper explaining to me privilege and intersectionality, I would have them write a letter explaining to someone in their lives, privilege and intersectionality. And if you looked at my website, some of my students did some amazing, amazing letters. And they were students that I wasn’t, in some cases, expecting that type of understanding. But when they’re explaining it, using their experiences is very different than how I explained it. But not only are they showing their understanding, they are teaching me other ways to reach other students. And so I found that very, very helpful. And part of what I do is I build reflection into all of my written assignments. So, what did you learn? How will it help you? Because my argument to students is that sociology is something that they can use no matter what their end goal is in life, you can always interact with people better. And so how will this help you in your civic life? So those are some of the ways that I try to make it more relevant to students.

Rebecca: It’s amazing how a small shift in the frame of a writing assignment can make all the difference, that content is really not any different. It’s just framed in a different way.

Celeste: Yeah. Because when you say it’s not a paper, and you say it’s a letter, then they start to write from their own, instead of trying to regurgitate what I said. When I say it’s a paper, they think I want to hear me, and I hear me talk enough. [LAUGHTER] So I really want them to show me their perception. So, to me, that was the most powerful change I’ve ever made.

Rebecca: Audience matters, for sure.

Celeste: Oh, yes.

John: Much of your work now is in faculty mentoring and faculty development. Could you tell us a little bit about your roles there?

Celeste: Sure. So once I started to feel that I was losing my empathy for students [LAUGHTER] and getting very frustrated in teaching… especially, it’s hard to teach online about race and hot topics, because they don’t really see you as a human being. And they feel really empowered to say things that they wouldn’t say, especially to my face, but they wouldn’t say in a class. And in a classroom setting, first of all, students will call each other out. So I don’t always have to be that person. And second of all, I can revert to: “Hello, we’re going to treat each other with respect, we agreed to this, we wrote a contract about it, we have community agreement.” It’s much more challenging to do that online. And so I began to feel like it was taking too much out of me to try to teach about these in a fully remote setting as I was during the pandemic. At the same time, I was working as a graduate assistant, paying for my tuition, and I happened to land a job in the Office of Instruction and Assessment. And I started to learn about faculty development as a career, which I really didn’t even know existed. And I began to think that is something that I can do. I’d been department chair, I’d been mentoring new faculty, I had done a lot of workshops on time management and classroom management. And so I began to shift my ideas into that was what I wanted to do. At the same time, I was working full time, working at least two jobs, because I was also a graduate assistant, sometimes three or four, and a single mom to a four year old when I started graduate school, and having some challenges with a cohort of students that were half my age who had very different ideas about social justice than I did, like we both wanted the same end result, but had very different ideas about how to go about it and was feeling very isolated and made a friend. And after a couple of years, where both of us sort of mentored each other, we both ended up in assistant director positions. And we started to think about the power of our relationship and how we could help people find that in a less organic way. Because it just happened to be magic. It just happened to be she worked in the office, she had really cool artwork, I walked in and asked about it. And when you see us together, you see this big Black lady and this little… she looks 12, but she’s not… and she’s got blue hair, and people are like, “How are y’all friends?” But at the core, we’re both about helping people. We’re both about social justice. We’re both about making the systems better. And so we bonded in a lot of ways, and we help each other in a lot of ways. And we actually complement each other in a lot of ways. For example, I hate rewriting and I would have not published all those chapters if it weren’t for the fact that she loves editing. So I would write it, she would edit it, and then I would fix it. And that’s how I got through. And we collaborated on a lot of things. And so we had been sort of building out this framework around peer mentoring, and how can we create, systemically, an environment where people could find their sort of match. And during that time, they were also, in the Office of the Provost, hearing that mentoring needed to be focused on and talking about creating a mentoring Institute. So she encouraged me to apply for this position, it’s a brand new position. And so I, in November, received this position, which is Assistant Director of Faculty Mentoring initiatives. And my main goal is to facilitate the creation of the MENTOR Institute. And I like acronyms. So MENTOR is actually an acronym for Mentorship through Effective Networks, Transformational Opportunities, and Research. And that’s really what we want to create. We want to create a place where we share social justice minded inclusive best practices about mentoring, and where both faculty and students and hopefully, eventually staff, will be able to do training and expand their knowledge and do research about mentoring best practices.

Rebecca: Sounds like a really great opportunity to start something new, but something that’s so needed in so many institutions. The mentorship piece is crucial for people, but also it’s so not facilitated. [LAUGHTER]

Celeste: Well, what we found is it’s just very different. In a huge R1 Institution, each college does things their own way. And so what we want to do is synergize and illuminate the great work that’s already been done. We have pockets of really excellent mentoring, and then to help facilitate for those who are going: “Yes, we need to institutionalize this, but we don’t know where to start.” And so it’s been really interesting. It’s been fun. It’s been a lot of work. [LAUGHTER] I’m currently working on our first workshop that’s going to premiere in fall, when everyone comes back, on mentoring practices. And I’m also conducting focus groups with graduate students to sort of understand what’s going well, and where we can fill in those gaps.

Rebecca: Sounds like really important and exciting work, but definitely work nonetheless. [LAUGHTER]

John: Do you have any other reflections on your work on the Picture a Professor project,

Celeste: I just want to say a couple of things. One is that I really hope that people will take the time to look at this book, because I think that part of what’s needed for the culture shift in academia is a shift in how we picture a professor, what a professor is. I spend a lot of time with people going, “where’s the professor?” It’s me. Hello, I’m the professor. And I also want to encourage people who are in graduate school to look for these types of publishing opportunities. I’m still working on my first sort of solo first-author publication in a peer-reviewed journal. I was part of the task force for the American Sociological Association, where we focused on contingent faculty. And as that I earned a first-author credit just because my last name starts with “A,” but I found it really challenging in any other ways to publish in peer-reviewed articles. However, I published three or four chapters of my dissertation by looking for edited anthologies that were coming out in the area that I was publishing. It’s still peer reviewed. It may not carry as much weight, but for me, it was a little bit more of a user friendly way to learn how to publish, to learn how to do rewrites, to learn how to do those multiple versions of wait a minute I thought I was done with this… [LAUGHTER] until it gets accepted, and it builds your CV. So I wish someone had told me that. I just happened to luck into it. And once I got my first chapter, then I started looking for other chapters. So that’s some advice that I wish someone had given me.

Rebecca: Well, thank you so much for all that you’ve shared with us. We always wrap up by asking, what is next?

Celeste: Well, I’m gonna be 100% honest, because I found bringing my authentic self was the only way to do it. And literally what is next for me is an epic road trip with my daughter.

Rebecca: That sounds awesome.

Celeste: She’s been a trooper for four years while I was in graduate school. She’s been a trooper for two years of a pandemic. And my little extrovert [LAUGHTER], who was stuck at home with just me and her. And I’m pretty much an introvert. So we are going to go on a road trip for two and a half weeks across seven states. And we are going to work on my bucket list, which is I want her to see all 50 states with me before she goes to college. So we’re working on breaking that down. And then professionally, it’s our first workshop. And we also facilitate faculty development communities for promotion. And we are looking into creating some sort of grad student communities in the fall as well. So, that’s what’s next for me.

Rebecca: That sounds like lots on the horizon. Have a wonderful road trip. That sounds wonderful.

John: It does. And thank you for joining us. It’s been great talking to you and we’re looking forward to sharing this episode with our listeners.

Celeste: Thank you

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

242. Student Podcasts

Student research papers have been ubiquitous in higher education, but there are many ways in which students can demonstrate the skills that they have acquired. In this episode, Megan Remmel joins us to discuss the use of student podcasts as a more engaging alternative to traditional research papers. Megan is an Assistant Professor of Political Science at Bradley University.

Show Notes

Transcript

John: Student research papers have been ubiquitous in higher education, but there are many ways in which students can demonstrate the skills that they have acquired. In this episode, we discuss the use of student podcasts
as a more engaging alternative to traditional research papers.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners. [MUSIC]

Rebecca: I guess today is Megan Remmel, an Assistant Professor of Political Science at Bradley University. Welcome, Megan.

Megan: Hi, thanks for having me.

John: Our teas today are… Megan, are you drinking tea?

Megan: I am not drinking tea. I have rooibos this morning. But I am now currently drinking my coke zero sugar.

John: It’s not that much different than many teas.

Megan: Yes.

Rebecca: Many other rebels join us as well. [LAUGHTER] I have English afternoon today, John.

John: And I have ginger peach black tea, a return to an old favorite as we move towards the end of our semester here.

Rebecca: We’re both getting to things that are comforting.

Megan: Ginger is calming. So, [LAUGHTER] you might need that at the end of the semester.

John: Oh, very much so.

Rebecca: So we invited you here today to discuss a podcast project that you’ve been using in your state and local politics class. Can you tell us a little bit about your project.

Megan: So I was trying to think of a way to make students try to approach things in a more neutral way. Because obviously, in poli sci, there’s a lot of soapbox standing. And I’d previously been using just plain old policy analysis papers. And students don’t love them. And so I was trying to think of a way to get them to do the assignment that I wanted them to do, and having some guidance, because they’ve listened to podcasts before, so they kind of know what some of these are structured like. And so I was hoping that that would help tone down some of the opinionation that can come out of these things. And so I YouTubed, and I found John’s YouTube page, [LAUGHTER] and found his podcast project and contacted him just out of the blue asking him if he had any materials he was willing to share with me. And he did. And those came in very handy in terms of being able to guide students in the project. But it was just me trying to give them a different way to do something. Some of them still opted to do a paper this semester, but I wanted to give them the opportunity to try something different, to maybe be able to say to someone in an interview that they’ve done something in this more kind of digitalformat. So it was trying to open up the possibilities for them in class.

John: And was this a face-to-face class? Or was this an online class or a hybrid class?

Megan: So the first time I tried to do it was last spring, and that was a hybrid class and was admittedly a disaster. But that class was a disaster for numerous reasons, I think hybrid being the prime driver of that. So this class was entirely in person. I did allow them to work in groups if they wanted to, and some of them did, and some of them didn’t. And I had them do two rounds of podcasts. The others who wanted to, wrote a paper and the percentages were equal. And so a number of them who worked in groups the first time around did not work in groups the second time around.[LAUGHTER] So they got to choose their own topics. I gave them a list of I think 10 topics from that section of the course. And so there were restraints, but I let them propose if they wanted to do a topic that was of interest to them. Somehow I managed to have a Sports Communication major in the class, and when we talked about special purpose districts, I mentioned to him that there are stadium districts where cities are basically using taxpayer dollars to do massive overhauls of stadiums. And so that’s where he went. So it was still in political science. It was still state and local politics, but it was something of much greater interest to him personally than say, term limits and state legislatures.

Rebecca: Imagine that.

Megan: I know, shocking, right?

John: So, the students worked in groups, how large were the groups that they work in for these podcasts.

Megan: So, I proposed having them work in twos. This class is a 300-level political science class, but it has historically been required for the history secondary education students and criminal justice students. and poli sci students have gotten more interested in state and local politics, but I don’t think they think it’s as sexy as national level or international politics, so I think that they realize that’s where the jobs are, they’re getting more interested. So the audience is not kind of a typical political science class. Because of that, I have these history secondary education majors, who because of how tight their curriculum is, are in classes all the time and know each other really well and work together and collaborate pretty frequently. And so I did allow one group of three to work together. So I basically increased the requirements. So if they worked in a group of one, they had to have eight peer reviewed sources that they could point to in the script. If they were a group of two, they had to have 12 sources, and then this threesome had to have 16 sources. And then it went from a 10-minute requirement to 15 and a requirement to 20 minutes for that three-person group and the three-person group was actually probably the best podcast I got. And I obviously can’t attribute it to whether it was just the number of them or they’ve also been some of the best students in the class this semester, just generally, so I wasn’t surprised that they did a good job anyway.

John: So you mentioned a script. Did you have students submit a script before they recorded or was that done after the fact?

Megan: So kind of both. I had them pick a topic and then I had them submit either an outline or a script and kind of gave the pros and cons, where an outline is obviously a little more freewheeling and allows for a little more conversational style in the recording, whereas a script would be much more definitive, they wouldn’t be scrambling for words necessarily. So they’d probably have fewer filler words and they could be sure that they weren’t fading off and losing track of what they were saying. So I gave them the option of either, I think the students who wrote scripts just generally did better. So I don’t know if in the future when I do this again, if I’m going to get the option of an outline, or if I’m just going to make them write a script, because those seem to just perform better, but with the script I made them include work cited, and they had to tell me where in the script or where in the outline which source connected to that material. So I was trying to make sure that they were still using peer reviewed sources, they could obviously use stuff from outside of that. But I wanted to make sure they were still using peer reviewed sources, the way that my policy analysis paper kids were. But letting them do it in this less structured style, in comparison to like an eight to 10 page policy analysis paper.

Rebecca: How did students respond to having these options?

Megan: I was a little surprised at how few students wanted to do the paper. [LAUGHTER] I don’t know if they’re just burned out from… I assume the last two years has just been a lot of online writing assignments, for instance, and so they were just scrambling at anything that didn’t involve them having to write in such a structured way. So I have relatively few students select the paper option. So I’d say it was probably three quarters picked the podcast and a quarter picked the paper. And the ones that picked the paper… my pattern deducing… seem to be the seniors in the class. And I think they just wanted to get their paper done and be done and not necessarily have to coordinate with other people. And maybe they have prior experience with less successful group work, for instance, and they were just: “I’m going to trust myself.” But that was kind of the pattern, where the underclassmen were more likely to do the podcast and the ones that seem to be picking the paper were the seniors.

John: Was there any apprehension about recording a podcast? Because when I’ve tried doing this, I know students are often a little bit anxious about things like, “I don’t know if I have the technical skills or have theequipment to do that.”

Megan: Yeah, well, what was great was in the material you sent me, you sent me a lot of options that students could use. So for instance, regardless of what they submitted to me, in terms of the outline, I have them use, I think it was Otter’s transcription. And so they were using some of the sources that you sent to me. And so I think they felt more comfortable. And as they went, I think, obviously, from the first round to the second round, the quality of the recordings went up. And some of them realized that there’s ways on their smartphones to record and that it will partly transcribe for them. So I think they got better as they went, I didn’t try to ding them too much for production value in the rubric. So there is stuff in there just about like, “Please don’t have insane amounts of background noise [LAUGHTER] in your podcast. Maybe don’t record it in your car…” or something like that. So I tried to have a kind of minimum standard, but I wasn’t going to hold it against them if it was kind of fuzzy audio, for instance. But they actually didn’t seem all that apprehensive about the idea. They were better at it than I would have felt.

Rebecca: So the burning question is: “Did they move away from so much opinion and they’re more neutral? Or did they stay pretty opinionated? [LAUGHTER]

Megan: So actually, it went better than I thought it was going to, because spring 2021, when I tried this the first time around, I could not get them out of being on their soapboxes. And when I created the instructions for the policy analysis paper, I frame it as though you were working for a state legislator who knows nothing about the policy topic you’re writing about. And they want a policy brief from you and then recommendations at the end. So, the recommendations part is the “opinion” part. But it’s got to be based in all of the research that you’ve talked about earlier. So if it were about legislative term limits, political science agrees on very little, but this is one thing there’s kind of universal agreement on is that they are bad, and they backfire and do the exact opposite of what we want. So if that’s what the research is finally saying, then the idea is that you would recommend to the state legislator to vote against instituting term limits in the state. So I found that they were generally able to do that… it took the scripts, that initial round, to be like, “some of this language is getting a little feisty,” and “some of this, I’m not seeing any citations behind it, so, as far as I’m concerned, it’s reading like your personal opinion.” So I think that stuff was pretty necessary to get them to tone it down. I also had them submit draft recordings before the final recording. So I could ensure that the script was improved upon for the recording and so I could direct them if they were starting to go a little too far into the opinion editorial page of the newspaper. And so they were generally pretty good at it. If anything, I think they might have been overly cautious by the end of it, in that they had all this evidence about something leading to something and it was kind of repetitive so… confident that that’s actually what’s happening and still feeling like they have to do a both sides-ism. So I think I’m gonna have to try to work on that to instill in them that “No, you can take a position at the end, it’s just got to be based on the evidence you presented earlier, instead of just constantly pontificating,”

John: …and once you have your students do that, could you have them work with some journalists out there? [LAUGHTER]

Megan: Yeah, as somebody who gets interviewed pretty frequently with local media, I get a little frustrated with the both sides-ism. And yesterday, I got interviewed a lot about the Roe draft. And the reporters kept wanting to talk about the leak. And I was like, “No, the leak is not the important part, guys.” So yes, I understand some frustration there.

Rebecca: Can you talk a little bit about how students either shared or heard each other’s podcasts or whether or not the podcasts were shared more broadly.

Megan: So, inside Canvas, which is the learning management software, Bradley uses, for the ones who gave me permission to share, I posted the files inside of Canvas. And then, strangely, and I don’t know if it was because they were maybe afraid of the quality of it, some of them let me share one podcast, but not the other podcasts. And it wasn’t necessarily like, they wouldn’t let me share the first and they would the second, I just think they thought I like this one better, and so you can let people share this one. And I didn’t like this one, and you can’t share this one. So I just put them on the Canvas website. A couple of them told me, the ones who got maybe low Bs, for instance, on the first one, because everyone did pretty well… the ones who got maybe high Cs, low Bs, on the first one, they told me, they went and listened to some of the other podcasts just to kind of see what the universe looked like. And one of them went, “Yeah, I realized I need to step up my game.” [LAUGHTER] And so I think it was useful from that perspective, I don’t necessarily think they were listening to it to learn about the topic that their classmates have done. But I do think it made some of them realize the quality of their work could have been improved If this is the comparison point.

John: I think that’s a useful benefit of any type of peer review of other people’s work, that when they get to see what other people are doing, they might feel better about their own work. But more typically, they realize that there were things they could have done better. And that’s, I think, a useful experience for everyone, including faculty.

Megan: Well, I think students don’t even realize that for all intents and purposes, we have to use them as guinea pigs from semester to semester to make a class better and to improve. So I realized that maybe the pure hybrid format of spring 2021 was not a good time to maybe experiment with assignments. And so it made more sense to try something now. And it’s unfortunate that those kids maybe didn’t get the best experience, but they are our little guinea pigs, and we also need to learn from their work to see how we can make their work better by improving our assignments.

John: One of the issues I’ve had when I’ve done this, I’ve only used it in online classes so far, mostly because my face-to-face classes are relatively large and I couldn’t listen to two or three hundred of these. But one of the issues I had was that for many students in the online classes, during the depths of the pandemic, it was the only time they really got to talk to other students at the same time and I ended up with these incredibly long draft recordings, sometimes, like 30 or 40 minutes for a podcast that was supposed to be quite a bit shorter. And it did add to the amount of time it took to provide feedback. And included in the rubric was a great penalty if it was too short or too long. So I had to remind them of that. It was a tiny penalty, I think the length was only like five or 10% or so of the rubric score, but I felt bad docking them for that, because when I listened to it, it was clear that they were just enjoying getting to know each other and they were having these great conversations and getting to know their classmates. On the other hand, the focus could have been a little bit tighter. And that is one of the trade offs about having a script versus something which is a little more freeform. But it was really encouraging to hear the connections that students were forming. Although, after many hours of this, I would have appreciated them being a little more concise in some of that discussion.

Megan: Well, to your point. I’m curious, I’m not teaching the summer, but I am teaching an online Intro to American Government class this fall. And when I’ve taught it online before I just used forum postings. And it’s a lot of “I agree with this person,” even though you have directions that tell them not to do this, “I agree with what this person said.” And I’m kind of wondering, and thinking about tweaking this for the fall of kind of doing these voice responses, in hopes that it might limit some of that just repetitive nature and get maybe something a little bit more substantive. Plus, it’s more interesting for me than just reading the same post over and over and over again. And because it’s in an online environment, and it’s asynchronous, though I do have weekly benchmarks so they can access everything all at once, I think it would allow them to have a little bit more of the interaction than they get into the standard asynchronous typical shell. So it’s nice to hear that. I think I would also then have to say it was only supposed to be a 300 word post. So that’s only like maybe two paragraphs so we really don’t need to give a War and Peace sort of opinion. But maybe that would give them some of that more conversational style and make them feel like they’re at least possibly getting to know some classmates, ideally with the idea that maybe they can talk to each other and go over course material instead of being in their own little silos.

Rebecca: There’s something about hearing a voice, or seeing a face that can make all the difference. Of course, from your end, if you just make sure they have to post things in accessible format, you can either listen or read, whichever might be faster. [LAUGHTER]

Megan: What are you implying Rebecca? [LAUGHTER] It was more fun to grade these for sure, it was way more fun to grade these than a standard paper, without a doubt, because I could listen and giggle. [LAUGHTER] Because some of them would throw in a little snarky bit. And you don’t get to have that in these really structured formal papers. So, for me, grading wise, it was definitely more enjoyable.

John: For me as well, it was much more fun. And my impression was students had a lot more fun with it than they would have had doing a written assignment.

Megan: Yeah, I still feel like I’m going to continue to allow them to do a written paper. I know, if I had been in their shoes, I probably would have still pursued a written paper. And I had a couple students in there who were just quiet as church mice. And were probably never going to have the self confidence to even attempt a recording. So I think I still need to provide the option, which I did not do last spring. And I think that’s another reason why it might not have been successful is just given the… I mean, you guys know… class personalities vary wildly. And so that class was just very quiet and reserved and not super engaged. And so podcasts probably not the best approach in that class, in hindsight, but I didn’t know that before they got into the class, and I had built the syllabus.

Rebecca: Yeah, those surprises do happen.

Megan: They do, they do. And it’s a little difficult to overhaul your syllabus quite that radically in the middle of the semester.

John: There is something to be said, though, for pushing students a little out of their comfort zone. And in fact, this podcast, in part, got started because of a similar experience that I had, where I was teaching in the Duke Talent Identification Program…

Megan: I remember that.

John: …and they asked me to be on a podcast they had just started. And I said, “Well, I’m really busy, I don’t really have time for this, and I don’t think I’d really be the best person.” So I gave them a list of people’s names who they should contact to be on this. And they said, “Okay, we’ll contact them, too. But we’d like to interview you.” And after trying to get out of it for a while I agreed to do it, [LAUGHTER] and then realized it wasn’t all that bad. And then I came back from Duke that summer and Rebecca and I were talking and I said, “You know I did this podcast and maybe this is something we might want to consider.” And it’s one of the factors that led into this. I wouldn’t have probably had been doing the podcast had I not been pressured a little bit.

Megan: [LAUGHTER] I feel something similar. 18 year old me would not have done the podcast option. 35 year old me who’s done probably 80 media interviews over the last few years…much more competent doing it now.[LAUGHTER]

Rebecca: I think one of the things that I really responded to that you were saying, Megan, is that you were offering options. And that there were two that you did two podcasts or two papers and that if students chose a paper the first time but then heard podcasts, there’s a second thing. So they could do perhaps one of each, right?

Megan: Yeah, so there was more flexibility. I did not have any of them do that. But at least it was a possibility for them. I feel like I don’t know if they misread the syllabus, but it was once I picked a path that is my path, I am locked in for that path. But there was the possibility of it. So maybe some of them in the future will get maybe a little more courageous and go from a paper to a podcast.

Rebecca: Or maybe they go from a podcast to a paper

Megan: …to a paper.

Rebecca: whatever works for them. [LAUGHTER]

Megan: Also true, whatever is most appealing to their preferences.

Rebecca: I really like what you were both saying too, about personalities of students coming out. And that when they might be writing a more traditional paper, it’s just like entire personhood just disappears. And that having that kind of positionality a little bit come out and their personality come out helps us to get to know our students better and to help them get to know each other better when they’re reviewing each other’s work.

Megan: Yeah, there were some students in the class who in class itself were really quiet and then I would hear these little snarky asides in their podcasts and be like, where’s that in class, I want that in class, please give it to me in class.

John: And they would often make connections to their own lives. They were trying to connect their own experiences to what they were learning in class, at least in the podcasts they were doing for me, and those are exactly the type of connections we try to encourage students to make so that they recognize the salience of what they’re studying. I think that was really helpful.

Megan: Yeah, with my history, secondary education students. In the first half of the class, we talked about state-level interest groups. And so I gave them the option to talk about the NEA and the AFT. And most of them picked it because I think they all know that they’re probably future members of one, if not both of those organizations. And I don’t think any of them realized how different those two organizations are, I don’t think they realized not only currently how different they are, but the histories and the motivations behind them are entirely different. And so I think some of them may not join both of those organizations now, [LAUGHTER] when they become teachers, because I don’t think they like the motivations of one group necessarily versus another group. So I do like that maybe this is actually going to impact their workplace environments, and actually how they choose to behave. Same thing with the second half of the course, we talk about tax policy, which I love… shockingly, not of super interest to them… and obviously, property taxes are one of the major sources of education funding for K through 12. And so a lot of them picked that. And they knew maybe that it was bad, I don’t think they realized how bad it was. And at least in theory, some of them seem to have a little fire lit under them. How quickly that the real world maybe extinguishes that is a different story. But at least for now, I think there’s a lot of desire, at least within these particular students, to try to change school funding formulas, for instance. So I actually looked at the roster in advance of the class starting and looked at the majors of the students to try to find topics that were relevant to state and local politics as a political science class, but that students of those majors would actually gravitate toward.

Rebecca: To me that seems like one of the most meaningful choices that you made in your assignment design, because that really hooks a student and keeps them engaged.

Megan: Yeah, forcing them to talk about a topic they do not care about is hugely problematic. I teach our research methods class, and basically, if it’s a quantitative social science paper, it counts. I don’t care what topic it is. And they’re just mind boggled. So one of them, he’s a political science major, but he’s writing his paper on how video games affect stress levels in people. And so they just get to poke around in stuff that they don’t feel like they have permission to poke around in otherwise.

Rebecca: The other thing that I found interesting as a design faculty who does similar things, maybe not a podcast, but we do things that are out in the public, and we might share them, is that I often give models for students to look at that are professional, we might even analyze those together. But it’s not until they see each other’s that all the light bulbs go on. [LAUGHTER] It’s something about seeing a peer get it that all of a sudden helps bring the rest of the students along. And so they’re always clamoring for getting to see each other’s work. And it does improve the overall quality of the work, in my experience overall….

Megan: Yeah.

Rebecca: …despite the fact that they might have these professional models to look at.

Megan: Yeah, I did, because of, again, John’s instructions, I found state and local related podcasts, and linked to some of them. So they could see how they’re talking about policies, but not being super opinionated about them. And I’m looking forward to now that I have permission to share some of these, I teach this class every spring next spring, being able to give them these models of colleagues basically having done this work. So that, yeah, it doesn’t have the same production quality, and there’s no intro music and ad breaks, but they can see that their classmates have managed to do well on this. And they too, can do well on this. I mean, I always provide sample papers, I get permission from students and remove all their identifying information and post those so that students can see like “You can write a research design in my research methods class, it is possible. This was an A, this is what it takes to get an A.” So I’m glad that a few of them gave me permission to share their podcasts. And I think I’m going to share some of the better ones and some of the less better ones so that they can see for themselves, the spectrum of possibility. And if they’re cool with just putting in somewhat minimal effort, then that’s what this podcast sounds like. And if you want to put in the effort that’s gonna get you an A, that’s what this podcast sounded like.

John: One of the things that my students have commented on at the end of the class was that some of them have decided that they really enjoy podcasting, and they started their own or they plan to do one in the future…

Megan: Wow.

John: …and a few of them have also said, “I never listened to podcasts before, but now I’m listening to these podcasts.” So I was really impressed. But it did have these other side effects that I didn’t really anticipate it having.

Megan: I can’t say any of them have told me that but I’d love for at least for them to listen to some more podcasts because clearly, that’s all I listen to in the car. [LAUGHTER] So many podcasts.

Rebecca: I’ve had similar experiences. John, although I haven’t taught a podcast class. I’ve introduced students to podcasts as part of learning materials.

Megan: Yeah.

Rebecca: …and having assignments… and many of them say that they really enjoy that format more than others, but they may have never really experienced it previously.

Megan: Yeah, I can assign them a 10-page article or I can assign them a 30-minute podcast. They definitely like the 30-minute podcast better. They seem to actually listen to it in a way that they don’t with the reading. So yeah, I have been more and more frequently been trying to find either like 5-minute local NPR stories or outright organized podcasts for them to listen to,

John: I’ve been doing more of the same. And I try to find podcasts that have both the audio and a transcript, so that people can choose a modality depending on where they’re working and reading. In some cases, it may be hard to find the time to listen to audio, or they may be constrained in some way and they prefer reading the text. And in other cases, students would much prefer listening to a podcast while they’re walking or exercising, or doing something else. So they have appreciated the choice when it’s used as a basis for discussions or some other assignment.

Megan: I hadn’t even thought of that. But I’m gonna have to think about that for the syllabi for the fall.

Rebecca: The transcripts are really helpful too, because if you are listening, and then you hear the name of something, or you’re not really quite sure how to spell it, or whatever, the transcripts can be really helpful… if those transcripts have been edited, of course.

John: One thing I’ve always been amazed by are the number of people who say they only read the transcript, they never listen to the podcast. Because what I enjoy about it is the narrative and the ability to focus on a conversation while I’m driving or walking or something similar. And reading the transcript would be very much like all the other reading I do, and it just wouldn’t seem as interesting.

Megan: I agree, but to each his own.

Rebecca: There’s a few podcasts that I listen to regularly that I might go back and revisit in transcripts to pull out some notes of things that I wanted to remember. And so I really get very frustrated when podcasts don’t have transcripts for me to do that.

Megan: [LAUGHTER] Fair.

Rebecca: To support my needs.

Megan: This is about me. Thank you very much.

John: It’s important for accessibility purposes as well.

Rebecca: Yeah, definitely. So Megan, you shared a couple of things that you might want to do differently in the future related to this assignment, do you have any other thoughts about how you might frame or structure the assignment a bit differently to continue producing excellent podcasts and your classes?

Megan: I’m curious about the idea of… It’s a 300-level class, and I feel like providing them the topics was a little hand holdy. And so I’m trying to figure out if I should let them pick the topics, because then they have to work a little harder to figure out what might constitute state and local politics. Because I think you can see that in pretty broad ways. But I worry that if I do that, then they’re just going to take some really black and white literal approaches. So I’m not entirely sure what I’m going to do on the topics front of things. And it might just, again, depend on who’s in the class. I think if it were more of a straight up political science class, I’d let them maybe wander a bit more. But since that’s not the audience of this class, typically, I might try to give them a little more structure, since they’re probably of all people gonna go, “I don’t know what you want for me in a class that’s not directly my major.” So that’s thing number one. I am also trying to figure out for the groups, for when they recorded together, given that some of the groups fell apart in the second round, I’ve never had great success with peer review, because they don’t seem to want to be telling the truth about each other. And so I’m trying to figure out how to get around that because it was pretty obvious with one group in particular that someone was doing all of the heavy lifting, but that person wouldn’t fess up to it. And so I’m trying to figure out if I should allow them to work in groups, and if so, how to try to ensure that the workload is being done somewhat more equitably. Because when I’ve had them work on group projects that have involved writing, for instance, I can follow the Google Doc, because I’ve required them to give me access to something like that and I can see who’s adding what. I’m less able to do that in this scenario. So I’m trying to figure out how to… maybe in the script writing process, still have them share it as a Google doc so I can follow the trajectory of who’s adding what, when, in an effort to try to get a better handle on making sure that one person is not being carried through the assignment. And that’s just, I think, a general struggle with trying to grade group work assignments. But that’s the only thing that I can think of right now and I’d love advice. But the only thing that I can think of right now to try to address that a little bit. And I knew it was gonna be a problem, I just didn’t know quite what to do with it. [LAUGHTER]

John: While you can follow the editing history, that can be a bit of a tedious path through that. What I’ve generally asked students to do is just to use a color code where they pick a dark color, so there’s still good visual contrast to meet accessibility issues. But they each have their own color that they write their text in. So when they write a section of a document, just have them block it and choose their color. And then when you read through it, all the dark blue will be from one person, the dark green will be from another person, and the purple will be from a third and it makes it a whole lot easier to evaluate the individual contributions. And that’s worked really well.

Megan: That is beautifully simple. I appreciate that. Thank you.

Rebecca: I do a couple of things, also, because I do a lot of group work, and group work that’s not always visible. I often have shared documents where it makes sense and ways of documenting it. But I’ve also done things like having students keep timesheets, just recording what they’re doing and when and how long it takes with the frame that it might be helpful for them to better understand where they use their time. And so that sometimes is helpful. We also tend to do things in design more like a process document. So it documents the process and milestones and summaries of what they’ve contributed at various points. And so I find those kinds of documents really helpful to understand what people are doing. And I always request them to provide a little bit of information about why they made certain decisions. And as soon as you do that, then you know who did it, it becomes very clear. And the other thing that I do is a Google form as review of the other collaborators. But I do things like ask questions about how willing they were to accept feedback, what was their greatest contribution? So it’s framed in a little bit different way than maybe a traditional rating system? Like, did they do all the things?

Megan: Yeah, it sounds more, what did you do versus what did your partners do?

Rebecca: Yeah. It’s more aligned with how you might do evaluations in a workplace or something rather than maybe traditional peer-to-peer evaluation.

Megan: Those are awesome. Thank you.

Rebecca: Megan, was there anything else that you wanted to make sure we talked about?

Megan: No, I just want to thank John for being so willing to share his materials with me because I would have been floundering about how to start.

John: I was really happy that someone requested it.

Megan: It was great. Thank you so much.

Rebecca: Well, we always wrap up by asking: “What’s next?”

Megan: I think I’ve got a lot of material to work with with state and local politics. Given the recent political landscape, maybe too much material to work with and state local politics. I think one of the things in the future and I’m nowhere near this yet, I’m interested in letting them explore alternate methods of this podcasting style. So maybe actually interviewing local candidates, working with political parties, the League of Women Voters is actually very, very active in Peoria, and they still subscribe to being non-partisan, so it would be nice to try to team up with them and see if they’ve got some sort of outreach campaign they’d like to do. So I’m thinking of trying to really expand, but next year is busy. So that might be the year after.

Rebecca: Well, thank you so much for joining us.

Megan: Thank you for having me.

John: Thank you very much. And I’m really thrilled that someone actually found that material useful. [LAUGHTER]

Megan: It was, it was great. [LAUGHTER]

John: It’s an activity I’ve been doing with my class for three years now, and it’s been working really well, and I’ve really enjoyed it. And many of the students really have to.

Megan: Yeah, time two was the charm for me.

Rebecca: Yeah, you have to have a practice round.

Megan: Yeah, unfortunately, those students were guinea pigs, but I learned from them.

Megan: Thank you for having me. I appreciate it.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

John: Editing assistance provided by Anna Croyle.

[MUSIC]

236. ePortfolios

As David Wiley has noted, “disposable assignments” often have small impacts on student learning. In this episode Nikki Wilson Clasby joins us to  discuss how one campus has used ePortfolios to create authentic learning experiences in their English composition courses.

Nikki is the coordinator of the English Composition Program at SUNY New Paltz.

Show Notes

Transcript

Rebecca: As David Wiley has noted, “disposable assignments” often have small impacts on student learning. In this episode we discuss how one campus has used ePortfolios to create authentic learning experiences in their English composition courses.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Nikki Wilson Clasby. Nikki is the coordinator of the English Composition Program at SUNY New Paltz. Welcome, Nikki.

Nikki: Thank you. It’s good to be here.

John: Thanks for joining us. Our teas today are… Nikki, are you drinking tea?

Nikki: I am certainly drinking tea, yes.

Rebecca: Woohoo!

Nikki: Would you like to know what it is?

Rebecca: Yes!

John: Yes!

Nikki: [LAUGHTER] So this is an exotic blend called Tetley, a very strong British brew, which we Brits love, unless you’re a PG Tips fan, but Tetley’s pretty up there. And I have it with 2% milk which is the best way to drink it.

John: Most of our colleagues on campus from England tend to drink Yorkshire Gold.

Nikki: Mmhmm.

John: They seem to prefer that to the other options.

Nikki: Yes, well I am a Yorkshire lass, but I have to say Tetley has that kick that I need. [LAUGHTER]

Rebecca: Good to know. I think today I have Scottish afternoon tea.

Nikki: Ooh!

John: And continuing with the theme I have an Irish breakfast tea from Twinings.

Rebecca: Oh!

Nikki: Oh very nice, that’s a good one too. I like that one.

Rebecca: This crew needs some strong stuff today.

Nikki: We need some scones now. [LAUGHTER] Then it will be complete.

John: We’re recording this at 12:30 today, and I’ve already had five meetings today including a class.

Rebecca: This is my second pot.

Nikki: I’m impressed. [LAUGHTER] You can come and have tea with me any day.

Rebecca: [LAUGHTER] Perfect. So we’ve invited you here today to discuss the use of ePortfolios in the Composition Program at SUNY New Paltz. But first can you tell us a little bit about your role at New Paltz?

Nikki: Yes, I am the Coordinator of the Composition Program. I stepped into this role two years ago, and I am also a lecturer. And so I teach mainly our upper-level writing and rhetoric courses where I specialize in visual rhetoric. And I also teach courses in what we call Practical Writing and Design which is a new course dealing with a sort of blend of graphics and writing. And I also teach a FIG, a First-year Interest Group, for the Communication Disorders. And I run practicum for our TAs.

Rebecca: So you’re not busy or anything?

Nikki: I’m not busy at all, no. Plenty of time for drinking tea. [LAUGHTER]

John: And plenty of reason to drink that tea with the caffeine.

Nikki: Which is why I drink Tetley, yes. [LAUGHTER]

John: So, we invited you here, though, because we heard about the common use of a WordPress site for the creation of student ePortfolios. And I think the first question we have to ask is… How did you possibly get agreement within a department on the use of one platform?

Nikki: [LAUGHTER] Actually it’s pretty simple, there’s no drama involved here. So in 2019 the composition committee reworked our three-credit English 180 Composition II course to a four-credit GE course, which we retitled English 170 Writing & Rhetoric. And we had been using print portfolios for a long time, and so during the process of revamping our course the composition committee reviewed how we could improve our portfolio assessment. And Matt Newcomb, who was the coordinator at the time, and I had been long advocating for ePortfolios. So during our meetings we decided that it would be a good time, seeing as we were revamping this course, to introduce ePortfolios into our curriculum. And we’d looked at options in Blackboard, but they were just too…

John: Awful? [LAUGHTER]

Nikki: Yes, too awful, but just by happenstance and pure serendipitous coincidence the university at this time decided to just opt for a CampusPress system, and they adopted Hawksites. And so it was made readily available for us to use. And so the timing was perfect, we just jumped on it right away and said, “Yes, this is what we want. This is the way we’re going to go.” So because Matt and I had been advocating for ePortfolios for so long it was pretty simple to get our program on board with the project.

John: And we should note that the Hawks are the campus mascot for SUNY New Paltz. And that Hawksites is just a campus-wide instance of WordPress, I believe.

Nikki: It is, yes. That’s exactly what it is. We just gave it the name Hawksites. Yes, it’s a campus-based university blogging website and ePortfolio tool.

Rebecca: Are students developing these in this more beginning course, and then working on the same portfolio throughout their entire curriculum?

Nikki: Well, this is what’s really interesting. So the faculty are allowed to use the ePortfolios as a tool for however they want to integrate it into their program, so they have free rein to do whatever they want with it. And we all use it in different ways and to different degrees, depending on our comfort level with technology, and how it fits into our curriculum. But as a composition program we use the ePortfolios for assessment purposes, so I can tell you a little bit about how that is organized. So whereas we can have free rein to use them however we want, we do have some very specifics that we need for our assessments. Would you like me to tell you about those?

Rebecca: Love to hear about those.

Nikki: [LAUGHTER] Okay, so for English 160 which is the basic, very first writing course, students have to go through this ePortfolio assessment at the end of the semester to determine whether or not they are fit to move on to English 170. So this is the tool that we use to make sure those students are ready for the more vigorous program. So for that 160 assessment process the students have to upload to the ePortfolio, or at least be able to visibly show on the ePortfolio, they have to have two of their strongest assignments, and they also have to have their revisions for those assignments. They can choose whichever ones they want to put on, but they have to be two major assignments. The only requirement is that they have to show that they have been able to write in different modes, different genres for different rhetorical situations. And there needs to be an element of research in their citation, you know the beginning stages of that research process. And obviously we’ll be looking for the standard of their writing as well, that’s why the revision aspect is really important. So that’s what they’re required to do for the ePortfolio. And then the 170 students, they have different requirements. But let me just backtrack just for one second. So across the board for 160 and 170 as part of the ePortfolio requirements, all the students have to create a reflective cover letter that goes up front in their ePortfolio. They write that reflective cover letter at the end of the semester and we give them questions, guidelines as to what to tackle. And what we want from them is a sort of critical overview of their progress during the course. And they have to cite examples of their writing to prove their case. So it’s a persuasive letter, and our assessors read that first, so they’ll read that reflective cover letter. And that gives us a very clear sense of what the student understands about their writing process, and that makes us feel a little bit better about whether they’re ready for 170 or not. It shows that they’re applying the techniques and skills that they’ve learned throughout the semester to that cover letter. So the 170 students, we have a very specific framework for our 170 Writing & Rhetoric program, it’s based upon a wicked question. So a wicked question might be… What should we eat? Or how do we save the world? Or what does it mean to be human in a digital landscape? And all professors can choose whichever kind of wicked question they want, that they’re excited about, and then they base all of their assignments around that wicked question. That gives us a lot of flexibility for Writing & Rhetoric, which is wonderful. So the semester is divided into two sections. We basically require two major assignments that are argument research based, and then each of those two large assignments has two smaller assignments that help students gear into those big assignments. So, for instance, you might have a proposal with an annotated bibliography that leads to a research paper. So students have to choose one of those sections. So in the ePortfolio we want to see two smaller assignments leading to a large assignment. We don’t need revisions at the stage for 170, we acknowledge that revision is part of the process, and that they will be revising anyway for those papers. So that’s the structure of the assignment sequences for those two ePortfolios. And then beyond that we add other things into the ePortfolios as we see fit. So, for instance, this semester we have our internal assessment which is for our 170 students, and that’s on basic critical reading. So that’s kind of how our ePortfolios are set up. And then at the end of the semester we have a system set up where we review each other’s ePortfolios based on a common rubric that we have put together. So that’s basically how it works.

John: It sounds like a great approach in ensuring standardization across their classes and making sure that all students meet the requirements to move on.

Nikki: It is, it’s very effective. We have lots of conversations afterwards about who’s on the cusp, borderline cases, and so it’s very democratically pieced together. And then of course we have to work on individual cases of students who are failing for various reasons. And it’s a pretty good system, and it’s been very effective over the last two years that we’ve been using it.

John: This is more of a technical question about the organization… Is each site organized by class or is it by students? In other words, does a student have their own WordPress account that they use and create an ePortfolio that is unique to them across all their classes? Or is there a class site where all the students in the class post their work? Or is it some combination of the two?

Nikki: So what happens for us is that in our composition program, we have a template on Hawksites, and our students create an account through Hawksites, and they are given the template that they have to use. So they are essentially creating their own account on Hawksites for our classes, and it’s unique to them. It’s not something that we share with other classes, this is specifically for our class. Does that make sense?

John: Mmhmm.

Rebecca: So just to clarify, if a student was in another class, in another subject area, they may have an additional site.

Nikki: Correct, students can create as many accounts as they want on Hawksites for individual programs. I have about 10. [LAUGHTER] It’s fantastic. It’s such a good resource, we love it.

John: I’m hosting a variety of WordPress sites as well for different purposes.

Rebecca: Me too. One thing I think that’s always important to ask when we’re talking about ePortfolios, is whether or not that student work is public to everyone, public just to members of the community, your classroom community? Or are they private? Or do students have a choice of the privacy settings?

Nikki: The students have a choice of privacy settings. But what we encourage students to do is to select the option that allows only people within our university that have a university ID and login to be able to access it, and only the people that the students give the link to, or the people that the faculty give the link to. And this allows us to share those ePortfolios amongst the people who are going to be assessing. So there is some choice for the students, but it also gives us the option to share easily amongst our colleagues. But I want to add something into this too, that within our template that we had created at Hawksites, we have a permissions policy embedded into the site. And that is a basic form and students can sign it, they can say yes or no. We ask the students, “Would you mind If we shared your portfolio for teaching purposes? Would you mind if we shared some of your work for research or for teaching methods?” And students can pick “yes” or “no” for all of those. And that’s nice to have that there on the ePortfolio, so whenever we’re looking for examples we can check the permissions pledge and see who’s agreed and who’s not agreed, and then of course we respect the students that haven’t signed it. So there are some levels of privacy within our cohort of teaching. There is a blog function on our Hawksite. It’s up to the professor whether they use the blog or not. But as they stand, the students can’t see each other’s ePortfolios, those are private. But there is a blog function within Hawksites, and faculty can choose whether they decide to share that blog function with other students or not. I have used that function for a different project, but I haven’t seen anybody take advantage of that because we also have Blackboard which has its own blog function too.

Rebecca: How have students responded to the idea of using ePortfolios?

Nikki: That’s a really good question. It very much depends on the instructor and how the instructor teaches the ePortfolio component. I can tell you that for TAs who are new at trying to grapple with this technology and pedagogy, some of them have in the past waited till the very end of the semester to have the students upload their work. It’s too stressful for students, they can’t handle it. It’s a lot of work to put a good portfolio together. So I make the TAs have the students sign up for an account within the first two weeks of the semester. And I encourage the TAs to find ways to get the students to engage with their ePortfolio on a low-stakes non-graded level just so that they can learn how to use all of the functions and the tools. And also get them in the habit of using their ePortfolio as a working kind of document, and not something that just gets shoved to the end of the semester. So it really depends on how it’s taught. But if you do teach it with those kinds of sensitivities in mind, and you don’t stress the students out, I find my students in particular love using their ePortfolios. They enjoy engaging with them, they enjoy seeing their work look professional on the site, they enjoy the option of using a more web-based writing process for embedding videos, hyperlinks, uploading images, embedding their beautifully designed Google slide presentations into their site. So they do enjoy that process. I give them time in class to do it so it’s very therapeutic for them. But they also appreciate learning some of the real-life skills that comes with curating an ePortfolio, and they recognize that this will help them later. So the enthusiasm for it is pretty high, and most students feel very proud of their ePortfolios by the end of the semester because they have something to show for all of their hard work, and it looks good. So they’ve adopted it really well. My worry about students is they do all this work, and they hit the submit button for grading, and then that paper disappears down the black hole never to resurface, and then they just move on. And it’s a shame because that work is good work, and we want our students to feel like they have a stake in the writing process, they have a stake in scholarship and research, and the ePortfolios provides a really nice platform for allowing them to think of themselves in that respect, and not just the humble student that struggles, if you like. [LAUGHTER] Helps them feel a little bit more professional.

John: David Wiley refers to those types of assignments that students post in Blackboard, or submit their paper at the end of the term and never see again, as disposable assignments. And having something that looks professional that they have access to, and that they can share and feel good about, is something that students really value. I’ve had students write some books in my class, and they really enjoy seeing this final product. It’s something that they can share with their friends, with their parents, with potential employers, and link to on their resumes and so forth or on LinkedIn, and they’ve appreciated that tremendously. I think you do some of the same, right, Rebecca?

Rebecca: Definitely the students love it when it’s like… It’s a real thing, a real shareable thing, with real audiences. [LAUGHTER]

Nikki: Exactly, and that’s the key thing, right? Especially in rhetoric having that real audience, it’s super, super important.

John: And in my experience it leads to a much higher quality of work when they have that non-disposable assignment. Have you seen the same?

Nikki: Yes, I totally agree. There’s a level of accountability that goes on there. So when you’re racing off an essay at the last minute and submitting it, it disappears into the black hole. With the ePortfolio it comes back to hit you in the face, and you can’t put that stuff on the web, you have to go back and revise it. And it’s really nice being in the classroom and having the students respond to your comments and make those revisions. And then you kind of hear the penny dropping, it’s like, “Oh boy, I really didn’t do this very well, I better snatch this up for the ePortfolio.” And it is very reassuring to see that in action. So yeah, it’s lovely.

John: So how have other composition faculty responded? Are they all comfortable with it? Was there any resistance?

Nikki: That’s a really good question. I know, for me, I’ve been involved in this sort of work for a long time, I came from Iowa State University here and we’ve been working with ePortfolios for a long time. And that switch, going from the paper portfolios which I hated [LAUGHTER] sorry, I hated them… Going from the paper portfolios to the ePortfolio, that’s a big mind switch to go through. So we had to work with our faculty, encourage them to set up a Hawksite of their own so they could experiment, help them feel comfortable sharing those Hawksites in the classroom so they could use that as a teaching tool. So initially there was some learning to do, and that’s great, I mean that’s great, that’s fine, perfect. So it took a while to make that switch to ePortfolios, but now that we’ve made that switch, I think we all recognize that it’s so much more accessible, it’s so much easier to organize, it’s so much easier to assess. We’ve only been doing it since the fall of 2019, but I don’t hear any complaints [LAUGHTER] about the ePortfolio. It is part of what we do now. So it’s good.

John: And that was perfectly timed to be ready for the pandemic.

Nikki: You know, it was perfectly timed for that. And what I like about it, and I think what we all agree we like about it, I encourage the faculty to have the students post the links to the faculty right from the very beginning. So that way we can just go in periodically, and we can just monitor what’s happening on there, and then we can give direct feedback to students about it. So it is, it’s a wonderful tool.

Rebecca: One of the things that you’ve mentioned is this template that you share out, and you mentioned some of the permissions that you allow students to choose. Can you talk about some of the other features of the template itself that you share with students? Like, what are some of the things built into it?

Nikki: Yes, so the template has the tabs already constructed so that students don’t have to work out how to recreate those. Obviously we teach them how to generate new tabs, but the basics are already there. So it has a homepage tab, so we encourage students to post a photograph of themselves and think about how they want to present themselves to a general audience as a student. So they have that, we work on that side of things. And then we just have the tab for the reflective cover page. Then we have the tabs for the individual assignments and their revisions,and then we have the permissions tab. And then we also include on the ePortfolio, this is a new feature, during the pandemic we had a lot of issues with attendance and accommodating students who were sick and who were in quarantine, so what we did was we posted the essentials of the course policies on the ePortfolio. And we had students acknowledge and sign that they had read them, and that they understood what those different policies were for attendance, for assignments, for what they needed to do if they were sick, all of those things we put on their ePortfolio site. So it became a quick reference guide for students that they can just pull it up, and they could see what was required of them. But also for us as faculty when students were suffering, or not keeping on track, or getting to the end of the semester and things were not looking good. We could pull that up, we could see who had signed the pledge and we could say, “Look, policy said that you needed to do this, this, and this, and you didn’t do those things.” And so that helps stem the flow of the great appeals at the end of the semester which I have to deal with. So that worked well for keeping students on track, and keeping that information transparent and clear.

John: And you have it in writing, digital writing.

Nikki: We have it in writing, and the students sign it. So it helps them take accountability for their part in this process. They can’t say, “Oh, I didn’t know about that,” when it’s on the ePortfolio and they’ve signed it. It’s like, “Mm, well apparently at some point you did read this.” So that helps. Not all students read it [LAUGHTER] of course, but at least it’s there though, that’s the important thing. Those documents are not buried somewhere else, they’re visible, they’re right up there. And I think that’s really, really important, and I’m really glad that we decided to do that, especially over the pandemic. It’s been helpful.

John: And I know I always read all the terms and conditions when I sign up for a new software package, and so forth.

Nikki: Of course we do. [LAUGHTER] The other thing that I want to add in there is that, for me, some of the professors do this too, but I have my students create a writing journal tab in their ePortfolio, and they have weekly writing journal prompts in there. And I do that so that students have a safe space just to write, and to reflect on what we’re doing in class, and to apply those ideas to material that they’re interested in. And I set that up because I wanted them to feel like they owned their ePortfolio, that it was their ePortfolio, that it was their personal sort of diary, if you like, of all of their work. So that tab is very important for my classes, and my students enjoy doing that kind of work.

Rebecca: You also mentioned earlier that the work looks professional, so I’m assuming then there’s some stylistic things that are built into the portfolio as well. There’s at least a base look for things, no?

Nikki: There is a very basic look, and I would love to be able to include more design tools in the ePortfolio because we don’t have a choice of font style, we can move our images around [LAUGHTER] to a couple of places. It’s very, very rudimentary, and it would be really lovely if we could add a few more tools in there to make it look even better.

John: So everyone in composition has agreed to use templates, but it sounds like they might use them all differently. Is that correct?

Nikki: Yes. Thankfully, even though the design elements are pretty rudimentary, there are some tools to change the actual overall look within the basic template. The students can change the background image, they can change colors, they can personalize it in a way that suits them which is really nice. So yes, that’s fun, and those are good skills to teach the students as well.

John: What about different sections of the course? Is there a standardization in terms of how the platform is used? Or does that vary from instructor to instructor to some extent?

Nikki: It varies from instructor to instructor depending on their comfortability with technology, and how they want to integrate the ePortfolio into their program. I’m not a standardization sort of person, but we do have… the basic elements for assessment are standardized, they have to have those specific elements for assessment. But apart from that they are free to use those ePortfolios as they wish, and that’s the way that I want it to be.

Rebecca: One of the things that might be helpful for listeners too, earlier you were talking about your assessment process, and that people from other sections review work, that you’re reviewing work of the students of other instructors. So I’m wondering if you’d talk a little bit about the logistics of how that actually works. Because I think for some folks it can be such a big undertaking, so hearing stories of how other people organize those sorts of things can be helpful.

Nikki: Yes, so first of all students have to be eligible for an ePortfolio review, that’s the first step. So students have to have completed all of the assignments and all of their requirements, like the library instruction, oral presentation, all of those things. The student has to have at least a D to be able to be eligible. So that sort of weeds out some of the stuff. And then what the faculty do is we take seven portfolios per class, and that’s a random selection, so you take the first student on your roster, and then every fourth student gets to go in that pile. So each faculty member has seven students randomly selected for ePortfolio assessment. Plus, we have then any student who is borderline, any student that is just clinging on there, or any student that a faculty member is really unsure about, so that goes into the pot too. And then my assistant and I, we create ePortfolio partners and we specifically place, for instance, seasoned faculty members with new TAs. And that’s the way that we do it, so we choose who assesses whose work. And that makes it a very organized system and a fair system, especially for the new TAs who are not sure about what to do, at least they’re working with someone who has experience. So that’s how we do it, and the assessments can take place whenever is convenient for that particular pair, as long as all of the results are all tabulated and submitted by a specific time period. And then after that time period we’ve got some space here to work on ePortfolios that have issues. So once that rudimentary assessment is done then anything anyone is concerned about can be given to my assistant and I, and we’ll go through case by case any of those borderline cases that we’re worried about, we can work on those. So that’s kind of how it works, and it’s a really good system. It works really, really well, it’s very efficient, it’s fair for everybody. At the end of the semester, you know we’re tired, the faculty have already been through all of the ePortfolios and given their verdict, and then we double check with those seven to make sure, it’s really a calibration thing to make sure that everybody’s on the same track. And I need to preface this by saying that all faculty members have to go through a standardized calibration training at two points during the semester, so we make sure that everybody knows how to use the rubric and can apply it effectively. So with those checks and balances it actually works out incredibly well.

John: Are there standard documents that you share with people, and then you see how they evaluated to compare against the benchmarks, for the calibration?

Nikki: Yes, we do. We have a standardized rubric, and then during our retreat sessions we will selectively pick, like, a very, very borderline portfolio for people to assess. We put people in groups, and then we make them grade the ePortfolio with the rubric, and then we discuss it and we talk about what’s working, what’s not working. And if there’s any huge discrepancies in the assessment of those ePortfolios we talk about what was going wrong with those discrepancies. So it’s pretty organized, and it’s pretty efficient.

John: It seems like a really nice way to provide equitable and fair assessments that adhere to the standards that you’re trying to meet. I’m impressed.

Nikki: Thank you.

Rebecca: You talked a little bit about students needing to meet standards to go through the portfolio assessments. Does that essentially equate to their ability to continue on in that particular program?

Nikki: Yes it does. If they’re not meeting the basic requirements for an ePortfolio review, technically it means they’ve failed. And so what we do with those students is we then decide… How did that student fail? Did they fail on their own merit? Or did they fail because they tried and tried and tried but just couldn’t get it? So we have standardized measures here that says, “Okay, so if a student has been trying really hard, and they just didn’t get it, then we will allow that student to repeat the course.” So we have checks and balances there for those students.

John: So this program is used universally in the Composition Program. Have similar practices been adopted by other departments at New Paltz?

Nikki: I’m ashamed to say I don’t know, and the reason for that is because I don’t get out much to see. [LAUGHTER]

John: That’s not uncommon especially during the pandemic.

Nikki: Yeah, I just don’t know, and I feel embarrassed to say that, but I came out of teaching a 4/4 load into this position. So that’ll be one of my next step projects is to figure out who else is using them on campus and talk to them about how they’re using those ePortfolios.

Rebecca: So another thing that is worth considering is… You mentioned that students can choose some privacy settings and things. How long do students have access to these portfolios after they’ve created them?

Nikki: As far as I know students have it for as long as they’re a student.

Rebecca: So we’ve talked about assessment being a primary motivator and maybe some professional skills as being a good motivator for putting ePortfolios in place. But are there other advantages to using student ePortfolios that we should be thinking about?

Nikki: So apart from the ePortfolios for the students being an opportunity to see themselves as professional communicators, to help boost their ethos and their confidence. I think we talked a lot about what the students get from this, but from a faculty’s perspective the ePortfolios are a fantastic tool because they are so accessible, they’re easy to coordinate for assessment, we don’t have to wade through buckets and buckets of paper. And also we don’t have to, [LAUGHTER] I know this sounds like a really minor thing, but when we used to do the paper portfolios we’d do the portfolio assessment, and then we would call the students into our offices to break the news to them whether they’ve passed or not, and give them their paper portfolio back, and a lot of students didn’t come. So we ended up with piles, and piles and piles of portfolios in our offices and it’s like, “Well what do we do with those?” I found it really distressing. You know, if you’ve got four classes and 120 students, and every semester, and then they just pile up, that was distressing. So to switch to the e-system just feels better on my soul, [LAUGHTER] for the planet doing this. But the ePortfolios, they’re just such a good tool for faculty for teaching, for training other faculty, and for sharing what we do with our students with each other, and sharing ideas and seeing what the possibilities are. The ePortfolios just offer so much more potential for pushing what writing and rhetoric is, and what we do with it in the classroom. So from a pedagogical point of view, I can’t imagine going back to paper portfolios. It’s just a fantastically amazing, creative, and soul-satisfying tool to have at your disposal.

John: That’s a really nice, positive note to end on.

Rebecca: So we always wrap up by asking, What’s next?

Nikki: Well, so last summer my colleague Rachel Rigolino and I used Hawksites to develop an online tutor training site because we need more TA tutors in our system to help with the writing program, and that was really successful. And so what we want to do now is to extend that. We would like to develop a Hawksite for our TAs so that we can put all of their innovative teaching ideas into a Hawksite, so that it’s accessible to everybody for sharing ideas. And that’s a really big project. So that’s our next big step, to do that.

Rebecca: Sounds like it’ll be really helpful, and really exciting to work on.

Nikki: I think so. I think it will be vital. [LAUGHTER]

John: This sounds like a really good program, and thank you for joining us, and thank you for sharing this with us.

Nikki: Thank you, it was a pleasure. Thank you so much.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

John: Editing assistance provided by Anna Croyle, Annalyn Smith, and Joshua Vega.

[MUSIC]

213. Wicked Students

Much of the training that students receive in college involves working with well-defined problems that can be resolved using the tools and techniques of a specific discipline. In this episode, Paul Hanstedt joins us to discuss strategies that colleges can use to better prepare students to collaborate on the “wicked problems” they will face in the future.

Paul is the Director of the Houston H. Harte Center for Teaching and Learning at Washington and Lee University. He is the author of Creating Wicked Students: Designing Courses for a Complex World, General Education Essentials: A Guide for College Faculty, which is about to go into its second edition, and numerous publications related to general education and writing across the curriculum. He has worked with many colleges and universities in revising their general education requirements.

Shownotes

  • Hanstedt, P. (2018). Creating Wicked Students: Designing Courses for a Complex World. Stylus Publishing, LLC.
  • Hanstedt, P. (2012). General Education Essentials: A Guide for College Faculty. John Wiley & Sons.
  • Hanstedt, P. (2021). Helping Students Understand Our Codes: Designing Inclusive Open Curricula. AAC&U Liberal Education Blog. April 29.
  • Jessica Tinkenberg – twitter
  • Standards of Learning (SOL) – Virginia Department of Education
  • Warner, J. (2018). Why They Can’t Write: Killing the Five-Paragraph Essay and Other Necessities. JHU Press.
  • Blum, S. D., & Kohn, A. (2020). Ungrading: Why Rating Students Undermines Learning (and What to Do Instead). West Virginia University Press.
  • Hanstedt, P. (2020). Higher ed needs to redesign gen ed for the real world. Inside Higher Ed (Opinion). February 10.
  • Zull, J. E. (2002). The Art of Changing the Brain: Enriching the Practice of Teaching by Exploring the Biology of Learning. Stylus Publishing, LLC.
  • Kate McConnell
  • Textbook used at Plymouth State in a wicked problems seminar:  LeBlanc, C. (2019). Tackling Wicked Problems. Plymouth State University.
  • An article by the instructor on the course:  LeBlanc, C. (2019). What is “Tackling a Wicked Problem”? Desert of My Real Life. May 10.

Transcript

John: Much of the training that students receive in college involves working with well-defined problems that can be resolved using the tools and techniques of a specific discipline. In this episode, we examine strategies that colleges can use to better prepare students to collaborate on the “wicked problems” they will face in the future.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners..

[MUSIC]

Rebecca: Our guest today is Paul Hanstedt. Paul is the Director of the Houston H. Harte Center for Teaching and Learning at Washington and Lee University. He is the author of Creating Wicked Students: Designing Courses for a Complex World, General Education Essentials: A Guide for College Faculty, which is about to go into its second edition, and numerous publications related to general education and writing across the curriculum. He has worked with many colleges and universities in revising their general education requirements. Welcome, Paul.

Paul: Thank you for having me. I’m delighted to be here.

John: Today’s teas are… Paul, are you drinking tea?

Paul: I am drinking tea.

Rebecca: Yes, rejoice! [LAUGHTER]

Paul: I’m actually normally a coffee drinker, but I’m drinking tea. [LAUGHTER] I was part of the new educational developers for the POD organization and Jessica Tinklenberg sent out a care package afterwards. And in my care package was a Stash Tea Jasmine Blossom. I’d already had a 16 ounce cappuccino today, I thought I’d better keep it mellow [LAUGHTER] for later in the day.

Rebecca: Sounds nice and relaxing.

Paul: Yeah.

Rebecca: I have Yunnan Jig again. I think it’s becoming one of my new favorites. I don’t have my Golden Monkey around, so I’m going to have to drink something different. But it is also a golden-tipped tea.

John: I’m drinking a peppermint spearmint blend today… taking it easy on the caffeine.

Rebecca: I don’t know why, John, it’s halfway through the semester. What is wrong with you? [LAUGHTER]

John: I need some sleep, it’s been a stressful semester. We’ve invited you here to talk about a couple of things. We saw an article that you posted on April 29 on the AAC&U blog on “Helping Students Understand Our Codes: Designing Open Curriculum.” But we also wanted to talk to you about Creating Wicked Students. When that book came out, we both looked at it and read through it. But we were at a really early stage in the podcast, so we weren’t quite ready to ask people that we didn’t know who were already on our campus or that we were comfortable inviting because they knew of us already. And that’s long been on our list of topics that we wanted to discuss. So maybe we can start with Creating Wicked Students. What is a “wicked student”?

Paul: Good question. Maybe I should define a wicked problem first. A wicked problem originally came out of city planning. And then it was adopted by engineers because they looked at it and they said, “This is exactly what we’re dealing with all the time.” A “wicked problem” is a problem where the dynamics are in flux, they’re shifting. What the problem looks like on Tuesday and what the problem looks like a week from Thursday can be completely different. Oftentimes, the data is incomplete. Oftentimes, previous solutions don’t apply. Very often, wicked problems are problems that must be solved, you can’t let it sit. There’s oftentimes contention about how to solve it, how to fix it. And almost always—and this is where the gen-ed person in me gets all excited—the solutions for a wicked problem are going to require drawing from a bunch of different fields. So the best example, and it’s a horrible example, but everyone will understand it immediately, is COVID. COVID is the perfect, horrible, wicked problem. The dynamics have been changing constantly. Even now, we’re still waiting to get around the bend and say, “Oh, okay now we’ve arrived.” If it were purely a science problem we’d be in great shape because we would have been done early this summer. But there’s politics in play, there’s economics in play, there’s culture in play, there’s religion in play. There’s messaging and communication and images and memes and social media and technology. All of these things are creating a dynamic quality to COVID that makes resolving it very, very difficult. And, of course, we must resolve it. So that’s a wicked problem. A wicked student is a person who can solve that problem [LAUGHTER] when they graduate from college. But in engineering, what they said when they saw wicked problems is, “Our students need wicked competencies, because they’re going to face, once they leave university, they’re going to face these wicked problems in the field.” So much of what we do in education is tame, static, the answer is at the back of the book, there’s clarity. So a wicked student is a student who can move beyond simple answers, move beyond solving problems where they know the answer because they’ve been told the answer, or they know the answer because it’s at the back of the book, or they know the answer because they apply an algorithm and arrive at a solution that’s clear. A wicked student is a student who can deal with uncertainty, who can struggle, who can ask good questions, who can draw from different fields, who can collaborate well, and who can, when they fail, pause, step back, deliberate, reconsider, and try again. I have a colleague in biochemistry, Kyle Friend, who talks about what he wants his students to finally know is that he gets it wrong 70% of the time, and that’s normal. For so many of our students, getting it wrong is bad, it’s failure. And, frankly, that’s our fault because we create that dynamic.

John: Would you say that most curricula is well designed to create wicked students who are able to handle these problems that are not so well defined, that cross disciplinary boundaries?

Paul: No. [LAUGHTER]

Rebecca: The end. [LAUGHTER]

Paul: Yeah. So many of the systems that we’ve put in place—in Virginia, it’s the Standards of Learning tests—they ask for certainty and clarity. I’m running a writing pedagogy seminar on my campus right now and using John Warner’s wonderful book Why They Can’t Write. And he makes a point that the five-paragraph theme, which for those of us with composition and rhetoric backgrounds, is the root of all evil. He says, “Actually no, it’s just the tip of the iceberg. It’s the symptom of the larger problem.” And the larger problem is our desire to mass produce education, to make education easy, to make our grading easy, to make learning easy so students can feel like they’ve mastered it, because they’ve got the five facts, or the 10 facts, or the 11 dates, or the four algorithms that they need to understand in order to do well in the class. So no, I think so much of what we do is tame.

Rebecca: So if we’re saying, “Yes, please,” to these wicked students, what do we need to do in our classrooms? What can we, as faculty, implement in our course structures?

Paul: Yeah, how long you got? [LAUGHTER] So…

Rebecca: I have all day, if you’ve got all the answers!

John: And there’s a good book on that, too, that people can refer to.

Paul: There is a good book on that, yeah. So any number of things. One is finding ways to bring uncertainty, lack of clarity, into the rhythm of the classes that we teach. Years ago, I was running a workshop and a gentleman named Dan Clark who was then at Western Oregon University, he’s not there anymore, and I forget the institution he’s at. But he talked about Monday morning riddles. You know, you walk in, and whatever field you’re in—whether it be psychology, or accounting, or politics—give a problem and put students in groups and have them not come up with one solution but come up with three solutions, three ways to approach it. And ask them to be able to articulate why. And then put them all on the board and discuss them. And the point is not: there is one answer, and there’s one way to get to that answer. And oftentimes there is, let’s recognize that. But learn to play, learn to ideate, learn to work with multiple paths, because sometimes the first path you take isn’t going to work. And I should say, really quickly, I’m always aware that there are people in the room in various fields, whether it be French or chemistry, where they’re saying, “Well, there are facts, and they need to know the facts.” Yes, it’s not about knowing the facts, it’s about whether or not 100% of our time in the class is about content delivery and content reiteration, or if we create space in there for application of that content, and sometimes application of that content and then discussion about that application, where clarity and certainty isn’t necessarily achieved because that’s not the point. So it can be in our daily practices, we can create exam questions like that. I can, in a literature class, give students a poem and say, “We’ve been studying the Romantic poets, which one of the Romantic poets wrote this poem?” The fact that they’ve never seen the poem isn’t the point. Actually, I might choose to include a poem from a poet they’ve never read. In fact, I might include a poem from a poet who’s not even a Romantic. Thing is, can they analyze? Can they think? Can they explore? Are they being deliberate about their exploration? And what I’m grading them on is not their ability to get to the answer, it’s their ability to travel to make that journey. I could keep going if you want me to. [LAUGHTER] We can talk about paper assignments, we can talk about text selection, we can talk about the goals we create for a course. When do our goals move beyond content delivery? When do our goals move beyond application? When do our goals move into our ideals? I mean, I didn’t go to grad school and then take a job where I was diving underwater for nine months a year in order to just make sure that students could identify passages from Dickens that we’d already discussed. There’s more to it than that.

Rebecca: One of the things that I really love about Wicked Students is, it’s a value system that we want students to embody. And you’ve talked about one way of getting at that and offering space for these messier problems or the journey. What are some other ways within the structure—thinking about syllabus, learning outcomes, assignment design—that might continue to embody those values? It’s one thing to say, like, “We want to do that.” But what does it look like when we’re actually doing it?

Paul: Right. Well one of the things, and everybody’s doing it these days but why not, here’s my nod to Susan Blum [LAUGHTER] and her book Ungrading. One of the things, if we’re going to have this uncertainty, if we’re going to ask students to take intellectual risks, if we’re going to ask students to not freak out when they don’t arrive at the perfect answer, we need to be sure that in our syllabus, and in the day-to-day work of our course, there are plenty of opportunities where the grade is not of consequence, where they are not hurt by the ability to get it wrong. So I talk about ungraded work that happens in the class, I talk about minimally graded work that might happen outside of the class, proportionally graded work where the first time they do it, it’s only worth 2%, and the last time they do it, it’s worth 20%. But they’ve progressed and they’ve gotten feedback. So that would be another one of the ways, even in things like large lectures, the pause… you’re 20 minutes in, you’ve been delivering content to 270 students, and now you pause. And maybe you use clickers, maybe you use PollEverywhere. Maybe you simply put that question up on the screen and say, “So how might this apply here? What do we think? What are the ways to approach it? This is considered a difficult problem, how would you deal with it?” Maybe you simply say to them, “Pair up with the person next to you or jot some notes, think-pair-share, with the person next to you.” And then you just do a little bit of pointing to the room, “You up there in the red sweater, let me know what you’re hearing. Keep in mind that we’re not looking for the perfect answer, we’re looking for thoughtful answers.” So those would be two ways. There’s a lot of other ways. I mean, I like the idea of co-writing our goals with our students. And letting them know upfront that, with this class, it is not about static information, it’s about construction of knowledge, construction of ideas. The goal here finally is, not just for me to tell you what I know or what other people think, but for all of us to approach this material, whether it’s in literature, or in chemistry, so that we take the thinking just a little bit further, or maybe a lot further.

John: How can we sell this to our students, especially our freshmen students who come in from a curriculum that’s very structured, that’s very well defined by disciplinary boundaries, and so forth, and where all the problems have nice, neat, easy solutions?

Paul: And oftentimes, they’ve gotten into university because they’ve been really good at playing that traditional game, right? And here we are changing the rules. [LAUGHTER] Well, part of it is you need to create spaces. You can’t just give them a big assignment at the end of the semester that’s wicked, or a test question that’s wicked, without creating those spaces for them to experiment, fail, and get used to it. But what I like to, frankly, do is walk into class on the very first day, and sometimes… I like to be very dramatic… and I don’t even give my name. [LAUGHTER] I just put that painting up on the screen, and I ask that question that can’t necessarily be answered perfectly, and then I ask them to write. I was at a workshop a couple years ago at a college up in Maryland, where a meteorology professor talked about on the very first day, he hands his students a meteorology map. He says, “Tell me what’s going to happen next? What’s the weather going to be like?” And he goes, “They get it wrong 97% of the time, but that’s not the point. The point is for them to work with it and play with it. And then as the semester goes along, you can periodically hand that back to them, and they can see themselves making progress.” So I think the first step is to begin. So often we try to just say, “If I just repeat it, then they’ll get it.” It’s hard to use words to combat 18 years of experience and 13 years of educational experience. We need to create alternative experiences where they live, where they see it, where they understand.

Rebecca: I know one of the things that we emphasize in design is process over product, often. We have some students who can make a fantastic product, but they do no process.

Paul: Mm-hmm.

Rebecca: And so it always ends up being a really long conversation about, “Well, what was your journey here? Why are you doing that? How does that meet the creative brief? Or how does that meet the problem? How does that solve the problem?”

Paul: Right.

Rebecca: It just looks good… it doesn’t mean that it does anything. So I think we’re always working on ways to emphasize that process piece more, because it tends to get overlooked. It’s like, here’s the beginning, here’s the end, but that muddy, messy middle part—which is the most important part, especially to develop wicked students—is often overlooked.

Paul: I really do like multiplicity ideation, multiple iterations. And maybe it just happens in the planning stage where you say, “Rather than just going into the task…” because there’s very few fields where you just jump into the task… “come up with plan, give me three different plans, three different ways to approach this, three different ways we might design this, three different ways we might interpret this poem, three different ways that we might design this experiment, three different ways that we might think about how to approach culture in rural Germany, three different ways about how to solve this medical problem.”

Rebecca: So three is really important, Paul? [LAUGHTER]

Paul: Three, yeah. [LAUGHTER] I guess I’m sort of focusing on three. Well, I mean, there is a certain sweetness to three. Five is way too many oftentimes, and two is probably not enough. So yeah, I don’t know why I got on three. [LAUGHTER] But thank you for teasing me about that, I appreciate that actually. [LAUGHTER]

John: And as you move through the course, you also suggest that the degree of complexity should be adjusted from the beginning to the end of the term. Could you talk about some ways in which you might do that in a given class?

Paul: Sure, yeah. So the classic example, and I use it all the time, comes from my colleague, Chris Connors, who’s in geology here at W&L. And he talks about how early in the geology course, they’ll provide a rock sample to students. And they’re asking for, in a simplified form, recommendations about drilling or mining. And in the early data sets, there will be one or two pretty clear paths, and a minimum of noise, being data that is meaningless or simply distracting. And if the student’s been paying attention in those early data sets, they should be able to get it, they should be fine. Later data sets, middle data sets, they’re more complex, more noise, and a multiplicity of reasonable answers. Some of which are going to be more self evident than others, and some of which need to be constructed. But the students, if they’ve been growing, they should be okay. And part of what they need to do is not just say, “This is the recommendation I’m giving,” but, “Here’s the why this recommendation, rather than these recommendations.” Latter data sets are just wide open, lots of noise. And the paths of recommendations, the ideas, the thinking, the conclusions that are being drawn, really have to be constructed almost from scratch by the students individually. And so that’s one example of how progression could occur. Also worth noting that you can increase the degree of difficulty by the level of interaction that you have with students: the amount of coaching that you offer, the number of tips or hints that you provide, how much you’re walking around the room, the degree to which you’re having them collaborate versus doing it individually. What I love about the geoscience example, too, is that in many ways it’s, again, as someone who works in literature, that’s what we do in a literature classroom. When I’m teaching Victorian literature, I begin with a relatively simple Victorian text. And then by the end of it, I’m handing them Eliot, which is millions of words, and a lot of noise. And they’re having to build these maps, construct these meanings. And I’ll just point out that construction of meaning, that production component where the student is taking it just a step further, they’re not handing to me a reading of Middlemarch that they’ve read somewhere else. They are building a path, they are collecting the data, they are doing that work. And finally, that’s what we want. If we’re going to graduate these students into this complex, messy, messed-up world, we had better have people who can build that path thoughtfully and deliberately themselves. Otherwise, we end up with a situation where some large portion of our nation might be being misled by other people, hypothetically.

Rebecca: Definitely hypothetically.

Paul: Yes.

John: One of the barriers though, I think, is that our classes and majors and programs tend to be structured very much within very narrow disciplinary boundaries. Would it help if, perhaps, we had more interdisciplinary courses, and activities, and seminar courses, in most colleges?

Paul: Yes. And I don’t want to take us down a rabbit hole unless you want to go with me [LAUGHTER] of general education, and over the last 40 years, the movement has been away from distributional models that say, “Two of math and science and two of social sciences and two of arts and humanities.” Distributions still exists, but the movement has been towards more integration, more blending, more of a recognition that it’s not about what content we’re delivering, but how that content connects to other content. How, when I teach a class on artistic and literary responses to science and technology, I’ll have a student reading Coleridge’s Eolian Harp and giving me an analysis that ties it to string theory in physics. How do we make connections? How do things blend? So, sometimes, yes, majors need to do what majors need to do, and I want to come back to that in just a moment. But gen ed can do a better job of just replicating what majors are doing. Gen ed, it shouldn’t be just about exposure, it should be about synthesis, it should be about reflection, it should be about building something, making connections. And gen ed is going a step further and really looking at the way high-impact practices, for instance, rather than having models that are driven by distribution, they can be driven by high-impact practices: e-portfolios, which is about synthesis, study abroad, internships, undergraduate research, first-year experiences, senior capstones, all of these things that are synthetic. They’re asking students to make these connections. They also push students towards agency, towards really doing the work themselves. A student abroad, one of the reasons that’s a high-impact practice is because from dawn to dusk, they have to cope. Just leaving their dorm room, leaving their dorm, is a complex act. Getting lunch is a difficult, challenging thing where they have to assume agency and do it. So right now, though, I just also want to step back and talk about majors because I referenced that earlier. Let’s face it, increasingly, majors are becoming interdisciplinary. They’re either doing it by building interdisciplinary majors—biochem, gender studies, environmental studies—but even within majors, they’re recognizing the ways that they need to bring things into play. I mean, psychology has shifted from being a social science to more of a hard science, because it’s bringing neuroscience into play. Again, there’s this idea that the world is a messy place. The academy, we’ve got our little hallways and our little cells and our little silos and our little blocks that we built, those are very convenient for us. They’re not necessarily helpful for the students, there’s some convenience and some value to it for the students. But if that’s all they experience, and if that’s all they see, and if we allow ourselves to fall into that, I don’t know that it helps.

Rebecca: So one of the things that often is a hard sell to students is general education.

Paul: Yeah, [LAUGHTER] I’ve noticed that!

Rebecca: It’s advising time around here, so helping students identify things outside of their major that maybe they might be interested in exploring or might be useful to them in these wicked problems as they leave the institution and go into the profession. What’s some advice that you might have in making that sell towards general education? Is part of the issue the way our general education is structured, so it’s not a good sell? Or is it partly just communication?

Paul: Yeah I’ll deal with the communication question first. It is definitely communication, we spend a lot of time on the “what,” and very, very, very little time on the “why.” I mean, in so many places, if it’s not literally a box check, it’ll have a brief description of the humanities, and then it’ll be on to just a list of courses. And frankly, I would say that if you’ve got a particular learning outcome or goal for general education that you want students to meet, and you’re trying to impress them with how important this idea, this value, this goal is, and then you’ve got 700 courses that can fulfill that requirement. I’m sorry, that’s a mixed message because it basically says, “This goal is incredibly important, so important that anything can fulfill it.” And again, oftentimes what’s happening there is the system is set up to please the department or the anxieties that departments might have or to get butts in the seat. So figuring out how to better communicate that “why,” both on the front end and in advising. We have ready answers for why students should take particular courses in our field. Do we have ready answers for why a poet should take a mathematics course? For why a student in sociology should study dance or yoga? We need to work on that. There is nothing wrong with talking to your colleagues and coming up with some answers so that when students come into play, you can sell it convincingly. The other question about the structure, I definitely think that that’s a factor. If we’re selling them isolated little building blocks, it communicates to them what matters and what doesn’t matter, why it’s happening, why it’s not happening. You know, they get distribution in high school, and call me naive or idealistic, but I think even the most cynical, jaded, least-engaged student in the world comes to college and wants something different. They want it to feel like a challenge, that they’re moving up, that they’re going somewhere else, this is something more. And if we don’t give them that, then they come away with that idea that college is just a transactional thing. That’s a failure.

John: I think this brings us quite naturally to your blog post on open gen ed requirements. Could you tell us a little bit about the concerns you raised about having a completely open or very open gen ed curriculum?

Paul: Sure, full disclosure—and that blog was edited to fit a certain word count, this full disclosure was in the original version—my son goes to an institution with an open curriculum. I actually think… and I’m not going to name the institution, I’m tempted but I’m not going to… I actually think this institution does an extraordinarily good job of advising. So that students, no matter what they’re studying, are pushed and encouraged to go into and take courses in different fields. So it can work really well. A couple of weeks ago, my daughter and I were visiting colleges, she was someplace where the guy ended the tour by saying he was there to study economics, he said, “If you told me a year ago, I’d be taking two classes in classics and really enjoying them, I would have laughed in your face.” That’s a win, that’s a well-done job. So open curriculums can work and I want to be careful not to just dismiss them completely. Part of the issue with them, on the faculty side of things, I think, it’s a missed opportunity because it means that faculty from different disciplines in different departments don’t need to be in conversation with each other. I think that’s a loss. And that’s unfortunate, because the more we talk to each other, the better our teaching all-around is going to be. But really, for me, the major concern has to do with students. Not all students come into college recognizing the value of that liberal arts component, that liberal arts dimension that is so much a part of the American educational system and has been almost from the start. My son grew up in a household where we went to Hong Kong for a year to help them revise their university curriculum from a three-year system with just a major to a four-year system that included liberal arts and general education. That’s been written into his DNA, written into his family history. We talk about stuff like this at the dinner table because I’m such a geek. He has an advantage because he walks in and even if he is really interested in studying physics, he knows that there’s a value to taking German courses and philosophy courses and courses in art history. So for him, in an open curriculum, there are not going to be any signposts. As bad as a really highly-structured curriculum might be, there are a lot of signposts, “This matters, this matters, you need to do this, you need to do this.” In an open curriculum with no signposts, the student who has that level of knowledge, that insider knowledge, they’re going to be okay. The student who walks into that setting, for whatever reason, without that knowledge, maybe it’s because they’re from an immigrant family that isn’t familiar with a tradition of the liberal arts, that phrase doesn’t even necessarily mean anything to them. Maybe they’re from a first-generation family. A young woman that I know actually came from a family where her parents had both gone to college, but they were running a business, and that was really their focus, a nd so this idea of the liberal arts and the value of liberal arts just wasn’t part of the conversation that they had. Perhaps it’s because students come from a historically or structurally marginalized background, I don’t know. And of course, we want to be careful about essentializing about any groups. But the fact of the matter is, if we have an open curriculum, and we don’t have some guardrails in place, we’re not paying attention, it can be inequitable. Certain students are going to benefit powerfully, other students are not going to benefit as much. That’s wrong. We’re educational systems, we’re educational institutions, our goal is to progress everybody forward, not just to allow the privileged to continue to be privileged, and the less-privileged to continue to be less privileged.

John: A lot of first-gen students come in with a very specific career goal and a very narrow definition of what courses they think are going to be relevant for that, not recognizing the wicked nature of some of the problems they’ll be facing or the world in which they’ll be living in a few years. How can we build a system that would correct for that if there is going to be a more open curriculum?

Paul: Yeah, well, I’ve already mentioned advising. So part of it is we need to have, as an institution, and as instructors and colleagues, a language of practice, of shared practice, shared understanding, shared values, that we communicate to the students. And one would hope that that happens not just in the advising session, because that’s really kind of too late, but in everything—from the initial literature the student received, to the alums and the alumni stories that we tell in the alumni magazine or the people that we bring to campus to have conversations with our students, the internships we set up with alums, and all of those kinds of things. So that’s one thing, advising, but also advising writ large. I also think we need to create some spaces where reflection and integration is going on. So maybe it’s a completely open curriculum, but maybe in order to sign up for your classes next semester, or maybe in order to complete your work as a sophomore, or as a junior, or you do your senior thesis, you have to have a reflective component that kind of puts some of the pieces together, that does that sort of integration, that synthesis. Students, they’re so busy, and they’re doing so many things. Sometimes we can reflect, but oftentimes we’re just doing. And so where do we build those moments to make sense? James Zull in The Art of Changing the Brain talks about how there are educational experiences, and they’re really just data until the students integrate it and reflect on it. And at that point, they move from data to knowledge, meaningful knowledge. So where do we create those spaces to make meaning out of the experiences that they’re having? Kate McConnell, AAC&U, says, “Assess and then disaggregate your data.” So those are three things you can do: advising, reflection, assessment and disaggregation. Finally, when I talked about this in the essay, and this is one of my favourite metaphors, my colleague, Rich Grant—who’s a physicist at Roanoke College and he’s actually now the acting Dean of the college—he talks about how students come to college with all these experiences, some personal, some educational, some social, some related to social media, and they’ve got this box of puzzle pieces. And again, on some level, they want meaning, they want purpose, they want to know how all these pieces fit together. If all we’re doing in college is just dumping more puzzle pieces into the box, I don’t think that’s success. Some students will thrive with that, other students will not. If our goal is to make sure that everybody thrives, what can we do that’s deliberate and thoughtful?

Rebecca: I was reflecting a little bit on what you asked, John, and then also the way that you’ve been talking about gen ed, and wicked problems, Paul, and I was thinking: I was a first-gen student who didn’t give a crap about gen ed. I remember. I had a couple things I was interested in, so I curated in a way that followed my interests, but I really didn’t see a lot of value in it until later on, when I had an opportunity, really, to work on a messy problem, to work on a wicked problem. And that was in a class that was cross-listed between geography and architecture…

Paul: There you go.

Rebecca: …and worked with community organizations. And then all of a sudden, I was like, “Oh, I need to learn all of these things.” Like then I had like a to-do list of things I needed to learn.

Paul: Yeah, and so they did a great job there of bringing the messiness of life into the classroom. I’ve got a friend who’s an architect, and a very good one, and every time he moves up the ladder in his organization, the problems get messier and messier and messier. And almost from the second stage, he wasn’t prepared for it. So how do we bring that messiness into the classroom, into the academy, into the curriculum? That’s a great example, I love that.

Rebecca: It’s making me think, like, having a really messy problem really early in a college education would be really important to getting students on board with the idea that you need to learn a lot of things…

Paul: Mm-hmm. [LAUGHTER]

Rebecca: …to have a lot of different kinds of experiences.

Paul: And there are increasingly places that are doing that. I believe Plymouth State is. In the first year, they’ve got a seminar that deals with a messy problem. In the Netherlands, almost all of the university colleges, the small liberal arts colleges and the larger universities, have problem-based and project-based curricula for gen ed, where students are taking these things on from the beginning.

Rebecca: That’s interesting, too, because that means a gen ed class has been designed as a gen ed class from the start, and not necessarily a major class that slots into a category.

Paul: Yeah. In gen ed reform, really, one of the stickiest questions is, “How do we determine what counts as a gen ed class or not?” And in some institutions, if it’s a gen ed class, it has a gen ed prefix and designator, and it is a gen ed class and nothing but. And, on the other extreme is, “Well, anything can count as gen ed.” And then, in between, you’ve got models that have core courses and distribution courses. And the core courses are gen ed specific, regardless… And the line that I constantly give to gen ed committees as they’re doing revisions is, “If you’ve got gen ed goals, you have structure, an apparatus, a process, a protocol in your course approval that honors those goals, unapologetically.” And that’s hard, because you’ve got departments pressuring you. But if we’re going to do it, we have to do it, we can’t just give it lip service and let whatever count.

John: Early in my career at Oswego, I spent one semester serving on our faculty assembly when we were discussing putting together the final stages of a gen ed curriculum. And much of the discussion was basically departments being very worried about losing FTEs, losing lines, and so forth. How can we get past that in these discussions?

Paul: Yeah. One of the things is, in the design process, and in the communication process, about whatever new gen ed models you’re bringing forward for conversation, you have to foreground that there are generally going to be multiple paths into the curriculum. So in the distribution model, well the history department has their own, that’s great because it’s clear, and it’s simple, and there’s assurance, and every department has their own, so everybody’s happy. If you’re going to make an integrative model that’s going to counter that, you need to show the history department that, look, in this model you have your one course. In this model, you can enter it the first year, which is really going to appeal to some people who prefer working with first-year students. You can enter at the capstone level, the senior or junior year, which is really going to appeal to some people who enjoy doing that. Or there’s these interdisciplinary courses over here, which is going to appeal to some faculty who enjoy doing that. Or there’s these hobbyhorse courses over here, that might really be interesting for people who have never been able to teach the bizarre, esoteric topic of their dissertation in a gen ed course, but now you can. And the beauty of that last one, in particular, my colleague, Hedley Freake who is retired from the University of Connecticut, he’s a chemist and he says, “If you give me an option between teaching Chem 101 yet again, or teaching gender and nutrition in developing nations, I’m going to take that latter course all the time, because it’s more engaging to me, it’s more engaging to students. And this is shocking, but the more engaged students are, the happier they are, and the happier I am.” But you have to really be deliberate about foregrounding those multiple entries and the benefits of those multiple paths. Again, it’s the simplicity of the algorithm, and all the experience we have with that safe, reassuring algorithm versus, “Oh, this is new, and it’s different.” And how do we clarify that idea with more than just words? We just had this conversation on my campus yesterday.

Rebecca: Sounds like a wicked problem to me.

Paul: It is, education is a wicked problem! [LAUGHTER] And it’s terrible, right? Because I was thinking, it’s not because education’s the solution. But clearly, we’ve got podcasts, we’ve got conferences, we’ve got discussions. It’s a problem, it’s a challenge, it’s fluid, it’s dynamic. It’s changing constantly, the opportunities, the challenges, it’s all… Gosh, you teach your 9 o’clock class and it goes perfectly, you teach the same thing at 11 o’clock and it’s a disaster. I mean, you know… [LAUGHTER] Why? Because students are wicked. [LAUGHTER] There’s a chemistry there that we can’t control, a dynamic that we have to work with. I love that, and this is it. I mean, wicked problems are engaging. They engage us emotionally, intellectually, socially. They’re exciting, the brain reacts to them, we like puzzles. The part of the brain that wants to solve, that appeals. And I do think that that, again, if we’re thinking about changing the way students think about education. If education is static—you hand me this and I hand it back—that’s disengaging. And a certain number of our students are not going to see the value of that. If, on the other hand, we say, “Here’s a problem, can you solve it?” That’s powerful.

Rebecca: And it’s fun.

Paul: It’s fun.

John: For them and for us.

Paul: Yes.

Rebecca: Dare I say education is fun? [LAUGHTER]

Paul: Wickedly so. [LAUGHTER]

Rebecca: So we always wrap up by asking the big, huge question, “What’s next?”

Paul: What’s next? I think we’re all still recovering. I mean, of course we are. But even those of us who haven’t been ill, the brain, our sort of cognitive power, is still depleted. So naps, naps are next. I’m very excited. I mean, I just got the contract for the revision of the General Education Essentials book last week. And I’m just delighted to be able to take that on because it came out in 2012, I wrote it in 2011, and in those 11 years my thinking has really evolved. And so I’m looking forward to seeing where that goes. I am always with the wicked pedagogies and the wicked problems thinking about, when I do workshops or something, I’m always collecting or trying to collect the examples that people use. So I kind of think, ‘Where can I go with that? Is there another way to approach this? Are there different modes of communicating that can be brought into play?’ I don’t know. So recovery and exploration and maybe trying to find some of the joy that was threatened, if not, depleted.

Rebecca: Yes. More joy, please. [LAUGHTER]

Paul: Yes please. And chocolate.

Rebecca: Yeah. It’s a good side.

Paul: It is, yeah.

Rebecca: Well thanks so much, Paul. We really enjoyed having this conversation and you always bring great ideas to the table.

Paul: Well, thank you. I very much enjoyed chatting with you.

John: We’re really happy that you’ve joined us.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer. Editing assistance provided by Anna Croyle.

[MUSIC]