406. AI: A Student Perspective

In past podcasts, we’ve often explored faculty concerns about student use of generative AI. In this episode, Kaija Hoyt joins us to discuss the evolution of her AI use. Kaija graduated from SUNY Oswego in May 2025 with a major in Human Resource Management and a minor in Mathematics. After graduation, Kaija provided a presentation on this topic to Oswego faculty and staff during an AI symposium.

Show Notes

Transcript

John: In past podcasts, we’ve often explored faculty concerns about student use of generative AI. In this episode, a student describes the evolution of her AI use.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Kaija Hoyt. Kaija graduated from SUNY Oswego in May 2025 with a major in Human Resource Management and a minor in Mathematics. After graduation, Kaija provided a presentation during an AI symposium on our campus in which she discussed the evolution of her use of AI tools. Welcome back, Kaija.

Kaija: Thank you for having me again.

John: Today’s teas are:… Kaija, are you drinking any tea?

Kaija: I am not today because the room that I’m in right now is too small for me to store my tea. So it’s really sad because for this entire month I’ve been tealess. Yeah, it’s very unfortunate.

Rebecca: That is very, very horrible.

Kaija: Yeah.

Rebecca: I have English tea time today, John

John: And I’ve been without tea, but I picked up some tea at a Whole Foods across the street from Duke where I’m recording from, and I’ve got some ginger peach black tea, again, restoring one of my favorites.

Rebecca: Oh, look how it doesn’t matter where you are, [LAUGHTER] you can still drink the same tea. [LAUGHTER]

John: It’s so convenient. So we enjoyed that conversation we had with you in last week’s podcast on microaggressions, and we thought we’d bring you back for another discussion. And once again, this is based on a presentation you gave during a workshop for faculty on our campus, except this time you were talking about how your use of AI tools evolved. ChatGPT arrived on the scene in late November of your sophomore year and was rapidly adopted by many students. What was your initial reaction to ChatGPT and AI tools in general?

Kaija: I hated it. I was so mad that they had kind of become a thing. Because for me, who’s always been like a strong writer and a strong student, it kind of devalued that in a way, because a lot of students were using that, and their writing was about at the same level as mine, or stronger. And some professors were starting to maybe not realize that it was AI doing that, and expect me to write more of that standard. And I also didn’t like the idea of using it. I’ve always really wanted my work to be fully my own, and so when it was first coming about and other people were using that, I was just very strongly against it, and still to this day, to some extent, like, I’m not a huge fan of AI and the use of AI in a lot of environments, but for me, I wish it hadn’t come about when it first did.

Rebecca: I hear, though, that your position or reaction or response to generative AI has shifted a bit over time. Can you talk a little bit about what changed your opinion?

Kaija: Yeah, so I was very firm in the AI use all the way until, I would say, honestly, like the end of junior year, so pretty much like a solid year and a half of being anti AI. I had a professor, Dr. Friedman, who loves AI. He’s kind of obsessed with it in a good way. So in our classes with him, he really encourages the use of AI and gives us some ideas on how to use it. He was really passionate about “You could use it to help you with this part of an assignment.” Or, like, for example, with writing assignments, he would say, “you could use it to draft an outline for you and then build off the outline.” Or when we were doing our compensation project, he said, “help it come up with competencies for you, help it come up with the weights, it can help you with all of that.” So he pushed it pretty strongly. And that compensation class I took with him junior year in the beginning. And even though he was saying that and pushing that, and my group members were like, “Yeah, let’s use it. Let’s use it.” I was like, “Listen, if you want to use it, you can, but I’m not going to” like,” if that’s what you choose to do, fine, whatever. I don’t care, but I’m going to still steer away from it.” And then he also became my honor thesis advisor at about that same time, and that was when he started pushing AI at me even harder. And I kind of was like, “okay, whatever like, just to get you off my back, I’ll try it this one time.” And then I was like, “oh, you know what? That actually did help a lot.” So I started realizing, like, “okay, it’s really useful with things that are, like, the small work that you have to put into a project that doesn’t really have to come from you, like things that AI can do for you that will make it easier to do the project and will also leave more time for you to, like, brainstorm and be creative.” So it takes that monotonous part out of it, which ended up being really helpful, and it also is really good with writer’s block, I feel like, so that was kind of the thing that switched me, for the most part, to being okay with using AI.

John: Could you tell us a little bit about how you used it in your writing?

Kaija: Yeah, so in my honors thesis, I used it when I was having a hard time, like merging two ideas together with like getting it to flow, just having it give me ideas. I very rarely used what it gave me, because basically what I did was like, I would have it help me, and then that would spark an idea for me. Maybe it would give me a transition word, and then I’d be like, I should use furthermore here, that would work really well, or something like that. So it was more of like a jumping off point for brainstorming, but it also helped me a bit if I was struggling to paraphrase something, like getting it to what is another word that fits here? Because sometimes I know there’s a word, and I think I know what the word is, but I just can’t remember it in that moment. So it did help me a lot with that. I also used it with restructuring my thesis. Because when I got to a certain point, I don’t even remember what point this was, but there was a point when I was like, wait a minute, my outline doesn’t make any sense for what this has turned into. So I needed to, like, move things around. And that was really stressful, because at that point I was definitely over halfway done. So there was, like, a lot of paragraphs, there was a lot of information, and I kind of knew how I wanted to move it around, but I also wanted that feedback of, does this make sense? Are these transitions better? worse? the same? And I was trying not to put too much work on my advisors, because I knew they were both very busy at the time and I also really prefer to get their feedback after I know what I want, so that I don’t feel like I’m just doing what they tell me to do. I like to know this is how I want it to be, and then hear their feedback, and then go from there. So I used it to help me switch up that outline a little bit, and I didn’t take exactly what it told me, like this paragraph should go here. For some of it, I was like, “Yeah, that makes sense.” And for others, I was like, “Actually, I feel like this is a better transition,” but it helps me kind of be okay with making that change. So basically, it’s helped me in a lot of ways with writing, but it’s mostly just that starting point and getting me comfortable with what I’m doing, and then later on, it basically looks like AI didn’t help me at all because of how many changes I ended up making.

Rebecca: It sounds to me like some of the ways that you’ve been using AI are to find out what you don’t want, like to bring clarity. [LAUGHTER]

Kaija: Yep, a lot of the time, a lot of it is because there are things that AI wants or thinks that I hate, or just, I’m like, “That is not my writing style. I’m not going to do that.” So I do definitely use it in that way. Or like, sometimes if I give it a paragraph to proofread, and then I see how it wants to make that paragraph, and I’m like, that’s not what I’m trying to say. And it helps me be like, this is what I need to change to make it work. So I definitely used it in that way.

Rebecca: One other thing you mentioned was the writer’s block. And I don’t know any faculty or students that get writer’s block ever. So I’m asking for a friend. How were you using it to overcome writer’s block? You hinted at a little bit, but could you give some more specifics?

Kaija: Yeah. So one of the big things is if, for example, I at one point was going to talk a bit about some psychological theories that relate to microaggressions, and Dr. Friedman had suggested that I cover that at some point in the thesis. He’d given me some brief explanations of different theories he thought would apply, like he gave me a lot to build off of, but I didn’t feel great about writing it, because I’m not really a psychology person, and so I asked AI for some help. One, it helped me find sources, but it also helped me with figuring out how to work that into my thesis and starting the writing. So I told it what Dr. Friedman wanted, and then it kind of gave me, like, “you could do this.” And so then I was able to figure out, okay, from that, what do I want to do? It’s also really good with brainstorming outlines and ideas for projects, because sometimes you just get stuck and you can’t think outside the box at all. Usually, in my experience, like I’ll ask it to brainstorm something, and I won’t really love the answers it gives me or the ideas, but it’ll spark something else. It’s like, if you talk to someone else about it and they gave you a bunch of ideas, except you don’t have to find someone who wants to talk to you about it. You can just ask it, and it’ll word vomit some things at you, and then you can be like, “Okay, I know what I want to do now.”

Rebecca: An introvert’s dream.

John: And also, if you’re doing some work at two or three in the morning, it might be easier to have that conversation with ChatGPT than to wake someone up and ask them to give you feedback. One of the other things you mentioned was that the type of feedback you were getting on your writing was different than the type of feedback that people get from Grammarly and other tools, because with Grammarly, which students have been using for quite a while now, it’ll tell you what to change, but it won’t explain why it should be changed. I think you were getting a little bit more information from ChatGPT in terms of the types of recommendations it would use, and that also ended up affecting the writing that you did later during your thesis. Could you talk a little bit about this?

Kaija: Yeah, so one of the main differences for me personally was occasionally I was looking for grammar checks, but that wasn’t my main focus, because grammar and spelling, like, I’m good on that, and mine is more like, “How can I just make it even better?” So I feel like Grammarly can do that, but yeah, like you said, It never tells you why it’s doing it. I also find Grammarly a little bit annoying, because it just yells at you about everything, and that’s not what I want. Like there’s specific things that I’m looking to fix, and you can’t tell it that, whereas with ChatGPT, you can be like, “Hey, check this paragraph to see if I used also 50 times instead of mixing it with different words.” Or one of the things that I did with it was in my thesis on microaggressions and talking about the trainings that I was proposing, I wanted it to be trainings (plural) consistently, because that’s what made sense for what I was writing. But a lot of the time Google and Grammarly, whatever, really wants it to be singular, which makes sense, but in the context that I was using it, it needed to be plural, even though it thought it was wrong. So I’ve used it in one way with that to be like, “Hey, if you see it, say training singular anywhere like highlight that or call that out so I can fix it.” Another thing, this isn’t a real example for me, but I know some people will start a sentence “although this” and then they never finish, like the last part, so you can tell it look for those situations, and it can highlight them for you. Another thing that I did was there’s like, active/passive voice, I tend to forget to check that, and also really struggle with like when I reread something to check for that, sometimes I just get distracted by something else and I forget what I’m looking for. So I tell it, like, call out those moments, and then I could see it. And then over time, like, the more it was like, “You need to fix this, you need to fix this, the less I made that mistake. So it was really more of a learning thing for me with figuring out, like, “Okay, what are the problems in my writing and what is the way to do it better?” And then, like, I would say by the end of the thesis, like, I wasn’t really using it that much, because most of the problems that I was having I figured out what I was doing wrong and how I should do it better.

Rebecca: Based on some of your examples, I’m thinking other examples that fall into the same category, or maybe, like, checks for first and third person, other things like that that we all make mistakes on when you’re initially writing a draft.

Kaija: Yeah, for sure. I think if it’s one of those things where you maybe are someone who writes… this is really good for students, because I know there’s a lot of students who like to write in the first person… I think it would be awesome if professors who notice, like, “Hey, you’re someone who has a really hard time getting rid of those ‘I’s’ like you love to write. ‘I think that,’ or ‘I believe,’ showing them how to use ChatGPT to help you reword it could be really helpful,” because it’s not that they want to submit it with the ‘I’ in there. It’s just that they don’t realize there’s a better way to do it.” And the more that you have something telling you this is the better way, like, the more likely you are to catch on and to learn it. And a lot of times, professors don’t really take the time to do that with students. They just say, like, “don’t use I,” but students don’t understand how to not do it. So they really need that assistance with the teaching on that part.

Rebecca: One thing, Kaija, that you mentioned earlier was telling ChatGPT, like, “No, I don’t agree with you. [LAUGHTER] I want you to focus on this in a way that you felt like tools like Grammarly couldn’t do that.” And I know that that’s something I enjoy doing too, like telling the machine, “No, do it this way instead. Try this instead.” Can you talk a little bit more about some of the iterations you were able to accomplish using ChatGPT?

Kaija: Yeah. So with different iterations, I would definitely say there were, especially with the structure piece. So trying to restructure it, I think I changed the structure a couple times. And one of the things that I started with, figured out the main ideas of my paragraphs, gave it that, and said, “What order makes the most sense?” And then it did whatever it did. And I was like, “Actually, you don’t realize what the paragraph really includes. So you don’t understand. I don’t agree.” So then I gave it more information. So instead of just like this paragraph defines microaggressions, I really summarized it a little bit deeper. So that was one of the things where I kind of went through a couple different attempts with it and got it to understand what I wanted. Another thing that happened, this is, like, less related to it proofing my writing, and more related to, like, the output it gave me. So one time, I gave it a paper because I had proofread it twice, and I was tired of staring at it, and I knew that there were mistakes, and I just couldn’t find them, so I gave it the paper, and I said, “Don’t edit it,” because I gave it the paper the first time and said, proofread this, whatever prompt I used for it, something along the lines of like, proofread this. And then it gave me the essay rewritten how it would write it. And I was like, “No, don’t do that. Don’t rewrite it. Just tell me what is wrong with it. Tell me what needs to be fixed.” And then I don’t even remember what that output was, but I was like, that’s not really what I want. So then I said, “Okay, without changing anything, just tell me what the strengths of this are, what the weaknesses are, and what things are just clunky.” And then it gave me a very broken down, “These are the parts that are strong. And then a couple of quotes of examples. And then these are the areas that could be improved.” And then if, with the improvements, I needed help with, like, how do I do that? Then I can ask it that, like, “Well, how do I make this more concise?” And it would give me examples.

John: When you gave that presentation to faculty, one of the other things you talked about was using this to help prepare you in your math classes. Can you talk a little bit about how you use ChatGPT to support your learning in math.

Kaija: Yeah. So it was in my introduction to algebra class, which started off a little rough for me. I was having a really hard time paying attention in class for the first, I want to say, like a month, and that first test came around, and it’s not go well at all, which is very strange for me, because I usually do really well in math. So that was, like, a big blow for my ego. And I was like, “Yikes. Okay, this is a problem.” So I started paying more attention in class, and that helped. And I was doing the homeworks and starting to understand them, but the first stuff that we had learned, like, kind of I knew, like, “I just really don’t get this, and I don’t know if I’m going to if I just keep going in the class.” So we had a textbook, but it was one of those textbooks where it’s like, the professor uses the textbook, but not really, so it doesn’t directly match up. It’s not like Calc I and II, where you are literally doing your homework out of the textbook, and the textbook follows the same path that the class does, like this class in the textbook were different enough that it made it kind of challenging to find practice problems in the textbook. And the other thing is that practice problems in the textbook are not always what you’re looking for, and there’s no way to like, filter them out, like, you just have to stare at it and find the one you want. You can’t be like, “Well, I’m looking for how to do mod eight.” You have to find that in the massive answers that there are. And the professor did give homework, but I think we had like one a week, and there was only like six to eight questions each. And I’m very used to math classes where you have like 20 questions for a night at minimum, although those are usually optional, but I do them because I love math. So it was kind of odd for me. And I was like, “Why are we not doing more?” And I also, in addition to the fact that I was struggling, like I also wanted to do more with it, I really enjoyed it. So I went to ChatGPT, and I was like, “I feel like this could help me.” So I kind of told it what the class was, told it what I was learning, and then said, “Do you understand what this topic is?” And it was like, “Yes, I can give you practice questions.” So then I would tell it, “Okay, can you give me a question on Z/8?” and then it would give me something, and then I could do it. This is the one that I had a problem with. It was that I told it like, “I just want you to say whether it’s right or wrong. That’s it. Give me the question, I’ll tell you the answer, and you say ‘yes’ or ‘no,’ and then if you say ‘no,’ then I’ll be like, ‘Okay, walk me through it.’” But it just kept giving me the whole thing anyway, even though I told it, like five times, so I just gave up. So that was kind of how I used it for mostly getting practice problems. And there were also sometimes, if there was a concept that I was struggling with, I would have it kind of walk me through it. And honestly, it’s pretty impressive how well it did with this class, because this is like a higher level math class. I did not expect it to understand it, but it really was good at walking me through like how to solve it. And then from that, I was able to create my own understanding of what to do with some of these problems.

Rebecca: Kaija, what class was this in?

Kaija: Introduction to algebra, which sounds easy, but it’s Math 330 and it’s not like solving simple algebra equations. It’s like abstract algebra concepts.

Rebecca: I kept thinking that doesn’t sound like intro to algebra. [LAUGHTER]

John: When you were getting these problems, one of the things you noted when you gave a presentation describing this was that you learned how to modify your prompts a bit to get more useful feedback. Could you talk a little bit about what sort of modifications you made to get more useful results from ChatGPT?

Kaija: I, for one, kind of learned how to get better at telling it what kind of problems I wanted, because I started off with being like, “Can you give me an example of something like asking whether or not it’s a homomorphism?” I gave it no context, so it didn’t know what types of groups we learned about and what types we didn’t. So one time it gave me this group that I honestly was like, “I don’t even know what that is. Never heard of it.” So then I was like, “Okay, I’m gonna start telling it like, these are the groups we know. Give me an example from there.” So that was for the practice poems it gave me, and then when it gave me the feedback on whether it was right or wrong. If it was a time when I was like, “Okay, I actually need this feedback because I didn’t do it right or I could just then I would read through what it gave me,” and then I would give it follow up questions of, like, “Okay, here’s where I’m stuck with your explanation, L I don’t know what this means.” Or “Can you clarify this more,” which sometimes it would just regurgitate the same thing. So then I had to figure out a different way that I can phrase this to get the part that I’m confused about out of it.” So asking, like, “Okay, I don’t understand where this Z came from. Why is there a z here?” instead of just, like, “What does this mean?” because if you just say, “What does this mean?” it’s just going to throw the same thing at you, and it’s not going to help.

Rebecca: So I’m kind of wondering, given the experiences that you’ve had in using ChatGPT in some really different contexts, how would you like to see faculty talk about AI in their classes, or what parameters or ideas do you think would be helpful for other students to understand how it might actually be a productive way of learning in a class?

Kaija: I have very strong feelings about that, so I’m glad you asked. For me, I think that it was really helpful having a professor who said, “This is how you should use it. This is the ways that it can help you in this class specifically, and I’m not going to penalize you for using it in those ways.” That really is what helped me, like, be open to using AI. And I know, not for me because I was anti-AI, but for other students who can’t seem to get away from using it, when a professor is just like, blanket no AI policy. You’re not allowed to use it like they just decide to entirely ignore the AI policy because they don’t care. They don’t know how to learn without it. And they’re so dependent on it that if you don’t provide them a way to use it productively and without plagiarizing, then they just can’t move away from it, and obviously some students are always going to use it to write their papers for them. I’m not saying that this is going to solve that problem totally, but I think that there are a lot of students out there who, if you say to them, “Hey, I’m okay with you using it to make the outline,” or “I’m okay with you using it to help you proofread,” or something like that, and showing them like these are the ways that you can use it without it becoming an academic integrity problem, then they are going to be more likely to actually put that work in alone, because a lot of it is like, they just don’t know where to start. They don’t know what to do. They’ve got writer’s block, and there’s a deadline, and so they’re just like, I’m just going to have it write it for me. But I don’t know for sure, because I wasn’t super close with the people that were in my senior seminar HR class, but Dr. Friedman said in that class for our paper that we had like “You can ask ChatGPT for an outline, and you can build off of that. You can ask it for assistance in writing this paper. You can ask it for sources.” And I’m pretty sure that a lot of students in the class really took that and did that and used AI responsibly and still submitted mostly their own work, whereas with other professors, I noticed them just kind of having it write it for them, or things like that. And I know that, like a lot of the time in the tutoring center, if I have a student come in for writing who is clearly someone who’s really dependent on AI, I try to give them that overview of like, if you use it in this way, A) you’re safe and B) this will help you in the future as well. And it seems to work. So that’s a small example. So I don’t really know, but it does seem to be really helpful to be clear about like, these are good ways to use it, these are bad ways to use it. Instead of just saying all of it’s bad, you can’t use it at all.

John: So during your time at Oswego, I think you had five semesters during which AI has been available to all students. How often, though, did professors talk to the students about whether AI could be used, when it should be used, and why it might be inappropriate to use it in other areas? Was that a conversation that happened very often?

Kaija: So I would say I had the one professor who talked about it lot. I had probably one or two professors who really consistently called out, like, please do not use AI in my class. If I catch you using it, I will fail you. And then I would say it’s hard with math, because math professors don’t really talk about AI very much, which is mostly because it can’t really do that much with math, because it’s really easy to catch it, because it hallucinates a lot when it’s math, and honestly, it will take more of your time to use it in a math class to, like, do your homework for you if you’re trying to get a good grade. So they don’t talk about it a ton, but they do say they have their policy of don’t cheat, and that includes AI use, things like that. And then in my other classes, I think most of them had it in the syllabus, like you are not allowed to use AI in this class, that that would lead to a failing grade and being reported to the dean. But if they even said anything about it, they only addressed it, like on the day that they went over the syllabus, and then they would just not talk about it again. So I think a lot of them, like, just put the policy on there because they feel more comfortable with that and they don’t really want to have to address it. That’s kind of the vibe that I’ve gotten. So I would say it’s like, mostly just this thing that, like, you know you’re not supposed to do, but you also don’t really know what’s going on with it, at least in the School of Business.

Rebecca: You’ve talked a bit about math and you were just pointing out the hallucination issue with math problems, and because you were doing practice problems and things with it, how often did you find the hallucinations bubbling up in your use?

Kaija: So surprisingly, it didn’t happen as much because it was more conceptual things than computational, but there were a couple things that were computational that I used it for, and that’s when I found it hallucinating. One of them was I was practicing the product of cycles, and I’m pretty confident in this, but I just wanted to practice it because the final was coming up, and you never know. So I was going through, I think it was the second or third example with it, and I did the multiplication the way that I knew was correct, and I got the answer that I knew was correct, and I told it, this is what I got. And it said, that’s wrong. So then I looked through the output that it gave me of it’s step-by-step, and it’s step-by-step didn’t make any sense. I don’t know what it was doing. I don’t know what happened, because it was working fine before that. I do suspect that it’s possible that it had been right when I’d run out of the like higher-level questions, and it switched me to the lower level, and that’s why it happened, but I don’t know that for sure. And so I got to the end of it, and I was like, “No, I’m definitely right. I don’t know what you’re doing, but it’s wrong.” So I basically told it that. I said, “Your answer is wrong, my answer is right. I don’t know what you did, but that’s what it is.” And so then it responded to that, and was like, “Yeah, you’re right. You got the right answer.” But then, like, it’s calculation, it had the answer, it had before, and then it had my answer, and then it said, “Yeah, so you’re right.” It was like, 123, so 345, and I was like, [LAUGHTER] that doesn’t make any sense. So I did stop checking my answers with it at that point with those because I was like, you don’t know what you’re doing, but that is the only time that happened with the higher-level algebra. I have seen it do funny things with lower-level math classes, like regular algebra or calculus, because I’ve used it for fun with that, just to, like experiment and see if I can get it to hallucinate, because I think it’s funny. [LAUGHTER] And it definitely has happened a couple times with that, which is a little bit interesting, that it can just kind of end up in places. And I’ve also found that if you tell it like it’s wrong, it doesn’t even care if it’s actually wrong, it just decides that it is. And so that is probably part of the problem, is people being convinced that they’re right, and so they’re training it that this other thing is true and it’s not. So it’s pretty confused on things like that. And I think that’s the other thing that I think is why it worked better for introduction to algebra, because I don’t think there’s a lot of people going to ChatGPT for that. So I think it really just had that database of whatever it found when it was first started, and less of that user input that can make it more incorrect.

John: One of the things you described just a few minutes ago was using ChatGPT to get more practice problems, especially in classes where there’s not enough practice problems to make you feel comfortable. Is this something that perhaps students should do more regularly or more often? Use it to help develop skills when they’re not getting practice problems that are relevant to their own areas. When instructors give assignments with a group of problems they’re generic problems that are designed to address the needs of all students, but every student comes in with very different backgrounds in terms of what they understand and what they don’t. Were you able to use this to help develop those areas where you weren’t as comfortable with and not having to spend that much time on those areas that you were more comfortable with?

Kaija: Yeah, so it’s totally adaptable to what I needed, and with what I said about I fell behind because I wasn’t with it at the beginning. So it was something where it’s like, we’re not going to have more practice problems. We left this way back there. It can still show up on the final but we’re not talking about it anymore, whereas he’s still giving us practice problems for whatever we’re working on now, and so I would do that homework, but that was something that I was like getting. So instead of spending extra time on that, I would just go do the areas that I needed, and I didn’t, in this context, but you can have it figure out on its own what areas it is that you’re struggling with, and then it can just throw those questions at you, because you don’t have to tell it: “Give me a question on homomorphism.” So you can say, “Give me a question that would appear on an introduction to algebra test.” And for the most part, it’s good, especially the more information you feed it. And then if you work through, and you work through, it starts to catch on, like, this is where you’re struggling, and this is where you’re set. So it can really modify to you in the same way that your professor would at office hours, without you needing to go to office hours and figure out that schedule with them, because our times usually don’t match.

John: When you presented this, a math instructor asked, “Why didn’t you just go and talk to the instructor with questions?” And you gave a really good response that I think would resonate with a lot of people. How did you respond to that question?

Kaija: So I basically said that for me as a student, I’m a very independent learner, and I also don’t like to ask for help, and so going to office hours is really difficult for me from that side of it, and I personally am someone who would rather spend two hours on a math problem than have anyone or anything help me with it, like I really want to figure it out on my own. That’s something that’s really important to me, and so the more help that I get with it, the less satisfied I am when I solve it. And one of the things that I really like about AI versus a human in that is like with your professor, they don’t really know what pace you learn at, and they don’t really know what specific spot you’re stuck on. And so with a professor like they might just either show me the whole problem or do it in that way where they’re trying to get me to figure it out, which are both great methods, but it’s not necessarily what I’m looking for in that situation all of the time. And so with AI, what I can do is I can do my steps and say, “Okay, this is where I’m stuck,” and then just see what’s the next thing. Or, like, “give me a hint on something small,” which professors sometimes are really good about that. The professor for this class was actually great with that. There was a couple questions that I went to him with, because I’m not going to use AI to solve the math problems. Also, it doesn’t know what it’s doing. So I would go to him and be like, “I’m really stuck, can you give me a hint?” And he would do that, which is great. But when it comes to a practice problem, I don’t want to go in and be like, “Can you give me a bunch of practice problems and sit there and solve them?” So there was that. I also feel like, for me, with the way that my schedule has been because I’m an overworker, so I tend to be like, overloading on credits, working two jobs and running a bunch of student organizations. I don’t have time to go into a professor’s office hours. I could send them an email, but a lot of the time, I find that communication to just be a little bit ineffective. We’re on different time schedules, so when you reply to me, I might not be able to reply for a bit. So there’s that side of it too, where, like, I’m not available during your office hours. I’m honestly not available when you’re awake, most likely. So I can’t really make that work. And so a lot of the time, it’s easier to have something that’s available whenever I have that five minutes to work on a problem, instead of like, “Oh, I have five minutes, let me email them and see if, in this five minutes, they can give me practice problems.” So there was that as well. And then, especially for students like me who struggle with anxiety, going to talk to your professor is like, one of the hardest things that you will ever have to do in college. Like, it’s just really intimidating. And if you don’t feel close to them already, it’s really hard, at least for me, to go into their office and have that one-on-one interaction. With professors that I bonded with throughout the class, throughout the year, like at the end of the year, sure, I’ll go to your office hours, but at the beginning of the year, when I don’t really know you yet and I’m not comfortable around you, that’s just too difficult for me, and so having AI there as a backup and as an extra resource is really helpful.

Rebecca: Thanks for sharing those. I think those are hard things sometimes for students to articulate and say, but I think it’s a common experience for a lot of students. I think one thing that you’ve pointed out, and I’m really curious how you got there, was being able to fully articulate what exactly you needed. So because you were able to say, “this is what I need” to the tool you could get what you needed. But sometimes people aren’t quite at that point, and you hinted at maybe there was times when you weren’t quite sure what you needed. Can you talk a little bit about how you develop some of those skills to be able to articulate what you need?

Kaija: Yeah, so I like to say that I’m a pretty self-aware person, so that certainly helps, like, I am a little bit better at being like, “Okay, this is an area that I’m struggling” or I know what I need right now, but there are obviously times when I’m like, “I have no idea.” So sometimes I had AI help me with it, like I would tell it, maybe just throw things at it, just like word vomit into it, and then have it be like, “Okay, this is what it looks like your problem is,” because it somehow can pick that out. But also sometimes it was like, just using my resources, so looking back through tests or the homework and figuring out where did I get stuck there, and really diving into it and thinking deeply about like, “Okay, I know I can’t solve this problem, but why can’t I solve it? What is it that I’m confused? Do I just not know the definition? Or is it I’m halfway through the problem and I just can’t get to the next step?” So it’s really a lot of kind of talking to yourself. For me, I do that out loud, and it really helps. But just like, having that conversation with yourself about, like, “Okay, let’s really think about this problem, and let’s really think about what part of it is confusing,” or “Let’s think about this class as a whole, and why are my grades not as high as they should be? Where is that problem?” So, like, part of it for me, like I said before, was really just that I wasn’t paying attention in class, and that is something AI can’t help me with. AI cannot help me study for a class if I don’t even know what’s going on in the class. So that was something that I had to be like, “Okay, this is a me problem, and I need to figure out a way to fix it so that then I can use AI as a supplemental resource.”

John: One of the things that’s been in the news a lot are student and sometimes parent reactions to faculty using AI to generate questions, problem sets, and other things. How do students react, in general, to faculty use from what you’ve heard from other students and your own reactions?

Kaija: Honestly, I haven’t heard a crazy amount about it. I think that for the most part we get it. We’re like, “hey, whatever.” I mean, as long as you’re still teaching us, as long as we’re still learning like, “it’s okay that you’re using it,” but where we get stuck is, “how come you can use it to teach us, but we can’t use it to teach ourselves?” That is the part that bothers me. I’m totally okay with you using AI to help you generate the syllabus, generate the questions that you’re going to ask, the learning objectives, like, that’s fine. I don’t really care. But if you can do it, then why can’t I? And to me, it makes that gap between us more. I understand that the professor is above me and standing like, that’s fine. I’m okay with that, but I want, at the same time to feel as respected by them as I’m supposed to respect them. And so when you say, like, “Well, I can use it because I know how to use it responsibly, but I don’t trust you to use it responsibly.” That’s where I kind of have a problem, where it’s like you need to respect students in the same way that you would expect them to respect you. So if you want your students to be okay with you using AI to assist you with the learning objectives, the curriculum, whatever it is, then you also need to be okay with students using it to assist them.

Rebecca: Well Kaija, this has been really great, but we always wrap up by asking, “what’s next?”

Kaija: Yeah, so who knows? So, as I said on the last one, I’m moving to North Dakota. I do have an apartment set up. So moving in on the 15th of August, which is exciting, still looking for a job, which is terrifying. Currently, hopefully I’m going to have one. I’m going in for like, the third round of interviews. So that’s hopefully a good sign with one company, and otherwise, I’m just really, really hoping to do something in human resources out in North Dakota for a couple years and then hopefully come back here.

John: Well, it’s been great talking to you, and we really appreciate your willingness to join us for these two conversations. And we hope everything goes well.

Kaija: Thank you.

Rebecca: Yeah. Best wishes on your job search.

Kaija: Thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

402. Preparing for Title II

Updates to Title II of the Americans with Disabilities Act regulations require public colleges to increase their efforts to ensure that digital content meets accessibility standards. In this episode, Sean Moriarty joins us to discuss strategies to foster a culture of access across an institution. Sean is the Chief Technology Officer at SUNY Oswego. Sean and Rebecca have worked collaboratively on digital accessibility initiatives at SUNY Oswego since 2017

Show Notes

Transcript

John: Updates to Title II of the Americans with Disabilities Act regulations require public colleges to increase their efforts to ensure that digital content meets accessibility standards. In this episode, we discuss strategies to foster a culture of access across an institution.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Sean Moriarty. Sean is the Chief Technology Officer at SUNY Oswego. In this role, Sean provides leadership for the continued development of a client-centered, agile, robust, accessible, and secure digital campus environment that advances the university’s strategic goals. Sean and Rebecca have worked collaboratively on digital accessibility initiatives at SUNY Oswego since 2017. Welcome back, Sean.

Sean: Well, thanks a lot. It’s good to be back with you two.

Rebecca: Today’s teas are:… Sean, are you drinking any tea today?

Sean: I am. I am having an Irish Breakfast tea.

Rebecca: I almost drank that knowing that you were probably drinking that. [LAUGHTER]

Sean: Yes.

John: And I am drinking a pure peppermint tea today.

Rebecca: And no fear, I’ve got English breakfast. [LAUGHTER] Got the British Isles represented.

John: So in January of 2019, we had you on to talk about SUNY Oswego’s work to build a culture of accessibility. And five years later, in January of 2024, members of SUNY Oswego’s workgroup on accessibility practices joined us to talk about one of our initiatives, the 10-day accessibility challenge. And several weeks ago, we had Mark Greenfield on the podcast to talk about the recent updates to Title II of the American with Disabilities Act (or ADA). Today, we’re planning to follow up on those earlier conversations and talk about some of the practical steps that SUNY Oswego is taking to address Title II. Meeting the requirements of Title II can seem pretty daunting if a campus hasn’t been actively engaged in digital accessibility practices. So where does a campus start, what were the first steps that SUNY Oswego took to address digital accessibility?

Sean: So first of all, thanks for inviting me back again. It’s always good to talk to you two. You mentioned that I was on in 2019 which does seem like a lifetime ago when you think of it being six years ago, but also the pandemic happened in between, and this really brought, I think, a whole new vision and awareness around digital accessibility and the role that it had in terms of helping students to navigate the teaching and learning that we went through during that period of time. And I think the work that we’ve done beforehand really paid off during the pandemic, and I think the work that we continue to do really helps with students. But if we go back to your question like, where do you start with something like this? The way that we have approached it here at Oswego is that the responsibility for creating accessible content falls to the people making accessible content. When we first had our OCR complaint, in 2017 that was, we saw just really how deep the hole was in terms of the content that we were creating and the requirements to go in to make it all accessible. So I think the way that we’ve gone and really done it is to focus on educating people on how to create accessible content and making them aware of their responsibility in terms of doing it, and trying to simplify the process as much as we can for everyone as we went forward.

Rebecca: I think one of the key things that we focused on was building a coalition of folks who wanted to build the momentum around digital accessibility. So prior to the OCR complaint, there was through our Center for Excellence in Learning and Teaching, we had a work group on accessibility practices that had representation of constituents across campus that has greatly grown over time. And so now there’s representation from many units and now faculty, et cetera, that does a lot of the professional development on our campus around digital accessibility. But around the OCR complaint, Sean also formulated the digital accessibility steering committee, and now those two groups are connected.

Sean: When we first had the OCR complaint, we really focused on the website in particular and having it reach standards. And I’ll just say we were one of 31 SUNY schools out of the 32 that had complaints against it. So everyone was going through the same thing at the same time, but once we went and got the website up to standard, we realized that it’s an ongoing task in terms of going and keeping it that way. So really, we got the group together, that started with our web services team and also included Accessibility Services. And Rebecca was a partner, certainly, in all this work, and Rebecca has a unique skill set in the sense that she teaches graphic design and teaches web services, but she also happened to be working with you at the time, John, right in our Center for Excellence in Learning and Teaching. So it really helped that we could go and integrate these teams together and to bring the work that we were trying to do and expand the scope as we went forward. Another important component, I think, of it, was how we went and integrated faculty inside what we were trying to do. And started with our first accessibility fellows… in 2019 I think that was. And our goal was really just to have someone from each of the different colleges to be a part of the team and kind of look at accessibility, particularly in their discipline, learn about how to use it, and then act as an advocate inside their area of expertise. But actually the first year, we had seven people step forward, and that was a good investment, I think, in terms of going and working with those people. The next year was 2020, and we had four people. And when the pandemic hit, by that point, really, we had 11 people who had gone through accessibility training and were really ready to step in and really acted as advocates and helped all the people inside their departments to go and to navigate what lay ahead as we went through the pandemic and our shift to online learning as it was for months and months to come.

Rebecca: I think if we were to talk about what we’d recommend for other campuses to do to start, it’s really to start with the coalition of the willing, or the folks that are most likely to advocate for digital accessibility, or might be in adjacent spaces focused on equity issues, for example, and to find representation across campus. So we have folks from the library, instructional designers, the teaching center, faculty. We have folks in Disability Services, folks in our student affairs unit as well, that are doing a wide variety of work and can act as a liaison in all those different areas to transform the practices of folks on campus. And I think that strategy has served us well.

Sean: Yes, for sure. And I think also, as we get more people involved, more people look and see other areas that we should involve as we move forward. And I know Rebecca has done a lot of work, and the people in the work group in areas such as orientation and how we bring students in. We also have the person who runs Slate on our campus, which is our enrollment application, that we go and interact with students as they apply to college, and then get information back and forth. But he was a graphic design graduate of our school, and was a student of Rebecca’s at one point, and he’s been able to go in to implement all of the same principles and really go to bring this kind of technology and this way of thinking to the way that we work on campus, and bring students in.

John: Just to clarify one thing… earlier, you mentioned an OCR complaint, and just to make sure everyone is on the same page with us, by OCR, you are referring to…

Sean: Yeah.

John: …the Office of Civil Rights.

Sean: That’s correct, John, yep.

Rebecca: …and then the Department of Education.

Sean: Yes, and actually, and just to go back to that, in 2017, over 2000 universities had OCR complaints against them, particularly around the website, and a number of them were in SUNY as well.

John: So, now, as we’re coming up to the April 2026, or ‘27 for small communities, compliance deadline, what are some of the concrete steps that are being taken to ensure that all digital content, web content, and digital apps, including those created by faculty, staff and students, will meet the WCAG 2.1 AA standards by that time.

Rebecca: So one of our strategies is actually to use the current WCAG standards, which are actually WCAG 2.2 double A in part because they include some important guidelines around mobile technology. So we’re always gonna adopt the most current WCAG standards, so that we’re always ahead of things, rather than adopting an older, outdated set of guidelines. [LAUGHTER] And so we have a Title II plan that we’ve worked on collaboratively that has essentially four components. The first is raising awareness and making sure folks know what we mean by digital accessibility, so defining that, and then also what Title II is, developing a professional development strategy, which we can talk about, and implementing policy and procedures, especially around procurement, and then finally, making sure that we have an assessment strategy and have a way for folks to evaluate their own progress and know where they stand, so using accessibility checkers and things like that.

John: So you mentioned these four steps. Could you elaborate on this a little bit?

Sean: So we’ve really tried to think of it in these four steps. The first one is raising awareness. And we’ve really been focusing, and actually, the way that Rebecca and I have got the plan here, and the steering committee of the plan it’s like a component for each season, although we will continue on with many components as these seasons progress. So awareness, we’ve spent a lot of time this past semester and during spring of 2025 focusing on awareness, making people understand what Title II is. We call it digital accessibility in our campus because we’ve really focused on having the digital campus as a core component of the way that we deliver education here at Oswego. The second component, that we’ll work on over the summer, is preparing policy and procedures, procurement is going to be a large component, I think, as we move forward, and I know we’ll talk more about that later. But we want to go and focus and make sure that we’re ready to move forward once we hit September again. Then we’re also preparing training and being aware of how we’re going to go and develop people as we move forward once we hit the ground in the fall when school returns. And then there’s the assessment feedback, and I know Rebecca just touched on the point, we want to be able to give people feedback so that they understand, if they’re creating accessible content, how to make it better, and whether it’s inside Word, inside the Brightspace environment, or the digital learning environment, or whether it’s on the web, people should be getting feedback and understanding if they’ve created and posted accessible digital content for others.

Rebecca: One of the strategies that we’re using for professional development, which might be of particular use for this audience, is organizing around content types, so everyone on campus is a content creator of some sort, whether you’re creating emails or documents, presentations, et cetera. And so the professional development that we’re doing is largely around these kind of content types that might have slightly different skill sets necessary to make those types of content. So we have email, documents, slide decks, multimedia, charts and tables, forms, social media, kind of page layout and design, folks that are using the learning management system, and how to navigate that and make sure things in that system are accessible. And then folks that are editing content on the front end of the website, as well as those that are doing more of programming or development on web or software applications.

Sean: Well, I think what’s interesting too is that the way that people create content really isn’t necessarily role based in terms of what we’re doing. One item that we really haven’t mentioned up to this point around Title II is how it affects students and how students will be required to create accessible content as well. We’ve really thought of this in a couple of ways. There’s what happens inside the classroom, and faculty can be responsible for that, but there’s also the clubs and how they have students interact with one another, and the social media, different technologies that they integrate too. So as we have this content type of training, if you’re doing social media, you could be in marketing communications, or you could be running the fencing club at school, and you’re going to need to have this kind of training and awareness to go and to be responsible. So the training will be good for both of those groups of people, and it really cuts across where you are in the organization.

John: Remediating materials created by an entire institution would seem to be pretty much an impossible task, requiring a tremendous staff, unless perhaps individuals are charged with that responsibility. So what ongoing professional development and training opportunities are being provided to faculty and staff to create accessible content effectively, beyond that initial awareness and beyond those initial departments that were reached by the accessibility fellows.

Sean: You’re right. I think, in that remediation, the quantity of work makes it impossible, which is why we took the attitude about six years ago, that we’re going to go on a step-forward basis, and this is where we’re at and we’re going to start creating as much accessible content as we can. And we really started by investing in training for our staff and our trainers. If I go back to 2018 and ‘19, and that would have meant sending people out to the WebAIM training out in Utah, which was a great investment, I think, for our staff and for their awareness, and they were able to go and to bring that kind of training back and start our own programs. But then we started a series of other kinds of trainings, which would include our CELT breakouts for our Center for Excellence in Learning and Teaching, where we would go and focus on different accessibility items. We already talked about the Faculty Fellows in terms of going and helping them with their training. And we have created a lot of on-demand training, whether it be on our accessibility website, and utilization of Deque.

Rebecca: So, Deque is Deque University, which is an online training platform. You can get subscriptions too. So the SUNY system has a subscription to Deque University, and that provides really great opportunities to learn about specific software. So if you wanted to learn digital accessibility skills in the Microsoft suite, the Google Suite, or web platforms, etc, so everyone has access to that on our campus. We’ve also developed a Brightspace course called Access: a Quest Toward Inclusion, that we’re rolling out on our campus. We’ve done a couple pilots, and that’s fully rolled out as we speak right now in the summer. And in that course, not only do we have some technical skills, but also conceptual ideas around how digital accessibility fits into ideas of inclusive pedagogy, diversity, equity, and inclusion, student success, et cetera, so that it helps connect those pieces and how digital accessibility also dovetails with UDL and some of these other strategies. That course is built upon an earlier experiment that we had on our campus called the 10-day accessibility challenge, which we rolled out in January of 2021 to support faculty as they were teaching online during COVID, and that we have a whole podcast on.

John: We’ll include a link to the earlier podcast discussions of that program and of other related topics. How many faculty fellows have been through training?

Sean: At this point, we’ve had 24 faculty who have gone through the fellowship training.

John: And you mentioned workshops, and those are generally taking place at least twice a year. And there’s probably eight to 10 workshops at least twice a year on all these topics.

Sean: Yes, and actually we focus on accessibility for a couple days in the January winter breakouts and training sessions that you have, which would be the time where we bring in the new accessibility fellows, and they go through specialized training. But the training is really available to everyone on campus. And, like I said, we really focus on that for a couple days.

John: So this is a pretty big task that you’re discussing here. And how did you effectively secure commitment from campus leadership to allocate those initial resources: the human, the financial and the time allocation for digital accessibility, especially when many on campus might not fully understand the urgency or the scope of moving to digital accessibility.

Sean: So when I think of the commitment, I think the OCR complaint really opened people’s eyes. And it raised awareness in terms of what was required to go in to do digital accessibility properly, and we’ve really looked at it from two components: one is how it ties to our mission in terms of student success, equity, fairness, and the second component of it is the risk and risk mitigation in terms of how, if you’re not going and doing this stuff, you might get sued. So I think both of those items really talk to two different components of the university. So around financial components, they’re really interested in mitigating the risk, and they can see where doing this work will go and avoid any lawsuits that we might have. But I think from the classroom side and academic side, we really want to go and focus on why this ties into the mission, and how we can go and really serve the students. There’s a second component, I’ll say, in terms of how we go and secure commitment. So the leadership is one component of it, but I would also say there is this component on campus that really believes in it and will go and do the work required around it. So when I think of Rebecca and her team and the instructional designers that she’s worked with, and really other people inside CTS, and then the faculty that we’ve dealt with, they’re committed to going and doing it and providing a structure and a framework for them to, in essence, either have extra service pay or to have time cut out of their schedule to go and to do it, was a wise investment, and showed that the university really was serious in terms of what we’re doing, and that’s what we offer for the faculty fellows, in terms of the structure around going and supporting it.

Rebecca: I think one thing that Sean’s not directly addressing is his pivotal role in all of this, and someone in his position, and getting someone who is a chief technology officer, a chief information officer, really on board is really integral to getting this work done. So we were doing a lot of ad hoc stuff in the Center for Excellence in Learning and Teaching through our work group, which was kind of a grassroots group that was just doing the work because we were passionate about it and thought it was important for our community to be a part of, but when we brought the need to bring this work into the classrooms, beyond just the website, which is what the OCR complaint was about, initially, Sean was really collaborative and wanted to work with us and provide resources and advocate for resources, and so that digital accessibility steering committee that we mentioned at the top of the show has become really integral as a space to discuss critical issues, to prioritize things that might need to be funded or advocated for, so that the work here can get done. So, for example, we use Google on our campus, and the Google platform doesn’t have built-in accessibility checkers. So one of the things that the work group brought to the steering committee was the need to invest in a checker. So we invested in grackle so that we have an accessibility checker for folks that are using Google Docs and Google Slides, et cetera. So that platform has been really important for fellows and for our work group to raise issues, and then for that steering committee to make some decisions about priorities, and then Sean’s task is that to advocate for that and either fund it through his budget or request funds elsewhere. [LAUGHTER]

Sean: Yeah. Well, I think when we have put forward a budget and we have money set aside, I would think for our accessibility initiatives, it’s less than you would think would be necessary. But I think when we think of what’s required, it is this investment in people and then in the technology to go and to make the work easy, and then it’s also in time. You wouldn’t underestimate the amount of time that’s needed to go and to provide for people to go and to get on training. When I think back to the time when we did the 10-day challenge and thinking these things through, I mean, first of all, they were a lot of fun to go and to do, but we also gained a lot in terms of going and moving our initiative forward as we went and invested. So the time is an important component, but it really comes down to prioritization. When I think back to the last few years, IT departments… when I think of how we can go and be involved in the diversity and the equity and the inclusion and the items that we were working on at the time… this was really a key component, I think, and one of our major contributions to going and helping largely around the equity that we provided to the students and really focused in on student success. So I think the initiatives really went hand in hand with what we were trying to accomplish.

Rebecca: Building in the 10-day accessibility challenge and our Access: a Quest Towards Inclusion Course, are really helpful because they provide scaffolded and structured learning, so that complements the on-demand resources that we also have available. So departments have advocated for their constituents to participate in these challenges or in the course, and that means that they’re prioritizing or allocating time to do that work, which I think is helpful.

John: You mentioned the issue of Google not providing the tools that are needed to help check accessibility, there’s also a lot of other software that’s being used on campus from third parties. Can you talk a little bit about how procurement strategies might have to change here and at other institutions in response to the need to make sure that mobile apps that students are asked to use are accessible?

Sean: Yeah, I think this is a large component, and I would say, for us, kind of the next frontier in terms of going and figuring out how we’re going to do it. So I think what makes it difficult is the testing that you need to do on the software that you’re looking to go and buy. And reading the VPATs and the ACRs, which are the accessibility compliance reports that software developers are supposed to provide you when you purchase software. So it takes a certain skill set to be able to go in to do that, and that skillset’s highly in demand and is difficult to go and to teach, but I think this is an area that we’ll focus on over the next year. So when I talked about policy before, it was around developing this software acquisition policy and procedure that we’ll go and integrate and for us, it’ll include all of the security work that we’re doing, and it’ll also include the accessibility and compliance checking that we’re looking to be able to provide to software end users.

Rebecca: One thing that we don’t always think about when we’re considering third parties is third-party content that we might be getting from publishers or PDFs from library databases and things like that. So those are all materials that we’re using for teaching and learning that are coming from third parties that do need to be evaluated, that maybe traditionally, we’re not attending to in that way, that we really need to build into our practices. So often we think about procurement as something that we’re spending money on, but it also, in the way that we’re thinking about it means that anything that we’re acquiring to share with others. So that may not cost money, but we still need to test it.

Sean: Yeah, it’s a skill set that we’ll really need to go and develop, but it really is necessary to ensure compliance.

John: Might this become a little bit easier, though now as third-party platforms are threatened with the loss of sales, as all public institutions are required to meet these accessibility requirements as we move forward?

Sean: I certainly hope so. There’s also a law in New York State that software developers need to provide software that’s compliant with what we’re looking for around the accessibility. I will say, though, that building software is kind of like steering a large ocean liner, and depending on where people are, it can be difficult for them to go and to change where they’re going. So I think I would certainly see this in the future, but we’re not there now, for sure.

Rebecca: But as universities kind of band together and put the pressure on I think we will see this change over time.

John: And one of the nice things about being part of a system is some of the work can be shared across institutions. And I believe there are some efforts to do that across institutions in the SUNY system.

Sean: Yes, I would say inside SUNY we’ve really worked together, and I give SUNY System Administration a lot of credit for prioritizing this, and they have a core group of people that have really prioritized it, and Rebecca and I have worked with those people, and they’ve really moved us forward a large amount. An example would be the Deque University training systems that are available. But there’s also other examples of where there’s a lot of training that’s provided by our Center for Professional Development, and they’ve really taken on items such as Universal Design for Learning and provided many opportunities for faculty to go and to incorporate those practices inside the classroom for themselves. I’ll also add that they’ve started a new program this year on accessibility advocates and allies that Rebecca is leading this year, and it’s really to go in to take our accessibility fellowship program, and there’s 11 accessibility and advocate ally fellows this year, and they’re working and seeing how they can go and further the work on their campuses to get these core groups working together and move the needle forward around accessibility.

John: Traditionally, when working with students or faculty with disabilities, much of this was handled by campus disability offices, where the focus had been historically on providing accommodations. We’ve been moving towards, and Title II is certainly going to reinforce, a shift from providing reactive accommodations to a proactive inclusive design model. So this is something we’ve been doing for a while, but what strategies have you found to be most effective in fostering a campus-wide culture of accessibility, especially for those who might be somewhat new to digital accessibility.

Rebecca: I think that depends a little bit on the audience. So for administrators and decision makers, helping those individuals see how this work ties to the mission is really core and critical. When we’re talking about faculty, we can integrate that work into other things that we’re talking about in teaching centers, like inclusive pedagogy, evidence-based practices, Universal Design for Learning, all of those things, with accessibility also support student success. And then, if we’re talking about student affairs folks, who really focus on the students, the whole student… when we’re thinking about student success… that’s also a way to tie this accessibility work into the mission and goals of their division as well. So I think tying it to what people are already doing and what they already care about is really critical in shifting the culture of access for sure.

Sean: So you did mention, historically, when this work is done reactively, it all falls to like, Disability Services or Accessibility Services, but I’ll just say that those people are still integrated into the work that we’re doing, and are key parts of our coalition, I would say, and of who we’re working with to go and to focus on the student service, but we have spent a lot of time really going and developing this coalition and looking at the different roles and responsibilities that each people has. And really, Rebecca and I have tried to go and develop a model in terms of how we go and look at this work and what we’re trying to do and how we move it forward. And we use an acronym called RAMPS, which is really a key set of tactics we have developed to cultivate a culture of access.

Rebecca: So RAMPS stands for request, amplify, model, prioritize, and support. And you might wonder why RAMPS? Well, we associate ramps with kind of the sloping planes that you might use to access a building. You’re on wheels, for example. So it’s already tied to the land of accessibility. So we were hoping that would make it a little more memorable. And then, in addition, the word ramp can be used as a verb, meaning to speed up or expand or increase quickly. And so we see this as a set of tactics that really can accelerate this culture of access. And so if we want to dig into each of the tactics in a little bit more detail, requests specifically means requesting colleagues, peers and others to use a specific accessibility practice, so use a microphone or captions or something like that. Amplify or amplify voices and perspectives of people with disabilities, this can look like raising your hand in a meeting and asking what kinds of accessibility features might be built into a particular event or software or other platform. Model is model best practices in your everyday work. So things like, every time you create a document, you’re running your accessibility checker, you’re using alt text and those kinds of things, so that people see that you care about it because you’re doing it. This is particularly important for leadership to do. Prioritize, is prioritize accessibility by allocating resources, and by resources, we mean time, funds, and personnel, and then support… support others in their accessibility journey through coaching, education, processes, and procedures, and so this can look like a wide variety of things, but making sure that as people want to develop in the space of digital accessibility, you’re helping support their technical skills, but also developing their workflows and other things where they might face a few hiccups along the way.

John: So could you provide some other examples of how administrators, faculty, staff and students can employ RAMPS tactics to help advance accessibility.

Sean: Yeah, so when I think of administrators, whether it be the presidents, provosts, vice presidents, deans, directors, and so on down the line, we’ve gone and developed a list of tactics. So, as an example, request units to review their policies and procedures to ensure they’re meeting the legal requirements, but looking around what they’re doing around accessibility and the content, amplify the why of accessibility practices, and I think that’s really an important component in terms of how it ties to the mission, because people often see it as more work than just putting material out, but remediating is way more work than it is to go and do it right the first time. Model, model accessibility practices on correspondence and particularly presentations that go out from your office. When we think of prioritize, I think of team time for professional development and the resources that are required, and support that would be through appropriate budget and resources that can be provided for these types of projects. I see the responsibility of CIOs, and what we do, and really around prioritizing Title II initiatives by ensuring availability of accessibility tools, ensuring that there’s professional training and support available, and ensuring accessible procurement practices are developed and implemented, and then support by really partnering with the other people on campus to ensure that we’re producing the results that we’re looking to produce.

Rebecca: We think about instructors and the role that instructors play, the tactics might look different in those settings. So for example, instructors can request that students follow accessibility guidelines like the WCAG 2.2 double A standard, just like they might APA or MLA style guides, and so that could be something that’s a graded component.

John: We could always hope that they do better with that than they do with the citation styles.

Rebecca: True, [LAUGHTER] but reinforcing it with grades or as a rubric component is helpful. We can also model using accessibility checkers, not only by checking our own work, but showing students how to do that as well. One way that instructors can prioritize this work is by participating in professional development related to Universal Design for Learning or UDL and accessibility.

John: So, what metrics do we use here, and what metrics might other campuses perhaps consider in monitoring the progress of meeting accessibility practices.

Sean: So, when I look at it from the technical point of view, I look at ensuring that we’re gathering these metrics and being able to provide people feedback. So we use tools such as ALLY, and we also use SiteImprove. So ALLY would be inside the learning management system. SiteImprove is an application that will go and browse your website and let you know what the accessibility content is and where there might be areas that need to be improved. And then we’re able to go and provide that feedback back to people so they can understand what they’re doing. We also look at people that are requesting accessibility workshops, people speaking up about microphones and using microphones or other accessibility practices. I’ll also say that we’ve really tried to focus on understanding where we’re at, and we’re going to move forward at the fastest pace we can but this is really when you go and develop culture, it’s really difficult to go and to leapfrog from one stage to another. You really just make progress by making steady progress and by doing the work that’s there. So we just focus on getting better each semester.

Rebecca: Yeah, some of the stuff that we’ve done includes analyzing some of our ALLY data to see whether or not the fellows have made an impact in their departments, to see if that’s improved their ALLY scores, and it has. So that’s exciting. It means that that’s a worthwhile investment. Sometimes it’s these really specific metrics where there’s scores, but when you’re really looking at culture change, some of the things that you actually observe are spaces like our Faculty Assembly, where maybe one person, often me in the past, would be the person saying, like, “Please use a microphone. Please do this. Please do that.” And now I don’t have to say anything. And there’s many other people who will speak up in these settings to request certain accessibility features be used in a wide variety of settings, and I’ve seen students, faculty, and staff, all make these kinds of requests in public settings. So that’s real advocacy work that’s happening, and is a real difference from where we started.

Sean: Well, I also think of people who have come to training, and when you think of culture like we have people in events that have come to our accessibility training and trying to understand better. The people running the orientation are really trying to go and ensure that they’re creating accessible content to provide to the students. So sometimes we’ve recruited those people, other times they’ve been recruited by others who are part of the culture, I guess I would say. So, I think when you see how it’s grown organically, in that sense, it’s really satisfying.

Rebecca: I think along those same lines, we can see a wider variety of individuals offering workshops during our Center for Excellence in Learning and Teaching’s breakout sessions in the spring and in the winter, and that just demonstrates how many more people are deeply engaged with the subject matter compared to previously.

John: So one of the things that really struck me was the comment about using microphones. It’s still an issue. We ran an AI symposium yesterday, and we had a number of people attending remotely, and some people in the back of the room said, “Well, my voice is loud enough so anyone can hear” and sometimes faculty in large classes will still do that. And it is important to get that reminder out that while people who are near you certainly will hear you, the people who are further away or who have hearing impairment won’t, and there’s a lot of people with hearing impairment who do not necessarily reveal that.

Sean: Yeah, it’s a real issue. Actually, one of the things I’m proud of, too, is how we’ve really worked to go at big events such as graduation and commencement, which we just hosted and brought in an application that’ll go and provide real-time translation of what the speaker is saying for people in the audience, and we post that on a QR code, both in the program and on the screen beforehand, so that people can hear and understand what the speakers are saying. And when you have an audience of over 4000 people, there’s going to be a lot of people who have hearing impairments who really will benefit from that kind of service that you’re providing.

John: So what do you see as some of the biggest challenges that institutions must face in meeting this Title II deadline? I know we’ve done a lot here, but a lot of campuses are much further behind.

Rebecca: I think even though we’ve made a lot of progress here, we still have challenges that we’re going to face, and one of them, and I think this is true across most of higher ed, is student-generated content has not traditionally been a focus. So this is really when students are sharing work with each other. Previously, we’ve certainly focused on things when they share it more publicly, [LAUGHTER] but they’re sharing it with each other in the class. That’s going to be something that instructors need to think about and may need to become integrated into our learning objectives through general education or some other spaces to reinforce learning some of those skills.

John: And that’s something that can be sold to students as a useful skill in that as more and more companies start moving towards making their digital content more accessible, there’s going to be a lot of employment possibilities there.

Rebecca: I know it’s been a great benefit to a lot of my former students. [LAUGHTER] Some disciplines also have specific challenges that we need to really come up with better strategies for. Some of this work is starting and is there, but it’s not streamlined. Some software packages just don’t have accessibility features built into them. So there’s workflows and habits that need to change, and changing habits and workflows and anything you’re used to is difficult, and people, by their very nature resist change often. So that’s something that all institutions are going to have to work with and address. And I would say, in particular disciplines with notation, so things like math, chemistry, music, all have some unique specific challenges. Or if you think about disciplines like art history that are heavily image based, and thinking about how alt text might need to shift depending on why you’re analyzing a particular image in a course, sometimes it might be more esthetic, sometimes it might be more important to be a more poetic alt text to fit the needs. And so education around some of those really unique features of disciplines is something that we just really need to work together on across institutions.

Sean: I’ll also add, I think procurement is going to be difficult for many colleges in terms of going and having the skill set, which I mentioned before, and also a lot of schools will have problems with resources in terms of training, in terms of having people to go and to train, and depending on where you’re starting from, I can certainly see it being a challenge. It’s an advantage to us to be in a system so that we can go and aggregate some of our resources together. But I can understand how it’s difficult for many of the colleges to go.

Rebecca: I would also add, though, that although these are challenges, these aren’t insurmountable things, these are all solvable problems, but it might need some collaboration and changes of processes to make it happen.

John: Well, we’ve addressed a lot of issues related to movement to meet the Title II requirements. We always end, though, with the question: “What’s next?”

Sean: So I think the first item is, like the game is afoot now, it’s time to execute on the next components of our strategy, which is around training for the content providers at Oswego, and focusing on meeting people where they’re at in terms of going and both offering the training and in terms of going and upskilling them as we move forward. And I think the second component is to invoke the student clubs in the equation and the students as we move forward, and partner with them to help ensure that they make the requirements and take responsibility for their social postings or documents, as well as integrating where it fits into the academic side of the campus. And I think really, one of the third parts is not to look at April 2026 as like this magic day when the project is over. It’s just another day, another milestone, we’ll l not be 100% perfect at that point, and it’s just a continuing project that will go on for years to come, I would think, and to make sure that we have a solid base to constantly be building on, so it becomes less work for people to go in and do, and it makes it easier for them to integrate into their workflows.

Rebecca: I think one ongoing thing to remember moving forward is that accessibility is not an on off switch. So we need to remember that there’s continuous improvement, and we can always work as technology develops to make things more accessible and to keep reevaluating where we’re at so that we can make those improvements.

Sean: I’m going to add one more component that’s what next, and it is our integration of the AI Fellows that we have on campus. So we started an AI Fellow program early this year, but I see the AI Fellows and the Accessibility Fellows integrating their work in the coming year, and to see how that can really go and help us to move this forward. That might be an area that can help us to leapfrog some of our actions forward and our ability to create accessible content.

John: And I did just see an article about several campuses introducing AI tools to read the names of students during graduation, which might actually sometimes give better pronunciations than some of the readers might otherwise, although we’ve had some very good readers here on our campus.

Sean: Yeah, AI is going to have an impact everywhere. So I’d look at where the intersection of these two areas is for sure.

John: And we’ve had a few podcasts where people have discussed how AI tools may help meet accessibility and UDL requirements, and we’ll share links to some of those in the show notes as well.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

401. Making Technology Fashionable

Technological change affects all aspects of our lives and our instructional practices must evolve to prepare students for their futures. In this episode, Loy Gross joins us to discuss strategies that she uses to prepare students for an industry that is evolving with digital tools. Loy is an online learning specialist and an adjunct technology instructor at SUNY Genesee Community College.

Transcript

John: Technological change affects all aspects of our lives and our instructional practices must evolve to prepare students for their futures. In this episode, we explore strategies used in one program to prepare students for an industry that is evolving with digital tools.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Loy Gross. Loy is an online learning specialist and an adjunct technology instructor at SUNY Genesee Community College. Welcome Loy.

Loy: Hey, thank you.

Rebecca: Today’s teas are:… Loy, are you drinking tea today? [LAUGHTER] See, the thing is, I know what the honest answer is. You told me, you outed yourself.

Loy: I did. [LAUGHTER] I meant to make a cup of tea, and I didn’t.

John: I am drinking a mix of peppermint, spearmint and tarragon tea.

Rebecca: Always a good choice, John. Today I have a decaffeinated Irish Breakfast tea, which just seems like an oxymoron. I don’t know. [LAUGHTER]

John: It could have been the really strong builder’s tea that’s decaffeinated, which would really be even more of an oxymoron.

Rebecca: Yeah.

John: We’ve invited you here today to discuss your course on fashion industry technologies, in which students work with AI image generation, 3D virtual design and modeling, magic mirrors, and artificial and extended reality technology. Can you tell us a little bit about this course and what role this course plays in the Genesee Community College fashion curriculum?

Loy: So, the course is actually called Fashion Industry Technologies. It’s an overview course, and whereas many of the classes in the curriculum are focused on hands-on making something right now, this class is designed to be a little bit more forward looking. It’s not the capstone class, but it does set the students up for their capstone, which is the Spring Fashion Show where they present their final portfolio. And this course really stands out from the rest of the program with the tech that we introduce the students to. So we do AI generated images, we do 3D garment modeling, all on the computer, we do digitized patterning, we do extended reality. We do things that right now, they’re being used by like the really, really big fashion houses. We’re talking Gucci, Louis Vuitton. We’re doing the kind of work that is being pioneered by them right now, and they use that technology to streamline the whole design process and accelerate to market. And so my philosophy with the course is that I’m not just teaching students or preparing students for a job in a year or two years, they may go on to another college. I need to prepare them for a job that’s going to exist four to five years out, and that’s where the focus of this class is. We’re giving them early exposure to very, very high tech, very, very cutting edge sort of tools that are really shaping the future of fashion. And honestly, I tell my students every day, it does not matter to me if you learn to press the correct button or you learn the names of all the buttons. What matters to me is that you learned how to think creatively in that new tool, and you learned how to problem solve, either with or without the AI, and you learned how to communicate your ideas in new ways and really think about fashion as an experience and not as something that you cut and sew together.

Rebecca: Can you talk a little bit about what students are actually doing? You’ve talked a little bit about what the technology is, but what are some of the actual things that they’re doing in the class?

Loy: So the way that I designed the class, and I took this class over from another instructor, and it was kind of funny, because she said, “Well, we do this and this and this and this, and then at the end of the class you have, like, these three weeks where you can pick a topic that you want that’s on the edge of fashion, and do what you want.” And then right away, I thought, “nope, nope, nope, nope, nope.” I’m gonna let the students pick something, and they’re all gonna pick something different, and they’re going to share it, and we’re going to have this wonderful peer experience that’s going to be much richer than anything that I could choose. So we have two tracks that run sort of side by side throughout the entire semester. On the one hand, they’re designing a single outfit that they’ll eventually have in the spring fashion show. So they’re using Photoshop, and they’re using Illustrator, and they’re using the 3D modeling software and other digital tools, and they’re realizing that vision. They’re working in the digital realm until they realize their vision, and then we project it onto the table, cut it out in the fabric, make it, which is wonderful. So that’s like one whole semester long project divided into a series of modules of different parts. But at the same time, I have them doing a semester-long technology project, and that can be anything they want to do. I ask them to develop a proposal at the beginning of the class, and I approve it. And then they go throughout the class, and at the end of the class, they present whatever their end result is. I have had students who have programmed AI to make sewing patterns. I’ve had students who’ve done custom textile prints and had them printed. I’ve had students who’ve made prototypes, I’ve had prototype motorcycle helmets, I’ve had prototype pants for wheelchair users, all kinds of really cool stuff. One student did an entire video series that was influencer marketing. It’s like, this is awesome stuff. So they do that sort of at the same time. So there’s really two tracks going on in the class, and they’re going on simultaneously, and that’s just how we run it.

John: Could you elaborate on those two tracks? What components are students choosing, and what components are common to all the students?

Loy: Well, I’m a glutton for punishment. The common track where they’re all designing an outfit, they are all designing an outfit, and they’re all at the same place at the same time, on the process of designing that outfit, but all of those fits will be different. So one of them is doing a beach outfit, and another one is doing a ball gown made of denim. So they’re all over the map, but they’re working side by side using the same tools, and they’re sort of at the same development process or design process. They’re at the same place. Now the second track, which is the individual project, they’re all over the map. Once they have submitted a proposal and I have approved it, I meet with the students once a week to say, “How are you doing on your project?” We basically have scrum sessions. “What did you do last time? What are you going to do next time? What’s standing in your way? How can I help you get over whatever your current obstacle is?” But I am talking to one student about the unreal gaming engine, and then I literally turn around next student, okay, we’re talking about flashing lights that are going to go on your helmet, [LAUGHTER] so that one’s all over the place. But I don’t think that students get as much out of the class when it’s a set assignment. I prefer that the students pick their assignments. So in both cases, they pick what they want to do.

Rebecca: What role does AI play in the class? I know this is one of the technologies you noted that you’re experimenting with in this class. Is that something that’s built into the track that everyone’s doing, or is that just something that some folks are choosing to do?

Loy: It’s a little bit of both. It shows up in a couple of different ways. So we do an AI-focused unit when we hit Photoshop, because we talk about AI image generation, and we talk about it from a practical standpoint of, what can you do, what can’t you do? What are the limits of it right now? And we talk about it from an ethical standpoint, is it really appropriate for us to be developing, let’s say copies of things? How much of the AI that you’re using is actually scraped from somebody else’s work, and how much of that are you comfortable working with? So we have those kinds of discussions, and I make sure that everybody has those kinds of discussions. A deeper use of AI usually turns up in the research projects, and it could be students can use AI to generate mood boards, they can generate new prints. They can generate something that sparks their own creativity, or they can use it maybe to do research so they could identify trends or do some analysis and use it in that way. I did have one student that tried to program an AI to develop technical patterns, and at the end of the day, he made it work. And I was just like, “Yay. I didn’t think you were going to be able to do that.” [LAUGHTER] I honestly did not think the project would work. And I was explaining to the student, if you come to me and you have a paper that says, “Here are five ways I tried it, and none of them worked for these reasons, that’s an A. I’m going to give you a solid grade on that. And he made it work anyway. He insisted he was going to make it work. [LAUGHTER]

John: You also mentioned that students are using augmented reality and extended reality. Do you have headsets for all the students, or are there a number of headsets that are available that students in the class can use while they’re working on these projects?

Loy: So we don’t. We got a grant this year. It’s a President’s innovation grant that happens every year at GCC and I, along with our media technologies department, we wrote up a grant for four VR headsets and five magic mirrors. And the thing about working on those is that when you’re developing the environment, you’re not wearing the equipment, so you’re sitting on the computer. We have 12 very, very expensive, very, very heavy gaming laptops that we use to do our 3D modeling, and those laptops are the same ones that we use to develop the digital environments. So there’s two things that we do with those. We do the magic mirror concept that takes the outfit design that the students have made and it puts it on a human being. And then we have the extended reality, or the virtual reality, where we can do a full VR showroom that you can walk around in and see the models, and you can reach out and touch the fabrics. You don’t get a tactile sense, but if you’d like to know, “Is this skirt full?” you can pick it up and spread it out to see how it looks.

Rebecca: How are students responding to using these different technologies in your class?

Loy: So, as with all things like each according to their own idea of how they like it or don’t, some of the students, they jump in and they just absolutely, “Oh, I’m so excited technology, gimme, gimme, gimme.” And some students are very frustrated, because I’m essentially teaching them how to design in computer, to do a thing that they know how to do in real life on a mannequin. So they’ve already learned how to drape a new garment on a mannequin and create something new, and they’re getting pretty good at it, and then they have to go back and relearn it on the computer, and of course, you’re starting over again. And so it’s very, very slow. It’s like learning a new language, like, “I know how to say this, but how do I say this?” And so some of them get very frustrating. But one thing that’s really fun is a student will come in right at the beginning of the class. You can always tell when it’s going to happen, because they come in and they crack open the laptop, and they’re all excited. They’re like, “Hey, hey, hey, hey, you got to see what I made last night,” and just it lights up the whole room, and all the frustrations are just out the window, and let’s get to working on our projects today.

Rebecca: Sounds like that would definitely lend to some momentum in class, for sure. Can you talk a little bit about how some of these technologies are being used in other contexts on campus. Are students having opportunities to use extended reality in other spaces, beyond the fashion program or some of the other tools that you’re talking about?

Loy: So I can talk a little bit about that. I personally would love to bring these tools into a whole bunch of courses, but we’re a two-year college, and time is tight, and there is what you can do, is what you can do. So I’m kind of looking at ways that we can layer it in. So for example, I mentioned that the students have already learned how to drape on a mannequin. One of the things that I’m talking to my department chair about is about making my class and that draping class co- requisites, so that the students are learning to drape in two modes at the same time, and one set of knowledge should be able to feed on the other, and that should improve our frustration level with it. The other thing I’m talking about, kind of talking to the Dean, is about the potential for teaching this class, not just to fashion students, but to digital art students and to CIS students, because when you’re creating a brand new avatar, and then you’re creating garments and accessories on the avatar, the end output of my class, it could be a fashion design, that’s what we’re doing right now, but the output at the end of my class could just as easily be a fully rendered digital avatar, and both of those programs could benefit from that technology. So we’re having those kinds of discussions. We haven’t moved anywhere yet, but I think that’s where we’re going.

John: You mentioned that students are doing the types of things that higher-end designers are doing? Could you talk a little bit about some of the applications that are being used in industry, and how that might perhaps motivate students a little bit to see that they’re doing something that is state-of-the-art work?

Loy: So when you’re talking technology, language sometimes gets fluid and becomes difficult because we don’t have words for the things that exist. You know, [LAUGHTER] it’s like, let’s go back to the 1800s and ask about a refrigerator. There is no such thing. But what we are doing is the students design the fashion, and when they’re designing in real life, they’re designing, they’re cutting, they’re sewing, they’re attaching, they’re fitting, and they’re coordinating and styling on a real-life person, and it’s a sort of a, I don’t want to call it a fixed experience, because it can be radically different every time. But it has a very fixed sort of sequencing. And when you talk about some of this virtual technology, a lot of that goes right out the window. So we can fit clothing onto our bodies before it’s ever been made. So I can make a nice Sherpa jacket, okay with the fuzzy Sherpa texture, and I can make accessories and make designs and patches and what have you on it. And I can put that on my body in my sizing and see in a magic mirror what it’s going to look like. And then I can put it on one of my students with a very different body type and see what it’s going to look like on her. And it changes the way that we think about the fashion experience. Instead of us producing a solid, sort of unchangeable garment, we start to think about ways that you can experience fashion, both before it’s been made and even after it’s been made. So some of my students have been inspired to do things. One of my students was inspired to create a light- up design in their fashion that reacts to the user and the user’s movement, or the wearer’s movement. And this is just a way that we’re rethinking how. We experience fashion

Rebecca: I know you mentioned that students are kind of prepping for a fashion show that follows this course. It’s a prequel [LAUGHTER] to the fashion show. Can you talk a little bit about how that has evolved over the last couple of semesters or years, as students are integrating more and more with different technologies.

Loy: So integrating it is actually one of my big struggles at the moment, that the students, as I said, they know how to design a garment on a mannequin, and they don’t want to learn a new way of doing things just before the fashion show. And so every year, we’re sort of increasing the number of requirements, or trying to replace the requirements, maybe, where they have to do X number of designs for the fashion show. Well now we can maybe do X minus one, and then you have to do one digital. One of the nice things about the spring fashion show is that that’s the point where it kind of all comes together, where students have been working on a digital image, and it’s in the computer, and they can see it in the magic mirror, and they can see it in the VR space, but it’s not real. You can’t touch it quite yet. And when you project the pattern on the table, and you actually cut it out, and you sew it together, and you put it on a model, now it’s real. Now it’s a real thing. I made this really cool digital thing, and here it is. It’s there. That’s fun. [LAUGHTER]

Rebecca: I’m sure it’s exciting for students to see the things that they’ve spent a lot of time developing in a digital space, and then to see that in a physical space. I know I have that experience with design students who make an image on screen, and then they see it in print, or they see it produced.

Loy: Right. When a student designs a new textile pattern or they design a dress, and we put it in the digital space, and maybe you’ll see different people wearing it in the magic mirror, but then we see it in person, that fabric arrives from the vendor, or that design is fully formed, and it’s put on a model who’s walking in it. It’s a whole full circle moment. I had this vision in my head. I made it happen on the screen, and now here it is in real life. So that’s the direction that we’re going in, and continuously sort of moving that way.

John: Are there other faculty who are teaching fashion courses, who are starting to consider using these tools?

Loy: So far, we have not had a lot of crossover between the various classes. There definitely is the potential there. And I think as the technology gets deeper and deeper into the program, and the students get more used to it, we may see some collaborations happening, particularly in merchandising, because there’s a lot of merchandising opportunity with this sort of technology, but so far, we haven’t done any of that.

John: One of the things that could also happen is, if the students get really excited about this, they may start suggesting that to other faculty, who might perhaps be inspired to extend their courses a bit in a new way.

Loy: I can only hope. I’ll go back to my student that I seriously didn’t think that he could get the AI to do what it did, and he got it to do what it did, and he was so excited by it, and he just brings that excitement over. And other instructors will come up to me and say, and [the student name] is so excited about the project that he did for you and told me all about it. Okay, great. Let’s talk about how we can kind of cross collaborate. Let’s talk about how we can do joint assignments. Let’s talk about how my teaching can feed your teaching and grow into something to give the student a more holistic view of a process, as opposed to I need this thing for this course and that thing for that course. I’m all about holistic learning, can you tell? [LAUGHTER]

Rebecca: I’m sure by the time the students are completing their fashion shows and they’ve gone through the struggle, and then they see things in reality, that they start to see the value in adding an electronic or digital practice into their process, because some things can be speedier. They can make some different decisions without having to make and remake physically, because those adjustments can be made. You can see it in the magic mirror. Try something else. See in the magic mirror again before you’re actually creating it. Have students reflected on that experience a bit and indicated, like, yeah, I can see how I was super frustrated in your class. [LAUGHTER] Now I can see how I might use this moving forward. I know that in some of the kinds of technology classes I’ve taught, I’ve definitely had students who are, like, super resistant during the class, but then, like, three years later, I get an email from them saying, “Guess what I’m doing?” [LAUGHTER]

Loy: This fall I’ll be rolling into my third year teaching the class, so I’m still waiting for those students to come back, but I will say that I’ve had some really, really good conversations with students about actually selling their digital designs, because beyond creating the physical element, there’s the element of selling your design in, I don’t know, The Sims or in the Metaverse. Of course, I’m a nerd. I have a Metaverse account, and my avatar in the Metaverse account has an outfit that I purchased from the Metaverse store. So I’ve had some really interesting conversations with students about the potential for designing fashion that is strictly digital, that will never be made. And that gets to be really interesting conversations. And obviously there’s no other way to do that.

Rebecca: No, digital clothing can do things that real clothing can’t.

Loy: Oh, absolutely, absolutely. [LAUGHTER] So I do cosplay from time to time, and when you talk about digital clothing that does things that real clothing can’t, the engineering that we have to go into to try and make that video game character outfit actually come to life, and then make it actually behave the way that it behaves when it’s on the avatar. To make the skirt fling properly, to make the cape fling properly. You got this feather thing sticking out your shoulder, like it doesn’t even have a name. We’re not really sure what it is, but it’s sticking out the character’s shoulder, and it goes three feet in the air. How do we make that without it wobbling all over the place? And we can use these new digital tools to try and design different sorts of structural elements to the fit so that when we do make it, hopefully it behaves the way that it should. But yeah, you can make a whole lot of things in the digital realm that just don’t work in the real world. [LAUGHTER]

John: So could you tell us a little bit more about the fall symposium and what students have done there and how it’s worked.

Loy: So the fall symposium is absolutely my favorite part of the course. It is their final exam in my course. And what they do is, whatever that long tech project that they decided they were going to do, they go and they present it. And so we try and make it as much like a symposium as possible. We don’t always get people to come, but we invite high school sewing classes, and we invite the 4H and we invite every student on campus and all of the faculty to come in and see what the students are doing. And we usually get a half a room full, big lecture hall, half a room full, and the students will present anything from a research paper to a fully realized prototype that people can pick up and come and talk about. What is really exciting for me is to see the students in this culmination of this project, because it’s something that is deeply meaningful for them, every single time. I mentioned a student who did a prototype pair of pants for wheelchair users, and that student had been in a car accident, and she came in with a prototype pair of pants and did a short presentation on why you should do adaptive fashion, why the major fashion houses should be paying attention to it. And what she had done for her project was a TikTok video explaining how to take a regular pair of pants and make it into an adaptive pair. And she finished really, really quickly. And the first question that I wanted to ask her, and I asked her, I said, “Now, how many times did you make that prototype before the one that you brought with you today?” And she said, “I think this is number 16,” [LAUGHTER] but they’re so excited, and they’re so involved, and they go so deeply into it because they care so much about what they’re presenting. And I try and give them a nice, wide audience, and we have the before symposium gathering where I say “It’s okay, I know you’re not a public speaker, but you can do this.” And they go in and they have that really transformative experience, from the fear of public speaking to “Hey, I’m gonna tell you about this thing.” It’s my favorite part of the whole class.

Rebecca: That’s awesome. It’s always great to see our students shining.

John: …and gaining confidence too, so that when they do go out into the job market, they’ve already had some practice with this type of thing, which is often a bit of a shock when people first do that, if they haven’t had those sorts of experiences.

Loy: Part of the reason that I put it in the class. At some point you’re going to have to pitch your designs to somebody. So this may not be a design, but give us your pitch.

Rebecca: Sounds like a great experience, for sure.

John: The fact that a student is willing to do something over and over again, that doesn’t happen with all the assignments [LAUGHTER] we give in other classes. So, that certainly provides a bit of information about the amount of intrinsic motivation that projects of this sort generate.

Rebecca: Especially when it’s going to be realized in front of an audience. It has an audience, I think that’s a [LAUGHTER] key component.

Loy: The first semester that I ran that, I had a student who wanted to do something else sustainability in fashion, deeply committed to sustainable causes and eco causes, and concerned about the Earth and its ecological health. And that student came in with a presentation that would have been fine as a dissertation. She had two slides of references and citations and just the depth that she had gone to. And I remember checking in with her weekly and saying, “This is great,” and she’s “…but I have to look into this.” “No, this is great. This is a two-year college. What you’ve done is good.” but she was determined. And of course, I’m not going to say “No.” [LAUGHTER] She was determined to go deeper.

Rebecca: Well, we always wrap up by asking: “what’s next?”

Loy: That’s a really good question. So we’ve revamped the course learning objectives and the description to make it more accurately reflect what we’re doing in the class, and to introduce some of the very heavy technological elements, the AI and the cutting edge engineering, CAD designing. So we’ve got those sort of cemented in place. And now I kind of want to see how we can get students thinking differently. Students are starting to get the idea of, “I can make this digital design. I can create it here, I can make it physically. I can export it.” But I really want to start getting them thinking about what that means for the industry as a whole. Because you can sell garments you’ve never made yet, it flips the entire process on its head. You can make garments that are never designed to be worn physically. They’re only ever made to be in that 3D modeling space. And these are just new and different ways of experiencing fashion. Instead of being something that you just physically put on your body, and okay, we’re going to walk around in it. It’s something that might react to how you walk, or it might react to how you move, or it might react to the environment that you’re in, although I’m not sure I would like it if my shirt did something if I walked in the gym, but hey, I want the students to start thinking about those things and think about what the next steps might be in the industry. So we know, like Neiman Marcus is starting to put magic mirrors in their flagship stores, where users can go in, visitors can go in, they can stand in front of the mirror. And you walk into that fitting room, and instead of trying things on, you just push the buttons on the side of the wall. Boom, I want to wear that dress. Oh no, I want it in red. And get the students to start thinking about what’s really possible out there. That sort of big picture thinking is a big part of where I want this class to go. We’ll add to that cross collaboration with digital art students, maybe with some CIS students, and start making it into something that’s more than just fashion.

Rebecca: Well, thanks for giving us lots to think about and maybe motivate some of us to integrate more technology into our classes.

John: Thank you. This was an interesting conversation, and was something a little bit different than what I normally do in my classes, and it’s nice to hear about these innovative approaches.

Loy: Thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

399. Improving Course Design Using AI

Generative AI can increase efficiency and support student learning, however students can also use it as a substitute for learning. In this episode, Nathan Pritts joins us to discuss ways in which generative AI tools can improve course design and strategies to encourage students to use AI tools ethically and responsibly.  Nathan Pritts is a Professor and Program chair for First-Year Writing at the University of Arizona Global Campus. Nathan’s recent work has been focused on the relationship between AI and human teaching.

Show Notes

Transcript

John: Generative AI can increase efficiency and support student learning, however students can also use it as a substitute for learning. In this episode, we explore ways generative AI tools can improve course design and ways to encourage students to use AI tools ethically and responsibly.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Nathan Pritts. He is a Professor and Program chair for First-Year Writing at the University of Arizona Global Campus. Nathan’s recent work has been focused on the relationship between AI and human teaching. Welcome Nate.

John: Thanks for having me, Rebecca, John.

John: Good to talk to you. Our teas today are:…? Nate, are you drinking tea by any chance?

Nate: I am indeed. I’ve got this Paris tea by Harney and Sons. It’s a fruity black tea with bergamot oil. It’s very nice.

John: We have some of that in our office. It’s a favorite of the current Associate Director of the teaching center here. So we keep that stock pretty regularly. And Rebecca?

Rebecca: I have Golden Monkey today, John.

John: Is it golden?

Rebecca: It has golden tips, yes.

John: Okay. And it’s a black tea?

Rebecca: And it’s good. It’s a black tea.

John: Was it one of the monkey-picked teas?

Rebecca: I don’t know. Maybe it was AI picked. [LAUGHTER]

John: And I have a spring cherry green tea. One of your favorites.

Rebecca: Oh, yeah, definitely my favorite, with those cherries.

Nate: Nice. [LAUGHTER]

John: It’s an ongoing thing.

Rebecca: Yeah, I hate it. [LAUGHTER] Oh, okay, you actually don’t like it.

Nate: No, I actually super hate it. [LAUGHTER]

John: I did end up with a couple of bags of whole leaf tea because she bought some because it smelled so nice.

Rebecca: It smells so good, but I just cannot stand the taste of it.

Nate: Easy to get taken in by some of these.

Rebecca: It’s true, the wafts are so good. [LAUGHTER] Alright, well, we invited you here today not to discuss tea but [LAUGHTER] the impact of AI on the design of online courses. In your March 19, 2025 article in Faculty Focus you discuss some of the ways AI tools can be helpful in augmenting our work while still maintaining human connection in our courses. [LAUGHTER] Can you describe some of the ways in which AI can help us create more effective courses?

Nate: I can talk about some of the ways that have worked for me. I mean, I think one of the things to realize in course design, some faculty will have a lot of people supporting them. They’ll have colleagues to bounce ideas around with, but at other times, a subject matter expert won’t have anybody there to support their build. And I feel like that’s where AI can really help support the course development. It sort of works as just another pair of eyes on the work that the faculty member is doing. It works to bounce ideas around. And I feel like there are some very targeted ways that that can come into play. Always, I’m trying to think about AI as a support for the human intuition, the human experience, what we bring to the table. Ethan Mollick, who’s a pretty well known AI researcher, talks about the human in the loop, which is the person who’s helping AI accomplish goals. I like to think of it the other way around, as having an AI in my pocket. So I’m the human. I’m always going to be the human doing the work, but I can turn to an AI tool to help me do things that I might not be able to conceptualize myself. I kind of break curriculum work down into two different categories. This is kind of what we came up with internally to help us think about some of the different ways that AI can support course design to make effective courses. We think of them in terms of accelerators. That is an AI that’s basically helping a faculty member get started, move faster, maybe streamline some of the processes. A faculty member is staring at a blank page, an accelerator might help them. We’ve developed some prompts that will do that. But then there’s also what we think of as multipliers. This is basically to help enhance the quality of the work that the human, the SME, the faculty member, might have already come up with. And that’s what that article, Rebecca, that you referred to, that’s what that really talks about. The stress tester for assignments is basically a multiplier. It’s assuming that a faculty member would have developed on their own an assignment for a particular class. And then will use AI to essentially test it, run it through some battery of tests just to see if there are ways to improve it. One of the ways AI can do that in this particular case is that it can simulate student perspectives. So you can feed the assignment that you developed, or the discussion prompt, whatever it might be, into AI, and you can ask it to simulate a variety of student responses. And you can give it some parameters. You can say, I want some A level responses. I want some C level responses. You can ask it to mimic what your student population might be if you’re teaching first year versus if you’re teaching graduate level. And I think that can kind of help to show maybe where the prompt could be strengthened, maybe students might misinterpret a particular aspect of it, or maybe they struggle with some part of it. We’ve all had that experience where we develop an assignment, we give it to students, and they just find ways to break it right out of the gate. We never thought to tell them not to do a certain thing, or we didn’t make it as clear as we needed to. This gives us an opportunity, working with AI to potentially catch those stumbling blocks before we put it in front of students. So we refine the prompt, we find blind spots, and hopefully this is a way of making that assignment prompt that we’ve developed a little bit more ready for the wild. And let me just say I get that an AI-simulated response to a prompt is very different from what a student is going to say. Students are going to find new and exciting ways to respond to our prompts. The AI doesn’t work like that, but if we ask it to generate, say 50, say 100 responses to a prompt, don’t share them with me, just generate them and then thematically, tell me what you’re coming up with. It still gives us a baseline. It gives us a sense of where our language might be unclear. Maybe we need an extra bullet point to clarify that we don’t only want a thesis statement, but we also need an entire introductory paragraph. Maybe we need an extra explanation for what essay structure needs to be used in this prompt. We can’t just assume the student’s gonna know. We gotta make sure to put that in. So this is just one of the ways I think that AI can really help in the course design process. Again, I mean, I feel like you’ve got that human developing the material, but then you’ve got the AI as that second pair of eyes, that different perspective, something outside of our own head, that can lead us into areas we might not have gone into on our own. I feel like we’ve all had that experience too of you’re developing a class, you come up with an assignment, and you just love the way this assignment works. You’ve used it for 5 or 10 years. You think it’s fantastic. We fall in love with these things, but students change, and the way that we interact with the content or the subject matter or the outcome might have changed within the course. It might have changed institutionally. And we need to be aware of those things, and we need someone to help us fall out of love with our assignments and really test them. And again, I think in the absence of a colleague who might help us do that, for people who are working in silos or people who might have tough deadlines, AI can really help with that

John: In that article that you just referred to, you also provide an example prompt, and we’ll include a link to the article, and then our listeners can go and take a look at the prompt themselves. And I think you provided an example of using a personal narrative assignment in class, and you also talked a little bit about how you can use the AI tool to refine your prompt based on the responses that it has provided. Could you talk a little bit about that example and how you might use AI to directly suggest improvements on the prompts?

Nate: Yeah. So I teach mostly first-year courses, first-year students. I’m the Program Chair for our comp sequence, so I oversee students who are coming through both of our composition classes. In our writing courses, one of the ways that we handle the fact that these are students coming in with a large degree of fear, a lack of confidence, is we try to meet them where they are in terms of their own skill set, of course, but also in terms of their own interests and ideas. So yeah, it’s a narrative prompt that we try to work on in these courses. We try to get students to look at their past experience and to reframe it in a way that’s going to help them see their academic goals, their lifelong learning goals, let’s say. So we come up with this prompt, and it’s a prompt that asks students to talk about an experience they’ve had. Now I can ask AI to run some simulations, and what might be revealed… in fact, when I tried this, one of the things that was revealed… was that the way that I had worded the prompt was allowing students to talk about emotional experiences, but not those that had any real direct correlation to their choice of major, their choice of career field, and that’s what I wanted. I wanted students to find ways to talk about, essentially, their ethos, how they’ve developed this in a way that helps to see their chosen career field in a different light. My prompt wasn’t doing that. It was allowing students to just talk about very traumatic or sad or happy experiences they had at any age. There was no way of framing that into what I wanted. I assumed students would do it, but they might not. So it helped me to really understand that, okay, if I’m going to ask students to talk about a personal experience or a defining experience, I’m going to have to add material to the prompt that clarifies that I’m not just looking for a personal experience, I’m not just looking for a particularly emotional personal experience, I’m looking for a defining one that led to their choice of major or career field. Most of my students are non-traditional in the sense that they’re already working so they already have a chosen career field. And this idea of major versus career field, we typically think of it in terms of career field. But my point is that the AI really helped me to see that one of the ways in which I could better this prompt was to put a little more scaffolding into it and slant it toward what I wanted. Of course, I was worried, as the classroom teacher, when you’re teaching comp, when you’re teaching any class, it’s not about right answers. You kind of want to be surprised. You don’t want only one type of paper or assignment to come to you as a teacher. So you’re trying to write a prompt that leaves a lot of leeway, let’s say, for students to interpret and to give you unique responses, but what I had done was left it so wide open that they weren’t even meeting the guidelines, reall,y weren’t even doing what I wanted, and so AI was able to help me nip that. Now I could have just put that in the class, and after a section, after two sections, I would have figured that out, but I think that that would have been challenging for those students. Let’s say this is a week two assignment. Well, when week five rolls around, suddenly they don’t have that stable week two material to build upon. And so we’re really looking at helping improve course outcomes. We’re looking at making sure students are learning what they need to learn in the class. And again, AI is an avenue to do that. I hope that kind of explains what I’m talking about. I think there are a lot of different ways to do it in a lot of different classes, but that’s just one sort of avenue I tried there.

Rebecca: It’s a really good example of how the AI tool can do analysis of the assignment. Can you give some other examples of the kinds of holes that AI might be able to identify for faculty?

Nate: One thing I’ve been working on recently is universal design for learning. So I teach at an all online school. Our courses are asynchronous, and as a result, access and equitability, and of course, UDL principles are important to all of us, but they’re very much a part of how we design our classes. But so many subject matter experts are not curriculum designers. They’re maybe not even teachers. They’re experts in their field. And so the model now for a lot of universities is just to have these experts, these subject matter experts, design courses. And they’ve got a lot of great ideas, but they don’t understand some of the basics of instructional design. So we were able to develop an AI-based prompt that helped ensure that UDL principles were baked into materials of the course, while at the same time explaining those principles to the subject matter expert that’s working on them. I feel like so many AI tools are kind of like a black box. You ask it a question, and it gives you an answer. And I think that’s one of the problems we see with student use. They have an essay prompt, and they tell AI to write it for them, and AI does, and then they’ve got a product. They didn’t learn anything. It’s the same thing in course design. We want faculty to understand some of these underlying principles. And so back to this idea of UDL principles, we can create a prompt that says to any AI tool, “Okay, here are the main principles of UDL, and here’s some background information.” We could even give the AI some background research studies. Maybe your AI tool has access to the internet and can find some of these things on its own. You can then check and make sure it’s understanding of UDL is, in fact, correct, and that it’s applying it appropriately, through some refinement and testing. But what you get then is a tool that allows a faculty member to say, “Okay, hey, look, I’ve got a discussion board prompt, and I want to talk about essay structure. And here’s how I’ve typically done it: I ask students to identify aspects of essay structure and talk about how meaningful they are, but I want to think of some new ways to do it, and I want to make sure that I integrate UDL principles into this.” And so now the AI can turn back to the faculty member, not only some different ways to approach that course content element in that format… you’ve identified the course content you wanted, which is essay structure, you’ve identified the format, which is discussion board… and so now the AI tool will give you some options that you might not have considered otherwise, but it can ensure that it’s foregrounding or emphasizing discussion prompts that will emphasize Universal Design for Learning principles, and it will explain those connections. So the faculty member will then have an example discussion board, and it will say the reason why this adheres to UDL principles is because of these reasons. So the faculty is learning right along with it, and they’re coming up with interesting material for their course design. Now they might not use that. They might use that as a baseline to spring off and develop their own material, but maybe they’ll internalize some aspect of that, and they’ll learn while they’re doing it. I think it’s a really interesting moment. We talk about how students need to learn how to use AI. I think faculty are in the same boat. There’s a lot of fear, there’s a lot of uncertainty, but the more everybody interacts with it, the more they can learn about the strengths and also the limitations, and maybe they can teach themselves a few things along the way that they might not have been able to pick up otherwise.

Rebecca: Sounds like a good opportunity to model how to use it as a learning tool, which might be really good for faculty to see.

Nate: And I think that’s how it translates into students as well. I mean, again, if we look at some of the popular sites that allow students to upload their essays for automatic grammar checks. I’m not going to name any names, but one of them starts with grammar, and I feel like what happens is that tool just changes the student’s work, and the student doesn’t really understand why or how what they wrote was wrong or less than correct… I don’t want to say wrong… because there’s no upskilling involved. And so I feel like, whether it’s a student application, or whether you’re using it internally for faculty development, baking in some kind of upskilling is what really is going to make this seem more valuable to people, even those people who are sort of anti AI. I think it can show the efficacy of the process, even if you’re still skeptical of the product.

John: You mentioned that a lot of students will just submit work based on the prompts that they receive. And in a September 2023 Faculty Focus article, you talk a little bit about how some faculty may choose to provide AI tools with rubrics or other evaluative criteria from their courses and use that to provide some feedback on student work. And there’s a lot of concern among faculty about whether we should be using it to grade student work, the possibility that we may have students using AI tools to submit work that we then use AI tools to grade, and there’s very little thinking on either side. And you suggest in this article, we should focus on the uniquely human attributes that faculty bring to their classes. Could you talk a little bit about how we can bring uniquely human elements into our teaching, particularly online teaching?

Nate: We all hear this. There’s a lot of talk about the things that AI can do well and the things that it doesn’t do so well. And I think one of the traps we catch ourselves in is AI is really efficient and it’s really fast. And so a lot of people, faculty members, are thinking, “Well, I could never be as fast as AI, I could never be as efficient as AI.” And so they start to feel pretty disheartened about all of that. And it seems like every day there’s more and more that AI is doing well, maybe it’s not doing it well, maybe it’s just doing it well enough. And so it’s pretty daunting. I think it’s a little scary at times, and I feel like a lot of what I was talking about in that article, and a lot of what I still believe, and when I talk with faculty, this is how I try to bring it up, is just that I feel like we do need to lean into these elements that are uniquely human, the things that only we can do in the classroom. For me as a teacher, my attention, my attentiveness in the classroom to the student work. Those are things that AI can’t hack, but AI can hack feedback. It can give really good feedback. So how is my feedback different or better than what the AI might provide? AI can provide their feedback 24 hours a day, whenever a student wants it. I can’t do that. I’m gonna check my email three or four times a day. I’m gonna get back to students within 12 hours, but I’m not right there with them all the time. I can’t be faster, I can’t be better, I can’t be always on. So what can I do? And I feel like that’s where talking in that article about the idea of trying to find those human handprints. This is something that Kevin Roose talks about and those hand prints, I think, are those elements in the course, those elements of interaction with students that are something unique that we could do. And I feel like that’s something that each faculty member, each teacher, needs to kind of come to grips with on their own. As I shared in that article, it was a pretty harrowing process for me, because every time I came across something in my class that I was like, “Oh, this is purely me. Nobody could copy this,” suddenly, AI can do that. I write snappy headlines for my announcements and I write amazingly emotive and snazzy emails. AI can do those things. So it was this moment of realizing, like, okay, all these things that I thought were conveying my attention and my attentiveness in the classroom to my students, those things are something that AI can do. So what’s left? And the thing I settled on, and it’s a pretty basic type of thing, is to interact with students using video feedback for their essays. I think what might get lost in the article, or maybe what I only came to realize more recently, is that the feedback I’m giving is more developmental. It’s experiential. It’s not meant to say, “Hey, your thesis was wrong, and I’m just going to use my face and voice to tell you that.” Really what I wanted was for them to see my face and hear my voice as I read through their papers. They got to see how I reacted to sentences that they wrote. They could see if my brow furrowed or if I kind of stifled a laugh or whatever. They could see when I was stuck. They could see when I was excited. They could register all that in my sort of running commentary on their essay. And I feel like that was one of those moments where I realized, okay, this is it. This element of connection is what I can uniquely contribute to the class. This is what I’m doing as a teacher in an online, asynchronous environment. It’s very different if you’re in front of a classroom of living, breathing students, but in my environment, that, to me, seemed like a moment of connection, and that became kind of a baseline for me as I looked throughout other aspects of the course. What are some things I can do that only I can do? Or that by me doing them, they become more meaningful than if AI was doing them. There’s an example in our courses. It’s an online class, and so we have pretty complex analytics and dashboards that show us how students are performing in the class. You can look at a discussion board and you can see that a student forgot to turn it in. But you can also look at this dashboard that will say, “Hey, this student has been late on three of their previous discussion boards. This is a pattern.” So that’s great. AI, some type of algorithmic tool has identified that. We probably could even create an automatic email that lets the student know, “Hey, you didn’t do this thing.” But is that email timed better than mine would be? Is it written in a more personalized manner, does it take that individual student and their entire record of work in the course with me into account? And I feel like again, maybe someday, yes, AI can do that, but right now, it can’t encompass the full range of my experience as an instructor and my experience of that student’s work in the course. I know when a student needs to be challenged, I know when a student needs to be applauded. I don’t know that AI can figure that out based solely on the product that the student either did or didn’t turn in. And so I feel like, again, on one level, this is kind of a personal process for each faculty member to sort of go through their course and think, “Okay, what’s me in this class? What is uniquely me? Where can I bring more of me and my experience to it?” Because really, as much as this was about my students and trying to connect with them, it was really for me. It helped me to reconnect and re-engage with my teaching. Faculty worry that AI is going to take their jobs or do certain tasks better than they can, and I think really the productive way to deal with that is to just keep doing things as humanly, as uniquely, as messily as we normally do them. Let’s say you’re sitting down on a Friday to grade 20 essays. We’ve all been there. We’ve all done that, and we kind of can shift into autopilot at times. Don’t do that anymore, because AI can do that. AI can provide rote feedback and bland email messages. So it’s almost like a wake up call, in a way, for all of us to stop teaching on autopilot and really reinvigorate our practice. I don’t want to say we’re competing against AI, but I do think it’s a moment that’s helping us reassess what’s important in teaching, what’s important in our own disciplines, what’s important in the content of the class, and try to kind of inspire us to get at it, to uncover those things in a different way. So yeah, it’s about reconnecting to that joy in teaching.

Rebecca: One of the things that it sounds like I’m hearing you advocate for is being a bit nimble in how you’re functioning as a teacher, as the technology shifts and change, and as its abilities to do certain things that free up our time to maybe prioritize or put our energy into other things so we can highlight or utilize the technology to do things that are kind of rote in nature, and then places where we can use our human creativity might be where we’d better invest our time. Can you talk a little bit about how we need to shift? For example, you talked about video feedback. There may be a day with new technologies as they’re evolving, like the HeyGen tool, right, where maybe some of that feedback can be generated, and it could be in video.

Nate: Yeah, it’s terrifying. If you stop and think about it for even a minute, this stuff can overwhelm you. So I’m an educator, but I also have a background in marketing, corporate training, more of the business side of things. And I think what you’re talking about, this idea of being nimble in thinking, it’s maybe not necessarily how a lot of academics usually think about things. You learn your subject matter, you get engrossed in it, and then you teach it, and you have that expertise. I feel like maybe it’s just me, or maybe it’s my training, or maybe it’s the different roles I’ve held over the years. I never think I’ve got it figured out. I’m always worried that I’m five steps behind. I’m always trying to think of new ways to do things, not just to make them better, it’s not about necessarily always making things better, but it’s about experimenting and exploring. And I feel like that mindset, that true growth mindset that we talk a lot about as educators, I think that’s part of what we need to apply to this field itself, to this field of teaching. So many faculty members, so many teachers, got into teaching, not to be a teacher, but because they got their masters and PhD in a particular field knowing that they would be a teacher, but without any actual explicit training in it. So again, yeah, it’s this opportunity to stay open, to be humble, to listen, and to explore widely and see what out there might resonate with us in our own practice. So, I mean, Rebecca, you’re asking for particular examples. And again, I guess I might just kind of default and say that those examples are going to be different for so many people. I think there’s a lot of faculty work that can be, and maybe will be, automated. There’s a lot of elements of record keeping, data tracking, things that we do and spend a lot of time on that we maybe don’t need to spend that much time on anymore with AI able to crunch some of these numbers for us or develop data visualizations for us. I mean, I can pull dashboards… I don’t want to scare any of my adjuncts who are listening in my program… but I can pull a dashboard and I can see how often they’re in the class. I can see what they’re doing. I can see their persistence numbers, their retention numbers. I can see all these different things, and I can compare them to other faculty. So I know that Professor X tends to have students who do a really good job understanding course learning outcome 3, but Professor Y is stronger on course learning outcome 4, but not on course learning outcome 3. In order to get all that information, though, I have to look at three different dashboards. I have to go into the class. I have to look at all these different things. And what does that give me? It gives me some element of information that helps me to understand how I might interact with these professors to provide professional development opportunities that might improve their practice in the classroom. Maybe AI can automate all that. Maybe AI can automate some of that data crunching, and then it can just tell me, “Hey, go look in Professor X’s class. Look at week three. See what they’re doing. Use your own human eyes. But I’m telling you where to go look.” We have tools that do this for student work. I think I’m just trying to sort of talk my way through an example of how some degree of faculty work, like in any career, is kind of just a slog. You wake up every morning, you’ve got 30 emails, and it’s just this digital slush that you have to work through to get to the good stuff, interacting with students, working on a new research article you’re trying to tame, maybe these tools can help us get through some of that, while freeing up our time to be more creative, more human, to do those things that we’ve designated are important for us to do as people. And again, maybe that metric shifts for some people. I’m teaching freshman comp. Feedback is really important to me, I don’t want to automate that, but if you’re teaching a 300-level class or 400-level class, and you want to be able to give some students feedback on grammar, maybe that is the kind of thing that AI could help you to provide to a student, freeing you up to deal more with the complex arguments they’re making in their capstone paper. For me, I live in those details, so I need to do that. But maybe that shifts, again, depending on what your role is, where you’re teaching, what you’re teaching, and again, yeah, like you were saying, just to kind of free us up to do things that are more meaningful when we are the one that does them.

John: We want to help our students learn how to use AI ethically and responsibly to prepare them for their lives beyond our classes, but we’re also concerned that they actually learn some basic skills. What are some strategies that you’ve used or you recommend to encourage students to use AI in a productive manner, but not as a substitute for learning.

Nate: I love this because I feel like so much of the discourse that we hear about is how to ban AI usage, or coming up with these really Byzantine ways of getting around AI usage, AI-proofing an assignment, and I feel like that’s going to have its place, because, as we’ve been talking about, eventually AI is going to beat past all of this. So the crux of this is, how do we find ways to use this in the classroom? For me, the key is to normalize and openly discuss AI use with your students, rather than trying to ban it. Students are already using the tools. We know this. There’s an article published every 10 minutes that gives us new data about how we know students are using AI in classes. So we’re not going to get rid of it. Even if your university or your department bans AI usage or limits it in certain ways, students are still going to do it. So by inviting it in, we can try to come up with a way of getting students to understand better ways to use it, rather than just like you were saying, John, rather than just outsourcing and coming up with products where they don’t learn anything, we’ll find ways to integrate it into the classroom. I did some research recently, and kind of basing on a few other ideas I found, I came up with a framework for balanced AI integration in course design and the framework, it’s just four parts. It’s pretty simple, actually. It starts with setting clear guidelines for AI usage, telling students what they can and can’t use, what tools they can and can’t use, where they can and can’t use them in a particular assignment. From there, it means that the assessment itself needs to emphasize the learning process over the product. The third stage is to ensure that you’re encouraging critical thinking, and the fourth stage is to build in feedback and reflection. So what that looks like is that you’re going to talk to your students about AI as a helpful tool for, let’s say, brainstorming or outlining or maybe checking your finished work. It’s not a shortcut, but it’s a way to use the AI in a productive manner, telling them they can use it in a certain prescribed way. Maybe they’ll use it only in that way. But from there, we do need to make sure that we’re modeling that appropriate usage. We’re showing students how we use AI in our own work. We’re talking about it. We’re discussing it. And we continue to position AI as an assistant, not an author, not somebody who is going to generate this material for us, but a way that it can help us get to certain aspects of whatever the assignment might be, emphasizing that process over the product. We’re so used to grading essays. Maybe the essay isn’t what we grade anymore. Maybe we grade the entire process that leads to the essay. It’s not about the thesis statement, it’s about how the student documents their process of developing the thesis statement. Maybe that’s part of how we do this. But I also think we need to make sure that we’re building in reflective tasks where the students can really analyze the AI generated content. They can talk about its limitations, they can talk about the biases. They can talk about how they might have done something different, and analyze what that means, try to figure out what the difference is between human-generated output, writing, versus AI-generated output. Having that reflection built in is something that I think can really help students with this idea of authenticity and authorship. So again, just making sure that you’re explicit in your guidelines, making sure that you’re showing where AI can and can’t be used, and kind of talking about that usage, I think that’s one way that faculty can really bring it into the classroom. It can’t be worse than it already is, right? We’re already dealing with half of our papers being generated fully by AI. I know it sounds almost counterintuitive to say to your students, “Okay, look, you can use AI for this, but you gotta use it in this way,” but I have to believe that if you set up those guardrails, if you work with students, I think they’re going to get to that point where they’re using it as a partner, as a tool, rather than something that’s just wholesale generating their content. I mean, again, this might work differently in a math class than it might in a humanities class, but I do think that there’s generalizability here. There’s a way to make this work in a lot of different environments.

Rebecca: Can you share some examples of how you’ve made it work in your writing courses?

Nate: I can, for example, we’re talking about the idea of generating. One thing I developed is a tool called a thesis generator versus a thesis accelerator, right? So you see these thesis generators online, and what a thesis generator does is a student plugs in a certain amount of information and it just gives them a thesis statement. Again, there’s no learning. The student hasn’t learned anything about what a thesis is, and they certainly didn’t have any real, let’s say, agency or authorship of the thesis statement that’s been developed automatically through one of these generators. And you can go to an AI tool and you can say, “Hey, I’m working on an essay about why I want to be a nurse, and it kind of stems from the fact that one of my parents was really ill when I was a kid, and so I just want a thesis statement that does all that. Make it sound good,” and the AI will do that. So this thesis accelerator tool that I’ve used in a few of my courses is a way for students to talk about their thesis statement without letting the thesis statement be written for them. The AI has been prompted explicitly not to write any material for the student to use in their essay, but to work with them to continue to test their assumptions and ideas, to get them to form this thesis statement. So it asks questions. It asks what the student is interested in, what they want to write about, what they’re thinking about, asking if it really aligns to the topic. It’s asking very probing questions that are pretty explicit in terms of trying to get this thesis developed, but it won’t write it. It will keep working on it that way. But the assignment is not about interacting with the AI. The assignment is not about the thesis statement. The assignment is about the student reflecting on “Okay, I walk into this process. Here’s what I wanted to do. Here’s what the AI wanted me to do. Where does that intersect? What did I come up with? Is that different from what I would have come up with on my own?” and to just really authentically kind of assess, “Okay, this thesis statement that I’ve got, some of these are my words. Some of these aren’t. Some of this idea is mine. Maybe this idea isn’t,” and I feel like that’s one way to get students to understand those limitations, to get students to understand that this is a tool meant to potentially help them, but not supplant them. And I found, as with any assignment, sometimes it works, sometimes it doesn’t. Some students really approach that strongly, and they get a lot out of it. Other students find ways to work around it. But I feel like creating a tool like that, creating a path for students to interact with AI, rather than simply to use it to get information or output. It’s in its infancy. We’re still figuring this out, but I think that’s the way forward to get to this idea of personalized learning that AI seems to be saying it is promising us, this idea that we can have all these personalized learning tools. How do we get there? And I think part of it comes from interaction and conversation. So teaching students in that way, truly dialogic, I think that’s one of the ways we can get there.

John: So one of the things I think you’re suggesting is that faculty have to engage with AI to be able to work with it effectively. And I think throughout academia, there are a lot of faculty who are reluctant to even consider the use of AI and just want to ban its use by students. What sort of strategies would you encourage institutions to do in terms of making faculty more aware of what AI is capable of and how perhaps their students might be using AI tools.

Nate: I think partly it starts with normalizing the use of AI, something we were talking about in terms of students in the classroom with faculty. I think we just need to make sure that there are forums for experimentation. Faculty need to be able to talk about the AI and the ways that they’re using it, they need to be able to share that with their leaders. They need to be able to feel a sense of trust that nobody’s judging them based on things that they’re doing, as long as they’re doing things responsibly, ethically, experimenting. I think that’s how we learn. And having forums for that, whether it’s a community of practice, whether it’s discussion circles, whether it’s a Friday open office hour, some way to share and talk about the gains, the wins, the losses. I think that’s a first step of taking an organization, an institution, a university, and helping it kind of take those steps toward AI use in higher ed. But I think that an institution can say, Okay, we’ve got this really forward thinking process with AI, and we think it’s okay to use it in X, Y, and Z ways, and we’d like you to experiment and explore. There are still faculty who won’t do that. A lot of faculty just aren’t going to want to learn this. And so [LAUGHTER] I’m not entirely sure the answer to that question, I think that’s the underlying problem with so much of the work that’s being done with AI and higher education, is the fact that you need to have willing partners, you need to have supportive institutional governance. You need to have supportive infrastructure in place, but you also need faculty to truly engage with it with an open mind. And I’m not saying that that’s bad or good. Everyone’s allowed to do what they want to do. I know a lot of faculty will never want to use this. The sort of pervasive idea that we see with AI is that we should ban it, it shouldn’t be used in the classroom at all. So many of my colleagues fall on that side of the spectrum, and that’s fine, but then I guess it’s a process that’s going to take time. I can only imagine what it was like for teachers when a principal walked into the office, the bullpen office one day and said, “Hey, you know what, tomorrow for your quizzes and tests, I want you to use the Scantron form. It’s weird. It’s different. It’s totally new. I want you to try this Scantron out,” or the day somebody first put an overhead projector on a teacher’s desk and was like, “Use this to teach. Give me your chalk. Start using this thing.” I feel like it’s fundamentally changing how we can interact in the classroom with our students, with each other. And if you don’t want to engage that, think about that. I guess that’s your prerogative. Famous story in my family, my dad retired from his job the day they put a computer on his desk. He walked out the door that day. I think it’s going to be a slow process, but I think eventually we’re going to get to a point where faculty are going to be able to see the benefits of this. We’re going to show the benefits to them. We’re going to have to run workshops. We’re going to have to run dedicated professional development tracks that explain the small wins and the large wins of using AI, some of the upskilling that we were talking about earlier in the conversation. If we show faculty this isn’t just about generating content, but it’s about learning while we’re doing it. It’s a tool for reflection, an aid for reflection. I think the more we can develop these use cases that show that and we can share those, I think the more we’re going to win people over. We’re not going to win everybody over, and I think that’s fine. There are probably a lot of people who still won’t use Scantrons, but I feel like it’s one of those moments where getting to the hearts and minds of faculty is what’s really crucial here, and a lot of the conversation around this doesn’t always seem to be productive for that. We’re talking about limiting AI or banning AI. I think we need to have more conversations like what we’re having today: ways to productively include AI, and then let’s talk about them, let’s delineate them, let’s share them, and let’s see if it resonates for some people. Maybe it will for others, maybe it will for some, and then it sort of spreads.

John: And we should note that in the podcast released a week before this one, we addressed some of those issues in terms of what’s being done at several campuses in SUNY, and we’ll include a link to that in the show notes. But one of the things we’ve noticed here is that many of the faculty were really resistant to the use of AI. Once they were in a workshop and got to see how they could use AI to help improve their teaching, they became much more aware of possibilities, and their attitude changed really dramatically within even just a few hours of that professional development. But the key is getting people to that professional development work, and it’s sometimes hard to get people started with that, especially if they have this fear or this serious concern about ethical issues associated with AI.

Nate: I think that’s why finding ways to show how AI could help do work you might already be doing is one of the ways in for faculty, especially. I mean, what you’re talking about is the same kind of thing we see in studies. People don’t want to use AI once they do it, because they see how it works, they start to understand, okay, this can be a powerful tool. They may still sort of ethically make a choice not to use it, I suppose, but I feel like it’s just seeing how it works. Can be the gateway for so many people. So what’s that gateway for faculty, but to show them how it might help influence their work, how it might help free up time to do the creative things we were talking about earlier. I feel like the more we can give examples of that, I think the more we can lead people to it. And it means starting small. It means looking at what we’re already doing and seeing if there are ways this can be made to help assist in doing it a little bit better.

Rebecca: Along the same lines, one of the things that I’ve observed in the way that institutions are handling AI is typically, right now it’s voluntary, like professional development around AI is voluntary. And so you’re getting folks that are at least curious or completely resistant because they want to fight against it, so they’re showing up to things, like there’s some motivation to show up, and it’s their motivation to show up. But if we start meeting faculty where they’re already at in department meetings and other places that are places where they’re already kind of required to be to at least raise the issues or the conversations that’ll continue involving some additional people.

Nate: That’s the hope. One of the things we’re going to start piloting this with the new academic year is we have a roster of course revisions that are going to happen over the course of the year, and we’re going to sit down with faculty experts, and we’re going to say, “Okay, you can follow the old 12-week model of revising your course, where you’re going to meet with people, you’re going to develop the content, or you can follow this new model. It’s nine weeks long. It’s a little shorter. It’s going to use AI to help assist you. Which way do you want to try and if you pick the nine week way, we’re going to document that, we’re going to share that out as a kind of story, good and bad, whatever happens.” And I feel like that’s Rebecca kind of at the heart of what you’re talking about, this idea of finding ways to get faculty to connect with it that are kind of low lift. You’re going to do this thing anyway. Do you want to try this other possibly easier, possibly faster way of doing things, just to see what happens? You want to help us figure this out? And I think that might help. I love being an academic. I love teaching university. I love my students, but you read these emails from Microsoft or Asana, or I mentioned Ethan Mollick earlier. He has a substack, and you just see the massive amounts of money that businesses are pouring into AI training. They’re mandating it. They’re throwing everyone into day-long workshops. They’re testing and piloting. They’re opening up tools and universities and institutions just aren’t doing that. We’re not as well funded, and maybe we’re a little stodgy, maybe we like to do things at our own pace. And I respect that and appreciate that, and that’s one of the reasons why I’m an academic and not a CEO, one of the many reasons I’m not a CEO. But I feel like sometimes I read those things and I just think, “Boy, how nice would it be if we could just mandate everybody an AI exploration day,” you know, just play with a new tool and see what you come up with. Because professional development, educational development in higher ed, is so different from what I experienced as a corporate trainer, where people were thrilled. They might make fun of it. They might think the outcomes weren’t going to be worth it, but they were there and they were active and they were engaged, and as we’re intimating here, it’s tough to get people to show up, it’s tough to get them to engage, it’s tough to track if they learned anything, and it’s tough to check in six months later and see if they’re still doing it. So what does that look like? That’s the challenge of educational development overall, probably. But maybe it’s small wins. Maybe it’s small communities that catch fire. I don’t know.

Rebecca: I wanna underscore one word that you said, which was play. I think that’s something that we don’t often allocate time to play around with new tools and technology, and we’re putting our time resources towards something else, but if we put time resources towards play and experimentation, we might find something that’s useful.

Nate: I think we just have to engage with that growth mindset. We have to be like our students. We have to be learners. We have to listen. We have to just explore, instead of always jumping in with the information, with the answer. We have to sit back and maybe that play comes from it. One quick example, my colleagues are probably not listening, so I’ll share this. I woke up one day and I had an email that had kicked off the night before. There were like six or seven of us on the email, and it was probably at that point, like, 16 or 17 emails long. I clock off, I go to bed, wake up the next morning, and there it is, staring at me. And I was like, boy, this is exactly what people talk about that, “Hey, I can help you with your email.” So I grabbed all of that, put it into a protected AI tool that’s not going to train itself on my data. And I just said, “Is my name mentioned here? Are they talking about comp? Like, why am I involved in this?” And it spit back some really good, useful information. And I was like, “Okay, great.” And then I had 30 minutes to play, to just do something else, something different, and instead of engaging in the back and forth politics of a gigantic email chain, I got to cut through the noise and do something that was more meaningful for me in that moment, and that was that play of exploration, trying something new. If we can get back to that and can enkindle that, I think we’re going to get there.

John: I did enable the Apple intelligence on my phone, which is only a few months old, and it does give me email summaries automatically. They’re often somewhat distorted. In fact, they’re often so scary it forces me to look at my email sooner than I would have otherwise, [LAUGHTER] because it does look like there’s something serious that I have to address right away. But it’s getting better. Those types of summaries can be really useful.

Nate: I remember when I first turned on AI summary on Zoom, we do a lot of work on Zoom as an online institution. I first turned on an AI summary, I was in a meeting, and afterwards, I’m looking at the summary, and I’m like, these aren’t the things we talked about at all. You got everyone’s names wrong, and this is really bizarre. And not even three months later, I was looking at it again, and I was like, this is actually now really good. And so along with playing, I think it’s that sense of continuing to grow and to learn to keep coming back, don’t play with it and then write it off, but continue to explore, continue to play, and to also take what’s there to be taken and don’t over rely on it. We don’t want our students to just over rely on this. You don’t want me to never read my emails again, just reading summaries of emails. But I do think that there are ways we can develop that mindset, really a deep sense of AI literacy as an important outcome in and of itself, where we realize how to interact with these tools in a way that’s going to help us free up that time. Do better work more as opposed to the slush work more. And we get buried in our emails. We get buried in grading. We get buried in so many different things. There are ways to shortcut some of that while still doing the meaningful stuff. I’d like to figure out what that is.

Rebecca: Sounds like a great note to get to our last question, which is we always wrap up by asking: What’s next?

Nate: Well, what’s next for me is probably grading papers. It’s… [LAUGHTER]

Rebecca: Wait. No, that’s the slush. [LAUGHTER]

Nate: For me, that’s important work. We’ve been talking about this a little bit. For me, I think one of the things that’s really important is to continue to learn alongside other people. That is how I’ve learned the most. I’m a teacher, but I’m also a teacher of teachers, and one of the ways I learn how to teach my students better is by working with them. One of the ways I learn how to interact with my other faculty members, the faculty members that I oversee, is by being a teacher myself, seeing how they do things, working with them, helping to figure out what those elements are that can be honed or refined or developed. And so to me, it’s always just about learning. It’s about putting myself out there, trying to figure out what can be figured out, and being curious, listening, finding ways to think strategically, to take the small thing I might be doing and think about it in terms of how that might scale to other classes, other teachers. I’m playing around with AI on my computer in the morning. I’m trying to figure out different ways of doing things. While I’m doing that, I’m also thinking, “ooh, how can I convey this to somebody else? How can I best show this, demonstrate this to help other people get excited about it?” So it’s about structured play. It’s about strategic thinking. It’s about having fun and getting back to the root of what brought me to this crazy discipline to begin with. I want to ask better questions. I don’t really want to know the answers to things, because that always seems like the end. I just want to keep asking questions and getting to new places along the way.

John: Well, thank you. This has been a fascinating discussion, and it’s one that is really important for people to be having right now on every campus.

Nate: Yeah, I appreciate it. It’s great to talk about this stuff. And like I said, you guys kept me on my toes a little bit here. It’s fun to think out loud, and I appreciate your time today, John, Rebecca.

Rebecca: Sounds like a really human activity that just occurred [LAUGHTER] that has maybe a relational aspect, right, that maybe can’t be replicated by AI.

Nate: I mean, as podcasters, you guys have explored with the Google podcasts, right?

John: Notebook LM? Yeah.

Nate: …where you can give it a research article, and you know you’re listening to it, and it sounds like a podcast. It sounds like you’re listening to NPR, but the information is wildly wrong, and it’s missing that nuance and these elements of redirecting things, stuff that’s coming up that’s not scripted. Some of the things we talked about today were not questions you shared with me that we might talk about, and that’s great. Yeah, that’s the human enterprise. It’s messy, it’s weird. Can’t be predicted. That’s what makes it fun and worthwhile.

John: Although notebook LM is getting better, as all these other tools are as well.

Rebecca: More deep fakes ahead. [LAUGHTER]

Rebecca: Thanks for joining us.

John: Yes, thank you.

Nate: Thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

396. Title II

While the Americans with Disabilities Act has long required digital content to be accessible, specific technical requirements were recently defined in updates to Title II of the ADA. In this episode, Mark Greenfield joins us to discuss the new regulations and what that means for public colleges and universities as the April 2026 deadline approaches.

Mark retired as the University at Buffalo’s Web Accessibility Officer after 35 years of service at the institution. He continues to consult on digital accessibility and serves as a member of the Association for Computing Machinery (or ACM) U.S. Technology Committee, which educates and informs Congress, the Administration and courts about digital technology developments and how they may impact public policy in the US.

Transcript

John: While the Americans with Disabilities Act has long required digital content to be accessible, specific technical requirements were recently defined in updates to Title II of the ADA. In this episode, we discuss the new regulations and what that means for public colleges and universities as the April 2026 deadline approaches.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Mark Greenfield. Mark retired as the University at Buffalo’s Web Accessibility Officer after 35 years of service at the institution. He continues to consult on digital accessibility and serves as a member of the Association for Computing Machinery (or ACM) U.S. Technology Committee, which educates and informs Congress, the Administration and courts about digital technology developments and how they may impact public policy in the US. Welcome, Mark.

Mark: Thanks for having me.

John: Thank you for joining us. Today’s teas are:… Mark, are you drinking any tea?

Mark: I am drinking tea. It is a Blackberry sage.

Rebecca: That sounds nice. I have just some decaffeinated breakfast tea, thanks to John making me some hot water. [LAUGHTER]

John: I have a peppermint, spearmint, and tarragon tea today. I’ve already had a lot of caffeine today.

Rebecca: So Mark, we’ve invited you here today to discuss new regulations in the U.S. related to Title II of the Americans with Disabilities Act and digital accessibility. In order to ground our conversation today, though, can you share a definition of digital accessibility?

Mark: Sure. So when we’re talking about digital accessibility, the goal is to make sure that everything we’re doing online works for people with disabilities. And it’s interesting, as I kind of explain, over the last few years, what I do for a living, how many people don’t know that that’s a thing, when, in fact, not only is it a thing, it’s a very important thing. And I like to also use the words digital accessibility rather than web accessibility, for a couple of reasons. One is that with web accessibility, you’re talking about a very specific technology where, with how technology has changed over the years, it really is much more than just websites. The other reason I like to use the word digital rather than web is that it lets people know that this just isn’t the purview of web developers. It actually impacts anybody who’s creating content online. So when I have a lot of conversations with faculty, if I talk about web accessibility, they’re assuming this is IT, and IT compliant, without realizing the impact that a faculty member has when it comes to making sure that their materials are accessible.

John: You mentioned that digital accessibility requires that the needs of people with disabilities be met, but are those the only people that benefit from digital accessibility?

Mark: So there is a lot of myths around how many people are impacted when it comes to digital accessibility. Most people, in their mind, automatically default to somebody who is blind or somebody who is deaf, when in fact, there’s a number of different indices on how many people have a disability. The number I use is 20%; about 20% of the population has a disability that impacts their ability to use technology. And when you’re thinking about the different kinds of disabilities, it’s visual disabilities, people who are both blind and have low vision and are colorblind. I think the number is 8% of the male population is color blind, so if you’re using color to provide information and using red and green as your color combination, somebody’s not going to be able to differentiate that. Then beyond visual disabilities, you have auditory disabilities, people who are deaf or hard of hearing, motor disability, somebody who can’t use a keyboard or can’t use a mouse, and also cognitive disabilities. And this is something I think is important for educators when you think about dyslexia and other types of learning disabilities, this falls into the realm of digital accessibility. But the other thing to remember is that, even though we’re talking specifically about people with disabilities, almost everything you do related to digital accessibility, improves the user experience for everyone. What can be frustrating for the general population can be a barrier for somebody with a disability. I’ve always been a huge advocate of user-centered design usability, and there’s a direct correlation to accessibility with that. And my message to web developers always has been, when you’re addressing accessibility issues, you are improving the overall experience for everyone.

Rebecca: Can you talk a little bit as we’re kind of framing this idea of digital accessibility, what some of the specific skills are related to digital accessibility, especially for content creators?

Mark: Sure. So there are a lot of things that make a website or a document accessible. Some of it does get complicated, but much of it is very simple to do, and something that I think everybody should just build into their workflow, whether you’re creating a web page or creating a document. So some of those include: color contrast, so the difference between the color of the text and the color of the background, there are specific contrast ratios you should be thinking about, but understanding to make that contrast workable for people who have low vision, and think about using your cell phone out in the sun. That would help in that situation as well. Related to colors, making sure that you don’t use color to convey information. I see a lot of schedules where an available time slot is green and an unavailable time slot is red, red/green is the most common color blind combination. So if somebody can’t see that difference because you’re relying solely on color to reflect that information. So another thing that everybody should think about is what I call semantic markup. And what semantics mean is that you’re describing the function of the information rather than what it looks like. So think about a heading. What you don’t want to do, whether you’re in Microsoft Word or using Google Docs or making a web page, is take your heading, make it a larger font and bold it, because that’s just addressing what it looks like, but not what the function of that content actually is. So when it comes to headings, when it comes to lists, when it comes to links, those are all things that can be marked up in a way that assistive technology understands what that is and will work properly with that. Again, very easy to do. Another thing is with images, making sure that you have provided alternate text, which allows a screen reader or other assistive device to be able to know the content of what’s in that image. Again, very easy to do. Another thing related to that is with videos, making sure that they’re captioned. Again, the tools are such now that you can do captioning much quicker than you could even five years ago. So really, no reason not to caption all your videos. And one of the things when I talk with faculty about captioning is that this really can be part of Universal Design for Learning. When I was working at the University of Buffalo, we had a large international student population, and they benefited from having captions on the videos, because they could understand the content much better. Making sure that when you are using a form, whether it’s a PDF form or whether it’s a web-based form, that you have labels for the input, again, important for assistive technology to understand how that form is working. I also want to make sure that when it comes to web pages, that your content will work with just a keyboard, not relying on the mouse. This is a skill that I recommend everybody learn. It takes about five minutes to learn how to navigate a web page using just the keyboard. Push your mouse to the side, and there are just a handful of keys you need to learn to be able to navigate a web page. This is very important for two reasons. One is most automated testing tools cannot determine whether the keyboard is working correctly or not. The second is that when it does not work correctly, that can be a complete barrier for somebody with a disability. One of the examples I use is that there was some administrative software at the University of Buffalo that we used, once you were into the software, it was fairly accessible, the problem was to log into it with your name and password, required the use of a mouse. So anybody who needed to use a mouse, it was a complete barrier; that tool was unusable. So really a good skill for everybody to learn.

Rebecca: You used assistive technology a lot in your last description, can you just describe what that is for folks that might not be familiar?

Mark: Sure, so assistive technology is developed specifically for people with disabilities. The most common assistive technology are screen readers, and there’s a variety of screen readers. Many of them are free. In fact, I recommend that people use free screen readers. On the Windows side. NVDA is a free screen reader, which is really powerful; on the Macintosh side, VoiceOver is included on both the iPhone and on a Mac, so again, very easy to learn how to use those. Those work for people who are blind. And one of the things about screen readers is that there are people who use those who can see but have other disabilities. So it’s not just somebody who has a visual disability. Another type of assistive technology is known as a mouth stick. So this is somebody who does not have use of their hands, but can still use a keyboard by just putting the stick in their mouth and then pressing on the keys instead of using their hands to do that. More sophisticated assistive technology is something like a Braille keyboard. So there are keyboards that allow you to type and get feedback using just Braille. So pretty advanced technology. And one of the things we’re starting to see is, I’m wearing AirPods right now, and those AirPods can be used as a hearing device as assistive listening, and that’s one of the things I’m happy to see is that a lot of mainstream devices now can be used as assistive technology.

John: The history of legislation related to disabilities is fairly recent, beginning with the Americans with Disability Act (or the ADA) that was enacted in 1990. At the international level. The UN Convention on the Rights of Persons with Disabilities was adopted by the UN General Assembly in 2006. In it is the explicit claim that accessibility is a human right. The first version of the Web Content Accessibility Guidelines was released in 1999 with a 2.0 version adopted by the International Standards Organization in 2012. More recently, laws have been updated throughout the world to more explicitly address issues of digital accessibility. As one example, can you talk about the recent updates to Title II of the ADA in the US?

Mark: Sure, so Title II of the American with Disabilities Act had rules established last April, and this was, in my opinion, a really important event in the history of how the web and disability come together. The important thing to remember about the American with Disabilities Act is that is a civil rights law. So that should be the message. This is about human rights and about civil rights. As you mentioned, the ADA was adopted in 1990, which predates the web. So the web went public in 1993. I was fortunate enough that I was there like a week after that it went public, and guessed that the web might be a thing. I taught myself how to program and away I went. But it’s always been case law, rather than regulations from the government about what does disability actually mean. And it was a long process. The real start to the current regulations was in 2010. That rule making was then dropped in 2016, picked back up and finally adopted last year. So this has been a long time coming, and one of the things to remember about the ADA Title II is that now we have a specific technical standard that we can reference. And for the ADA Title II, it is WCAG, which is the Web Content Accessibility Guidelines version 2.1, level AA, and we can talk more about what all that means if we want to talk more about what all that means. But anyways, this was the first time that there was a specific technical standard that people could reference. There was an interesting case with Domino’s Pizza. This was like four or five years ago. Domino’s was sued because somebody who was blind could not order a pizza online, so they took Domino’s to court, and one of Domino’s defenses was, “Tell me what it means to be accessible, and I’ll make it accessible. There’s no standard. How do I know if I’m making it accessible or not?” For me, that was an interesting argument. However, eventually that case did go to the Supreme Court, and the Supreme Court chose not to hear it, so Domino’s didn’t win on that argument, but it raised a really legitimate point: that having a technical standard would be so helpful, and this is why the ADA Title II regulations are so important. A couple other things about the ADA Title II regulations. This is specifically for state and local government. That is what Title II is. And all public colleges and universities fall under Title II. Private colleges, however, are not part of Title II, and some people who work at private colleges may think, “I’m off the hook. I don’t need to do this,” when, in fact, that is not the case at all. For anything outside of state and local government, it’s business as usual. That means that you still absolutely can be sued in court, if you have accessibility issues, but they’re not going to use the WCAG standard necessarily as the measuring stick. It’s going to be up to the court to decide what are we going to use as a measuring stick. In fact, there was just a case in Louisiana in February where the state of Louisiana said we don’t have to do this until next April. And the courts are saying, “Oh, yes, you do. This is still in effect, even though the deadline for Title II isn’t until next year.”

Rebecca: So, Mark, you’re talking a little bit about the laws in the U.S., but this isn’t just a U.S.-specific thing. Can you talk a little bit about what’s been happening globally, in a general sense?

Mark: Yes. So, globally, there has been a tremendous increase in legislation specific to Web and Digital Accessibility. In the European Union, they’re actually a little bit ahead of the United States, because their accessibility laws deadline is this June, and pretty similar in terms of what the expectations are technically, but they’re again a year ahead of where the United States is. Ontario, same thing. Ontario has had a pretty strong accessibility law in place for quite a while. So, in many ways, the US is catching up to this. One of the things that is nice about the WCAG standards is that they are internationally recognized. So almost every law that you see specifically references the WCAG standard, which I think makes it much easier for consistency, to understand what is expected when it comes to web and digital accessibility.

John: How do the changes in Title II impact our educational system, specifically higher ed, in terms of its effect on institutions, students, and faculty and staff?

Mark: So, Title II regulations are actually a major change with the way that colleges and universities need to think about Web and Digital Accessibility. And that major change is that the ADA Title II regulations move to a model of full accessibility, rather than accommodations. For anybody who is familiar with Section 504 of the Rehabilitation Act, that is an accommodation model. If someone has a disability, it is very specific to their situation. This person is blind, is trying to access this information, and we’re going to create an accommodation that will help that specific person. The expectation with Title II is that everything is fully accessible from the get go. So this, for institutions is a major change philosophically in terms of how you need to think about meeting your accessibility goals… huge, huge change. For faculty and staff at a university, I think the Title II regulations bring the importance of this to the forefront. I am a longtime advocate for accessibility beyond legal requirements. In fact, I would do everything that I normally do when it comes to creating a website if there was no law, because it just is best practice and usability and all of those kinds of things. But with law, that gets people’s attention, and I think with the Title II regulations, this is getting people’s attention because you are breaking federal law if you are not making your sites accessible if you’re a public university. So I think that changes things for faculty and staff, where there’s a level of seriousness now and a level of training that’s needed that perhaps wasn’t there before. When it comes to students, I think this is an opportunity for students to learn about accessibility and why that matters. One of the questions I get is that, technically, students posting information onto a class website or a class activity within their learning management system, that needs to be accessible. And a lot of administrators, faculty and staff, are kind of pushing back against that, saying, “How are we going to make that happen?” Well, the answer is, you train students how to do it. It’s not that hard to do the basics. Every student I’ve ever talked to has been fascinated by the fact that you can make things accessible for people with disabilities. There’s a level of empathy there that perhaps isn’t there with people in my generation. So I think this is a great opportunity to train students on what accessibility means and give them the basic tools to make their content accessible.

Rebecca: I’ve heard some conversations with decision makers across higher ed about whether or not these regulations will be enforced because of current executive orders related to DEI, the dismantling of the Department of Education and the reduction of the federal workforce. What is your sense of the stability of the law and the momentum of the work on digital accessibility in higher education?

Mark: So that is a great question, and my answer may change an hour from now [LAUGHTER] than what it is right now. That’s fair. [LAUGHTER] It is very, very fluid. That being sai, one thing about the Title II regulations is that the current administration cannot legally just throw those out. They were established in April of 2024. I believe it’s 180 days have to go by, and then it’s kind of written in stone at that point. So the current administration can’t say, “Never mind. We’re going to just ignore these.” That’s legally not what they can do. Now, whether they do that anyways, we’ll see what happens. So that’s one thing to think about. The second thing to think about is that much of what happens in the courts around accessibility are private lawsuits. That has nothing to do with the Department of Justice and how they prioritize Title II. Anybody can bring a lawsuit against you at any time, and now you’re in the court system, and it has nothing to do with the administrative branch of the government, so you are always exposed to a lawsuit, and that’s where most of this activity happens. The other thing to keep in mind is that most states also have laws around accessibility. For those who are in New York state, there are pretty strong laws around web and digital accessibility. So even at the federal level, you may not think you need to worry about this, but at the state level, you absolutely do. As far as the Department of Education’s Office of Civil Rights, I’m actually pretty good friends with a lot of people who currently and formerly work there, unfortunately. What has happened with the OCR is that the central team still exists, and again, I’m saying this in April of 2025, but that team still exists, but it’s been drastically cut in size. And the big question is, how quickly can they respond to complaints? Because they have like 10,000 complaints on the docket, not just for accessibility issues, but beyond accessibility issues. So how quickly can they respond to those, that’s open to anybody, who knows what’s going to happen with that. So I don’t know what’s going to happen. I think it would be misinformed to think that you don’t have to worry about this, however, because, who knows? The bottom line is that, as I mentioned before, we should be doing accessibility work, regardless of the law, there is tremendous value there. So one of the things I do as a consultant is when I come on campus and I meet with senior leadership, is I talk to them about how important is web and digital accessibility to everything that happens on your campus. It used to be that we would talk a lot about mission and vision statements, which always included the words diversity and inclusion, which web accessibility fits right in with that. That’s a piece that I’m concerned about right now, is whether we can connect accessibility to DEI initiatives. One of the interesting things for me when I was at the University at Buffalo, as the Web Accessibility Officer, I reported to the Director of Equity, Diversity and Inclusion, and that was something I told the administration I wanted to do, because it sends a much different message about why we’re doing this when it’s part of diversity, equity, inclusion, rather than being part of the IT office, where now it’s an IT compliance issue. Now would I take that same strategy right now? Probably not, because of some of the challenges around DEI. I am hoping that people push back on this a little bit, because the ADA is federal law. So to me, there’s a complete disconnect between what’s happening around DEI nationally and what the law actually is. Now, how courts interpret that, how the current administration interprets that, is anybody’s guess. I understand why some people are gun shy about talking about DEI and then adding A into that as well, but I think that there are federal laws around this, and I think there is solid ground for continuing to do this work. So who knows what’s going to happen again? It’s a very fluid situation. It’s an unfortunate situation, because last year, after waiting for 15 years, we finally got these Title II regulations, and now a lot of that work is being questioned about how this is going to move forward.

Rebecca: I think, as you mentioned before, about the global context, too, that underscores the idea that it doesn’t really matter what the current political climate is, that globally, there’s an initiative in this direction, and we’re likely to continue seeing it. We’re gonna get behind if we’re not doing it here.

Mark: Absolutely.

John: Now, when faculty and staff and others creating digital content are creating new material, if you start from the ground up and are not retrofitting accessibility onto older work. It’s pretty easy to create accessible content, but there are areas, though, in some disciplines, where it’s a little bit more challenging for faculty. That includes areas where there’s discipline-specific notation, such as chemistry, math, or music, or limitations to machine-generated captions for content that is sung or in multiple languages or spoken by non-native speakers. How should institutions handle content with these more complex challenges?

Mark: This is a very, very important topic. I recently read a statistic that people with disabilities constitute 10% of our national workforce, but only 2% of STEM professionals. So that disconnect tells me that this is really an area that we need to think more about and to address. And as you mentioned, basic accessibility is relatively simple to implement, but there are places where accessibility can be a challenge, whether you’re talking about chemistry notations and math formulas and those kinds of things. What I recommend that campuses do is that they really work hard to create awareness among those faculty members in those disciplines to understand what some of these additional challenges are, and then providing the support and resources to help them meet those challenges. The good news is that these challenges are not new. So there are a variety of tools that are being created to help with math formulas and scientific notation and others. So I think it’s really important that the faculty understand, 1. we’re going to have to take that extra step, and 2. that a campus provides those resources. And related to that, I think it’s important that at least one person on a campus really is paying attention to these additional types of tools. And they’re improving every year, and I think it’s important to stay up with how those improvements are happening, and have somebody play point on campus so they can connect the dots with the vendors who provide these tools and the faculty members who need them. There’s also a lot of good information out there on how to make, for example, STEM materials, accessible. So if you Google that, a lot of places will come up. I have done some work with the National Center on Accessible Educational Materials, the AEM, and they have a lot of great resources. They’re very much involved with Universal Design for Learning… bring the accessibility component into that. So that is a place where you can get a lot of great resources about how to make these more challenging educational materials accessible.

Rebecca: One of the other areas that I know often raise challenges for faculty, but other folks in higher ed, are third party content like learning materials, content platforms and services, PDFs of articles with complex charts and graphs are often a concern. What role does higher ed institutions need to play in moving the accessibility needle in these other spaces, with these third party vendors.

Mark: Third party vendors and procurement is the most challenging aspect when it comes to your digital accessibility program. The phrase that the Office of Civil Rights always uses is we’re going to look at your program, services, and activities. When you think about a campus’s program services and activities, they are almost always happening on third-party products, whether it’s your learning management system, whether it’s your student information system, your alumni system, on and on that list goes. But the reality is that it’s third-party products where the rubber hits the road. So this is really, really important. One of the challenges with the ADA Title II rules is that they don’t apply to vendors. Those are private companies. They don’t need to legally make their products accessible. So what does higher ed need to do to kind of help fix this situation? One is to recognize the buying power, the collective buying power of 4500 colleges and universities across the country, and start to put the appropriate level of pressure onto the vendors. As I say that, the approach I try to take with vendors is rather than it being adversarial, let’s think about this as a win-win opportunity. I happen to know the heads of accessibility at many of the major educational technology companies, and they want us to complain, because in these big organizations, it’s up to the product manager to determine how accessible a given product is, not up to the Accessibility Officer for that company. So we need to put pressure on vendors, and I think there is opportunity for us to do that collectively, rather than individually. This is something I have been talking about with a number of people nationally, about how do we become more efficient in terms of how we approach vendors? And two things to think about: one is testing can be challenging to determine whether a vendor’s product is actually accessible or not. So rather than 4500 colleges doing their own testing, is there a way to combine that and just kind of share best practices, share results? Good idea in principle, but in practice, many times lawyers get involved with this and they’re concerned about legal risk if I, as Mark Greenfield, representing the University of Buffalo, say product X is not accessible, the people at product X don’t agree with that, so we’re going to take you to court and question that. So unfortunately, the lawyers have been involved with that, but there are ways around that, which we continue to work on. And then the second thing, again, is the collective buying power. I have been pleasantly surprised over the last couple of years about how serious publishers and the major educational technology vendors are taking accessibility. They are making progress with being honest and objective about what the shortcomings are, and putting resources to address those shortcomings. So I think it is really important that we continue to do that kind of work. One of the things I was disappointed with with the new ADA regulations is that they only applied to Title II, which is state and local government. I wish they would have also addressed Title III, which is the private entities, the vendors would fall under Title III. For a whole bunch of reasons, it would have been nice for them to address both of those at the same time, but unfortunately, that didn’t happen. So I think we really need to be an advocate about why this matters, and kind of use our collective buying power to encourage vendors to push them kind of in the right direction.

John: The focus on improving the accessibility work on many campuses have focused on faculty and staff but had not addressed students in most campuses, probably. What role do our institutions need to play in moving the accessibility needle in these other spaces for classwork from students or from student clubs and organizations, for example?

Mark: I would love to see college campuses be much more proactive when it comes to training students about the importance of accessibility, why it matters, and just very quick and easy things that anybody can do to make their content more accessible. I remember 20 years ago, I taught a general education course at the University of Buffalo, it was called UB 101, where we basically gave them the components: this is how you kind of survive in college in your first year, and what all the various offices do, and some other advice and guidance. I would love to see any campus that has a course like that, you know what? Spend the day, spend an hour talking about accessibility, what that is and why it matters, and show them the basics on how to do it. Again, my experience has been students are very happy to take those steps to make something accessible, and I think they would just eat that right up. And I think it’s a good service. I am a little disappointed that here we are in 2025, 30 years after the web was invented, and 35 years after the Americans with Disabilities Act, and yet we have made little progress when it comes to the accessibility of higher education websites and documents, and that’s very frustrating to me. I think one of the ways to start to improve this is let’s start to work with students and have them understand, and not just computer science students. There is a group called Teach Access, which is working with computer science faculty to make sure they’re incorporating accessibility in their teaching. But I think it needs to go much farther than just Teach Access and computer science majors to everyone on campus. And again, this is not that hard to do. A real quick story for you. One of the favorite projects I have worked on in my entire career was working with a group of third graders to make a blind athlete’s website accessible. It was a fascinating project. The athlete’s name was Rachael Scdoris. She runs in the Iditarod, and she was legally blind. Through the ADA, she actually sued the Iditarod to have a spotter 1000 feet in front of her, so she had some sense of where she was going in the middle of Alaska. She won that lawsuit. When my daughter was in second grade, as a class project, they followed the Iditarod, and my daughter chose Rachael Scdoris to follow. She was young and blonde, and my daughter identified with her, so when I found out she was blind, I went to her website and found out that it was completely inaccessible. So I didn’t contact Racha el directly. I contacted her agent and told him, you know, this probably isn’t the best look, because Rachael is actually pretty vocal about accessibility and disability. And at first I said, “You know what? Maybe I’ll fix this for you.” But then I had a better idea, let’s train my daughter and some of her classmates how to do this. So I took a group of third graders, taught them how to code websites, this is back in 2006, 2007 and they recreated Rachael’s website and it was perfectly accessible, including captioning the videos that were on her website. So when people tell me that this is too hard, I tell them, “No, it’s not. I had a whole group of third graders who could do it.” The bigger lesson from that was when I asked the third graders, “Why does this matter?” It was all about empathy. “Of course, we’re going to do this to help as many people as we can.” So instilling that mindset in the students, I think, would be a big step forward to help us address why we are still kind of challenged by making everything accessible.

Rebecca: I mean, we are institutions of learning.

Mark: Exactly.

Rebecca: We’re well positioned to educate an entire generation on how to do this work.

Mark: And when you think about how important the web and digital is now compared to a generation ago, I think COVID actually brought this to the forefront when we moved everything online. Now, all of a sudden, everybody’s really paying attention to what happens online and accessibility as well. But as you think about the program services and activities, more and more of those are moving online all the time. So it makes the importance of Web and Digital Accessibility all the greater. And there is an opportunity to train the next generation to really just be aware of and understand what this is all about.

Rebecca: It’s really easy for folks to get hung up on the legal obligations, especially as we’ve kind of framed the conversation around Title II. But can you talk a little bit more about the value of digital accessibility and why we should be doing it anyways?

Mark: So again, one of the misconceptions is that it’s a small part of the population that has a disability, when, in fact, it’s 20% of the population, and that is just people with permanent disabilities. We’re not talking about somebody with a temporary disability. So for example, if you broke your arm and couldn’t use a mouse anymore, or a situational disability, whether you’re in a library watching a video where you can’t have the sound up, or those kinds of things. So there’s a lot of value, just in terms of the percentage of people, but beyond that, one of my goals is to get people to think about accessibility, not as a cost center, but as a strategic investment. Forrester Research a few years ago, did a study on the ROI, the return on investment, of both usability and accessibility together. So this was not just about accessibility, but usability and accessibility are definitely joined at the hip, and really you can think about those very similarly, but the ROI they found was 100 to one. For every dollar invested in usability and accessibility returned $100 of value. So think about it that way, the value beyond. Again, I was talking before about students who maybe English is their second language, and the value of having captions on a video. So there’s just a lot of opportunity there. And the thing is that it’s really not hard to do the basics of accessibility, and if you start with that mindset, it is relatively easy to do. Another message for my web development friends is don’t try to make everything as fancy as possible. Simpler is better. So, as an example, without getting too technical here, there are a variety of ways that you can add alternative text to an image. The simplest way and the best way is to use the alt text within the image tag within HTML, instead of trying to get fancy with ARIA and other fancy programming, which you can kind of accomplish the same thing, but you’re much better off keeping it simpler, because, even as we speak in 2025, the way that web browsers, assistive technology, and the operating system all interact varies tremendously, and ARIA doesn’t always work. So you can get a combination of things where it’s not working on NVDA, where it does work in voiceover because you’re using ARIA. So again, a message I have to developers is, try to keep things as simple as possible. This is a usability thing as well. There’s not a day that goes by that my wife doesn’t hear me say, “What’s wrong? This website’s awful because of usability issues,” and that’s, quite frankly, still the case with higher education. Part of my consulting business is doing audits, not just accessibility audits, but doing just general accessibility and usability audits. And I have yet to find a college or university where I can’t write a 20-page report about the usability issues that a site has, and a lot of that has to do with people just trying to be too complicated.

John: We always end with the question: “What’s next?”

Mark: Fascinating question when it comes to technology, and technology changes so fast. So I’m going to tell this story. Again, I’ve been doing IT work for 45 years. Gordon Moore was the CEO of Intel and Moore’s law is that computing technology doubles every 18 months. He said that back in the early 1960s, we’re here in 2025 that is still the case. The challenge is that it’s difficult for us as humans to get our arms around exponential change. I like to share the story of the inventor of the game of chess. So an inventor comes up with this new game called chess. He takes it to the Emperor, shares this game with the Emperor. Emperor loves the game. The inventor says, “Here’s what I want for a reward on the first square of the chess board, I want one grain of rice, on the second I want two grains of rice, on the third square I want four grains of rice, eight grains, 16, exponentially. We’re going to grow that until we’ve done all 64 squares of the chess board. I ask people, “How big of a pile of rice do you have after you’ve filled all 64 squares?” People are amazed that that pile of rice is bigger than Mount Everest. When I started working at the University of Buffalo, 1987, we wanted to buy a Cray II supercomputer, biggest, baddest computer on the planet. Cost, I believe, $17 million in 1987 dollars. We even, as a research university, couldn’t afford it, so we rented time at Calspan down the street at $10,000 an hour. Anybody who has a second generation Apple iPhone or newer has more computing horsepower in their hand than a Cray II supercomputer. That’s what exponential change is. So in your mind, you’re saying, “That’s great. Over the last 30 years or 40 years, we’ve made that much progress. In another 40 years, we’re going to also make that much progress.” That is not exponential thinking. In the next three or four years, we’re going to make that much progress again. So to loop this back to kind of where technology is going and where accessibility is going and what’s next, one of the things I’m paying attention to is voice technology. I gave a talk at an international voice conference a few years ago and talked about how voice could improve accessibility, and it’s really interesting about what the application of voice technology can do, because it can free us from the interface of having to use a computer and a mouse, where now you don’t have to worry about a lot of the disabilities that come into play right now. So the future is multimodal, multi-surface interfaces, which can take into every combination of things and really address accessibility. I was very encouraged that at this voice conference, people are taking accessibility very seriously and trying to build some tools into the voice interface. Related to that is artificial intelligence, and many people are predicting that ultimately the user interface for AI is going to be voice. Now I go back to watching a Space Odyssey and thinking about HAL, and that interface with HAL was a voice interface, so I can see a lot of that coming, and there is real opportunity to address accessibility issues with that. We need to take caution in terms of how quickly we use AI to improve accessibility. One of the big controversies in the accessibility world now is the use of accessibility overlays, which are products and tools where they tell you a single line of code can be installed on your website and immediately address all of your accessibility issues. In the last couple of years, they’ve been talking about AI as the driver of that, the reality is they don’t work. And I am very disappointed in most of the overlay companies who are, quite frankly, telling lies about what these products can do. And for anybody who’s thinking about using an overlay, or currently using an overlay, know that that that can get you sued. There are actually a number of court cases right now specifically addressing the use of overlays on websites, so be very cautious about that. Also, a lot of talk now about how artificial intelligence can be used to remediate documents and remediate websites. I think there is a lot of opportunity there, but it is too early to have that working the way it should be working. For example, in Microsoft Word right now, AI will generate alternative text for you. My experience has been that’s good, maybe one out of 10 times. So you really need to pay attention to that. There’s an old quote. It’s known as Amara’s law, and it says we tend to overestimate the effect of technology in the short run and underestimate the effect in the long run. And I think that is the case with AI, where everybody’s kind of running out to say AI is going to fix everything today. Not the case. But I am very encouraged down the road about what AI can do. And let me just kind of close this with, I would be remiss if I didn’t mention a book in this talk. I have a tendency to mention lots of books, and a book I would recommend everybody learns is called Haben: the Deaf Blind Woman who Conquered Harvard Law. It’s written by a woman by the name of Haben Girma. I’ve actually interacted with her a few times online. She is just awesome and such a passionate advocate for people with disabilities. People are amazed that she could graduate from Harvard Law School being deaf blind, but she did, and she is a huge advocate for that. If you get the opportunity to hear her speak, she always is talking about how there is an opportunity for innovation when it comes and she’s encouraging all of the technology people to really think about innovation and how we can use technology to improve people’s lives. And that certainly is something I hope we see again, even as educational institutions going forward, how can we provide that platform for this innovation?

Rebecca: Yeah, that’s a great book. Thanks for recommending it. Thanks so much for joining us today. It was great to talk about accessibility, a topic I never get sick of talking about.

Mark: Thanks for having me.

John: And it’s a topic that all institutions need to be addressing to a much greater extent as we approach that deadline. So thank you again.

Mark: Thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

394. Pacific Oaks’ Approach to AI

Generative AI tools are challenging traditional models of college instruction. In this episode, Camille Huggins, Yolanda Carlos, and Orlando Saiz join us to discuss how Pacific Oaks College is working to use these tools to more effectively support student learning. Camille, Yolanda, and Orlando were participants in an AI Institute offered at Pacific Oaks College this year.

Show Notes

Transcript

John: Generative AI tools are challenging traditional models of college instruction. In this episode, we examine how one college is responding to more effectively support student learning.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guests today are faculty and administrators at Pacific Oaks College. Since we have several guests participating today, we’ll have each of our guests introduce themselves, describe their role at the institution, and state what type of tea they are drinking.

Camille: My name is Camille Huggins. I am a core faculty at the Pacific Oaks College for the last five years, and I’m Caribbean, so I like that strong Lipton yellow label tea. It has a lot of caffeine to it, it’s a good little balance with the lemon. New Yorkers, we love a lemon, no milk, so that’s what I’m doing today.

Yolanda: Sounds good. Camille, my name is Yolanda Carlos. I’m core faculty at Pacific Oaks College. I’m over at the BA and MA Early Childhood Education degree program, and I love Earl Grey with a bit of milk.

Orlando: My name is Orlando Saiz. I’m an administrative faculty and Director of Research at Pacific Oaks College in the EdD Early Childhood Education program. I normally drink coffee, but today I’m having the loose-leaf spearmint tea.

John: Very nice.

Rebecca: Yeah, some yummy tea choices for sure. John, are you drinking any tea today?

John: I am drinking a ginger peach green tea today.

Rebecca: Nice, John. I’ve switched things up, John, I have chai today.

John: That’s been a while.

Rebecca: I know, I know.

John: We’ve invited you here today to discuss the AI initiatives that you’ve been working on at Pacific Oaks, located in Pasadena, California, where it’s much warmer than it is here today. So first though, could you tell us a little bit about Pacific Oaks College and its institutional mission?

Yolanda: Sure, I’d be happy to. So yes, you’re right. The weather here in Pasadena, year round, is beautiful, and the Pasadena Children’s School began in Pasadena, California in 1945. It was started by six local families as a children’s school, which believed that each individual possessed an inner light worth nurturing. It later became a teacher training institution founded on Quaker values of community, equality, and peace, which would offer a progressive education that would help the world heal. Pacific Oaks College was established in 1958. The mission of the college is to train future professionals to be of service and positively impact their communities, to help, and not harm them. Presently, the college is focused on building competent professionals who are culturally aware, respectful of the communities they serve, open and willing advocates focused on justice, fairness, and prepared to advance or lead in their profession.

Rebecca: Our institution has a somewhat similar history in that it started off as a teacher prep institution as well. That’s kind of fun to hear a related story. Can you talk a little bit about the student population at Pacific Oaks?

Camille: So we have a majority is online. 80% of our school is online right now. So we have a combination of asynchronous, synchronous courses. We still have some on the ground students, because we transitioned from on the ground to online during the pandemic. So around 2022, 2023 it became that perhaps this works better, because our students were more interested in doing online courses than on the ground courses. Our typical student body… we are a Hispanic-serving institution…. are Latino middle-aged women in their 30s to 40s. They are working, they have children, they’re married. So sometimes English is not their first language. They have maybe went to school. If they went to our bachelor’s program, they may have had some remedial courses or whatever. But if they are in our master’s degree courses, which is a lot of our courses, they would have gone to college, but they’ve maybe had a gap between bachelor’s and master’s about eight to 10 years. So the academic acumen is the issue when they first get to school. So we have to spend a lot of time really trying to hone in on their learning abilities and basically help them get themselves to match what the rigor of the program is. But yeah, we love these kind of women. They are in the trenches. They are not into lofty ideas. They’re into really learning the skill sets that they are basically trying to gain because of our programming, which is marriage and family therapy and social work and education. It’s a very professions-based kind of school, so they spend a lot of time really getting skill sets, being practical. They’re very practical in understanding what they need to know, and we really help them with their skill sets.

John: In November of 2022, ChatGPT appeared right before finals at the end of the fall semester, and it resulted in some fairly significant effects on higher ed, how did faculty at your institution respond?

Yolanda: Some instructors embraced ChatGPT initially quite readily, and others even used AI apps for assignments to enhance them. Other faculty were hesitant and wanted more information. P.O. is a smaller higher ed institution, and with that being said, we have the ability to be nimble and to add changes to our assignments as needed and to keep up with best practices. P.O. is part of The Community Solution (the TCS) system. It’s a centralized infrastructure and culture that supports six higher ed education institutions. In the spring of 2023, TCS provided a conference space for our system faculty to showcase AI, living out the mission of embracing a culture of learning. So faculty across the institutions presented and all worked collaboratively in experiencing AI in a variety of modalities at our central location in Chicago.

Camille: So I think, how did we embrace it Is that, for the students, we kind of looked at it as a plagiarism kind of situation… so punitive, this is going to stop them from learning blah, blah, blah. And as we got into the AI Institute for the AACU we discovered that this can really help the students. We said our student body is first-generation women, mostly Spanish-speaking, different languages, and so forth. So AI can help them with writing. AI can help them getting their thoughts in order. A lot of times, these students ask, “How do you want this assignment to go? How do you want this assignment to look?” And I thought, AI can help them in that avenue as well. The more you saw a lot of these applications come in ChatGPT starts it off, but then you got Deep Seek, you got Claude. You have a lot of different platforms. You realize that this can really be used to help them educationally. So for us, as faculty, we maybe have been using it secretly. I started using it just to do emails, you know, “write this nicer, put my thoughts and write it nicer,” but we started to not look at it as a negative, but this can be the mechanism of the future. It’s like autocorrect. I can barely spell, but autocorrect makes me look as though I’m passing national spelling bees.

Orlando: I’m relatively new to the institution, so I wasn’t around in 2022, I was working at a different institution, but right away, I was invited to join the AI committee at our school, and I found it very interesting the tools that were available that I was completely unaware of, and just to see how there’s certain programs and GPTs where they can serve as a tutorial and be of service to students, faculty, it’s just amazing. I’m very much looking forward to what the future holds.

Rebecca: So you’ve kind of given us a little bit of a base for how folks were initially responding to AI. Can you talk a little bit about ways that faculty are now using AI to support the educational mission, whether that’s in curriculum or educational activities or other uses?

Yolanda: Recently, I’ve been focused on the basic logistics in application of AI, student use to complete assignments or to create assignments. And so, for example, there is in one class a poem they have to develop. And with that, I used an AI tool for them to download, a free use, to put in their poem, and this AI app creates a video with music, with words and with pictures, and it brings to life their poem. And the students were really excited about that. It really helped to bring that assignment to the next level and then at the institutional level, our Pacific Oaks college AI team has been working on developing the institutional policy for AI usage, for students, faculty, and our community, for example, we believe that it’s important for students to submit their assignments and documents in a format that can be screened for AI usage by the systems that are made available to faculties for screening Word documents. For example, we use Turnitin. We want students to be able to generate and create their own content and use AI as a support for developing ideas, not writing their papers for them. So as an institution, we’ve been engaged in critical discussions and in planning around the use of AI in the classroom, and then also distinguishing the human element, or the connection, versus automated AI machinery, tools, and apps. We encourage the using of AI for brainstorming, creating ideas. This should always be followed by student-created content, rather than the use of AI tools and prompting to create or develop assignments.

Camille: To add to that, I’m the chair of the Faculty Council for our college. On a macro level, we basically engaged in a lot of conversations. We’ve had a lot of staff meetings with the adjunct faculty as well as regular faculty, about AI and how to engage with it for ourselves, as well as for our students. Another thing we did was, as Yolanda said, we are part of a larger system of six universities, we invited the larger system to come in and do a two-day training on UDL (universal design for learning) and then AI. And we’ve been looking at making collaborative initiatives between the UDL and the AI systems to basically incorporate it in our classes as well. Another thing we’re doing is working on a policy, it’s a working policy, as Yolanda situated, but also we have not really introduced it to our students. So that’s our next part of our journey is basically how to appropriately engage students and basically give them a demonstration. I think students really benefit from a demonstration. They definitely, when in online schools, they really benefit from one one-on-one personal interaction via Zoom. They really like it. So that’s what we’ve been working on as well.

Orlando: Just to add to that, in advising doctoral research students, some of my students are using AI platforms to organize their sources. They can engage in mind mapping, and I think it’s a helpful tool for the literature search, even though I don’t think it’s a good idea for them to fully rely on that. I think a good mixture of human capacity versus AI platforms and tools to complement each other are important.

John: Let’s go back to the use of AI to support UDL. Could you talk a little bit more about how AI tools are being used to support a universal design for learning approach in the course?

Camille: So UDL has a lot of different facets to it, audio, visual. What I’ve really been looking at is the growth mindset piece, because what we’ve noticed with some of our students, I’ve been doing some one one-on-one. We’re gearing up to do focus groups with them. We got a small grant to basically implement UDL in the entire college. And so what I noticed with our particular students is that they don’t want to necessarily identify as having a learning disability. That’s just not their thing. But what they talked about, in a very roundabout way, was the lack of confidence, the lack of really being scared to look for assistance. So I was thinking that we need to implement a growth mindset kind of component into our teaching modes, as well as, and AI can help with that, because it can help give you courage to ask questions. You can ask AI to look at how we can integrate: “I’m having difficulty understanding this assignment, I’m having difficulty understanding this article. Can you break it down for me so that you can make more sense?” So integrating an AI component with the UDL will help enhance their learning abilities. So that’s what we’ve been kind of structuring. And I heard from the students that they really were having issues with just self confidence, which makes a lot of sense based on the fact that they haven’t been in school in years, and everything is just moving at lightning space as far as learning acumen. So that is one way.

John: One of the things you mentioned earlier was that students come in with fairly differentiated backgrounds in terms of their prior knowledge, and they have to get up to speed. Have they been using AI to help fill some of the gaps they may have had in their prior learning experiences.

Camille: I’ve noticed it in their assignments, yes, but what I’m learning is also they just put in the assignment, but they don’t put in the reading material. So the assignments come across very superficial and not necessarily depth of critical thinking or any kind of reflection of the reading. So the AI won’t even put in references in it, so the references won’t match what’s in the coursework. So getting them to not use it in the underhanded way… You’re using AI, I have no problem with you using it, but it has to be used to assist you, not do the work for you, and that has been the bridge that we’re trying to cross.

Rebecca: You mentioned the large percentage of your coursework being online, and I know that faculty, in a lot of our conversations around AI, have been really concerned about using AI in online environments, because it’s a little bit harder to distinguish the human from machine-generated. Can you talk a little bit more about ways that you’re helping students move in the direction of the assisting and not doing it for them, so where it’s not an academic integrity issue?

Yolanda: So, what I’ve been using is what’s called the AI sandwich. I’ve been working with students to help them understand how they can use AI like, for example, if they have a topic, but it’s really broad, to helping them brainstorm using AI to narrow down their topic or to develop ideas for topics, and to help them to create and understand how to develop a good, concise thesis statement for their topic. And then, with that being said, the next step is how to gather their data, so using AI to create questions for interviews, for surveys, and then methods for data collection for their action research project. But with that being said, then I go into the humanization of AI, and I shift the focus to our model for P.O. It’s the head, heart, and hands model. I talk to them about, when we’re completing assignments, it’s not just to complete the assignment, but it’s to gain that knowledge, not just to regurgitate it, but to have that passion, because then it’s in the heart. So it’s the knowledge in the head, the passion in the heart, then our practices, our hands, that comes forth in our practices, and that sets us apart from others, and that’s something that AI cannot do for us. That’s something that we as the human, that’s how we humanize the use of AI, but the human-to-human, I talk to them about how AI has helped you generate these questions, these surveys, but you’re going to be conducting these interviews, you’re going to be writing the anecdotal records. You’re going to be taking the raw notes and submitting those, perhaps maybe taking voice recordings or video, but then we can take AI to help organize those for them, so that then they can maybe create their outline, and then they can submit their papers. How I do it is they submit it in chunks, and then I review and we’re in revision state, and I provide feedback. The feedback I provide is using a tool called VoiceThread where I provide specific assignment feedback using what’s called VoiceThreads, where they can see me, they can hear me, and if they need to, they can also see the wording as well. So it touches upon all learning modalities.

John: I have used VoiceThread in the past, and I’ve really enjoyed it. I had to drop it because my classes were large, and just listening to all the audio responses took far too many hours.

Camille: I know Orlando, you did some AI stuff. You’ve been doing it in your doctoral program.

Orlando: Yes, just thinking about most of the students that I teach are at the doctoral level, and most of them are engaging in doctoral research. So if you consider that traditional approaches versus futuristic or current approaches, most of the material that students are engaging in at that level is meant to be challenging. They need to learn research and it’s important to learn statistics and different methodologies. So I’m super open to new tools that they can use, but it’s difficult to substitute AI tools with general educational tasks that are meant to help students advance and to gain a wealth of skills. But some of the newer tools that I’m becoming aware of, and that I’ve noticed could be helpful as a tutorial for statistics and for research methods, even research design. There’s one called Julius AI, where you could drop your data in there and it can spit out a result. If it doesn’t spit out the right prompt for you, you can re-prompt it until it gives you what you want. I’ve tried it with simple data that I’ve had, running a correlation. It gives you everything you need. So I mean, if students are struggling with conceptualization or just to have the right terminology, because it is important to verbalize your research in a way that’s accurate and specific. So I think the AI tools could truly help for that, as well as general organizational tools. NVivo is another research tool that students are using. I’ve used it in the past as well. It is fueled by machine learning now, so creating those hand-coded or manual themes that was done in the past is probably going to fall a little bit by the wayside, but I still think there’s some value for students to learn the traditional way and to mind the author’s recommendations from grounded theory and from phenomenology. I think there’s some real value in that, and they could really showcase the ideas that they have. My exposure to AI is relatively new, and it started when I began teaching here at Pacific Oaks and I joined the AI committee. My doctoral program is very new. This is an inaugural class, and previous development of the doctoral research manual included a passage for plagiarism, to guard against plagiarism. After reading some material, particularly AI for Teachers, by Jose Antonio Bowen. I noticed the finding in there that faculty generally do not do well recognizing AI passages versus AI itself. So I thought this is something that I need to step up, and it has to do with academic integrity. So I wrote a follow-up passage to that where students’ work will be detected for AI passages. It doesn’t say how many passages or the percentage, but I think it’s going to be important for students to understand that they can’t just copy and paste their whole doctoral dissertation and that be acceptable, and there has to be some systems in place to guard against that.

Rebecca: So you’ve mentioned using Turnitin and tools like that to detect AI. Can you talk a little bit about ways that you’re managing false accusations or false positives on AI use?

Camille: So I don’t really trust Turnitin. Let me just put it out there as a misnomer. I feel as though sometimes they see as plagiarism, and when I actually look at the paperwork, it’s like they use the same word the 10 million times and it’s been picked up. So I don’t know if I don’t trust Turnitin or I don’t know how to use it properly. We put it out there like that, and so I don’t really rely on it as much, especially for those who English is not their first language. What I’m looking for is execution of how they write. When I did my PhD, I wished there was a ChatGPT back then, I had to hire an editor who was from another country, and that scared me. I was like, I’m paying you, and I was born in America and speak English, and I’m paying you… she was like from Ukraine or Russia… to edit my paperwork. So because of that, I had to learn how to write. Something about that was not sitting well with me. So I had to learn how to write. And I felt as though ChatGPT and one of these things can help you to learn how to write. In Spanish, the adjective comes after the actual noun, whereas in English, it comes before. And so I thought that this would help them. If, in fact, they can learn how to write, I can overlook plagiarism. What I can’t overlook is them not using the readings and the learning resources that I provide for them. I grade on how they write, and that’s really good, but I also grade on use of learning resources, and I think that that was more important to me than the other thing. Another thing is a lot of them don’t know how to use it properly, so they don’t even see the attachment upload document to put in their articles. So that tells you that maybe sometimes they’re just cutting and pastes. And if you’ve never noticed in ChatGPT, they’ll say the same thing different ways, and it’s up to you to pick up on which way to say it. So me catching them there has been very helpful. Orlando’s correct. Sometimes you can’t tell, but then that’s good, because then you’re learning how it’s supposed to be written in the first place, and then ChatGPT also has a lot of spaces in between, so I’m teaching them not to cut and paste. I want to teach them how to use it in a sense that it can craft a paragraph for you, as opposed to you just cutting and pasting. So catching them in that area has been helpful to me. But again, I will say I don’t know much about Turnitin. I don’t trust your plagiarism readability. So I go in that direction.

Yolanda: I agree Camille. They also have a disclaimer in there, so it kind of is a little bit on the nebulous side. And typically, when I go in and I look, because I think that’s a humanization of anything that we’re going to be using, it still requires us to take that step, to go in, to look at, and to make sense of the meaning of what has been submitted. And then I agree with you. We’re looking for content. Do they really understand this content, and can they apply what they’ve learned? Are they applying this in a real case scenario. But when I’m looking at Turnitin, it flags references, and that tends to be the large chunk of it. When I can see that it’s flagged references. And I’m looking to see, are they in seventh APA edition? Yeah, they are. It’s flagging them because they have submitted this in the revision before this. And so those are things to keep in mind as well. Nothing’s perfect, but it’s learning how to use the tools that we do have available to us that’s important.

John: So you’ve all talked a little bit about how students are using AI, and Camille mentioned how she’s used it to help shape emails. Are many faculty using AI to help develop curriculum, to help develop learning activities, to create various scenarios or other ways in supporting their instruction.

Camille: It has really helped me, and I think other people are doing it too. I’m in the social work department. My other faculty have not caught on as much as I have, but it really helps me with case studies, because my classes are more applied. It helped me develop case studies that make sense. They have better characterizations, like they’ll sit there and say, identify mental health symptoms and then identify environmental stressors. And I was like, “Yeah, I never thought about creating it in that way.” So I think that has been very helpful. It has helped me create quizzes, exams in a lot of ways. So I’m in love. I’ve subscribed to ChatGPT as well as Claude. I’ve been trying out Deep Seek and you know, the platforms can go on and on and on. We were just told that there’s an AI for curriculum development that’s specific for lesson plans and so forth. So I’m going to look into that as well if there’s a free trial. So I’m into it big time, my colleagues, not quite yet, I don’t think. And I’m also a writer, so it helps me with contextualizing ideas and in figuring out what’s out there right now, and so I can look at different articles. I think Deep Seek is pretty good when it comes to accuracy and references, because I check it constantly against what’s in there and what’s outside. But I love it, and I think this AI Institute really opened my eyes to the vast applications that are out there that I think we all should know and not get overwhelmed by. It’s like Bitcoin. You don’t know what’s going on, but I’m really excited about it.

Orlando: Yeah, for myself, I tend to use Copilot. I think it’s helpful, since it’s kind of integrated into the browser that I use, and it’s helpful to summarize long passages, to bullet point them. But also, as a writer, I use it if I’m struggling to find a source. I’ll just drop a prompt in there, and it’ll help me to generate a few more sources that I wasn’t aware of. But at first I was a little resistant. I was just unaware of how it worked and how it operates. But I’m starting to learn more and more, and I do still have a concern about privacy, so I won’t drop students’ whole papers in there, just because it’s not my work. It’s something that I’m not in charge of, and is not my property. So I’d rather just kind of use it in a broader sense, just to kind of quicken my pace in the work that I do.

Camille: I just want to put it that a student told me about ChatGPT. That’s how I first learned about this whole thing in the first place. And I always say I talk to young people because they know and keeping up with them. I’m 53 and I officially have no idea what’s hot anymore, what’s happening. I’ll have to admit it, but this student was like, “Why aren’t you using ChatGPT?” and I’m like, “What are you talking about?” And when it came I was like, “Whoa, this is just next place to go.” So I’m open to it, because the young people know about it, and I’m glad that they have it, because it makes life easier. But you have to know how to prompt. I think that was the biggest thing. Learning how to prompt it and yield it to what you need is what been the biggest challenge.

Yolanda: For me, I have mainly used the app. So initially I discussed how I used one for a poem, and it was Lumen5. It’s an animated avatar video program that they download for free, and they’re able to create this beautiful video with the poem that they developed and they created. What’s really cool about it is that they get excited about an assignment that before was just something that they just went through and they just jumped through the hoops. Well, now with that Lumen5, it’s just kind of has brought things to the next level, and I also use ITSE standards for educators. It’s how to use AI and AI tools for educational purposes. So that’s something that I do and use, and I’m stretching and finding new apps at different times, and then having students go in. I use it as kind of like a pilot program. I’ll pull it in, and I’ll say, “Well, this time, we’re going to use this.” And I’ll say, “it’s not mandatory. Those that you want to use it can use it. Those that don’t want to use it can use the regular standard assignment.” And it’s amazing to see that the majority of them choose to use the AI tool.

Camille: It also creates flyers, if you do that. And it has helped me with ethics applications. So, yeah, it’s a part of my life. It’s on all my laptops [LAUGHTER] and my computers. It’s kind of embarrassing now, but people say, “Oh, you’re leaning on it too much. And if you lean on it too much, it becomes they take over your ability.” But I’m directing this. I’m still involved. I’m the creative director of what I will use and what I won’t use, and I’m still a part of the equation. They haven’t taken me over, have they?. This is the kind of philosophical questions you ask yourself.

Yolanda: Amen, that’s the humanization of AI.

Rebecca: I think one of the things that I’ve heard you all talk about today is that the AI Institute gave you some concentrated time to practice and explore and learn, and kind of set that time aside so that you had the time to do that. I think often it’s one of those add-ons, like in my free time that none of us have, that we might explore these things. So it seems like that dedicated time was a really valuable and important investment for each of you to really integrate it into your work.

Camille: Yeah, we had a staff meeting because, you know, again, our Senior Vice-President of Academic Affairs, he’s really interested in it to kind of go, how can it be used for our professional use? And I remember my colleague and I, we created a case note: “How to Write a Case Note through AI.” And I think that just was, like, blown away. The other faculty were like, “Wow.” If you know anything about social work, you could write it as a SOAP note, which is a subjective objective assessment plan. You can use it as a DAP note, which is a diagnostic assessment plan. So we used it as a demonstration about all the different ways you can write case notes. Now there are AI systems to help with case notes in social work agencies which Is like: you put the paperwork in, put the information in, and they will create yourself an intervention plan. So I think that’s the good thing about Pacific Oaks College, because we’re such a profession-based kind of college, you’re teaching Marriage and Family Therapy. It’s one of the biggest marriage and family therapy schools on the West Coast. And then social work we just got basically a couple of years ago, using AI to help with you as a professional, I think has been great. So doing it with the teachers was the first thing, faculty, and now we’re going to try to see if we can do it with the students.

John: So you all participated in the institute. What proportion of the faculty participated in the institute? And do you still have some faculty who are resistant to trying AI?

Camille: For the Institute, it was seven of us. Three of us showed up today, but the seven of us. One, the Dea,n has moved on to another position, but everyone else has maintained. has stayed. More and more people are interested because of the fact that we’ve been doing staff meetings. And I was very surprised, because when I set up the TCS, which is the system-wide AI and UDL classes, it was like three hours of their time Monday and Tuesday, and everyone showed up. Everyone showed up. Everyone’s interested. And every time we do it, they’re like, “Wow.” Every time you see in the chat, “This is mind blowing.” So I think they’re interested. But we haven’t done anything formal to basically quantify how interested they’ve been and how involved they’ve been, but we’ve shown to them, AI is here to stay, it is valuable, and it can be used by anyone.

Yolanda: I believe we have developed a survey tool that we’re going to be sending out to faculty. So that’s something that we’re going to be looking at, gathering the data of their familiarity with the use of AI. And then I think we’re going to do a pre- and then a post-, and then we’ll probably then follow up on that, because that will denote the need.

Orlando: I think, as well, at other larger institutions, that have decided on a specific platform to use, as far as AI, and how to integrate that into the school’s existing tools. We’re still in the process of deciding about that. I know some of the schools, they use a paid version of ChatGPT or CoPilot. We’re still in the phase of selecting the best platform, but I know there’s some good options out there, and I think it really will add to and cause us to progress in our programming.

Rebecca: So we always wrap up by asking: what’s next?

Yolanda: So preparing for the unknown. What I would say, first is we need to focus on relationships, the ability to connect with others, so that they can collaborate and work in teams together, because this is the 21st century workforce need. Second is helping our students with resiliency, I also like to call it flexibility, because the one thing that is constant in life is change. That’s the one thing that we can depend on, is change. And resiliency is the ability to push through obstacles and to have the confidence to act on the new knowledge that they have to create the change they want to see in the world. And then lastly, this is a P.O. core value is reflection. All of our assignments generally have a reflection piece that’s weaved in there for them to reflect upon. So I always tell them it’s important to stay humble enough to reflect upon changes that need to be made, and then the courage to act on the next steps that need to take place.

Camille: What’s next? Institutionally speaking, what I like is the fact, though we are a part of a system which is TCS and the six universities, the wisdom of the President was that he didn’t want a uniform AI platform for each school. He thought that we have a law school, we have a medical school, they’re going to need different kind of AI platforms than us. So we have been given the authority to autonomously pick our own AI platform that will work best for our particular students. We are keeping our students heavily in mind. We want to make sure that AI is used ethically and with integrity, but while being helpful to them. So we’re rolling out a policy that’s going to help them in that sort of way. We are also redoing our plagiarism handbook and basically incorporating AI and making sure that that kind of meets and it’s more seamless. We are definitely trying to pick a platform that kind of works for education, marriage and family, and social work, three different distinct professions, but yet very similar in a lot of ways. We’re also working on an AI manual, to some degree, to basically figure out how all the different components that come with AI, rethinking it and reshaping it. We have not done a review of our faculty manual in about 10 years, so that’s also being incorporated. We’re in the midst of change at Pacific Oaks, so AI came perfectly so they can be instituted in our paperwork and our regulations.

Orlando: As an institution, I think we’ll continue to serve as possibly thought leaders for the topic of AI. A lot of us are integrating it into our work, and I can see that continuing in the future. I think we all have a great idea about responsible use of AI, and I think that will definitely continue. Personally, I’m working on writing another book chapter. Most of my materials have been on doctoral researchers. So this new chapter is about doctoral research agency, where it’s based on a lot of material I’ve been looking into. Part of that should be focused on helping students to adapt and prepare for the future. As Yolanda noted, I think the skills of adaptation and integration are important, and AI could definitely help with that process. And yes, overall, just using AI to help prepare students for the future, whether it’s in the job market or for personal enhancement. I think that’s all important, and we could definitely motivate students in that way and help them to navigate that process.

Rebecca: Well, thanks for joining us. It’s nice to have a little case study of how a particular institution is working through AI.

John: And this is an issue that all campuses are facing. So it’s great to hear how you’ve been addressing it. Thank you.

Yolanda: Thank you for having us.

Orlando: Thank you.

Camille: Thank you so much. I hope that we were informative. We’re trying to move to cutting edge while keeping our tradition and our principles.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

380. Chatbots to Support Learning

Generative AI tools have made it easy to create custom chatbots. In this episode, JeVaughn Lancaster joins us to discuss the process of creating chatbots and some potential uses in higher education. JeVaughn is the Manager of Instructional Design at Lynn University. JeVaughn’s work using generative AI to support effective course design resulted in a Best in Track award at the 2024 OLC Innovate Conference. Some of her more recent work on this topic was presented at the OLC Accelerate Conference in November 2024.

Show Notes

Transcript

John: Generative AI tools have made it easy to create custom chatbots. In this episode, we discuss the process of creating chatbots and some potential uses in higher education.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is JeVaughn Lancaster. She is the Manager of Instructional Design at Lynn University. JeVaughn’s work using generative AI to support effective course design resulted in a Best in Track award at the 2024 OLC Innovate Conference. Some of her more recent work on this topic was presented at the OLC Accelerate Conference in November 2024.
Welcome, JeVaughn.

Jevaughn: Hi. Thank you for having me. I’m so excited to be here.

John: It’s good to see you. I saw you at your session, which is what resulted in this invitation. So we’re really glad to have you join us. Today’s teas are:… JeVaughn, are you drinking any tea?

Jevaughn: I actually do have tea. It’s been my heart and soul for the past couple weeks, I should say. It is a ginger honey tea, but I added a splash of soursop. I don’t know how to explain what a soursop is. So you can drink just that one. [LAUGHTER]

Rebecca: …sounds good. I have a London Strand breakfast.

John: And today I have a Darjeeling tea.

Rebecca: So, today we invited you here to discuss your work developing GPTs to serve as chatbots that support faculty. Can you start first by describing what a custom GPT is, or maybe even what a GPT is? [LAUGHTER]

Jevaughn: Oh, yes, that is, I feel, the perfect way to start before we talk a little bit deeper in what a custom GPT is. GPT really stands for generative pre-trained transformers, and a lot of people really get that confused. But when we say generative, that’s exactly what it does. It generates content based on a multiple of things, like patterns, responses to questions. A lot of people know ChatGPT as the essay writer, [LAUGHTER] lo and behold, but that’s really generative. So it generates things. Then when it gets into the pre-trained aspect of it, it is trained by a huge data set of information that people feed into the GPT. So every time somebody enters a prompt, it continuously trains it and builds that data set to be a little bit bigger. And then the transformer part. I like to always say that the transformer part is like a multitasker, so it puts all those little data bytes and pieces together to analyze it. So it’s almost like using a learned language. It identifies a variety of patterns, and again, like I said, it’s a multitasker. So it brings in all of these bits and pieces of information and then generates the response to your prompt, making it a GPT. So with that said, a custom GPT is really dedicated to a specific task of something that you do often on a daily basis, that you just want to make your life a little bit easier so you want to customize something for your immediate needs. So I really think that’s what a custom GPT could be, in a nutshell.

John: So in order to create one of these custom GPTs, you do need a paid chatGPT account, and initially to use one, you needed a paid GPT account, but that’s changed. Are there any restrictions on the use of GPTs that others create for free users?

Jevaughn: Yeah, you’re right. So before, when someone created a GPT, in order to share that, the end user would also have to have that paid subscription. But now with the updates, it’s so easy, because what happens is that the paid user can create a GPT and then share that and as long as you have an account set up, a username and password, it doesn’t necessarily have to be paid, you’re able to then use that customized GPT.

John: So that means that instructors can create GPTs for their students, and people in professional development roles can create GPTs to share with their faculty, which is what you were presenting on there.

Jevaughn: Exactly, and I feel that it makes everything so much easier, because you have those that are really into it, and they’re creating all different types of customized GPTs on so many different topics. And then those that may not be as great with technology that they’re not really able to put these things together. However, it’s so easy to use by adding in those prompts, it’s already built and customized for whatever it is that they need, so it really makes life a little bit easier. Now, there are a couple things that a free subscription might struggle with, even when using a custom GPT, and there are a few restrictions that they have. So, for example, tokens, they won’t be able to submit as many prompts as someone else with a paid subscription. Or if there are bandwidth issues, if there’s a lot of people using ChatGPT in one instance, someone with a free account may struggle. They may have a lot of slow responses to their GPT.

Rebecca: At OLC Accelerate, you provided a presentation on creating GPTs? Could you describe the process of creating a GPT?

Jevaughn: Absolutely. Oh, my goodness, that’s the fun part. And I think a lot of people feel that it’s a lot more difficult than it really is to do. It’s so simple. So when you’re logged into your ChatGPT account, there’s a little button on the left side that says, “Explore GPTs.” Once you click on that, it’ll open up this toolbar, and on the right side, you click on it, and it says “Create.” And it has a list of prompts that you can follow along to really help you build your GPT. It’s going to ask a description. So there’s where you say this is what this custom GPT is going to do. You can keep it short, sweet and to the point, because it is what it is, it’s the description. And then after that, it’s going to ask you some instructions. So what are you going to instruct that GPT to do? And this part is really important, because it’s almost like guiding the GPT on what to do. You’re training it. And just like any other GPT model, you have to train it and you have to fine tune it and customize it to fulfill your needs. So because of that, you want to add in things like, if you’re building rubrics, what are those specific criteria that you want if you ask it for a rubric, if you’re using it for grading, you’re going to want to have to put in those specific details: “Well, I don’t want my feedback to be more than 100 words,” or “I want it to be in a nice tone.” You really have to give it these specific instructions so that your GPT will give you the output that you’re really looking for. So after you do the instructions, there’s a section called knowledge, and that part is really important, because there’s where you can do things like upload specific documentations that you want your GPT to pull from, and that’ll give you more straightforward responses. So rather than ChatGPT searching random articles or information that it finds on the internet, it’s going to first go by the knowledge you provided. It’s all part of the GPT training. So for example, at OLC, we created a GPT that was almost like a teacher’s assistant. And it was important because we found that a lot of faculty members struggle with learning objectives and how to create it and align it. So with that, we took the Bloom’s Taxonomy chart, and there’s some people that still like the old Bloom, some folks like the new Bloom’s. Then there’s the digital Blooms. So to make everyone happy, we uploaded all three [LAUGHTER], so there’s no discrepancy at all. And then there’s many specific things that you can also add in. So if you’re looking for things that have to do with universal design for learning, you can link to the UDL page from CAST. There’s so many things that you can do so it can give you that information that you want when you ask it as a prompt. So all of that is going to be built out into the knowledge section. So you’re building something that you can utilize to help you with your information. If you are conducting research, or if you’re using it to help you with research, you can link specific databases that you would use so you find those peer- reviewed articles. There’s so many things that you can do to train it, and then, hey, if you find out something’s not working, you can edit it and fix it and go back. [LAUGHTER] So after you finish adding your description and giving it your instructions, you can then also give it some talking points. You know, when you log on to ChatGPT, sometimes it’ll give you four different options. You can add in question prompts. You can do that, and then you can say, “Okay, now that we’re done, what are we going to name you?” And it’ll offer you suggestions for a name, it’ll offer you suggestions for an icon image, and you can generate it, save it, and you have your custom GPT. [LAUGHTER] Again, it’s a lot easier to accomplish than it seems.

Rebecca: I know it sounds so intimidating at first, like, make a custom GPT is like,” Ah, I’m not qualified.”

Jevaughn: Yeah, it does. It does. And then when you get into it, it’s just like, “Wow, I really just did that all by myself,” [LAUGHTER] and you can customize it down to how it’s responding to you. I have a friend and a colleague that has it sound like a Southern belle every time it responds to them. It’s amazing, the things that you can do with your GPTs. You can really customize it and personalize it.

John: And it’s really no more difficult than just interacting with ChatGPT in other ways. When would you use a custom GPT rather than just interacting directly with ChatGPT?

Jevaughn: I think if you want specific tasks done, because there’s so many times when you are working with just regular ChatGPT, you have to prompt after prompt after prompt until you really get the output that you want. If it’s a task that you’re doing 10 times a day, it’ll be more stressful sometimes, I think, in my opinion, to continuously prompt to get things down to right where you want it, rather than have this custom GPT that I can upload an assignment that I just created and say, “Hey, can I have an analytical rubric off of this and it’ll just give me the output that I need immediately with one question.

Rebecca: Are these custom GPTs less subject to hallucinations?

Jevaughn: I think so. I think that they really are, because once you feed it that information, and once you feed it that knowledge, it’s always going to pull from there first. Now, there’s something that I have noticed, when a lot of faculty members try to look for content, it’ll definitely hallucinate a lot of links. So a lot of the links are always, I feel, fictitious. You would click on it, you’d get the 404 code. You’ll get “this video no longer exists. However, if you actually search for that author, you’ll find it, 9 times out of 10 you’ll find it. So I feel that it’s definitely reduced the amount of hallucinations. And then in your custom GPT also, if there’s a database that you frequent that some people will link it to Google scholar or something that may not be behind a paywall, you’ll be able to go right to it as well. Or I’ve even suggested that with those links and titles that the GPTs might give you, log into your institution’s library and see, 9 times out of 10, you might find it there too. So yeah, in my use I’ve noticed that it reduces hallucinations.

John: Going back to your earlier response, where you suggested that it’s good for things that you might dorepeatedly, you’ve also suggested that it could be good if you want to create something that you share with others. So could you talk a little bit more about how faculty have responded to the GPTs you created to assist faculty? Have many faculty been using it, and how have they reacted to it?

Jevaughn: Oh, my goodness, my faculty absolutely love it. [LAUGHTER] They love it. And then also they’ve had suggestions to take it to the next level. It’s incredible. So first and foremost, I mentioned those pesky learning objectives. For whatever reason, it’s hard for a faculty member to think about alignment in the sense of using those specific words. They’re definitely experts in their own areas and maybe teaching and pedagogy is not one of them, so sometimes it could be a little bit more difficult. So one of the main things that all the faculty love is those learning objectives, because they can say, “Hey, I need this aligned properly.” Now, one thing that I did receive was that some faculty members noticed that when I first created it, they noticed that it wasn’t aligning to the correct course level. So maybe a 100-level class was getting “create” or something in the higher levels of objectives. So I had to go back in, I refined the GPT and say, “Hey, if a faculty member asked for 100-level, I want it to align with these levels of Bloom’s. And if it’s a 400 level, I wanted to align with these levels of Bloom’s.” So then once you regenerate it and you save it now, hey, as soon as somebody reopens the link, they’re getting all of those updates in real time, so now they’re able to help with their alignment a little bit better. So their suggestions really come in handy. I appreciate it. I listened very carefully at those.

Rebecca: Can you talk about some productive uses for GPTs to support instructors and students?

Jevaughn: Yeah, definitely. So for faculty members, I already mentioned those rubrics, there’s rubrics, and that’s such a time saver right there, because I know that that’s really my pain point when it comes to course development. So yeah, there’s a lot of things that faculty members and students can use customized GPTs for. So, for example, I’ve seen a lot of faculty members use it to create lesson plans. We have two and a half hour block scheduling, and there’s many times where some faculty members teaching four classes in a block, it’s tough sometimes for them to make sure that they have their daily lesson plans. They create timed daily lesson plans to keep them on track for their two and a half hour block. Quizze, is straightforward. You can upload a PDF chapter and say, “Hey, can you create me a quiz with 20 questions?” And you’ll be able to get those and of course, you’ll have to tweak them a little bit. I would never say, to take whatever it is that a regular GPT or a customized GPT, and just copy and paste and put it in your class. We don’t want to do that. As educators, we always want to fact check anything that any type of AI gives us. But again, it’s a time saver. You want to help save your time and your brain power to do tasks that will more benefit the students than staying and creating rubrics. [LAUGHTER] Discussion questions is a really big use case, and I’ve seen faculty members do this for both asynchronous and face-to-face classes. For the asynchronous that’s really self explanatory, but for the face-to-face classes, I’ve seen it really help the discussions flow nicer in the classroom, because now, if the faculty member is discussing an article or a chapter, they take that same article, run it through ChatGPT, and they ask for discussion questions. And it really helps enhance the course, because they get brand new course discussion questions every day, or if they’re teaching it multiple times throughout that block, each class has a different question and a different discussion, which really, really helps. Feedback and grading, I already talked about that. A big use case is accessibility needs. Now accessibility is growing, and UDL, we preach all the time, and there’s many times where you just can’t figure out how to make an assignment accessible, but you can get those suggestions from ChatGPT as well. Now, on the student side of it, it’s awesome because students can use it as tutors. And I know that I was telling them at OLC that I created a custom GPT for my son in math, and it’s just an adaptive learning so it’ll provide, depending on how you create it, the one that I have will provide multiple questions, and he’ll have to answer it, and if he gets it wrong, it’s adaptive. So it’ll break the question apart and say, you got this part correct, this part correct. But let’s focus more on this step, and it’ll take him on a step-by-step journey. And then after he completes 20 questions, he gets a report, a spreadsheet saying all the ones he got correct, all the ones he got incorrect, and it showed him the steps of where. So really good for student tutoring. Another thing is research help. It definitely is great for students. I’m a dissertation chair myself, and I help the students use AI to leverage their work. So I just had a student that had Zoom focus groups and interviews, so the ChatGPT was able to transcribe the audio, it was able to create pseudonyms for each attendee, so it’ll help the privacy, and it was able to pull out themes, so now the student is able to spend that brain power on other parts of the research and that content really and not spend hours of time trying to transcribe items. It’s really interesting, and I feel that this is just the tip of the iceberg. There’s so many things, so many different use cases that all of these GPT models can do.

John: In terms of creating a tutor, one of the first things I did after seeing your session was I created a tutorial for my intro micro economics course, because the book I’m using is tied to an OER textbook. So I could upload the whole textbook to it and ask them to use it, and also have it ask students initially, what they know about the topic, ask them what they have questions about and then have them ask their question, but then guide them to an answer, rather than directly answering the question. And it works remarkably well. And because it’s trained just on the textbook that I’m using, I haven’t seen any substantial hallucinations. And so far, it’s been working well.

Jevaughn: It’s incredible when you’re able to really dive so deep, to be so specific, and accomplish those things with AI. And I mean, I can even say after one of the faculty members created a GPT focusing only on assignments, so he has the GPT assign students, I think it was like six different research papers, and what happens is that everything is uploaded into that knowledge base, and then from levels easy, mid, difficult, by difficulty, and then once the student enters their name, it will never give the students the same assignment twice, and it will always give the student one of each level of difficulty depending on what week of instruction they’re in. It’s amazing how far and how creative everyone has become customizing these GPTs.

John: Should we be careful in uploading information about our students in terms of personal information? Might perhaps we want to use pseudonyms or something else for students so that they’re not being trained on information specific to individual students?

Jevaughn: Absolutely. Yeah, data privacy is really, really important, especially when we’re talking about students, because we have to be so careful. Remember, anything, especially if you’re not in a paid account that you upload to ChatGPT is then used to train future models and versions of it. However, what I found out is that according to ChatGPT now, both the free version and the paid version allows you to say if you’re okay with sharing your data or not. On the Settings icon, there’s a data control button, and one of the options under data control is to improve the model for everyone. Now, if that is turned on, they’re taking all of the data that you put in and using that to train but if you turn it off, it won’t share your data, and it’ll delete those conversations, so it won’t share anything. Now is that 100%? I don’t know. Who knows? Personally, I don’t 100% trust it, so I don’t feel like I would ever upload actual student data, God forbid, financials or anything like that, but I would still be careful on it, but that’s just an added step of security to turn that off and make sure that you’re not sharing or you’re not giving them the right to use whatever information that you upload.

Rebecca: It also seems like if we’re having students using GPTs in our class, that talking about data privacy and things might be a topic that we might want to cover with our students. You want to talk a little bit about ways to maybe do that with students?

Jevaughn: Absolutely, and I think that really goes with the whole topic of AI literacy. I always recommend to faculty members that, hey, number one, if you’re going through some of these information sessions and you’re learning how to use AI in your classroom and you’re using AI to create those discussion questions, let’s teach the students the proper way of also using AI ethically in their academic work. So I think that a conversation that should be had. I’m sure that high schoolers are already having those conversations. I know that my son, who’s in 11th grade, definitely is with his teachers, but I think that that’s a conversation not only to have right on entry when the students are entering the institutions, but constantly, it should be everywhere. It should be in the syllabus. It should be in that very first class of every semester. You want to make sure that students are aware that whatever it is they upload is fair game unless they protect themselves. I mean, we had to have those conversations with social media also. So I feel like this is just the next layer.

Rebecca: What’s your advice to instructors about disclosing their own use of AI to their students?

Jevaughn: I think it’s important, because I feel that students are really less motivated to use it for non practical purposes. [LAUGHTER] If they know that their instructor is using it as well, they know that their instructor is well versed in the use of AI, they’ll be careful, and they’ll be very focused on their content, rather than putting in a prompt and submitting it. My advice to faculty members is always, “Hey, you can go ahead and disclose that you’re using AI, but also give your students the opportunity to focus their brain power on what you feel is more important.” So my example is that, for me, I’m all about the content. I want to make sure that my students know the content, forward, backward with their eyes closed. I want them to know that, however, if there’s a presentation, go ahead and use AI to create that PowerPoint. I can care less as long as you know that content, you can focus that brain power on solidifying that content and using AI as an assistant for you. And I feel like that would be one of the better use cases, or the better discussion that a faculty member can have with their students rather than saying, edit your paper using ChatGPT.

John: One concern that a lot of faculty members have is that students may be using this as a substitute for learning instead of as an assistant for learning. What can we do to encourage students to use AI to facilitate their learning and not to short circuit that learning?

Jevaughn: Yeah, I think that it will really enhance the overall conversation and relationship between the student and the faculty member, because now the student is able to go off on their own and ask all of these questions of inquiry to their GPTs and then come back to their faculty member, or their professor, and say, “Hey, so I was thinking about x, y, z, and this is what I found.” So now the faculty member would have the responsibility of saying, Oh, my goodness, this is wonderful. Let’s discuss it more, and it’ll help the student boost his confidence, or the faculty member can say “Mmmm, you don’t have that quite right. Where did you find your information? Let’s figure this out now together that you’ve already went out on your own to try to ask the question.” And I feel that these days, a lot of students are lacking that wow moment in their educational career. I think most of us just had a wow moment that’s memorable. It’s always important to make some type of learning memorable, and I think a lot of students are losing that. And I think a lot of students, and maybe even faculty members, are losing that even more with all of these AI, but if we have the ability to let the students go fish and learn on their own without having that negative point against them saying, oh my goodness, I’m using AI, am I a terrible person? Rather than helping the students utilize it the right way. That might just be their moment of making that educational moment memorable for the student, because you’re now on their level in how you can adapt to their educational needs. And I think that’s really important.

John: And our students come in with really diverse prior learning. And one benefit of AI is it provides an opportunity to bring everybody up to a higher level, because it can address their specific needs. It’s available 24 by seven, and it allows students to get help when they need it, where they need it, on the specific concepts and topic they need, as long as they’re not doing that as an alternative to actually learning. So with every aspect of AI, there’s some really strong positives, but there’s also some really serious concerns, and I think we all have a lot to learn about how to use this effectively, but for me, at least, it strikes me as being really silly to try to ignore AI and assume that this is not an issue we need to deal with, because students are going to be working with AI in some form for the rest of their lives, and not preparing them for that world strikes me as being not particularly helpful for our students.

Jevaughn: Yeah, I agree. At this point, we’ve all realized that it’s not going anywhere, it’s going to evolve [LAUGHTER] and move on to so many different things. So we have to be adaptable to technology. AI, it’s updating as we speak. [LAUGHTER] It’s learning more and more as we speak.

Rebecca: And I think that one of the things that really strikes me is that you were pointing out motivating curiosity, and when someone is indicating that they were curious, to not smash it, regardless of whether or not their curiosity led to a correct answer. And I think one of the things that I’ve experienced with students, even prior to the surge of AI is that sometimes when students are asking questions, even when they were just Googling answers, is the way that they were asking the question was where their misconception lies. And so sometimes having inquiries about how they were asking the question, or how they were using AI to answer their own questions could be an interesting way to engage with students, and opening the GPT and exploring with them could be a great exercise to do with students.

Jevaughn: Absolutely and having these types of discussions with our librarians, I found out, and I didn’t know this until maybe right before that conference in November, [LAUGHTER] that actually, when you’re working with APA and student writing, it’s an APA requirement that the student attach the entire conversation with the GPT as an appendix. And that part I didn’t realize. So if the student puts in their paper and say, I want this. I want that, they have to include every word of it so they can’t delete those conversations. I was floored by that. I had no idea. I’m like, well, that’s interesting. I never knew that APA required that, but according to our librarians, they do,

Rebecca: But also not a bad thing for faculty to request. Sometimes, if we’re asking students to use AI or use a GPT as a way to get to an answer to use as a learning tool to show their work, it’s something they can save. [LAUGHTER]

Jevaughn: It’s true, and most institutions use tools like Grammarly, and I know that a lot of our faculty members require students to check their work through Grammarly to make sure that the grammar and punctuation. But then there’s the new Grammarly, where it does just that. It records every keystroke that the students are typing to say, “the students typed this,” this part came from AI, this part was copied and pasted from this website, and all of the rest of it seems to be human text. And then the students can create a share link and share it with their instructor, and you see it in real time as the students are drafting their papers. It’s amazing. I mean, AI has come such a long way from where most people think it began two years ago. [LAUGHTER]

Rebecca: Feels a little creepy, but okay. [LAUGHTER]

John: AI has been going on for decades, and it was always something that was going to happen soon, and then all of a sudden, it arrived, way before anyone expected anything this powerful to be released with an interface so friendly.

Jevaughn: Yeah, no warning, just boom, here we are. [LAUGHTER]

John: …right before finals.

Jevaughn: Yes, yeah. [LAUGHTER]

Rebecca: Alright, so I always wrap up by asking, what’s next?

Jevaughn: As far as AI [LAUGHTER] or GPTs is concerned, I think about it all the time, again, from where it started to where it is now. I was just reading where there’s a K-12 school in Colorado that has two-hour intensive AI instruction, and it’s completely done by AI, the instruction, the curriculum, everything, and the rest of the day it focuses on life skills, which, to be honest, that’s dwindling a little bit with all of the gaming and all the other technologies, there’s got to be a gap somewhere. So focusing on life skills isn’t bad, but I think in the near future, I feel that we’ll see a lot of enhancements when it comes to that data security, because it’s such a hot topic right now. We’re already doing so much with accessibility, but I think that’s going to be a huge push when it comes to AI and ethics and the ethical concerns behind it. Who is actually behind those keys training. So we really have to think about that. And honestly, I feel that’s where it’s going. Of course, it’s going to advance when it comes to the databases and the types of knowledge that it provides, but I think in the near future, we’ll see a lot of ethical concerns and a lot of data privacy concerns being targeted.

John: Well, thank you. This has been a fascinating conversation, and your presentation inspired me to start creating GPTs because, at the time, I didn’t realize that free users could access them. But now that that’s there, it opens up so many possibilities for supporting students and for supporting instructors and anybody more broadly. So it’s a really nice improvement.

Jevaughn: Absolutely, I couldn’t agree with you more. It’s so exciting of where we’re going.

Rebecca: Thanks for a great conversation. And it really is important for folks to understand that it really isn’t that hard to create them. It sounds really scary and really intimidating, but it really isn’t.

Jevaughn: Yeah, the platform is already built for you. You just have to feed in that information. [LAUGHTER]

John: Well, thank you. This has been great.

Jevaughn: Thank you guys so much for having me. So much fun.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

375. UDL, Access, and AI

In November 2024, we moderated a panel at the OLC Accelerate Conference that used the universal design for learning (or UDL) framework to consider the impact generative AI has on equity and access. This episode is the live recording of this session. The panelists were: Liz Norell, Sherri Restauri, and Thomas J. Tobin.

Liz is a political scientist and Associate Director of Instructional Support at the University of Mississippi Center for Excellence in Teaching and Learning. She is also the author of The Present Professor: Authenticity and Transformational Teaching, which has recently been released as part of the Oklahoma University series on teaching and learning. Sherri is a faculty member in the Department of Psychology at Coastal Carolina University, having recently left administration in her role overseeing digital learning and access. She has been working in the field of digital and online learning for 24 years and now runs an educational consulting business to provide support to educational companies and institutions alike throughout the world. Sherri’s research and work focuses on neurodiversity and mental health in higher education, and she has published, as well as presented, extensively on these topics over the years. Tom is a founding member of the Center for Teaching, Learning, and Mentoring at the University of Wisconsin, Madison, and the author of the forthcoming book, UDL at Scale: Adopting Universal Design for Learning across Higher Education, as well as Reach Everyone, Teach Everyone: Universal Design for Learning in Higher Education and several other works related to teaching and learning.

Show Notes

  • Norell, E. A. (2024). The Present Professor: Authenticity and Transformational Teaching (Vol. 3). University of Oklahoma Press.
  • Behling, K. T., & Tobin, T. J. (2018). Reach everyone, teach everyone: Universal design for learning in higher education. West Virginia University Press.
  • LearnWorlds
  • Goblin Tools
  • Warner, J. (2018). Why they can’t write: Killing the five-paragraph essay and other necessities. JHU Press.
  • Maha Bali (2024). Cultivating Critical Literacies. Teaching in Higher Ed podcast. Episode 545. November 21.
  • Canva
  • LUDIA

Transcript

John: In November 2024, we moderated a panel at the OLC Accelerate Conference that used the universal design for learning (or UDL) framework to consider the impact generative AI has on equity and access. This episode is the live recording of this session.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Welcome to “Equity and Access: Artificial Intelligence in Support of Universal Design for Learning – an expert panel.” I’m John Kane, an economist and Director of the Center for Excellence in Learning and Teaching at SUNY Oswego.

Rebecca: I’m Rebecca Mushtare, a designer and Associate Dean of Graduate Studies at SUNY Oswego.

John: The widespread adoption and rapid evolution of generative AI tools like ChatGPT In the past two years has sparked many conversations about the impact of AI, as we’ve seen at this conference so far, on many aspects of higher education. This panel, however, will focus on AI’s relationship to accessibility and universal design for learning. Our panelists are Liz Norell, Sherri Restauri, and Thomas J. Tobin. Liz is a political scientist and Associate Director of Instructional Support at the University of Mississippi Center for Excellence in Teaching and Learning. She is also the author of The Present Professor: Authenticity and Transformational Teaching, which has recently been released as part of the Oklahoma University series on teaching and learning. Sherri is a faculty member in the Department of Psychology at Coastal Carolina University, having recently left administration in her role overseeing digital learning and access. She has been working in the field of digital and online learning for 24 years and now runs an educational consulting business to provide support to educational companies and institutions alike throughout the world. Sherri’s research and work focuses on neurodiversity and mental health in higher education, and she has published, as well as presented, extensively on these topics over the years. Tom is a founding member of the Center for Teaching, Learning, and Mentoring at the University of Wisconsin, Madison, and the author of the forthcoming book, UDL at Scale: Adopting Universal Design for Learning across Higher Education, as well as Reach Everyone, Teach Everyone: Universal Design for Learning in Higher Education and several other works related to teaching and learning.

Rebecca: This wouldn’t be a complete episode of Tea for Teaching if we didn’t ask about tea. So today’s teas are: Liz, are you drinking tea? I mean, I already know the answer, but…

Liz: I am drinking two non-conventional teas. You may have heard of them: One is Diet Coke, and the other is water with a little bit of Mio flavoring in it, which I think counts as tea.

Rebecca: Tom?

Tom: I’m drinking a lovely decaf rooibos.

Rebecca: That sounds good. Sherri?

Sherri: So I actually am drinking my favorite iced coffee. I have a salted caramel mocha with me.

Rebecca: Great.

John: And I am drinking a Tea Forte black currant tea.

Rebecca: And I’m back to a good old favorite that I picked up when I was at Epcot yesterday, which is English afternoon tea. Our last segment for today will feature questions from the audience. Because we’re managing two sets of mics, as you can see, one for amplification in the room and one for our recording, we ask that you use the QR code on the screen to submit your questions for the panelists.

John: Technological advancements like touch interfaces and speech recognition were initially developed to provide access for people with disabilities, but now the standard features used by many. Likewise, early AI innovations, such as real-time captioning and transcription services and tools like spelling and grammar software, initially designed in support of accessibility, have been widely accepted and adopted as useful supports for all students. In what ways can instructors use AI tools to efficiently develop accessible digital content or design multiple means of representation or options for interaction? We’ll start with Sherri.

Sherri: Thank you. So I had an opportunity to think about this question in advance, and in my opinion, based on a couple of decades of watching AI come to the forefront, I feel like AI tools themselves are, in their current state, something that provides faculty and students, as well as instructional designers, with the ability to have different perspectives than we would otherwise. I kind of highlighted, and I wanted to go ahead with our questions by highlighting two of my favorite tools that I figured you guys may not have found yet, because we all know what ChatGPT is, but one of the tools that I have evaluated, and I feel like is going to change our world in course development is called LearnWorlds, and I encourage you to take some time to dive into their free 30 day service, because it is amazing. The one that I use most extensively with my students is called Goblin Tools, and both of those tools are ones that, over the last three years, have extensively changed the space of building what is available for us as faculty and helping us if we don’t know anything yet about UDL, it’s actually helping us to create those without having to have too much background knowledge, because UDL is built into the. Central mechanism of how these tools work as AI. So I encourage you to take a look at Goblin Tools and Learn Worlds if you’ve not looked at either of those yet, because they are very interesting, and it will get you kind of started with a tool that was pre built on the foundation of UDL.

Rebecca: Tom?

Tom: Well, the key here is that it used to be up to the designer or the instructor to create and provide the multiple means of engagement, representation, action and expression for the learners, the 3.0 version of the universal design for learning guidelines recognizes that artificial intelligence and other tools now put the ability to create in everyone’s hands. So the verbs changed from provide to design. This acknowledges that we can both give UDL options and teach learners how to recognize and craft their own customized options as well. For example, before large language models came along, if I wanted a text version of a video clip or I wanted to hear it in another language. I had to rely on humans for those transformations. Now I can ask AI tools to create the alternatives I’d like, and then, and this last part is crucial, do a double check with the humans who have the skills to be able to say, yes, that’s accurate and trustworthy,

Rebecca: As noted earlier, AI tools can also help students with grammar and spelling and basic writing and organizational skills. Will these uses of AI allow students and instructors to focus more attention on the development and higher order thinking skills. Liz?

Liz: I just want to say that when I was invited to be on this panel, I thought these people all know a lot more than I do. So when I was thinking about how to answer these questions, I did what I think many of our students might do, and go to ChatGPT and say, like, “give me some thoughts on this.” And I found that to be really helpful to kind of clarify how I want to answer this question about whether AI tools can help us focus more on the higher-order thinking skills. So in response to this question, I would say “yes, and…” because generative AI can create opportunities for us to focus on those higher-order thinking skills, and to do so as educators, we have to invest time and thought into creating assignments and projects that do that, that engage those higher- order thinking skills. And this is something that I’ve tried to make clear to my colleagues when talking about generative AI, both in my discipline of Political Science and with the faculty I work with in our center for teaching. And I’m just going to do a quick nod to the 1992 presidential campaign, because that’s my age, so please don’t take this as any sort of like derisive comment, but it’s the pedagogy, stupid. It’s always been about the pedagogy, and John Warner’s book Why they Can’t Write: Killing the Five-Paragraph Essay and Other Necessities, sort of gets at this in his title, that a five-paragraph essay may not engage those higher-order thinking skills. It’s a formula, and he wrote that book well before ChatGPT was a going concern. So I think we have to do the really hard work of figuring out what an assignment looks like to engage those higher-order thinking skills, and that requires work, not just from our students, but from us, as we work with faculty and do the hard work of education.

Rebecca: Sherri?

Sherri: So, I agree with Liz on her premise that it is really about the pedagogy. It’s always been about the pedagogy. I am in a position now where not only am I teaching at my home institution, but I also teach at a couple of other institutions as needed, and each of them have exceptionally varying policies and restrictions on the use of AI. I won’t name the one that has a restriction, but I will point out that because my work is extensively in students with what we would call hidden disabilities, a lot of times there’s a misunderstanding about the need for AI. AI is absolutely a requirement. And for example, Goblin Tools I use with all of my students who have any kind of learning disability, ADHD, like myself, if they have any kind of mental health concerns, then Goblin Tools is an essential tool for allowing them to bolster their executive functioning. And I’ve had to share that research and share that type of understanding with my colleagues at the institution that has a restricted AI policy that tells students they will fail if they are known to use AI. And I’ve had to tell them that this is an equity issue. It is a requirement for these students to be able to utilize this and there was a presentation two sessions ago, earlier this morning, where they shared that less than 20% of institutions in the United States have college students that disclose a disability. That means we’re missing about 80% of them, and that’s an important fact to keep in mind. They may not tell us they have a disability, but it is important for us to advocate at all of our campuses, that AI actually is allowing individuals who may struggle to do these basic skills of spelling and grammar and outlining without these tools.

John: Students enter our classes with quite a bit of variation in their prior learning experiences, and that can create a lot of challenges for instructors. In thinking about designing outcomes to sustain student effort and persistence. How might AI tools be used to provide enough challenge to individual students and enough individualized support that’s tailored to the needs of each student? Tom?

Tom: Well, beyond just creating multiple formats as materials, and that’s something that large language models and predictive AI do very well, instructors and students alike can use AI tools to create self-quizzing questions about materials and differentiated study pathways based on learners’ own engagements. The most promising access barrier we can lower with AI has to do with customizable study methods that learn about you and help you practice, prepare, engage. Of course, many of us know that the least effective way to study is print out a text and review it with your highlighter marker in hand. The better way is to read and create application and recall questions as you go along, and then after a while, quiz yourself about the materials. Our learners may not yet be experienced in crafting their own self-quizzing questions; they can ask. Ai, not for a summary of the reading that would be doing the work in place of the student, but for questions to ask about the reading that’s augmenting and customizing the study skills of the learners. Liz, you got thoughts on this too, don’t you?

Liz: I do, and something that I don’t hear discussed very often, although, Sherri, I’m glad you brought it up, is that these AI tools can be really helpful to support executive functioning by offloading some of the things that executive functioning is all about. So that can be really helpful for our neurodivergent learners, and also for us if we’re neurodivergent. So for those who struggle to get organized, AI tools can help. If you need to break a project into discrete goals. AI can help if you need to create a schedule or reminders or you want to come up with some ideas to gamify, AI can help with all of those. That’s a really nice affordance of the technology students can take advantage of these tools to help them identify areas where their work might need some strengthening, or provide feedback on where they’ve made mistakes in some of their work, which can help students who might otherwise feel left behind or feel lost to catch up and stay with the class. So just two days ago, I had a study session with my statistics students, and one of them told me, when I get to a question in the homework that I don’t know how to do, I open up ChatGPT. I say, don’t give me the answer, tell me what are the steps to do this question. And that’s a really nice way for them to learn the process and then take those steps and apply them themselves. This is a really smart use of AI tools by a conscientious student trying to learn and improve.

Rebecca: Continuing on with the principle of designing multiple means of engagement, one UDL guideline is to design options for welcoming interests and identities with considerations like providing students with a higher level of autonomy and choice or making sure that learning experiences are meaningful and relevant. What roles do AI tools have in assisting faculty and supporting student identity and interests? Sherri, do you want to start on this one?

Sherri: Absolutely. So I had a different answer for this until yesterday. So I want to tell you that I’m editing on the fly here because I feel like I have utilized the principles of inclusive design and UDL, I’ve built in identity until yesterday, and somebody presented on a wonderful session about how they submit their syllabi into AI with a specific prompt telling them what your background and what your history and what your varied identities are. And it changed my perspective, because I haven’t done that. I’ve been trying, on my own, to tell students I am also neurodivergent. I also come from this background, and I’ve tried to use that to identify with them, but the solution that was presented yesterday was really unique, because they submit their syllabus and they say I come from these five or six identities. Help me make sure that my language in my syllabus is open and inclusive to all identities. That’s a technique I’m now going to be implementing as of yesterday, because I’ve been trying to do this all on my own with thinking of the other identities. But the real value of artificial intelligence… and just allow me to nerd out for a second as a psychologist… is intelligence is just what the general community knows. That’s how we define intelligence. Artificial Intelligence, they know a lot more than us, because it’s big and broad, and it touches every culture and every continent on the entire world. And so from that perspective, I will always get a less biased response from AI, instead of trying to rely on what my own brain can tell me about trying to be open and inclusive of everyone’s identities. So that’s a tip that I’m taking directly from our colleagues from yesterday, of just even starting with a syllabus and saying, “These are my identities, help me make sure that my work is representing all other identities who might be in my class.”

Rebecca: It’s a great example… continuous development, continuous improvement. Liz?

Liz: Yeah, so I want to echo what Sherri said, and just say that one of the uses of AI that I think we often overlook is this idea that it can help us do some reflective practice about our own potential cultural gaps or lived experiences and those of our students. And so if we want to support student identity and interests, we probably need to have at least some fluency with that, or the ability to get that, and especially for many of us who are not the same age and even close to the same age as our students, or for those of us who teach very large classes, this can be very hard. So I would like to suggest that AI tools can help. Sherri, don’t want to go off on too much of a tangent, but I was listening to another podcast episode this morning with a conversation with Maha Bali of the American University in Cairo, and she was talking about the implicit bias that comes from large language models, because they’re reflecting back the text that they have been trained on. And so if you ask these generative AI programs, what is terrorism? or who are the people who are terrorists? It won’t answer. But if you ask it to give you five examples, they’ll all be of a certain kind. And so I think that there are opportunities here as well for students to think about and for us to learn about implicit bias in the culture by doing a critical analysis of the stuff that generative AI gives us. So Bonni Stachowiak talked about asking ChatGPT or some other program to give her a picture of a classroom that was a philosophy class at Harvard, and they were all men, and the women in the class noticed that, the men did not. So these are opportunities for some critical reflection. I also just want to say one more thing, AI tools can be really helpful for our students who are not native English speakers, because they can help them build fluency by parsing text and correcting their own writing.

John: Traditional online assessment techniques such as discussion boards and essay assignments on traditional topics in our disciplines may not align well with the diverse interests and lived experiences of our students. How might AI tools be helpful in designing well scaffolded assignments that better connect to the diverse interests and lived experiences of students, providing them with multiple means of action and expression? We’ll start with Liz.

Liz: So, from instructors’ perspectives, AI tools can help those of us who are subject matter experts and may have a hard time adopting a novice mindset, break down projects into smaller steps so that our students can approach those in a more accessible way. If someone asked me to write a journal article in my discipline, I would know how to do that, soup to nuts, right? No problem. But a sophomore or junior in a class who’s asked to write a term paper may not even know where to get started or what kinds of things will help them get there. So AI tools can help instructors who need some help returning to a novice mindset and understanding what those discrete steps are to create that scaffolding that you mentioned. From the students’ perspectives AI tools work well here, if and when, instructors allow students at least some choice over what the topics of their assignments or projects are, and especially to create assignments in different formats. So be that, video, audio, visual, written, etc. In those cases, AI tools can help students identify topics, refine ideas and then create structures for their eventual work products. That helps the instructors meet the students where they are, and as an instructor, it makes grading those assignments far more interesting, because you’re not reading 100 papers on exactly the same topic. I love getting to know my students through their assignments, and I suspect many others do as well. Tom, I think you have some more thoughts.

Tom: Yeah, to build on what Liz is talking about here, we’re most often engaged in creating assessments of learning: tests, quizzes, papers, exams. AI can help us construct those kinds of things and suggest alternate ways that learners can show those skills. But where I see the greatest potential for artificial intelligence is in thinking about assessment as learning. In our 300-person online lecture courses, they’re a terrible format to begin with… don’t get me started… there are scarce opportunities for engagement and for showing what you know. Designers can craft ways for learners to use artificial intelligence tools, almost like a private tutor. Ask AI to create study flash cards, self-quizzing questions, like we talked about earlier, fill in study guides and the like. The key is to make sure that what the AI produces is good information. Vet the content yourself during the creation process or design in a tech check as a course activity so that the instructional team can assess the quality of the self- assessment materials that AI is generating.

Rebecca: So we’ve talked a lot about how AI can facilitate learning, but haven’t yet addressed some of the equity issues in accessing and using AI tools. What barriers might some students face in using AI tools in their online learning experiences? Tom, do you want to start this one?

Tom: Yeah, I can take this one. There’s a lot of ethical considerations to using generative AI tools in online education. I’ll spotlight four of them here. First, we already see the haves and the have nots, the folks who can and can’t afford to use customized targeted data sets and tools. We have customized tools for the C-suite and hallucinations and errors for the rest of us. Second, water and electricity usage… for every image that you ask AI to create of a butterfly, unicorn, kitten flying through space eating a cheeseburger, three liters of water and 10 watts of electricity are consumed. Third, we preach respect for intellectual property, while the most common LLMs and generative AI models have been trained on oceans of copyrighted content without consent. And fourth, and perhaps the biggest barrier for widespread adoption of AI tools for UDL purposes, the high prevalence of racist, sexist, and pornographic inputs to the most general models. Ask AI for an image of a doctor, and it will always create a white, male, older doctor. These are all elements that we should share with learners about the tools that they’re using. That was a bit of a pessimistic turn. Sherri, do you have something different here, or you want to follow in the same way?

Sherri: Mine is going to support what Tom said [LAUGHTER] and actually what Liz brought out earlier. So at one of my universities, because I use AI as a teaching tool in the field of psychology, I actually build into week one and two of our classes how to use AI effectively. And then, after my first semester, because so many of my students love and are familiar with the free tool, Canva, that you might be familiar with, Canva now has a free functionality to generate images. However, Canva is, to date, the single most biased image generator I have ever seen. And as soon as I recognized that when they input things like mental health or ethnic diversity or poverty or crime, that it always provided the same specific images of individuals, then that led me to needing to narrate and modify the way I teach them about which types of AI tools and what to trust, because as future counselors, they do not need to be creating content or using AI’s incorrect LLMs, as Tom and Liz have pointed out, to create a belief instead, that only these individuals are representative. Tom mentioned doctors, and they always have one particular group. In my area, we’re talking about mental health disorders, and it is so, so problematic as a professor to have the student potentially create a presentation that only represents certain ethnicities and certain genders when we’re talking about mental health disorders, when that is incorrect. And Liz, you highlighted this so well, [LAUGHTER] even without knowing what I was going to say, because the intelligence behind AI is growing. It is growing every day. And one of the statistics I wanted to share with you that just came out last month was some of the original developers of AI estimate that AI is in its infant stage, it’s not even a toddler stage, but it currently has an IQ of 160. That’s five points below Albert Einstein, but it’s only a baby, and so once it grows, it, we hope, will become less biased, because it will receive input from us, but it gets its knowledge from us. So if we are inputting biased information, it will continue to output biased information. So it’s only as good as we are good at not being biased about the information that we’re publishing as well. So thinking about that diversity and the equity, I think that we cannot encourage students and we cannot utilize AI ourselves without also making sure we’re teaching them about the inequities. And if they understand the dynamics of how AI is created, its intelligence is based on the fallacy of humans, sometimes are also biased inherently, then they know to be a little bit more conservative about evaluating the quality of the material it presents as well.

Rebecca: So as we move into the audience questions segment, we’d like to remind you that this session is being recorded, and if you’d like to ask the panelists a question, please do so using the Google form that we provided. And we do have some questions in there. Do you want to ask the first one, John?

John: Our first question is from Elizabeth Blythe-Lee, from Arizona State University Online. Her question is: “How do you see AI being used to support personalized learning and supporting UDL? What will that look like?”

Sherri: Alright, I raised my hand so I get to go first. [LAUGHTER] So one of the things that I see it doing… if you guys have ever heard of the concepts of choice boards, or of the idea of student agency, where students have a choice, sometimes it’s difficult for new faculty, new instructional designers, to come up with enough choices to make learning personalized. And so one of the things that I’ve seen happen, whether you’re using the built in AI idea generator or content generator in Pearson or Cengage or LearnWorlds, or any of the ones that are about to come out in our LMS colleagues, they will give you ideas of potential projects that may suit different types of learners. And what I’ve always done in my classes is I’ve created a final project that has allowed students to make a choice: which modality suits your strengths best, pick this modality versus that modality versus that modality, but I can only come up with so many, and so using AI to not only come up with the ideas, but say, “AI come up with these ideas and build the rubric.” It’s a huge time saver for me. And so I already had the ideas about potential projects, but AI has enhanced that and truly made it more personalizable for my students going forward.

Tom: Many of you might know the concept of differentiated instruction, or DI, it started in the K-12 realm, and a lot of us in higher education are doing this as well. It’s very difficult to do differentiated instruction when you’re teaching a lot of people. Differentiated instruction is paying attention to patterns that appear among the learners who are in your class now and then doing design work in how you respond to them. To pay attention to those patterns and respond to those patterns. Universal Design for Learning is what we do before day one of our online courses, it’s how we design, not knowing who’s going to be there, and so we assume that there’s going to be wide variability. Differentiated instruction, on the other hand, is what we do after day one, and artificial intelligence helps us, not only in the proactive design in terms of UDL, how do we give people more on-ramps to get started? How do we give people more representative samples or methods or means for the content? How do we give them more than one way to show what they know? The flip side of the coin is also intriguing. We can design in opportunities to ask students to use artificial intelligence to do personalized, differentiated instruction for themselves, and then share that information with us so we start seeing the patterns more clearly.

Rebecca: Our next question comes from Marcus Popetz from Harmonized Learning. And the question is: “How do you feel about the AI note takers that record the class and offer recall and quiz questions to help the student? Is the note taking and creation of questions the important part, or the quizzing and recall.”

Liz: I appreciate this question a lot. So first of all, I just want to acknowledge that we are having this conversation in a context where being recorded in our classroom can feel unsafe for some instructors and some disciplines. And so I think that there is reasonable concern from faculty when a note taking AI tool might be recording everything they’re saying, getting a transcript and then generating questions. Because many of us feel quite rightly, under increased scrutiny. And so I sympathize with the idea behind this question, that the summarizing and the question generation is an important part of learning, but it may not be as accessible to all students as we would want it to be. And I think to what we’ve been talking about here throughout this panel, is that we want to be accessible to learners at different stages of their learning. And so to say no, you can’t do this, because question generation summarizing is an important skill of learning, might then preclude some students from ever getting to that higher-level thinking. So I’m personally not comfortable with saying no, but to engage in some reflection about what is our resistance, where is it coming from, and how can we think about this in an as inclusive of a way as possible, of different learners?

Sherri: So I was sharing with Tom right before our presentation, that I am doing something for the first time in 24 years of teaching that I never thought I would do. I’m excited to no longer be in administration, but this semester, I’m teaching eight classes, and somehow I’ve survived it. And so I just want to point that out, that in those eight classes, across eight different classes themselves, I may have 60 students with ADA accommodation letters. It’s a lot. It’s grown significantly, and out of those 60 accommodation letters, at least 75% have note taking as a core component of their varied accessibility needs. Again, I want to throw this back to executive function, which, regardless of what type of disorder you have, executive functioning, your ability to pay attention in class and take notes is likely to be impacted if you have any kind of diagnosis, and if you don’t have a diagnosis, and by chance you have trauma in your background, your executive function is also negatively impacted. So you might not have a formal diagnosis, but you need these note taking functionalities, as Liz kindly pointed out, in order to even have a level playing field. So yes, in psychology, we talk about some things that get very uncomfortable, and more than myself, I’m more protective of the other students’ comments and those being shared in the note taking. It’s not myself, it’s what’s being disclosed in our classroom, because these are individuals being trained to become clinicians, and they learn best by sharing their own stories. So I’m protective of it, but in the same way, I want to recognize the fact that it’s important for everybody to see that these are useful tools for individuals who may and may not ever be diagnosed in order to have a level playing field in their learning experience,

John: We have a question from Richard Powers from City Colleges of Chicago, and his question is Beth Stark and Jérémie Rostan developed Ludia, an AI tool that reviews lesson plans, syllabi and other documents through UDL lenses. Reactions have been really good. Do you see educators using specific UDL review tools such as these in the future?

Tom: Yes. [LAUGHTER] No, the Ludia tool is a splendid thing. It was developed just at the end of last year in late 2023 and what the researchers, whom Richard is referring to, what they did was they took a chat bot model and customized it only on a data set of universal design for learning documentation, so if you’re putting in “Hey, I have this challenge, or here’s this barrier, or my students are having these kinds of challenges,“ Ludia will say, “Hey, this sounds like this is the barrier. This sounds like applying this particular checkpoint from the universal design for learning guidelines applies.” And I use the word checkpoint here because it’s still on version 2.0 of the UDL guidelines, they’re working right now to update that to 3.0. I can see that one of the have and have not barriers that is likely to be lowered in the near future is that we’re in the adoption curve with artificial intelligence, where the tools are still designed for expert users. They’re still designed for the coders, the instructional designers. They’re not designed for everyday folks. Here I’m going to hold up my mobile device. Think about every app on your phone. All of those apps started out as something that only people with specific skills and knowledge could use, and they’ve now been designed into things that everyday people can do and use and participate with. So that’s going to happen with artificial intelligence tools as well, and that have/have not divide right now, the people with all the money and the specific business cases they get to train their AI on sort of higher quality or narrower niche kinds of data sets. And Ludia is a wonderful step in that direction because it’s open source and everyone can use it. So good plug for that.

Rebecca: Thanks for your great questions. I know we didn’t get to all of them, but we got to the majority of the ones that came in. So thank you. We always wrap up by asking: “What’s next?” and we’ll start with Liz for this one.

Liz: Okay, I actually want to get some clarification on this question, because I don’t know if “what’s next” means for me or for this topic.

Rebecca: We always leave it on our podcast to be very open. It can be like, I’m gonna go eat lunch..

John: …or I’m going to Disney World…

Rebecca: Yeah, [LAUGHTER] or it can be the big existential question, so it’s really up to you, Liz, or it could be both/and… either/or.

Liz: My particular flavor of neurodivergence is autism, so I just need, like, some clear expectations. So what’s next? I think my relationship to AI continues to evolve. I think when it first came on the scene, I was curious, then I felt overwhelmed, and so I just started saying, “but the environment” to avoid thinking about it very much. Now I’m kind of in this uneasy frenemy sort of relationship with generative AI, where I’m sort of like, “okay, I’m curious, but also kind of skeptical.” So in terms of what’s next, I’m just gonna say our relationship continues to evolve, and I’m not quite sure where it might end up.

Sherri: And from my perspective, I also feel like we’re gonna see some big things happen. My big takeaway that I would love for you to think about is remembering that underneath AI are humans. The intelligence of AI comes from humans. And I think there’s some real value in solving big world problems by the combination of all of our human intelligence together. There’s some major issues that we’ve not been able to solve in medicine and other areas that I think we’re gonna see AI actually give us some solutions for. So keep an eye out for that. And I think it’s dependent on us. It’s not AI that’s solving it. It’s our ideas joining together to find really big world solutions that we can’t find unless everybody puts their information in.

Tom: And if the question is, “what’s next?” we will soon see a diffusion of innovation shift around AI use in UDL practices. We will move from training people how to craft effective prompts to how to use AI tools to shortcut already expert processes.

John: Well, thank you all for joining us. Thank you to our experts on the panel, for providing us with your responses, and thanks to everyone who’s attended. [APPLAUSE]

Sherri: Thank you.

Liz: Safe travels home too.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

367. Teaching Effectively with ChatGPT

AI tools can help faculty improve the quality of their teaching and assist students. In this episode, Dan Levy and Angela Perez Albertos join us to discuss a variety of ways in which ChatGPT can be used to support learning.

Dan is an economist and a senior lecturer in Public Policy at Harvard University where he teaches courses in quantitative methods, policy analysis, and program evaluation. Angela is a graduate of the MPA program in International Development at the Harvard Kennedy School, where she currently serves as a Teaching Fellow. Dan and Angela are the authors of Teaching Effectively with ChatGPT.

Show Notes

  • ChatGPT
  • Levy, Dan (2021) Teaching Effectively with Zoom: A Practical Guide to Engage Your Students and Help Them Learn. 2nd ed. LSC Communications
  • Levy, D. and Angela Pérez Albertos (2024). Teaching Effectively with ChatGPT: A practical guide to creating better learning experiences for your students in less time. LSC Communications
  • TeachFX
  • Teaching Effectively with ChatGPT Companion site

Transcript

John: AI tools can help faculty improve the quality of their teaching and assist students. In this episode, we explore a variety of ways in which ChatGPT can be used to support learning.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guests today are Dan Levy and Angela Perez Albertos. Dan is an economist and a senior lecturer in Public Policy at Harvard University where he teaches courses in quantitative methods, policy analysis, and program evaluation. Angela is a graduate of the MPA program in International Development at the Harvard Kennedy School, where she currently serves as a Teaching Fellow. Dan and Angela are the authors of Teaching Effectively with ChatGPT. Welcome Angela and welcome back Dan.

Dan: Thank you.

Angela: Thank you so much for having us

John: Today’s teas are:… Dan, are you drinking tea?

Dan: Moroccan tea.

Rebecca: That sounds nice.

John: And Angela?

Angela: I am drinking Chai Latin, my favorite.

John: And Rebecca?

Rebecca: I have English afternoon tea. It’s been a while since I’ve had that.

John: And I have English breakfast tea.

Rebecca: That’s unusual for you.

John: Yes, it is.

Rebecca: [LAUGHTER] Alright, yeah. We’ve invited you here today to talk about Teaching Effectively with ChatGPT. Can you talk a little bit about how this project got started?

Angela: Well, Dan and I had been working for a while already, when we started talking about this book, and we had been experimenting on different ways to integrate technology for more effective teaching and more effective learning. And I had personally always loved working with Dan, and he had written a book already about Teaching Effectively with Zoom that was very valuable for many educators during the pandemic, and he was thinking about doing something similar for ChatGPT. We saw that many educators were paralyzed by this technology. We saw that many students were already using it, but may not necessarily know the ways in which they could use it best for their learning, and there was just a big need to experiment better with this technology. We started with a small workshop that we did at the Kennedy School that was a massive success, and then from there, we saw there was a big need and a big desire from educators and students to learn more, and so we just decided to go ahead. And I think since then, it’s been a wonderful experience.

John: One of the things we’ve noticed in workshops is that faculty are often a little bit resistant to experiment with ChatGPT or other generative AI tools until they actually try it. So we thought maybe we’d start with that. What are some ways in which generative AI can be used by faculty to help design new courses or improve the design of existing courses.

Dan: I think generative AI can be used by faculty in a number of ways. And just to reinforce your point, John, I think you don’t have a good sense of how useful it can be to you until you actually start using and experimenting. So I think if we could leave faculty with one message today, it would be: “Start experimenting with the technology so you can understand the benefits and the potential limitations.” We can talk about ways in which we can use the technology to, as you said, design new courses or improve the design of existing courses, and I’m sure we’ll be doing it throughout the podcast. In terms of designing new courses, you can do things like help you refine your teaching goals, for example, or you can have it help you as a brainstorming partner in a class that you’re thinking about designing. You can ask it to provide you feedback with material that you’re developing. So there are a number of ways in terms of improving your course. You can ask it for feedback on slides that you have produced in the past. You can ask it to summarize documents, summarize course evaluations, to gather what are the main things that you need to do, but at a super broad level, maybe the way that I think our book tries to crystallize the use of AI, or ChatGPT in particular, is you should think of it in potentially two roles for you. One, it could be a brainstorming partner, a thought partner for you, and the second one, perhaps the most current use, is it could be an assistant. It could be a teaching assistant, a research assistant, a general assistant. So anytime that you are in front of your computer and you’re trying to get something done and you’re feeling stuck, I think you should just ask yourself, is this an activity where maybe spending three minutes with ChatGPT could help me either get unstuck or arrive to an output faster than I could in the absence of it.

Rebecca: I know as an instructor, I’ve used it to get past a blank page, just to get a jump start on something. In the second chapter, you describe ways in which ChatGPT can be used to customize your courses in the interests and needs of your students. Can you talk a little bit about how ChatGPT can create a more student-centered learning environment?

Angela: One of the biggest potentials that the education world has seen in ChatGPT is the opportunity to approach closer to the ideal of one tutor for every student. Research has known for many years that providing personalized learning can have huge impacts in each student’s learning and. And ChatGPT can enable part of that benefit. It’s not perfect, but it can get us closer to that outcome. Now, how can it do it for a professor? I like to think about it in three ways. One is that it allows educators to process the student information that has high volumes. So for example, in every class that I teach, I start by asking students to fill in a form where I ask them about their interests and what they’d like to learn. If with ChatGPT, I can get a summary of those interests and like the profile of my students. The second way is that it provides access to knowledge or to context that allows educators to tailor activities to their specific students. So for example, when Dan and I were updating one of our activities for the statistics class that Dan teaches, we were trying to think of topics that were relevant for the students in the class. And we asked ChatGPT to provide different ideas for topics. And these went from topics related to health to finance to arts, and many of these topics we were not experts in, but they were topics that our students were interested in learning more about. So ChatGPT allowed to tailor our activities and our context to make them more relevant to what our students wanted to learn. And then the third is that ChatGPT can be made as an avenue or as a tool to personalize student learning directly. So we can ask the students to learn about different topics directly on ChatGPT, so that the approach is the one that works best for them. And we’ve seen this in action as well, where, in one of the examples that the book covers, is how one of the courses that Dan was teaching, he asked his students to learn about signal theory, and then you have two students that take a completely different approach. One of them asked for more in-depth and more expert-level explanations, while the other one says, “I have no context about this, so I actually need to understand this as someone that has zero background knowledge,” and that is super powerful. There’s no way that an educator would be able to provide the two explanations in a class to different types of students. So in those ways, I think that the potential is huge.

John: And you mentioned using a form to gather information about students and feeding it into ChatGPT. One of the things you suggest, though, is that you don’t want to include personally identifying information, such as their name or other things. Could you talk a little bit about why it’s important not to do that?

Angela: Absolutely, so there are huge privacy concerns about what data we put in to ChatGPT, because basically, the algorithms are trained on the data that is existing on the internet, and right now, we have no good sense of what openAI is doing with the data that we input into ChatGPT, and so in that sense, we strongly encourage educators to not put any sensitive data, like student contacts, student grades or anything that would make the data that we are adding about the students identifiable. Now there are solutions that openAI is introducing for universities that are available and that we also talk about them in the book, but our general recommendation is to be very, very careful with the type of data that is used in conversations with ChatGPT.

Rebecca: Can you talk a little bit more about additional ways that faculty could incorporate ChatGPT to improve the active learning in their classrooms?

Dan: So in the book, we describe sort of a simple prompt that you can use, where you give it the slides or the materials that you use in a class a prior year, and you sort of say, “I want to incorporate more active learning into this class. Can you give me a few ideas?” and what ChatGPT would tend to do is provide you with a list of active learning activities. So maybe it would suggest a poll question for your slide number three, or a breakout room kind of activity for slide number seven. The reality is that if you’re just trying to inject a little bit of active learning into a class you’ve already planned, you don’t want to incorporate the 10 ideas that ChatGPT would give you, but it’s enough for you to have one or two good ideas come out of that literally three minute exploration for this to be, I think, worth the effort. I think often we think about, can ChatGPT be better than us?, or can AI be better than us? In the book, we emphasize that’s not the question that you should be asking. The question we suggest you ask is, can I plus ChatGPT be better than I alone? And so in this particular example, you might have a class from the previous year that you’re trying to inject some active learning activities. You ask ChatGPT for a little bit of help, maybe give me five ideas or 10 ideas of active learning that I can incorporate into this particular class. You get one or two that you like, and you might run with them. Or maybe it’s enough of a…not the exact thing that you want to do… but it’s enough of an idea that you can explore. The other interesting thing about AI is that it has infinite patience. So if you don’t like any of the 10 activities that it gave you, you can ask for 10 more, maybe 15 more. And if all you’re looking for is one or two, the spark of an idea might be there. You sort of were describing before, maybe there’s a blank page and I want to get some ideas. The same thing is for injecting active learning into the classroom. One more thing that I want to add is that both in terms of personalized learning and in terms of injecting active learning into our classroom, is that one of the things that has been very interesting is to observe, and I think Angela has been an amazing conduit to be able to see this, is to observe how our students are using ChatGPT, in the absence of us doing anything to use ChatGPT. And so just a couple of quick anecdotes. This happened, actually, after the book. This happened in the last week. So in one of them, I have a student in one of the classes who was hesitant to take the class because the class does require you to run simulations with Microsoft Excel. And he said, “I don’t know Excel. I’m willing to work hard, but I don’t know Excel.” And he, basically in a couple of weeks in the semester, designed simulations with the help of ChatGPT, in a way that he didn’t even think was possible. So to observe how he was able to pursue the curiosity, the intellectual wanting to learn about this and sort of struggle a little bit with ChatGPT: “Can you give me the Excel formula so I can do this?” And so it has been wonderful, and frankly, I couldn’t have spent the hours with him that it took him to do this, to the point that he’s now creating simulations of stuff that we’re doing in the class where we’re not even asking them to do simulations. He came back this week and said, I have created a bot for your course, and I have essentially put the materials from the class, and now I’m asking the bot some questions and getting answers, and that I think it would have been hard to do before. So those are just a couple of the examples of being able to see the students engage in this active learning themselves without us even doing much.

Rebecca: I think that underscores the idea that you suggested earlier, of this infinite patience. I love that idea.

Angela: In the book, we also talk about ChatGPT being empowering, because at the end of the day, it removes the barriers to learning, and so it gives them the encouragement that students need to be able to learn new things by themselves. And of course, critics have sometimes criticized that this only works for motivated students, because you need that motivation to learn to begin with, and that’s absolutely right. But is it not a benefit that at least those that are motivated to learn will be able to do things like this and feel that empowerment, which in turn, is going to feed more into their desire to learn new things?

John: And for those students who come in with a somewhat weaker background, it can help to equalize that background by providing a tutor that never gets tired, for the same reason, that it has infinite patience, and that’s something that human tutors may not have, or their friends, or other people in the class working with them may not have.

Rebecca: Or that lack of judgment.

Dan: There’s an additional benefit, John, to what you just said, which we discovered when interviewing students for the book. It’s not just that it has infinite patience. It’s when we asked the students, what do you see as the advantages of using a bot or just an AI tool to learn, two that came up, one we expected, the other one, in retrospect, we should have expected, but didn’t. The one that we expected is, well, it’s available to me. 24/7, an instructor is not. And the second one, which is very interesting, was summarized by a student who said, I can ask the tools questions that I would be too embarrassed to ask a teacher or a teaching assistant. So it’s not just the infinite patience, which, frankly, a human being won’t have after the third or fourth time that a student says, “I don’t get this.” You might sort of try in seven other ways, but at some point you might have difficulty understanding where they are. Or it’s not even infinite patience, it’s infinite time. You might want to spend time with a student, but you might not be able.

John: And students who may experience some imposter syndrome, perhaps that may help them get past that barrier of asking for help, because they don’t want to reveal what they’re not comfortable with.

Dan: Absolutely.

John: One other thing you talk about is course evaluations, and one thing that most faculty experience is that they may get hundreds of really positive ones and two or three really negative ones, and what they walk away with is a memory of those less positive comments, the negative comments tend to stick a little bit better. You suggest, perhaps using AI tools can help remove some of that. Can you talk a little bit about that?

Rebecca: How did you know they stick more, John?

John: I’ve heard rumors, anyway. [LAUGHTER]

Dan: Yeah, so I think you just pointed out one of the advantages of being able to use an AI tool to summarize course evaluations, which is that sometimes what you remember from reading course evaluations is that comment that was either offensive or hurtful or just like, mean, frankly. And what you can do with an AI tool is to just summarize and sort of say, “Give me what are three to four things that students seem to find effective in this course, and give me three or four things that students find ineffective,” which at the end of the day is probably the most important thing you want to learn. And you might even ask the AI tool to give me some specific suggestions for how to improve the course given these evaluations. Now, you might not agree with the suggestions. You might sort of say, “I know students are unsatisfied with this, but I’m not willing to do what ChatGPT is suggesting.” But again, it at least gives you a little bit of a sense of direction. The other thing I would say is that even the mere act of summarizing the themes is something that I think it’s hard for the human mind to do, like if you have 50 or 60 or 100 evaluations to read one after the other, you start thinking about that comment that was either very good or very bad, and you lose a little bit of track of what were the major themes. And so I think those are some of the benefits. I do want to say that I don’t think ChatGPT is as good as having a teaching professional read the evaluations and come to you and have a conversation with you about them. But you might not have such person at your disposal, and even if you did, that person might not be available when you need to do this, or maybe might not be available every semester. So I think there are some advantages of doing it in this way.

Rebecca: It almost seems like a possible benefit of: “Here’s your evaluations, and also here’s the summary.” [LAUGHTER]

Dan: Yeah, well, I think academic institutions should be thinking about doing things like that, where you automate and by the way, we had a meeting two weeks ago with our faculty, and in half an hour, I created a simple bot that our faculty could use to upload their course evaluations, and it gave them sort of the equivalent to what I was just describing. I even added like a little instruction for the bot: take the most favorable quote so you end reading the evaluations with a nice quote from a student. And this is just like half an hour investment in something that could be useful to many faculty members. You could imagine thinking more deliberately about, “Okay, what are the things that we want the faculty to be working on, and how do we design a simple bot to bring those things.”

John: And I think you also suggested that if a department chair or Dean is also reviewing evaluations, this could make it a much more efficient process to summarize them, rather than them having to go through and read them one by one, especially in larger classes or departments.

Dan: Absolutely, I think in general, the ability of AI to both summarize documents and to allow you to interrogate documents really far exceeds the human capacity to do that. So if you have 100 pages of student feedback or course evaluations, there’s no way that you can do it in the speed at which ChatGPT, or an AI tool similar to it, can do it.

Angela: Dan, there may be, like, a useful tip to give here to our listeners, which is, when summarizing student evaluations, it’s always useful to ask for how many people have made comments about a specific theme, because this helps you weight how much the themes that are being brought up are widespread across the students or just a one-off comment for somebody, and that may be something that ChatGPT may not organically. And then the second one is to also split themes between positive and negative, because there are some times that you have a theme, say, like, problem sets are very long, maybe some student makes a positive comment about it because they think that they allow them plenty of time to practice topics in depth, while some other complaints about the workload, right? And so here we comment how interrogating a document may also be a back and forth process where the better questions that we ask, the better the quality of the output that we are going to get from ChatGPT is going to be.

Dan: Absolutely.

Rebecca: One of the other examples that you provide about getting some feedback about teaching is having faculty members record their class audio and then have it transcribe and then ask ChatGPT to evaluate and provide suggestions about their teaching, and then have ChatGPT analyze those recordings and assist with peer evaluation of teaching. Can you talk a little bit about how that feedback might be helpful and maybe perhaps less biased than human feedback on teaching?

Dan: I want to first preface this by saying that this was done by one educator, as we highlight in the book. There are obviously issues of privacy and permissioning that need to be resolved before scaling this, but I think the potential of having an AI tool be able to analyze a class that you teach and provide you with detailed feedback customized to your own teaching philosophy, you can sort of say, here are the teaching principles that I have and that I bring, and I want you to assess what I did relative to those principles, as the educator that we highlighted in the book did, I think is wonderful. Again, comparing with a counterfactual, what would you do if you didn’t have the AI tool? If you had a teaching coach or someone who specializes in teaching and learning, they might be able to see things that the AI tool won’t be able to see. Because they know you, they might be able to give you advice that’s more sort of adjusted to your own needs. But there’s no question in my mind that most of us don’t have access to such a person on a literally daily basis, and so the AI could help scale that feedback, could help complement… Angela and I in the book, talk a lot about how AI can complement things that we tend to do with other human beings, and I think this is one of them. In terms of being less biased, obviously, there’s a lot written about how AI has some built-in biases that goes, I think, beyond the scope of this podcast, but I do think that an AI tool can, if you give it: “Here’s the criteria by which I want you to judge the class that I just gave,” might be able to help you see things that you’re not seeing.” So is it ready for prime time right now? I mean, our educator was super, super innovative in the way that they did it. My sense is that the tools will come so that it’s much easier to do it. And one of the areas that we’re most enthusiastic about is to think about the use of AI inside the classroom, not just to provide feedback after class to a teacher, but how can AI be used inside the classroom to do lots of things? I think that’s a chapter in the book that is a little bit of reflecting experiences from educators, but mostly speculating about future directions. My hope is over the next year or two, we’ll see lots of super interesting uses of AI in the classroom that could help advance our teaching goals.

John: One of the things that people who run teaching centers sometimes note is that faculty will come to them and talk about what they’re doing in classes, and then the feedback they get from more senior people in the department may not always be consistent with evidence-based teaching practice. [LAUGHTER] Of course, that would not happen at our institution, [LAUGHTER] but I think that would be one way in which, while there are biases in AI because it’s trained on human data, it’s at least trained on a very large base of human data, rather than just the perceptions of the one person who’s sitting in observing the class that semester. So it might actually provide somewhat more neutral feedback, again, as long as the prompts are well designed.

Dan: Yeah. And one thing I want to add is that you can literally tell the AI tool, let’s say there’s a book about teaching and learning that you think captures particularly well the evidence and how you would like to teach. You can sort of give that material to the AI tool and say, I want you to use this as a basis for providing the feedback. As a person who teaches and tries to be as helpful as I can to my colleagues when they ask me to observe them teach, one of the challenges that you face when you observe someone else teach is that instead of thinking about, how can I be helpful to this person where they are, it’s almost inevitable you start thinking how you would have done it differently, and that’s probably not the right approach to help someone get better, because whatever you would have done differently might or might not help the learning of the students in that classroom. So I think trained teaching professionals might not have this issue, but if you’re getting feedback from a colleague, again, I don’t think it has to be a substitute. But if you ask yourself, how many times have I had a colleague observe me teach in the last year? I think most of us would reply, not that many. And AI could help scale that feedback and certainly complement.

John: A related note is that when there’s surveys of faculty in terms of how much they use active learning techniques, generally, most faculty report a relatively high level of use, but when students are asked about that, the reported level of use is a bit lower. And perhaps this, again, might be a nice way of getting at some assessment of that that’s independent of the faculty’s self-perceptions.

Dan: Absolutely. Again, I’m not saying that this is happening now, but one very raw measure of how much active learning is happening in your classroom is what percent of the time in your classroom you are speaking. I have had someone measure that in my own classrooms, and I severely underestimate that percentage, I think I speak much less than I do, and so it’s a reality check. But now that plus 100 other statistics about your class, average wait time, how many open-ended questions have you asked? How many times do you say “hmm” when you’re teaching? How much back and forth there’s between students, like a volleyball kind of dynamic rather than ping pong, where they’re always going through you? All of those things which you might have imperfect perceptions of what’s going on. You could imagine an AI tool being able to capture and give you a more realistic sense of what’s happening in your classroom.

John: I believe that there is a tool out there that will record your classes and use AI to give you some feedback. What’s the name of that application?

Dan: The people that I actually know and highly recommend the tool is called TeachFX, and they’re able to do that, and maybe some of the things that I’m describing now they can already do, but if not for sure, they will be close to being able to do. It’s almost like you have a full diagnostic of what happened in your classroom in a way that would be very hard to do otherwise.

Rebecca: So shifting away from teachers thinking about their own teaching and back into the hands of students being in control of some of their own learning, what are some ways that students can use ChatGPT to assist their own learning?

Angela: I love this question, Rebecca, because it’s a big part of the book, and it’s something that was very important for us to reflect. Dan has a very good sentence that he uses when he starts introducing workshop which is, teaching is not the same as learning, and so teaching effectively may not always be the same as learning effectively. So that said, I’d like to start this the answer to this question by highlighting one of the most important principles that we talk about in the book, which is that different uses of AI lead to different degrees of learning. A nd so we strongly believe there’s not such a thing as ChatGPT helps improve learning, or ChatGPT impacts learning negatively. It just depends on how it’s used. So I could give you a range of different uses that students can give to ChatGPT, and we actually talk about six of them in the book. They include things like getting feedback about their answers, which relates to this idea of using ChatGPT as a tutor. They are things like learning about a new topic or finding arguments and counter arguments about a topic. These are basically anything that a student has to do in their schooling process, t here’s a way in which ChatGPT can learn. What I want to give you is this very specific example that we include in the book, and that explains how ChatGPT can be an agent in the active learning process, rather than an agent in making learning passive. And it’s actually an example that I did myself when I was trying to create an essay for one of my philosophy courses. And one way in which I could have gone about this exercise is asking ChatGPT to write the essay for me. And I could have said this topic is about effective altruism, please write an essay of 1000 words with some pros and some cons, and then just submit that essay. That would have, of course, negatively impacted my learning, and it would have been cheating, obviously. But there are many other ways in which I could use ChatGPT for the same task. What I did in particular is I asked ChatGPT to play the role of a philosopher that was very acquainted with Peter Singer, one of the philosophers that was particularly relevant for the topic that I was writing about. And I had a debate, a back and forth debate, with the AI tool while the AI tool was impersonating Peter Singer. And so I threw the AI some arguments, I threw the AI some questions, and then the AI tool would answer me back, and that was incredibly helpful for me. It helped deepen my understanding of the philosophy, it helped me strengthen my arguments, and it overall improved the quality of the essay that I ended up submitting massively. Now it’s very difficult for educators to understand how students are using ChatGPT in the background when they just see the end result, but educators can play a role in encouraging productive use of ChatGPT.

Rebecca: It’s a super fun example. [LAUGHTER]

John: It’s something I’ve encouraged students to do too, to have it play the role of an economist and then ask questions about current policy debates. In particular, I suggested having it play the role of David Ricardo and ask questions about trade barriers in an introductory class. And they enjoyed that, or at least the students who tried that enjoyed it. It wasn’t a required activity, but it was just something I encouraged them to do.

Angela: It’s fascinating. Yes, I agree

John: What are some of your own favorite ways of using ChatGPT.

Angela: I’m using it recently for things related to marketing. I find myself having to create a lot of marketing copy, which is something that falls way out of my comfort zone. And it helps me make my communications more crisp, and it helps me with creativity. I use it a llot to brainstorm ideas where I just say, “Give me 10 different jokes that I could use in starting this email, for example. I find it amazing. It solves my life. It’s my best friend these days. I have been integrated into almost everything I do, and I’ve been finding it particularly helpful for this task.

Dan: Going back to what I said at the beginning, I think of it as a thought partner and as an assistant. As a thought partner, a way of brainstorming lots of things. So it could be teaching related or not teaching related, particularly when thinking about broadening things, I think it can be very helpful. But I want to talk maybe about a use that we haven’t touched on and which I think might be of interest to people, which is that it can be incredibly helpful at doing things that we hate to do with our computers. So for example, the other day, someone sent me a list that, in reality, I would have preferred to have a table, because it really had literally separated by, I’m not even sure, space, double space, sometimes comma, whatever it is. And I just copied and pasted that into ChatGPT and I said, “Give me a table with this.” So anything having to do with formatting, you’re much more likely to be able to do it quickly with ChatGPT or similar AI tool than you would trying to do it manually. So another of those menial things, I know it’s not a big sort of deal to do it, but I basically had to write an expense report for someone who had invited me to do something, and all I had on my computer was a scan of the eight receipts that I had. And one day I said, “Okay, I have to do it.” And so I just dragged the eight receipts to ChatGPT and I said, “Please prepare an expense report with a table in the middle, listing each expense and totaling the expenses” and in three minutes counting the time that I edited that letter afterwards I had the expense report written. I know that’s like a super small sort of thing, but think about a number of things that whenever you find yourself dreading to do something on your computer, you should think of this almost like as an augmented operating system. It’s almost like as an assistant. Normally, when you’re trying to do something in the computer and you need help, you might go to someone and say, “Can you do this for me?” And then you have to wait. Here it’s almost like the assistant is right there in between you and the computer, and able to do lots of things like this, even things like, here’s a printout of a table that I had on a piece of paper, put it on an electronic table, add these two columns. So after you brainstorm if you want things in a different format. The other day I had someone send me a bunch of numbers, and I just copied and pasted and started doing some basic data analysis with ChatGPT. So lots of activities that would normally take you more time are ones that you can do. Those are not very profound uses, but if they save you time so you can go back to your research, your teaching, or anything else, or even fun, that would be great. And then just as a couple of fun uses: one, next time you’re at a restaurant and there’s a dish that looks delicious or that tastes delicious and that you want to have a sense of how it was done, take a picture, upload it to ChatGPT and say, give me a recipe for this dish. I’m sure it’s not going to be as good as the restaurant, but it can literally give you a sense of that. And then nowadays, with audio capability, you can literally have conversations with ChatGPT. You don’t even need to start typing. So all of those things are now possible.

Rebecca: I like the idea of saving dread. That’s good. [LAUGHTER]

Dan: Yes.

Angela: Someone once told me that they took a picture of their fridge in their kitchen and then asked for potential recipes they could cook during that week. So the people really get very creative with what they can do with ChatGPT once they start experimenting

Rebecca: Anything to save a headache, sounds like a good plan.

Angela: Totally.

Dan: Absolutely.

Rebecca: You included a chapter in your book on creating chatbots. Can you talk about some ways that an instructor can use chatbots, either for their own work or for student use?

Dan: I think Rebecca, the distinction you just made now, I think that is a very important one. You can create a chatbot for your own use, or you can create a chatbot for others to use. Others could be your students or any other person that you want. So for your own use, if you think about activities that you’re constantly doing, and you don’t want to write a prompt that has a context every time that you go into ChatGPT, you could have a bot that helps you with this repetitive task. So a simple example would be, suppose that you have a course where you want ChatGPT to help you every class session, you want to upload your slides, and you want ChatGPT to give you feedback. And so you might create a bot where you upload the syllabus of the course, any material of the course that’s relevant for ChatGPT to have as context. And then you have a prompt for the bot that describes the type of feedback that you’d like to receive. Now you could, every time you’re going to teach a class do exactly what I’ve just described, so upload the materials, put the prompt and so on, but without much extra effort you can create a bot that basically allows you to go to it every time, and then instead of having to do all of that from scratch at that moment, you just sort of say, “Alright, here are my slides for tomorrow. Go ahead and give me the feedback,” and so it’s a very efficient way of being able to do tasks that you do often. I would say one important thing, maybe the most important thing that I think Angela and I can say about bots is that they sound like something very hard to do, but they are not. If you already have the basics of how to prompt ChatGPT, creating a bot is not anything extra. There’s no code. It’s English. It basically has two components. You upload files and you write a prompt, and that’s it. You obviously need to test it to make sure that it does what you want and so on. So that’s number one. That’s for the instructor. But you can also create bots for your students or for anyone else. And so there, I think there are interesting opportunities. in the teaching realm. You would upload your syllabus, you will upload a bunch of documents relevant for the course, and then, depending on what you want the bot to do, we have lots of examples in the book about what educators have done. So, for example, our colleagues Sharad Goel and Teddy Svoronos created a bot to answer questions about statistics course and give practice problems for them. We have David Malan from CS 50 created a bot to help answer computer science questions that students often have at different times in the day and at night. So there are many, many different uses. You just have to think about, okay, what are things that I would want my students to have access that maybe I cannot provide that access right now, and it might be a good thing to do. But the bottom line is, this is not rocket science, if you know how to prompt, you know how to build a bot.

John: You also provide a companion site. Could you talk a little bit about what’s on that companion website?

Angela: Many things, but on the topic of creating chatbots, we actually have that same chapter linked for free in our companion site. So as Dan was encouraging educators to just try and give it a go, they can refer to the chapter that is linked in our companion site. A lot of the work that we did with this book was try to demystify AI for people that were not familiar with this technology. So we are not using any particular slang. It’s all conversational English to explain how to use it. In addition to these, we have other resources that, due to the nature of AI and how rapidly it’s changing, we expected them to potentially be out of date soon, and so we have various types of resources linked. One example that we reference on our book and that we feel that people may want to explore in more depth, too, are the same prompts that we included in the book are included in a document that is linked in the site. And we feel this is important, because if anyone is reading the book and they feel that they want to try out something, instead of going to ChatGPT and having to write the prompt from scratch, they can just go to this document, copy and paste and have the prompt ready to go. And then we also include some additional research or additional resources that can be useful for people who are interested in learning more.

Rebecca: One issue that students are definitely concerned about is the effect of generative AI on their job prospects. What types of jobs are most likely to be affected and will the widespread availability of AI assistance reduce the productivity difference between skilled and less skilled workers?

Dan: So, I can see that John was behind this question, because I know he’s an economist, and I’ll be curious to hear your views on this. As part of the job that I do here at the Kennedy School, I started co-teaching a course on generative AI, and we had a session on generative AI and jobs. And so I think the short answer is that I don’t think anyone knows for sure. So people are trying to understand how these tools can be helpful. I find historical evidence about technological breakthroughs to be at least informative, but there are people who say that we’ve never had any technological revolution that was as disruptive as this one. And so those people basically say this time is different. But the one thing I would say is, if you study technological innovation in the past, almost every time, people have said this time is different. [LAUGHTER] So I’m not sure what to make of it. Maybe this time is indeed different, but I think at a super broad level, I think we’re not gonna run out of jobs. I think some jobs will disappear, and some jobs will substantially be augmented by AI, and some new jobs will be created. That’s my best guess as to what will happen. Students who go to college, my sense is that they will probably be in a relatively good position to take advantage of AI. But if I had to give students advice, is to take advantage of the opportunity of being in school to learn how to use AI in a productive manner. I think we tend to sort of think that our students will figure it out quickly, but I do think that there’s ways of using it that can help students learn more effectively and just to work more effectively. Whether it will reduce the gap between skilled and unskilled labor. I think that feels to me that there are different sides of that argument, so I leave that up to you, John, to sort of say in which side you’re in. On the one hand, some people say that it’s substituting cognitive work, and therefore it’s going to reduce the gap; It’s one of the technological innovations that seem to be displacing more of the cognitive work than previous technological innovations. On the other hand, it might be precisely for the skilled labor for which the technological innovation can help increase their productivity.

John: Yeah, it’s really early, as you said, and it’s really hard to guess where this will be heading, but some of the initial studies, I think, have shown that it’s tended to raise the productivity of less skilled workers, or less experienced workers, relative to those of more skilled workers, which could reduce some of those gaps and perhaps narrow some of the pay differentials. And we don’t know in what direction that will go.

Dan: It could.

John: And on a broader level, there’s the whole issue of AI raising productivity of workers, which could result in substantial gains for society. But the question is, how are those gains going to be allocated? Will they show up in the form of higher incomes for everyone? Will it be concentrated among the firms providing AI tools and services, or will these be shared? Could we end up with that 15-hour work week that Keynes predicted way back in the 1930s?

Dan: I’m skeptical that we will end up in the leisure society of 15 hours a week, because one of the people that I follow on this topic is David Autor, a professor at MIT, and he argues, I think convincingly in my view, that we as human beings have an insatiable sort of capacity and demand for new products and services, and I think that’s going to feed the next generation of products and services that we will want to consume. And if you think about occupations that existed at the beginning of the 20th century that no longer exist, and now there are occupations completely new that didn’t exist before. And my sense is that 20 years from now, there will be occupations that we didn’t even think would exist. So my best guess is that it can have a positive effect on productivity and therefore increase in general economic well being, but I don’t think it will increase it to the point where we’re all gonna work less. I suspect that the two of you will work just as hard, even if AI could do half of your job. Maybe you’ll create a second podcast. Maybe you will do some other thing that will keep you occupied. That’s my best guess. But again, this is highly speculative. I don’t really know what’s going to happen.

Rebecca: Dan, I feel like you know John really well. [LAUGHTER]

John: And the work week has been stuck at about 40 hours since the 1940s or so, roughly.

Dan: I do want to sort of at least mention very explicitly that, even though the tenor of this conversation is one that is positive on AI, there are obviously lots of challenges and risks. On the Teaching and Learning realm. Angela already mentioned, but AI can be used in ways that hinder learning, that are not going to help learning if students start using it just to do homework for them instead of with them. So I think there are many, many challenges and risks inside the teaching and learning realm, and there are obviously huge societal level challenges, just to mention a few: misinformation and disinformation, challenges of intellectual property, challenges of jobs that we have just discussed. There are some people who are really worried that, even though, in the long run, we might not lose jobs, the reality is that some jobs will disappear, and so do we have a strong enough safety net to be able to help people transition from one kind of job to the other? And there are obviously existential risk that people talk about, what AI could do if it were out of control… so beyond this podcast. But just to return to the job of an educator. I think if you’re an educator and you’re not using AI, we suggest that you at least experiment to see how it could help you advance your teaching and learning goals, and maybe even try to sort of see how your students are using generative AI, because that would be very instructive in terms of you hinking about how you can use it to stimulate their learning.

Rebecca: So we always wrap up by asking: “What’s next?”

Angela: For us, the hope is to get our work out there to as many educators as possible that could benefit from it and continue learning, because there’s so many changes that are still going to happen, and so many that we don’t know. So staying open to learning and to exploring how to incorporate this technology for better teaching and better learning.

Dan: I agree with everything that Angela just said. I think for me, I’m fascinated with the potential of generative AI helping us learn. Not just help our students learn, but help us as educators learn. And so to me, it’s like incredible to literally have available 24/7, a resource that I can ask questions and have conversation with in ways that wasn’t possible before. So in terms of what’s next as an educator, I’m very curious to continue this journey. As an educator thinking about our students, I’m just literally fascinated just learning how they are using some of these tools. And if you could do one thing as an educator, maybe create space for them to not just use the tools, but share with you how they’re using it. So it could be something as simple as you build into an assignment, answer this question, and then go into an AI tool, get some feedback, and then tell us how useful the AI tool was for you. And I think you’ll start discovering some really, really interesting uses that, as Angela said before, get closer to fulfill the promise of personalized learning that we have been sort of exploring for many years.

Rebecca: Well, thank you so much for joining us. This has been a fun conversation.

Dan: Thank you.

Angela: Thank you so much for having us.

John: Thank you. It’s an exciting topic, and thank you for helping lead people along in learning more about AI and how it can be used.

Dan: Well. Thank you, John and Rebecca, for the work that you do to illuminate us, not just in use of AI, but in so many topics related to teaching and learning, you do a huge service to the teaching and learning community. So thank you very much.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

359. Privacy Booths

There are few private quiet spaces on most college campuses where students can record podcasts or converse online with counselors or health care providers. In this episode, Michael Revenaugh and Forrest Warner join us to discuss how Hamilton College addressed this by providing students with privacy booths and soundproof recording spaces

Michael is an instructional designer who specializes in video and audio production at Hamilton College. Forrest Warner is also an instructional designer with a focus on 3D modeling, graphic design, visualization, spatial analysis, and video and audio production, also at Hamilton College.

Transcript

John: There are few private quiet spaces on most college campuses where students can record podcasts or converse online with counselors or health care providers. In this episode, we examine how one campus addressed this by providing students with privacy booths and soundproof recording spaces.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guests today are Michael Revenaugh and Forrest Warner. Michael is an instructional designer who specializes in video and audio production at Hamilton College. Forrest Warner is also an instructional designer with a focus on 3D modeling, graphic design, visualization, spatial analysis, and video and audio production, also at Hamilton College. At Educause last year, Michael and Forrest presented on the use of privacy booths at their institution. Welcome Michael and Forrest.

Forrest: Hey, thanks for having us.

Michael: Yeah, thanks.

Forrest: We’re super excited to be here.

John: Our teas today are… Michael, are you drinking tea?

Michael: I do not currently have tea, I apologize, but my go to is a Celestial Seasonings mint magic.

John: Very good.

Forrest: I’m rolling with chamomile this morning. I like to keep it calm, keep it smooth in the mornings. This is nice.

Rebecca: That sounds good.

Forrest: What are you all drinking?

Rebecca: I have Hunan Noir.

John: …and I have spring cherry green tea.

Forrest: Very nice.

Rebecca: We invite you here today to discuss the use of privacy booths on your campus. Can you talk a little bit about how this initiative started?

Forrest: So Mike actually joined us kind of just after we had started this initiative. And actually I started just after they had actually even come up with the idea. Nhora Serrano, our director, and I believe is was also Brett Olsen, were working on expanding podcasting on campus. And what we were running into, and I think I talked to you about this while we were at EDUCAUSE, was we have spaces on campus that can do those kinds of things, but they’re department specific, so you have to be taking courses in that department in order to have access to those spaces. So if you ever wanted to use any kind of recording equipment or anything like that, it just wasn’t available to you, unless you happen to be taking a video course, an audio course, whatever. So they were looking to expand in the library to give them better access. And the idea they had come up with at the time was to get a couple of free standing audio booths. We had ended up finding a model that we liked. Studio Bricks was the company that we had, the plus one model, which was kind of meant for like one and a half people. [LAUGHTER] I don’t know how you fit a half person there, but whatever.

Michael: I think our record was four at one time, [LAUGHTER] students decided that they could get in there. It was evocative of phone booth stuffing. [LAUGHTER]

Forrest: Yeah, and I mean, the booths were great. We had them for a year. It was kind of leading up to the renovation that we ended up doing that following summer. So that would have been the fall of ‘22 is when we got them. They worked really well for what they were. They were kind of like a phone booth style booth. It had audio proofing, and they had a dedicated computer, audio equipment. We had Shure microphones in there as well. It was a nice little space, and really just kind of like, “Hey, let’s see if this is something the students are interested in.” And right off the bat, we had a lot of action from that. And then, leading into the renovation, we decided to go all in, and we built four of the audio booths, one of which we’re in right now, which are much larger, and then we can talk about it more detail a little bit. But great spaces… get used a lot. The data is like off the charts. We’re getting a lot of information, a lot of people using the spaces. So yeah, very cool.

Michael: Yeah. We had a bit of a unique opportunity to transition, because the first floor of the Burke library here at Hamilton underwent a gut renovation in the summer of ‘23 so we could remap the entire floor plan, and we did, and we moved some things around, and were able to allocate space specifically for these four booths. So it wasn’t found space, we could build them specifically to our needs, which was great.

John: And the booths that you’re referring to and that you’re sitting in right now seats two comfortably. How many people could fit inside of one of those?

Forrest: The rooms are like eight by eight…

Michael: Yeah, eight foot by eight foot. So we have two dedicated microphones so people can do interviews or projects, like we are doing currently, but we also have some more video applications. As you can see, but our listeners can’t, behind us we have pull-down green screens. We have three point lighting installed in them too. And we also have ceiling microphones that we can switch to. So if people want to do any sort of smaller video project, newscast, what have you, they can use those things as well, but we did primarily design them with podcasting in mind. So as far as fitting people in here, I think the most I’ve done is 10, and that’s usually like new student orientation or Parents Weekend or faculty instruction. Like, here’s the things that we have, come on, like, let’s all get into this one so I can point out all the cool stuff and then shoving them in that way, but I think typical student usage maxes out around four or five, and they seem to be able to do that with no problem.

Rebecca: How soundproof are these studios?

Forrest: Fairly, fairly soundproof. They’re nice because they do have some paneling. Actually, the gray paneling you can kind of see right now, that’s all sound paneling. And also the door itself has soundproofing capabilities as well, so it does stay very quiet in here.

Michael: Yeah, I unfortunately don’t have a number on it, but walking outside, I’m unable to hear conversations that happen. And I’m sure if screaming started, then it would get through, but for any mid-range conversation, you can’t hear anything from the outside.

Forrest: Which is obviously ideal.

Michael: Yeah.

John: Between the smaller privacy booths and these larger rooms, how many of these do you have on campus, and how do students access them? Are they just open all the time, or must they be reserved in advance?

Michael: That’s a great question. We actually have four currently: the two modular ones that we used, we have shifted out of the library, we’ve repurposed them, and currently [LAUGHTER] they’re trying to figure out what to do with them. We were demonstrating a need for this student privacy, and it’s just kind of figuring out where on campus they would best go, as far as like existing blueprints and footprints, and where the students would be able to find and access them. In terms of scheduling for our four permanent booths, they are open whenever the library is open, but they must be scheduled. We currently use the 25 live scheduler, which is the system that the campus uses, so students are limited. They can book up to three hours a day in the production booths, and then the next day they can get three more. But we try to limit it that way and encourage students, as much as possible, to make reservations, especially towards the end of the semester, when they are getting very crowded, and also just for our use in data collection. One of the frustrating things that we run into is we have the statistics that we’re able to collect, but because the booths are open all the time, we know that they’re being used a lot more than the recorded data reflects, because students are seeing that there’s an open door, I’m just going to pop in there and not fill out a form online, because why would I? I’m right here.

Rebecca: Can you talk a little bit about how you’re seeing the spaces used? What kinds of projects students are doing in them?

Michael: Sure, in our data collection, we basically ask to avoid any infringing privacy. We ask if they’re using them for an academic purpose or other. And other encompasses a wide…

Forrest: …everything

Michael: … range of things, either someone’s personal podcast project, we’re seeing a lot of telehealth and therapy sessions going on, we’ve partnered with the Wellness Center on campus, so students that partake in online therapy are frequently looking for some place to go, that they don’t have two or three roommates hovering around all the time. So they’re pointing them in our direction to let them know that these resources are available. Job interviews are another big one for students looking for internships or opportunities after they graduate.

Forrest: Yeah, the big thing to note about Hamilton in particular is that it’s an entirely residential campus, so every student lives on campus, and finding the time and space just to gain a little bit of privacy is actually really difficult. And like Mike said, it’s difficult if you’re in your room trying to do a counseling session, and then your roommate and three of their best friends bust into the room while you’re doing that. It’s like, oof, really hard to do that, it can probably be really annoying in general. But these spaces, again, right from the beginning, we didn’t mention that we partnered with the health center, and they’ve been a great partner, and they’ve been directing students to these spaces. So if they want to do their telehealth in some place private, this is available to them. And these have been really great for those purposes, on top of the academic uses. It’s kind of like the added bonus for finding that people are probably using these spaces more for those uses than academic at certain points. So the data has been really great, and even just the amount of reservations has been really great. A little bit of data is actually really telling. So the students have been really helpful with that.

Michael: Yeah, also completely separate from the technological aspect, I believe they’re popular just for quiet study spaces as well. So sometimes I’ll come in in the morning and all of the keyboards and mouse and everything will just be pushed completely out of the way. The students just set up their own computer, and we don’t know what they’re doing, [LAUGHTER] so it could just be studying or small group work, but they’re available, and as long as they’re not stepping on each other’s toes as far as the schedule is concerned, it’s up to them what they want to do.

Forrest: Yeah, so far, so good.

Rebecca: I think what’s nice is that it’s in the library, so there’s no stigma to maybe what the space is being used for; whereas, if a space is in a particular location, like if the space was in a health center, or if the space is in career services, or if the space is in a particular location, then there’s an assumption of what someone’s maybe doing in that space. But because that’s in the library, that’s a multi-use space, and there is less stigma attached to maybe why someone’s using this space. So there’s less judgment or less concern about why someone’s using this space, and I really like that about this particular project.

Michael: Yeah, absolutely. There’s less stigma if you’re setting up a therapy appointment and you don’t want people to know, say “Oh, I’m just going to the library,” and it’s completely fine. It’s also a universal space on campus for everyone, which allows it to be more welcoming. We talked about the other booths that are in the studio arts building. And if you are a government major who’s never stepped foot in that building, then there’s kind of a territorialism about it. It’s like, “Oh, I have to go to this science building, but I’m not a science major. Are they going to know that I’m not a science major and chase me away?” It’s like, no, the library is for everyone, so everyone is welcome to come in and use these spaces. And we think that has really been reflected in the numbers.

John: How have faculty responded? Have they increased the number of digital storytelling or podcast projects in response to the availability of these booths?

Michael: Well, that is another role that we as instructional designers have on campus, is that we offer course support. So I primarily take the lead in podcast assignments, so I make myself available to courses that express interest in it. So we see that ebbs and flows. There tends to be more in the fall than in the spring, but faculty are adding more podcasts in terms of final projects to their courses. Some other language faculty will take advantage of the technology for pronunciation and recording that way… small group discussion for a less like fully produced final project.

Forrest: I mean, it’s really kind of from all over the place, and it’s interesting, and actually, this is probably a good time for me to kind of walk through those numbers, just to kind of give you an idea of the general response over time. We introduced the freestanding booths in the fall of ‘22. We got a total of 76 reserved hours, which was primarily aimed at the academic which was like, “Yeah, that seems like a pretty good number.” We were pretty excited about it. And then in the spring of ‘23 we ended up with 181 reserved hours, which is a huge jump. And we’re like, “Hey, yeah, man, these are catching on. This is awesome.” We’re feeling good about going into the fall with the new booth. Fall ‘23 after the renovation had happened, we went from 181 to 934 reserved hours. So again, that was like, “holy moly.” And actually, that’s, I believe when we talked, that’s what you saw. We also have some additional data from this past semester. We went from 934 to 1496 reserved hours. So another 60% jump in usage. And really exciting. Again, it just kind of shows you like, they want this. And I think we had about 300 unique users to the space, potentially, students that would have never spent time in the library, to students that tend to spend time here, but just they’re like, “Oh, this is a really great resource.” So yeah, we were really excited to see how much these are actively getting used. And this is primarily student usage.

Michael: Yeah, there are some faculty that use it for research. They conduct interviews. Actually, one of our college archivists has started doing oral histories. So he’ll bring in community members and use the production booths to record oral histories of departments or initiatives that the college has done over the years, and then back those up in the college archives. So we’re just seeing a really wide range of use in them. And it really speaks to there has been a need for spaces like this.

Forrest: I think leaving it open has always been kind of the way to do it. It’s not creating this wall like we said, it’s like giving people as much access as they can get and just see what they do with it. And I think if you gatekeep or whatever, you’re just holding yourself back. So this has been a really great experiment. I think it’s been very successful for us.

Rebecca: Is there so much demand now that you need more booths?

Forrest: It’s a good question.

Michael: That is a good question. I don’t think we’ve maxed out, again, we’re kind of hamstrung with our data from the people that actually reserve the booths, versus just going and use it. In my personal experience, if I’ve ever run into a conflict, like, oh, I have this booth reserved, and I come down and someone’s sitting there working on something. I’m an adult, so they tend not to give me any pushback. And I say, “Excuse me, I have this booth reserved,” and they leave immediately. But we also have our digital media tutors who are in the library, and then, just conversationally, we haven’t really heard of any conflicts.

Forrest: Even, like, sometimes there’s even open booths available. So if for some reason, somebody was in your space, you could go over and just reserve it real quick, because we keep reservation QR codes right on the doors. So if anybody walks up at any time is like, “Hey, I want to pop in the booth, they can reserve right then.”And we do get lots of walk ins. The data we gave you is only a percentage [LAUGHTER] of who’s actually using the space.

Michael: Again, as is perhaps predictable, towards the end of the semester, around finals week, once those podcast projects are coming due, we do see a big spike in the usage, and then they’re pretty much booked as long as the library is open. But the library also adds extra hours then too. So I don’t think we’ve yet maxed them out, [LAUGHTER] but there’s an additional building that’s being built behind the library and has potential for additional spaces in this vein.

Forrest: Yeah, it’s essentially a Center for Digital innovation, and it’s supposed to help us expand into things like we built the new Makerspace with the new renovation. This will hopefully be more of some spaces dedicated, some probably a little bit more, I don’t want to say intense, but getting into things like robotics or metalworking,

Michael: Yeah…more purpose built, as Forrest mentioned, as part of the renovation, we’ve made a makerspace which houses our 3D printing and virtual reality, and unity and video game development, but we were a little bit hamstrung by we were renovating a space and things that require access to ventilation, like soldering or circuitry or things like that, unfortunately, we weren’t able to fit into that particular makerspace.

Forrest: The new building will have more of those capabilities, again, allowing folks to expand the capabilities and what they’re able to do safely. That’s always the concern with any of these spaces, just making sure everybody knows what they’re doing, and obviously not sitting there breathing in toxic fumes is always a good thing.

Michael: And Hamilton’s slogan, “Know thyself,” and it’s an open curriculum, so the entire college really encourages student exploration and trying new stuff. So all of the things that we’ve been doing here at the Library really fit that mission.

John: You mentioned that towards the end of the semester, there were a lot of student podcast projects coming due. Could you give us a feel for the types of classes in which podcast projects are used, or some examples of the types of podcast assignments that have been assigned there?

Michael: I’m working with one class right now that is in the Classics Department. It’s a mythology course, and it’s going to be a modern retelling of classic myths. And so are going to be working with scripting those out. I think one of the more successful ones that Forrest and I both worked on was in the art department, which was a course on architecture and politics.

Forrest: …art history.

Michael: …art history, yes. So it was a course focused on the intersection of politics and political environment, and how that influenced the type of buildings that were being built and vice versa. And that was pretty fascinating.

Forrest: Yeah, and that was partnered with a WordPress workshop. So the students were doing some web design as well, and they were able to incorporate their podcasts into their web pages that they were creating as part of a course website. And obviously we’re able to add a lot more media and other things to it. So it was really a cool, really multimedia project, and the students really did a lot of work.

Michael: Yeah, some examples from that were: one student did like the new Buffalo Bills stadium and how taxpayer money is used for certain private building projects. There were a couple that were very Hamilton-centric. One building in Hamilton has a very historic wallpaper to it. However, it is also problematic, and it’s just like, “what is the tension between preserving this very famous printmaker piece of history, but how do you properly present that when it does have its flaws? So they’re really well produced and well thought out. And then with course help, again, with the supplemental materials available on their WordPress websites, they were really well presented as well.

Forrest: I mean, you probably get a couple different courses that are like, some are like, they want more of a production value. And then some are like, a little bit…

Michael: I’d say most of the ones we work with are kind of the NPR-style journalistic reporting, but I also worked with a professor in the creative writing department who wanted to give students experience reading their own work. So they would record themselves reading short stories, and then added a little production element, like some spooky music beds or sound effect underlay to emphasize parts of that. And then there are some people that are just like, I want four students to read this article and have a discussion about it on microphone, and then don’t need that edit at all. Just 20 minutes. Hit record, hit stop, turn it in.

John: Sounds like a nice mix of projects.

Rebecca: What role does the library play in preserving some of this work and archiving it?

Forrest: Our primary role is support. We work with the faculty to help them design these assignments, figure out when we’re going to come by and work with the students, give them general support after the fact, and we help them with things like they’re looking to clean up everything. We’ll work with them on that. And then if they want to actively put that out into the world, sometimes, like, especially with things like websites and things, faculties want to make sure everybody can see what the students are making, what they’re doing, which I think is really exciting. Those will continue to exist in that form. Sometimes faculty members don’t want that stuff out in the world too, and they want the students to feel that they can do these assignments discuss in a way that they want to still keep their opinions relatively private, so they might not put those out into the world, and depending on the project, I think sometimes those end up in the archive, but I think that comes from the faculty end more than anything, not necessarily that we do that automatically. So I think if it’s going to be part of the long-term archival process at the college, I think they can just actually work with our on-campus archivist and make it available.

Michael: Yeah, I think they primarily land as student projects, and we make them aware that if you want to share this, either some things that you need to be more mindful of. Music rights is one. But if professors just want their students to go nuts, have fun, this is only for in class, then sure your intro can be Beyonce, but if you want to then share this out in the world or put it in a portfolio to bring with you to a job interview, then you might not want to do that. But, in general, once they’re student projects, they belong to the students. We’ll sometimes have a copy of them, like on Blackboard, if they host them that way. And then it’s as far as archiving, it’s basically like, do we archive student papers? Not particularly. So even the WordPress sites, once they get up, we make it clear to the professors, like, yeah, we built this website for your class, and it’s your responsibility. Like, how long do you want to keep maintaining it? Or make sure, like, the links don’t age out, or you end up, like, with a broken page that people can get to in four years time. It’s relatively new, so we are still negotiating that as we get new projects coming in.

Rebecca: For folks that might want to get started in creating media booth or privacy booths on their campus, what advice might you have in kind of those initial steps to get started or starting a conversation about that on their campuses.

Forrest: I got a feeling most campuses actively could use the privacy spaces. I mean, even just seeing what we’ve gone through, I’m sure there’s lots of ways to apply that to any college at any size. Again, we’re a unique size. We have about 1800, 1900 students. Again, they’re all residential, so it’s easy to kind of like focus them. For us, we were lucky enough to be able to have the resources to afford to purchase things like the freestanding booths. They aren’t cheap. I wouldn’t say everybody could just go out and do that, but you could easily change a space that maybe isn’t getting used very much into a podcasting space. Again, just to kind of prove the point, see if it’s necessary, you know, soundproof it how you can, get the equipment that you can, and then advertise it as an open space. The students actively respond. They definitely love the access, particularly if you’re running into the same issues that we’re running into with departmentally kind of blocked off spaces… things like that.

Michael: I’d say, location, location, location. And it’s a tough choice, because space is at a premium, and we understand that there’s a lot of things that need to happen, but if you can find a space in a building that is open to the entire campus that students feel comfortable in, that students naturally pass, or that is on their way to somewhere else, like centrally located, and that would be good. But again, it’s a delicate balancing act, because you want them to be as soundproof as possible, but you also want there to be a lot of people around.

Forrest: Just hiding these in the basement somewhere, I think, is probably not, even though that always seems like it would make sense. It’s like, if they don’t see them, they’re just not going to use them.

Michael: Yeah, out of sight, out of mind. Just put them somewhere that the students would go anyway.

Rebecca: Do you think partnering with the health center or wellness center was actually really important in the initial steps of your project?

Michael: Absolutely. I’d say yes, very much so, as far as publicizing them to the students and making sure that we had the right setup, making sure that the right equipment was here, making sure that students knew about them and felt comfortable. This Wellness Center also donates fidget toys. So we have in each thing, we have baskets of toys and things that people can manipulate with their hands when they’re doing therapy, just that sort of somatic processing. So invaluable resource to connect over there and just make sure that the students know about it. Because again, communicating with students, I don’t think we’ve really fully figured it out. You can blast them with emails all you want, but if they see, oh, library, delete. Like getting students to internalize the information is an ongoing challenge, so I guess the more angles you can get them with communication from the Wellness Center, communication from the library, communication from their faculty, just to get feet in the door.

John: In terms of the rooms that are set up for podcasting, what type of software do you use, and do you provide any training or instructions for students on how to record?

Michael: Yes, hardware wise, we have our Shure SM7Bs. We also have a Vocaster 2…

Forrest: …audio interface. The audio interface, very simple to use, just relatively compared to some of the more complicated things out there, especially for first-time users.

Michael: And for our audio processing and editing, we use Audacity primarily. It’s free, it’s open source. It gets the job done, an equity issue. Students have been paying enough for tuition and books to be like, “Oh, okay. And for your final project, you need to buy Adobe.” Yeah. [LAUGHTER] We do offer support for like GarageBand and Audition and a few other things that if students want to use it, then, yeah, we can help them out with it. But in course support, I default to Audacity. I encourage them. It’s free, platform agnostic. Download it right now. Typically for core support, I will do two workshops. I will do a pre-production and things to keep in mind, and then I’ll do a post-production where I do an intro to audacity in class for those ones. But also our digital media tutors are trained up on Audacity and can at least do the basics. So if you have a question and when you’re in the booth, flag them down. I h ave office hours, and I’m always happy to walk through things or troubleshoot any problems that students have.

Rebecca: So we always wrap up by asking, what’s next?

Michael: Coming up next? We are learning how to best utilize our green screens right now. They’re really easy to use with like Zoom backgrounds, but finding a good video processing software that is more intuitive or easy for the students to take advantage of. So there’s a little tweaks here and there across the board.

Forrest: And now we’re prepping for the new building, one of the things we’re actually doing more of too, because again, we built the maker space last summer. We got through a year with it, and we’re like, okay, we survived. Everything seems to be working and helping bring people into the space. I know we’re working with our students, our DMTs, who were primarily just tutors in the past. We want to get the space a little bit more active and a little bit more engaging for them and the students on campus. So we had been doing some what we called lovingly Makerspace Mondays, and those were staff led in the past. Those are events that would take place on Monday evenings, where we would need some sort of workshop that was more meant for fun. Those were great. Staff have a hard time doing them the whole semester, so we’ve opened it up to our DMTs, who are actually going to help us provide programming throughout the semester and hopefully bring in a lot more students in general, just to see what’s available. They don’t have to necessarily follow, kind of like, Hey, we’re doing 3D printing VR or whatever, the students, the DMTs, can explore areas that they’re particularly interested in. It could be crafty. It could be computer based. You can do stuff about ChatGPT. You can do stuff about air dry clay. So there’s all these different options. And again, we’re just trying to open it up. so people feel like, “oh, I can do a lot more here than I thought.” So again, just trying to get the word out and yeah, usually that’s through word of mouth, which, honestly, even with the production booth, I think was part of what made it successful was actually more about word of mouth than direct advertisement. So if you make a good interesting space, the students will find it,

John: And those numbers you reported certainly attest to the importance of that word of mouth in spreading the word about the availability of these resources. It sounds like a really nice arrangement.

Rebecca: Sounds like a lot of fun.

Michael: Yeah, definitely.

Forrest: It is that too. Yeah. When things succeed, you always feel good, and then you just have to, if things aren’t going as smoothly as you want, you just tweak it up and make some changes and keep pushing forward, right? So I feel like we’re been super successful here. And there’s other areas I’m sure we could do a little better in, and we’re just going to keep pushing forward.

Rebecca: Well, it’s nice to hear some updates from my hometown.

Forrest: Clintonian?

Michael: Nice, that’s awesome.

Forrest: I’m from Sandy Pond, so both my parents graduated from Oswego, which is where both of you are at, right?

Rebecca: Yes.

Michael: Both of my parents graduated from Oswego as well, teachers all day, right? [LAUGHTER]

Rebecca: Some hometown exchanges. [LAUGHTER]

Michael: That’s right, [LAUGHTER] my wife is a native Clintonian

Rebecca: Small world. Thanks for joining us.

Michael: This was great.

Forrest: All right, yeah. Thank you for having us.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]