99. HyFlex Courses

The traditional college model of full-time face-to-face class attendance does not work well for people with difficult work schedules, those that live at a distance from campus, or who face other barriers to attending classes on campus. In this episode, Judith Littlejohn joins us to examine how the HyFlex course modality can break down these barriers and allow more people to realize their potential.

Judie is an instructional designer and historian from Genesee Community College in Batavia, New York. She is a 2014 recipient of a State University of New York Chancellor’s Award for Excellence in Professional Service and a 2015 recipient of a State University of New York FACT2 Award for Excellence in Instruction. Judie chaired a committee that established procedures for HyFlex courses at Genesee Community College.

Show Notes

Transcript

John: The traditional college model of full-time face-to-face class attendance does not work well for people with difficult work schedules, those that live at a distance from campus, or who face other barriers to attending classes on campus. In this episode, we examine how the HyFlex course modality can break down these barriers and allow more people to realize their potential.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[MUSIC]

John: Today our guest is Judith Littlejohn. Judie is an instructional designer and historian from Genesee Community College in Batavia, New York. She is a 2014 recipient of a State University of New York Chancellor’s Award for Excellence in Professional Service and a 2015 recipient of a State University of New York FACT2 Award for Excellence in Instruction. Judie chaired a committee that established procedures for HyFlex courses at Genesee Community College. Welcome, Judie.

Judie: Thank you.

Rebecca:Today our teas are:

Judie: Mine is a blueberry green tea.

John: I have Tea Forte black currant tea.

Rebecca: I have Prince of Wales tea.

John: We invited you here to talk about HyFlex courses. But first, perhaps you could define what a HyFlex course is.

Judie: A HyFlex course is a regularly scheduled course in which all the content is provided online so that students can choose to participate in the classroom live, or they can video conference into the live class, or they can participate asynchronously online. So, students can also choose every week or during each class time which way they’re going to participate. So, if a student regularly attends class, and then has a medical appointment, and has to miss class, they can catch up later on online. Or if somebody has to travel in this class, they can participate online. Or if somebody registers, planning to take the course online but then decide they’d rather be in the classroom, they can change their mind and come to class. So, it’s literally highly flexible, in that the student has full choice of exactly how they’re going to participate from course session to course session.

Rebecca: Sounds to me like if you’re going to have something that’s that flexible for students, then there’s a lot of planning that needs to go up front on the part of the faculty. Can you talk a little bit about what the requirements are for a class like that, and what some of the things are that a faculty member might need to think about to have a good experience across all those different options?

Judie: So that’s exactly the most difficult part, I think of a HyFlex course, is just the amount of preparation the faculty member needs. So literally, you have to create the entire online course, so that you can think of it as two course preps really, because you have your full face-to-face course and your full online course. And it’s key that before the course even opens, you have the entire course schedule all fully developed so that the students can look ahead and see, week to week, or if you’re meeting two or three times a week from one class session to the next, exactly what’s going to happen in the classroom, or how they would have an equivalent learning experience online if they chose to be online. So it’s tons of work. And then on top of that you have to be comfortable with the equipment. So you have to have students video conferencing into your live classroom, you have to manage those remote participants; you have to be able to include them in what’s going on. So if you’re having a debate, you need some virtual attendees to be able to participate in a debate or in small group work. And you just need to be able to manage all that… respond to questions from virtual participants, and pay attention to your face-to-face students too. And make sure that the students in the classroom and the virtual participants can all see each other.

Rebecca: Why would I want to do this?

Judie: So, it is a lot of work. But the faculty who do it say that the students get a lot out of it, because they do have that freedom to choose how they’re going to participate. The way our college is set up, we have our main campus in Batavia. And then we have six, we call them campus centers. So they’re like little satellite campuses in our region. And we have a four-county service area; it’s about the size of the State of Delaware. From one corner of our service area to the other is almost a two-hour drive. So if you think about how spread out our students are, if they’re in our area, and then the size of some of our programs, or how complex some of the equipment and materials are in the programs, we can’t offer every course at all those campus centers. So many times the students will be driving over an hour, just to get to our main campus to take a one-hour class. And it just doesn’t make sense. So we struggle with enrollments in some of these programs. But if we offer the courses this way (HyFlex), the students can stay where they are and still participate in the class. Some of these rural, remote areas don’t have very good wifi access. So the students can just drive to their nearest campus center and participate from there. So it does help with student access to the courses. And just with work schedules, family life schedules, it helps people stay in college, even if work and family are disrupting what time of day they can participate.

John: You mentioned the ability to go to other campus centers, would there be separate meeting rooms where students might meet in or would they have to do it on their own from some location on the campus center, if it’s not offered at that site,

Judie: Well, there’s a mix of that type of thing. So if you’re at a campus center with an empty classroom, you could go in and watch it from there if the staff help you get set up for that. If you have your own laptop and headset, you could participate from just about anywhere. It’s funny that you mentioned that because currently, the Dean of Distributed Learning is working with the Campus Center’s Associate Deans on a grant project where they would come up with funding for eight or 10 little workstations, like semi-private workstations, at each of the campus centers so students could participate in this type of course in the future,

Rebecca: Especially because of high speed internet and things, it would be really important if you’re going to participate synchronously remotely, that all students necessarily have that available to them at their homes.

Judie: Yeah, exactly. So, these workstations would be excellent for them.

John: What sort of software are you using for doing the live streaming in the remote sessions?

Judie: Right now we have a small group that is using WebEx who had been using it historically for other purposes. But the college as a whole uses Zoom. So Zoom has been working out really well. There’s a Zoom learning tool integration with Blackboard. And so we can have it set up right in the course so it’s seamless for the students to access it. We also use the Ensemble video server, and there is a Zoom to Ensemble link. So they call it ingestion. So when you record in Zoom to the cloud, then ensemble will ingest your video and publish it for you. So it’s right there in your Ensemble library ready to pull into Blackboard into your class. There’s an additional step where you have to trigger the captioning, and then go back through and double check the captions. But other than that, it’s pretty seamless.

Rebecca: How many classes have you offered in HyFlex method so far? And can you give us a sense as to how they’re working or what’s unique or really exciting about some of those classes,

Judie: Just off the top of my head right now I’d say we have about a dozen running. So right now our Computer Information Systems and Computer Networking, people use HyFlex in their program. And we also have Paralegal Studies offering all of their courses this way, so that they can extend their reach. Paralegal in particular, had trouble with those students who lived about an hour from campus and weren’t able to make the drive to all the classes. The way this all came about was: our Provost… her name’s Kate Schiefen, and she’s our Provost and Executive Vice President of Academic Affairs… she came up with this idea last fall to really kind of get our hands around HyFlex, because faculty were trying to do it independently, and they didn’t have much guidance or support. So we put a team together to come up with guidelines or requirements for what has to be present each course and what you need in each classroom that’s going to offer courses this way. What are the expectations? Where are the definitions? We looked at it holistically because we need our registrar to be able to schedule these courses with the meaningful code, so that when we report to SUNY what types of classes we have, they’re coded correctly. Everything from that to how the courses are posted on the website in the schedule so that students understand what kind of course they’re getting into, and what kind of equipment they need, and what the student expectation is. We looked at everything from top to bottom, how it affected the whole college and all the different offices… So like our success coaches, and how do they explain the course to the students that they’re advising… and put together a big manual, it’s a 43-page guidebook, that should be referenced in your show notes, I think, for anyone who wants to take a look at that. And we do have condensed versions for people, so they don’t have to read all of that.

John: I thought the 43 page was the simplified version. [LAUGHTER]

Judie: So yeah, we have the whole process the faculty member has to go through to make sure that their course meets the online course quality standards and all accessibility standards, and has all the content and schedules that they need… and then how we have the room setup with the microphones and the carpeting and soundproofing and things like that, and how the messages get out to the students. At this point, we use Banner as our student information system. And so we have it set up so that once a student registers for a HyFlex course, then within 24 hours, they receive an email that explains “You just registered for a HyFlex course that means…” …you know, and then this explanation. So the student knows that they should have a headset or a webcam and a microphone. And if they choose to participate remotely or of course they’re welcome to come on campus. So a lot of different things are going on right now. In our college in Batavia, we’re working on getting two rooms a year upgraded to be labeled HyFlex classrooms. So that carpeting is coming in, different furniture, desks on wheels, so that people can form into small groups easier… just more useful and versatile learning spaces are being created. So that’s helpful. And in the meantime, we have to train the faculty and make sure that they’re comfortable and come up with their whole timeline of development. Because on our campus, I’m the instructional designer, but I’m the only one. So I can’t really develop a dozen HyFlex courses at a time. But I can work with the faculty who are developing their own materials. So we have a couple different timelines depending on if you already have a fully developed online course that’s already been through all the different review processes or if you’ve never taught online at all. So there’s a big spectrum of faculty that are interested in teaching in the HyFlex modality but have different levels of experience with all the technology. So you might be looking at a year and a half, like three semesters of development, before you finally have your HyFlex course. Or you could start developing today and have it ready in the spring if you’ve already been teaching online and are comfortable with that.

John: And it sounds like the pathway is from online teaching to this rather than primarily from face-to-face to HyFlex…where it would be an easier pathway. Is that correct?

Judie: Absolutely, that’s an easier pathway. And we see it, we can see it in the courses that we have running now. Because there’s a couple of faculty members who have been teaching online historically, who are very student focused and very aware of the importance of active learning, and are used to working with students that they’re not seeing right in front of them. And their courses are fine, they had them set up, they had their schedules ready, a nd we really didn’t have much of a problem. We have other faculty who have never taught online before and are unfamiliar with active learning, and really unfamiliar with some of the changes in learning theory that have come out over the last 20 years…

John: or more.

Judie: Yeah…. That’s a struggle. They’re sort of unaware of the deficiencies in their courses. And it’s hard to help them understand how much better the students would do if they could change some of their faculty-focused materials into student-centered active learning projects or activities.

Rebecca: I can imagine that no matter whether it’s a HyFlex, or just moving to online, anytime you’re changing, and now you’re re-looking at the class as a whole, we don’t always do that. This forces us to have to look at it and a lot of faculty don’t have training necessarily in teaching. And so maybe someone that’s been teaching for a long time, now they’re like, “Oh, we’re having some assistance in moving into something, someone else is taking a look at it, I need to get familiar.” So there’s a lift of having to get from familiar with learning science, then getting familiar with a new modality, whether it’s online or face-to-face, it really could be either. And then on top of that layering in an idea of HyFlex, which they’ve never experienced as a student.

Judie: Yeah, and some of these particular people probably have never taken an online course either. So they have very limited exposure to much of this, they may have strong opinions about it, but they don’t really have any personal experience of it. So that can be a little challenging.

Rebecca: I can imagine it being a really exciting experience, trying to set something like this up, but also like a real brain puzzle in some ways. As someone who doesn’t really teach online, I teach mostly in person, I can imagine the complexity of that. And when I’m teaching in person, and I don’t have people also online or in other places that I’m also having to worry about, we can easily make a decision in class, “Oh, we’re all struggling with this, we’re going to pause in what we already have planned…”

Judie: Right.

Rebecca: …to do this other thing. So I can imagine that that ends up being much more of a challenge, or that flexibility in that way becomes a challenge in a HyFlex course.

Judie: Right. So part of what we encourage and what we’ve seen, especially in paralegal, the faculty do is start the semester before they want to be in HyFlex. And they’ll be in there face-to-face classrooms and they’ll say, “Okay, next week, how about if half a dozen of you stay home and try to log in and join the class from home.” And so they’ve practiced incrementally week to week, got used to seeing themselves on camera, hearing their voice in the video, and managing the students that are accessing the course remotely. And other faculty have been practicing just using Zoom as just a recording tool to make small informational videos. So they’re getting more familiar with the Zoom software and recording and all of that. So I think all those little steps that people take, before they start the HyFlex helps a lot too. And they’re always invited to stop in to watch a live HyFlex course and see how the instructor is managing. And frankly, part of what our team recommended at the end of our work was that, particularly, new HyFlex instructors have some sort of technical person in the room with them for the first few weeks until they feel confident that they can manage this on their own. Unfortunately, that recommendation requires funding that we don’t have at this time. But that is the hope, that one day faculty would not have to worry about that layer of the technical aspect and know that there’s somebody in there to support them

John: …until they get comfortable themselves.

Judie: Right now, when they start it up we’ll try to walk by or they know who they can call. But it’s a little bit different when somebody’s standing right there and can help them.

Rebecca: It just provides this whole layer… like anxiety just goes away… someone else will solve this problem and I can just deal with the other things that come up in the first day of class that aren’t technical issues.

Judie: rRight.

John: One can only wish. [LAUGHTER] But, going back to Rebecca’s point, I think one of the difficulties for people, especially those transitioning from face-to-face to a HyFlex format is that in face-to-face classes, you’re used to be able to adjust on the fly so that if students are stuck, you can stretch something out; if they’re able to pick something up more quickly, you could accelerate some things. But those teaching online are already used to a structured format where the tasks for the week are set in advance; students know where they’re going to be. So it seems like that would be a more natural transition. But I could see some problems in adjusting the first time you’re doing this in terms of coming to class expecting to have a whole class period worth of activities, and students either get stuck on something and you’re not able to finish it in that class period, or students just breezed right through it, they picked things up really quickly and they’re ready to move on or to leave. Have people had many issues with that.

Judie: These are courses people have taught before. So it’s not like they’re going through this material with students for the first time. So they know where the stumbling blocks are for the students. And they’re pretty prepared, they’d schedule in extra time for those content parts that students need extra time with. And honestly, there’s nothing wrong with having a scheduled course and with your online component and then decide to make a change and then post that in the online part of the course for the people who aren’t attending right on the spot. So I think that may not be as much of an issue as it may seem.

John: If people are having trouble with it in face-to-face classes, it’s likely it’s also a bit of a stumbling block for the online classes so that alignment between the two might make it easier to identify those issues and adjust the pacing, particularly for future iterations of the course, too.

Judie: I teach online, and I can see when students are struggling with something and I can send out a clarifying announcement or add some additional content or extend a deadline. And there’s no reason you couldn’t do the same thing in a HyFlex course,

John: Are some courses better suited to HyFlex, and others. How do faculty decide if HyFlex is right for their courses,

Judie: it all just comes back to the learning outcomes. If you have some sort of a course, where students can do a lot of independent work that might be ideal for HyFlex, if you want students to work in small groups a lot, there’s really no problem with that in HyFlex either. I would say big challenges would be if you had wet labs and things like that, that are difficult nuts to crack in the online only format too. And some courses, honestly, I think don’t need to be HyFlex. There’s nothing wrong with just offering them 100% online, if students are just engaging with the material and kind of doing independent work. But really the beauty of HyFlex is that the students can be 100% asynchronous, but still be part of that community and they can see the class and they can feel like they’re part of the group and they can interact with the students. It’s just so important that all that is built in correctly from the start, that the student-to-student engagement is all built in. Because I think that when we tell students, if we advertise that you can take the course from wherever you are anytime of the day and have an equivalent learning experience, and then when they get into that experience, they’re not feeling engaged, and they’re not communicating with the other students. I just think that we can do a lot to recruit students. But really, it’s once they’re in the course and having that experience, that’s what’s going to retain our students and help them be successful and stay with the program. So it’s just a matter of ensuring that all those pieces are built in so that the students aren’t isolated and they’re not passive learners. One of the pitfalls that I think people fall into is they think that all I have to do is lecture and we’re going to throw that video in the class. And then that’s good enough, the students can watch my lecture, and they’re going to know what they need to know. And we’ll move on. And that’s just a huge issue, because that’s just passive learning on the part of the student and they’re not engaged and they may have it on and be washing the dishes or doing other activities and it’s just not a good learning experience for students. There has to be that attachment, that engagement, has to be built in to make sure that students are successful and feel like they’re part of the learning community.

John: It’s’s also a requirement for federal funding too, that there’ll be some degree of interactivity in the classes.

Judie: And we use the OSCQR rubric, that’s the Open SUNY course quality rubric that OLC, the Online Learning Consortium has also adopted. And it’s one of the requirements in OSCQR too, that the students have active learning and student-to-student interaction.

John: One practical thing that you touched on a bit earlier, but I think might be worth emphasizing a bit, is that with demographic shifts, which have lowered the number of college-age students in many areas, particularly in community colleges, this provides a way of offering courses where there may not be enough students face-to-face or online for the courses to carry. And it provides a way of maintaining a larger variety of courses that might not work at any one of the campus centers.

Judie: Yeah, that’s exactly right. For years, we’ve had what we call video linked courses. So you could be in the main campus and link it to one of the campus centers where they might have six or seven students. And we may have six or seven students in ours, but together, it’s enough to have the course run. And so that works pretty well. And in some instances, I think faculty have thought maybe they would turn a course into a HyFlex course, and then decided that really all they need is a video linked course, so that their students don’t have to drive to campus but they’re all participating at the same time. And that’s absolutely fine. There’s nothing wrong with a video linked course. And some people think that they may want to offer their course HyFlex, because they want to record their lectures and have them all in the course. And basically all they really want is lecture capture to have as a resource to subsidize what the students are already doing. And there’s nothing wrong with that either. It’s just not a HyFlex course.

John: But this type, of course, would seem to benefit a lot of students who might not be able to take the other formats…

Judie: Exactly.

John: …the students who have more challenging schedules, people doing shift work, or who are taking care of ill parents or relatives, or who just can’t have a regular schedule. Are there other students who might benefit besides those who can’t meet synchronous times regularly?

Judie: Well, the students who are not in the area, really. We do have online learners from all over the place. Occasionally, we’ll have an international student who has to go back home for a time for whatever reason, and you know, that would be excellent for a student like that, who’s starting off on campus, and then having to move elsewhere geographically later on. But yeah, it is good for what we call, in air quotes, are truly distant learners, then they can participate in a HyFlex course just like they would in any other online course.

John: Or even sometimes distance students, those who are in the National Guard and may get called away for a few weeks, or who might travel a lot for work.

Rebecca: There probably are some challenges that do arise. Have you had any experiences where there’s maybe not enough synchronous students to do synchronous activities? Like too many students maybe have decided to just be online or be asynchronous? So what about that inconsistency there? One week, there might be a lot of people synchronous. And then another week, nobody’s there.

Judie: You’re absolutely right. A couple years ago, I was helping out a new adjunct who was trying this out for the first time, and he only had one student in the room when I was in there helping them get started. And then a second student came in and all the rest of them were online. So in that kind of situation, it would be tough to do a group project in the classroom. And I think that could be problematic. And you’d have to, depending on what you’re using, like Zoom has a groups tool. So if they’re all tuned in at the same time, you can easily put all your virtual students in small groups with each other. The tougher problem, I think would be when you want to do the group projects, and then all of your students decide to be asynchronous, because that can be a little bit trickier. And you need a little bit more time. So one of our recommendations was to schedule a HyFlex courses that only meet once a week, or twice a week at the most. Because if you think about what you have to do as the asynchronous student, so if you have a monday, wednesday course, on Monday night, they’ve got to try to watch that recording and do all that work. So Tuesday, do whatever reading and prep to get ready for the Wednesday course, it would be tough to try to fit in a small group asynchronous project too. And I also think that with HyFlex, it’s kind of like a catch 22, because you need to schedule the course. Typically, our cap is 32, because we have 32 desks in a room. So now you’re scheduling for 32. And you only have three, and you still have this big empty classroom and maybe another class could have been scheduled at that time. But the minute you try to move it into a smaller location, what if all 32 show up? You always have to be ready to have the 32 students, regardless of how many show up.

John: In economics, we call that a peak-load problem… that you have to be able to meet the peak demand period.

Rebecca: HyFlex is just more resource intensive in general, because you have to support all those things all at once. Right?

Judie: Yeah, absolutely. I think it is resource intensive. And I don’t think it’s for every faculty member. But the people who’ve been doing it for the last couple of years really seem to enjoy it. And so I know the Director of our Paralegal Program is just thrilled that now she has a course that last year at this time was in danger of being cancelled from low enrollment. And now she’s got 25 students in it, and it’s HyFlex. And that’s exactly what she was going for. And as she grows more comfortable with it and adds more resources and other materials to the online part of the course, the course becomes more robust each time she does it.

Rebecca: Do faculty get additional resources if they’re doing a HyFlex class, because now they have to be constantly checking their online version of their class as well as the in-person? You kind of mentioned that it’s almost like having two preps? How was that accommodated for faculty?

Judie: I think it is two preps, honestly, and how faculty are accommodated or compensated for it is something that’s always under discussion between our faculty and our union and the administration. Currently, there’s no additional compensation for a HyFlex course… down the road, hopefully some of that can change. But right now, it’s just considered one course.

John: Could you give us an example of some private projects or activities that might be done in classes, where students are getting the same learning objectives in different formats?

Judie: Well, one of our team members, her name is Karen Wicka, and she teaches criminal justice. And she has not taught HyFlex yet, but she’s preparing right now to do so in the spring. And she’s already been working on her schedule. And she said that she does a lot of debates in their criminal justice classes. And she sees now in the face-to-face class that she has students who struggle with the debate because they’re really not comfortable speaking in front of their classmates and having all the attention on them. So now in her face-to-face class, she’ll say “The debate is Thursday, and you have to be prepared, and if you do not come to class on Thursday, then before we meet again next Tuesday, you have to turn in an essay…” and she gives you the parameters of the essay, which would be the alternative assignment. And she said she would easily transfer that to the HyFlex course so that the students who are participating synchronously virtually or in the class room would all be having the debate and the asynchronous online students would be writing the essay.

John: So it has some aspects of universal design to it, that you’re providing multiple formats and multiple means of people demonstrating their competency on these particular skills.

Judie: Exactly. And the students in the HyFlex, they’ll be able to look ahead and say, “Gee, there’s a debate, two months from now, I don’t need to get stressed out about it, I can choose to stay online that week and write the essay,” or “Gee, that’s an essay, I’m not comfortable writing the essay, I’m much more articulate. So I’m going to go to the class and I’ll participate in the debate.”

Rebecca: I can imagine that that would motivate some students to just make choices like ”Oh, I really want to be in class for this,” whatever it’s going to be or that I’m going to schedule my life around this particular couple of times when I want to be in class, and then also make choices about “I would really like to avoid that.”

Judie: Exactly. That’s why I think that schedule at the beginning is so important, so that students can make those choices and make those plans.

Rebecca: I can imagine that with all the time and energy that would need to go into the HyFlex course the thing that would draw faculty in the first place is probably the rewarding experience of students having such a positive experience or having positive outcomes. Is that what you think motivates most of the faculty? Or is there something else also.

Judie: I think that has a big part of it, because we see students who we know they want to come to class, and they can’t because of different life situations. So definitely the faculty want to see the students be able to be successful, no matter what kind of format you have to teach the course in. And honestly, I do think that declining enrollment has something to do with it also, because we are trying to find more ways to reach more students. And we’re trying to reach out to adults who want to change their careers or have never been able to finish college in the past. And this could be a way that they could continue working their full-time jobs and still participate in courses. Some people honestly like the technology, and they just want to try all different things. So yeah, I think there’s a lot of different motivating factors. But definitely, the faculty generally have the students’ best interest at heart and they want to do whatever they can to help the students be successful and meet their goals.

Rebecca: Of course, embedded in my question, was the assumption that students are responding positively. [LAUGHTER] Can you talk a little bit about how students are actually responding.

Judie: Yeah, the students… they are happy to be able to have the choice. And students have commented on different things like some have said, “I thought I would just stay in the classroom. But as I got comfortable with the learning materials and the format, then it was easier for me to stay home and just tune in virtually.” And where we live in western New York, especially in the spring semester where it’s, you know, January, February, March, the weather’s so bad that it’s great for students to be able to stay in a safe location, and not have to drive to campus. And those students particularly are happy to have that choice. So if we wake up in the morning, and there’s a whiteout or something, and in being in such a big region, we can have a whiteout in one county and have a sunny day in another county, then they’re still expected to come to school. So the students don’t have to take those risks of driving in bad weather. But, yeah, they have responded favorably. We’ve also had students who thought they would stay online and then saw what was going on in the classroom and really felt like they wanted to be there and be able to participate live with the group. So they came to campus more often than they had planned. So I think it works both ways. But they definitely like the choice. There were surveys that I read in one of the articles that are mentioned in the resources list, where students were more satisfied with the class, just knowing there were those options, whether they took advantage of them or not. So the students definitely are pleased with that.

Rebecca: I can imagine that for students who are a little bit tentative about returning to school, or going to school for the first time as an adult maybe, that online learning can be really intimidating. So, getting to know your faculty in person and having some exchanges with students, I could understand that first student you’re discussing, like the idea that I have an experience in class, and now I feel comfortable being online, or those that felt really confident that they could be online and maybe it just wasn’t a format that they were familiar with. They could go in person, get some feedback, or get some help where they feel stuck, get un-stuck and then go back online.

Judie: Right. Yeah, I think that’s good …that flexibility.

John: In several of our recent podcasts, including those by Linda Nilson on specifications grading and on self-regulated learning, and the podcast with Sarah Rose Cavanagh, where she was talking about the role of emotions, a concept that’s come up quite a bit is the notion that students tend to learn more when they have a greater degree of autonomy, and this type of class environment seems to provide that. And that’s very consistent with what you were just saying, I think.

Judie: Well, I think any of us, as humans, we like to know we have options, because things happen. You just may not feel well one day and not feel up to the drive. And then now you know, you don’t have that pressure to make the drive no matter what, you can still stay home and earn the A where you would have been penalized, otherwise, if you didn’t show up to class,

John: As part of the planning for the HyFlex courses, what types of support are being provided by the college?

Judie: Well, we have a team that works together with the faculty, we have myself as the instructional designer, and we do have a person who is an accessibility technologist, and that helps a lot. We have media, our media department, and our librarians will help out with any resources that we need. And our computer services people will also work with faculty, if they need particular software, things like that. Our media people will work with the faculty one-on-one in the classroom that they’re going to use. So they have some mandatory training before the class starts. And we already said that they become familiar with Zoom ahead of time, but we will activate it, you know, fire it up in the room prior to the course starting so they are used to where they should stand and what the cameras are picking up and what the students will see from their view. We also have a group of faculty who are really interested in sharing ideas and supporting each other. So that is our HyFlex Users Group, which is the “HUG.” [LAUGHTER]

Rebecca: That’s cute.

Judie: So, yeah, I think that’s cute. But they that way they can talk about what’s working well and particularly the nuances in the different classrooms. If you’re sharing the same room and you know that this particular microphone isn’t working very well or whatever, or picking up too many student noises, then that’s the kind of information you can readily share with each other. So it’s good. It’s nice that there’s some faculty like cross-departmentally working together to solve some of the technical problems and to support each other as they try to do this, because it is a lot to take on. But I think they find it rewarding in the end.

John: Very good. Well, this has been fascinating. And I think this is something that probably more and more colleges would adopt and it seems like you’re probably a little ahead of the curve on this as compared to many other campuses.

Judie: Well, the articles… some of the research that I read has come out… It’s Brian Beatty, who wrote, I thin, what we think of as the seminal article about HyFlex, and they came out in 2014. And he was doing it before then. And some of the research that he refers to was even earlier than that. So I think it’s probably been around a good 15 to 20 years, but is really starting to take off now as the technology becomes more readily available. And students have this equipment, you know, you can Zoom from your phone, they don’t need that much of a setup, if they’re comfortable with the devices that we have now. But yeah, I think it’s great. I’m glad that it’s an option. I like seeing that we have full programs going this way so that a student doesn’t just start off in an introductory course. And then they’re left high and dry when they can’t access the rest of the courses to finish their program. So the commitment, I think by these program directors to do their full program HyFlex is just great, so that the students know when they come in the door that they can really finish the entire program and be successful. So I think our next thing is to get some of the general education requirements online because the programs that are online now are AAS programs. So they’re applied associates where students are preparing for the workforce. But I think if we can get some transfer programs and general electives in the HyFlex format that could be helpful.

Rebecca: Yeah, it sounds like an exciting time and some interesting things getting developed. I can imagine that, from your seat, it can be kind of interesting seeing the different kinds of classes evolving, and what’s working and what’s not working.

Judie: That is interesting. Sometimes as an instructional designer, you can get bogged down in watching somebody’s video or you start reading these articles like ”Oh, I didn’t know that about…. Well, wait a minute, what am I supposed to be working on here?” [LAUGHTER] But we’ve seen it over the years with online… and so many courses and programs are online and I think that’s wonderful because you have access from wherever you are. But for the students who really want more of the community experience in the classroom, I think HyFlex is a good choice for them.

John: I think that one thing that makes it easier from the faculty side is that there are so many workshops online and so many meetings that are being run through Zoom or other systems, that faculty are just necessarily getting more used to that type of interaction. So that should make the transition a little bit easier for many people.

Rebecca: …or even that type of flexibility, like attending a department meeting virtually is becoming a thing.

John: We’ve done that many times. We had a member who is in Pennsylvania for much of last year and so she came in through Zoom. We’ve also used it for all of our workshops here that where nearly every workshop is available through Zoom. And we have a lot of faculty attending remotely. So that familiarity is growing.

Judie: Yeah, I think it’s good. And I think as far as administration goes, or while you’re planning, looking ahead to course scheduling and program scheduling, you just have to think about who are your adult learners? They’re you and me, they’re your neighbor and your brother, and they can’t drop everything and run to the classroom and sit there from 10 to 2, or 8 to 11 or whatever it is. They have to be able to have that flexibility if they’re going to stay with the program and finish it. So I think it’s great.

Rebecca: Well, we always wrap up by asking, “Well, what’s next?”

Judie: What’s next in the world of HyFlex?.

John: …or in general for you.

Rebecca: …for you.

Judie: For me, we’ve got a lot of different projects going on in our area. We have an Accessibility STARS program, we call it. We’re trying to create different modules to help faculty and staff be able to create accessible digital content from the start instead of trying to retrofit everything for accessibility later on. So that’s exciting. We have that about a third of the way completed right now. And I think that’ll be a good program. We’re also working a lot on open pedagogy projects and trying to get some of our faculty working with students online to develop their e-portfolios and different things like that through the SUNY Creative Grant.

John: The IITG grant.

Judie: Yeah, that is based at SUNY Oneonta. So that’s exciting too. I know you guys are working on that also.

John: We now have 10 faculty members who’ve joined into that.

Judie: Yeah, that’s great. And SUNY Geneseo is also involved.

Rebecca: Well, thank you so much for joining us. It’s really interesting.

Judie: Thanks for having me and thanks for sharing tea.

John: Thank you, Judie. It’s always great having you here. We’ll have to get you back for some future podcasts too.

Judie: Sure….

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

98. Developing Metacognition

Many students arrive in our classes with relatively little understanding of how they learn. In this episode, Dr. Judith Boettcher joins us to discuss how well structured project-based or problem-based learning activities can help students develop their metacognitive skills so that they become more successful as learners.

Dr. Boettcher is the author of many books and articles on higher education and has long been a leader in the field of online education. The Online Teaching Survival Guide: Simple and Practical Pedagogical Tips, co-authored by Judith has been an important resource for faculty transitioning to online teaching. At Oswego (and many other institutions), many faculty have been using materials that Judith has developed for ACUE (the Association of College and University Educators).

Show Notes

Transcript

John: Many students arrive in our classes with relatively little understanding of how they learn. In this episode, we examine how well structured project-based or problem-based learning activities can help students develop their metacognitive skills so that they become more successful as learners.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[MUSIC]

Rebecca: Today our guest is Dr. Judith Boettcher. She is the author of many books and articles on higher education and has long been a leader in the field of online education. The Online Teaching Survival Guide: Simple and Practical Pedagogical Tips, co-authored by Judith has been an important resource for faculty transitioning to online teaching. At Oswego many of our faculty have been using materials that Judith has developed for ACUE (the Association of College and University Educators). Welcome Judith.

Judith: Thank you very much, Rebecca and John, it’s great to be here.

John: We’re really pleased to have you here. Our teas today are… are you drinking tea?

Judith: I actually… yes, made a special point. Here’s my cup, which you can’t see. But I chose one of my favorite teas, which is a lemon and ginger tea from England, of course,

John: the Twinings version.

Judith: No, this is a Hamptons tea from London.

John: We have the Twinings version of that in our tea collection.

Rebecca: I’m drinking Jasmine green tea today.

John: And I’m drinking oolong tea today.

Judith: Sounds good.

Rebecca: Judith, your mug looks really interesting. Is it abstract art. Is that what was on it?

Judith: It’s actually pears.

Rebecca: Okay, I only saw the bottom part of it. I can see it now.

Judith: Yeah, right. Well, I will confess that at some point, I finally decided to clear every vendor cup out of my cupboard.

Rebecca: That sounds refreshing.

Judith: Yes.

John: I have vendor cups all over… in my vehicles… in my offices, everywhere.

Judith: Well, that was part of my retirement process that I went through. I said, “Okay, that’s it.”

John: One of the things we had trouble with is picking a topic because you’ve worked on so many topics, but we settled on having you talk a little bit about how students can work to improve their metacognition using project-based or problem-based learning. But before we do that, could you talk a little bit about what metacognition means?

Judith: I would really like to John, partially because I had this book with the title of metacognition that I was reading when I was with a family event. And one of my relatives said, “What in the world is this? Meta what?” [LAUGHTER] So, an easy way I like to think about metacognition is the definition of just it’s thinking about thinking. It’s a definition, I think. that we can all just really grab on to and we can really use. But then I kind of like to expand that definition into one that’s in the How People Learn report that I go back to pretty regularly and that is that “metacognition is the process of reflecting on and directing our own learning.” And I really like that one, because it’s got the two steps, I think, what we want to really kind of focus on with metacognition, and that is reflection… really stopping thinking, pausing… and then actually directing our own thinking, because that leads to action. So then we have reflection and action, which I think is the core of metacognition skills.

Rebecca: One of the things I think we often talk about in education context is this reflection piece. And we always tell students to reflect, but we don’t always give them the time and space to do that.

Judith: Yeah. [LAUGHTER] Very much.

Rebecca: So can you talk a little bit about project-based and problem-based learning and how metacognition connects to those rather than standard ways of operating in the classroom?

Judith: Yes, I would love to do that. In fact, that was one of the first things when we’ve got into online learning, was that there was a real struggle as to how do we maintain the security and everything of people taking tests. And so it turned out that we decided that one of the best ways of gathering evidence of student learning was not by doing these tests… that we would actually have the students do projects. And that kind of evolved into the following process. And that is that in some of the work I’ve done for ACUE, and also in the book, I’ve mentioned that I really like to design a course that starts with the students selecting and doing a project, actually in week one or two of the course. And then that students actually focus on that project throughout the entire course. And that’s the mechanism by which we gather evidence of student learning. It kind of also avoids this whole process of buying papers and buying other kinds of things. Because you really have milestones along the way.

I’m going to stop and talk about the first step for just a moment. And that is choosing a project. One of the wonderful things about choosing a project is that then students actually have to stop and then think about the kind of project that they want to do. It gives them an opportunity to actually customize a course to their interests, which starts getting past that big motivation problem that sometimes teachers might say, “Well, how do I motivate them?” Well, we give them the opportunity to choose something that is of interest to them. So they choose a project, and then they actually write up what that project is that they want to do. But that’s not the end of selecting the project. Before the project is really kind of finalized that they’re going to be working on, they actually then sit down and talk with some of their other students and the other peers. They switch and swap their proposed project descriptions, so that they actually talk out loud about the project. And then hopefully, by talking to their peers about it, they get some additional ideas, and they refine it a bit. And then it goes to the faculty member. So the faculty member doesn’t get it right away, but it goes through this first the individual students thinking about it, and then the other students thinking about it, and then the faculty member can take a look at it. And that’s only milestone one that can take up to about the third week of a course. But by then, hopefully, that gives them a real focus of the course rather than having just the topics thrown at them from week one through week 16… that they’ve got a real focus of: “Oh, how is this going to affect my project?” We can come back to that I just want to mention briefly then there’s like four other milestones, five other milestones for every project throughout the course. And the first is that project description, then the second one would be planning how do I plan to do it, which is a really important metacognitive skill. And then another milestone would be some type of other “Just checking in, how are you doing?” …kind of a thing. And then there’s two final things. One is where they actually share their project with the other students, like in a mini conference, whatever. And then the final thing is the actual final thing, which might not be a paper, it might be a video or an interview, it could be one of a number of things that would go into their student portfolio then. But, that gives the student a focus throughout the entire course that way. That’s a lot, isn’t it?

Rebecca: It is a lot. [LAUGHTER]

John: When you have them give feedback to each other, do you recommend that that’s done synchronously or asynchronously If it’s an online course?

Judith: You know it’s actually best, I think, that the students do it somewhat like a brainstorming event. What you and I are doing right now here with Zoom, students can do with FaceTime, they can do it with just an online gathering chat, whatever. If they’re really, really busy online students, and they have to do it asynchronously, that can be done too with email. I mean, that works too. But it’s often really great for the students themselves to talk out loud. We don’t have them talking enough, I think. They read passively, and they kind of think and everything else, but we don’t have ways for them to use their voice to talk about what they’re thinking.

John: It sounds like the project’s really nicely scaffoldied. But how do you bring in the metacognitive development? How do you get students to improve their metacognitive skills? Is that something they’re explicitly thinking about? Or is it something that’s done as part of the structure of the project?

Judith: Well, of course, it depends on how the faculty member wants to do it. As I had the chance to go back and look more intensely at the metacognitive skills, it occurs to me that thinking metacognitively is such a basic intellectual skill in many respects, particularly now in our 21st century. It’s as fundamental as reading and writing. And, you know, I think we need to look at our entire curriculum from pre-K through whatever as to really how do we explicitly teach and model and coach metacognition skills, which includes with that initial project proposal, we can talk about the fact that what they need to do is think and be sure to build on their interest to give them the criteria and coaching as to how that’s going to really work for them. It’s really a problem when they have to select a project. So what are the constraints on that problem? What are the features or benefits that they’re going to get from this? …and to build that into the assignment and actually writing out the initial proposal and then meeting with their colleagues and peer students, that’s all part of the coaching and the modeling of the metacognitive process.

Rebecca: I think your emphasis on talking about things is really interesting. Because I find that students often will passively write something, and it makes no sense to anybody. But as soon as they try to explain it out loud, they realize it makes no sense. Because when it’s in writing, or they’re just reading in their head, they don’t often have that realization. But as soon as you try to say it out loud as a sentence, it’s not structured in a way that makes sense. They catch themselves or they realize, “Wait, there’s a big hole in what I’m talking about here… nobody knows what I’m talking about.” You can tell it by other people’s faces looking blankly back at you.

Judith: And then they realize that they don’t know what they’re talking about.

Rebecca: Yeah. [LAUGHTER]

Judith: So yes, in fact, that’s apart of the power of talking with their peers about the project, because the peers would most likely say, “Well, wait a minute, why did you choose this? Why are you interested in this?” And so that’s when they have to dig more deeply. It almost goes back to that Socratic questioning, “Why do you think that? Why is that important to you? Do you think this is going to make any difference in your life?” One of the things I really recommend in online learning is that the students, when they read and look at the objectives for a course, to stop… and in the first week, actually, to have the students process those learning objectives, and then personalize one or two of them and say, “This is what I really want to make certain I know when I finish this course. This is how I’m going to be a different person.” Thinking “What skill am I going to be able to do when I finish this course?” They kind of set that goal and set those expectations early on. Hopefully, students setting those goals and objectives become again, more personal to them, and something that they can check themselves. And then as they go through the course, “What progress am I making on this particular goal? How is this coming?” …kind of fun.

Rebecca: Are there ways that you would suggest a faculty member model metacognition early on in an online course?

Judith: Well, I think a really easy way for faculty to model meta cognitive skills is… say, for example, in biology or one of sciences, one of the things I love to look at is the biography of a scientist and looking at, “Well, how did they come to this point? What made them think X, Y, or Z as opposed to A, B, or C?” and we find it’s really rooted in their personal lives and their thinking that they’ve been doing. So faculty member can somewhat do the same thing, in fact, very early on in their introduction to the course. Now, what do you teach Rebecca?

Rebecca: I teach web design.

Judith: You teach web design, okay. So in your introduction, then, to your students, you can say the reason I love web design is as follows. And you can go back into your life and your experiences and say, This is what happened to me… and this is what I was thinking… this is how I got to this point. So you really speak out loud, and you share your processes by which you arrived at that point. And we can do that for any kind of thinking… as we’re talking about an experiment. We do want faculty to share their expertise and their dissertation, for example, they say, “Wow, you know, this is why I’m interested in this. And you know, after 25-30 years, I’m still interested in this because of this.” So they share their thinking processes. Another really easy time is when students ask them a question. And obviously, this can happen online in the synchronous activities. And the students might ask them a question about, “Well, gee, Professor, so and so what does this really mean in this instance, or in this context?” And the faculty member can say, “You know, I really am not sure about that. And I would like to, before I answer that, I would like to do a little more research and thinking, and I will get back to you on that.” So it sends the message that the process of thinking is something that we keep doing all the time.

Rebecca: I think that moment of admitting that you’re not always the expert in everything in the moment, is always a good thing for students. And they respond really positively to that.

Judith: That’s right. It also gives them the opportunity to say, “You know, Professor, I would like a little more time to think about that. Let me get back to you on that.”

John: How can we tell that students have improved their metacognitive skills? I like the idea of having the peer instruction do that. Or to work with students to help them recognize what they know and what they don’t know. But how can we measure that? Or how can students know that they’re more metacognitively aware? How can they observe improvement?

Judith: Well, one of the things I did as I was thinking about this was, you know, I was kind of preparing for you asking me the question, “What are the actual metacognitive skills?” and I came up with five thinking skills that we really want to encourage and model for students. The first one is an easy one. And that is, number one, we really want to encourage students to think. I know that sounds somewhat simplistic, but oftentimes think about in the online environment, we give them an assignment and students, they don’t even read it, really, they kind of scan it. And they kind of assume without thinking that that’s what that assignment is going to give back. And so one metacognitive skill is to pause and stop to really take some time to think and process. In fact, I kind of like to think about the assignment as a briefing. You know, we use briefings in business and politics and detective crime solving and all the rest of it we use briefings. Maybe as a faculty member, you want to encourage the students to think of an assignment as a briefing and a briefing is, “Well, this is what we know now, what do we want to know about next? How are we going to find out what that next is? And when you finish this assignment, what do you expect to know or think about or become clear about?” So step number one is really pausing and thinking. There’s a book out recently called, was it Kahneman? It’s that Thinking Fast and Slow or Slow and Fast?

John: Yes, Thinking Fast and Slow. It’s a great book.

Judith: Thinking Fast and Slow, right. Well, you know, he makes the point that we live in such a fast-paced world that our first response to anything is that, “Oh, I know the answer to that.” It’s like Jeopardy, and you really don’t stop and pause and think. And so, because it’s really easy, that’s the short-term memory, we don’t have to think about it. We know that in order for learning to occur, that we really have to stop and give time for information going into our short-term memory to get into the long-term memory. The only way anything goes from the short-term to the long-term memory is for us to connect what we know already with the new information coming in. And you know what? …that takes time. So that’s the one thing for all of us. Time is so seriously, we don’t want to take the time. But if we don’t take the time, the only way learning occurs, you know, if we grow dendrites in our brain, and so if we don’t take the time the dendrites don’t grow, and nothing lasts. It’s kind of a fast bullet shot, so to speak. And then we forget it. As soon as we use it in a sentence, it’s gone. So the idea that we have to really discipline ourselves to stop and think and process, what is it that I’m needing to do? What is it that I want to learn? What do I want to get out of this? And when I finish this assignment, how will I know that I’ve really finished the assignment. Which brings us to the next thinking skills. One of the things I really liked, I use myself a great deal. And this is kind of a hard won practice of my own. And that is that, whenever I was given an assignment whether it was at work or wherever, whenever I had a hard time getting started… you know, getting started is sometimes one of the most difficult parts of anything, right? So anyhow, I finally figured out that one of the reasons it was hard getting started was that I didn’t quite know what it was I was going to do. I finally realized that my best practice is that I visualize what it is going to be when I finish. I get requests to review articles for journals, etc, etc. Well, I know now that my visualization works is that I’ll be done when I finish answering all those questions, you know, read the article, finish answering all the questions, I compose my response back to the editor. And that’s when I’m done, okay? So with any kind of a project, we want to encourage the students to say, “Okay, what is my assignment going to look like when I’m really done? When I have finished reading this article, or reading this core seminal research project? When will I really be done? Will I be done when I can explain the research to someone else? Will I be done when I can actually implement these ideas in a web design project? Is that when I’m going to be done? Just what is that project going to look like when I’m really done?” So we just celebrated the Apollo landing on the moon, in July. I just had the recent opportunity to see the Apollo 11 program that they created out of the original footage from everything that was happening at Cape Kennedy and Houston… the pictures, it showed like, literally, a room full… it almost look like 100 guys, and they were all guys at that time… 100 guys sitting at computer terminals, and you think when they worked on that project, how did they envision success? They had to envision success as actually a man being on the moon. How did he get to the moon? What did he land on the moon in? And then how are we going to get him back from the moon safely? I mean, think of all the things that had to be planned and worked on and everything had to be coordinated to make that thing happen.

So thinking skills, we have to think, we have to visualize, and then we have to plan. Once we know what that final vision is, we need to then plan each of those steps along the way. And again, we can model some of that and coach that by building the planning into the assignments for the project. We definitely want the students to give me a plan with the date, the milestones, the resources they’re going to be needing,]… if they need to make appointments or interviews when that’s going to happen. So we help them realize that projects just don’t happen. They happen after all of these various steps. And then, of course, we build in step number four, evaluating and pausing to then debrief each step along the way: How am I doing? Do I need more time? What else might I need? What else do I really want to know, if I do have enough time? I mean, this really does happen with web design, right? We get to a certain point, we think of it’d be great if I did this. Great if I did that. Do I have enough time to do that? Do I have the knowledge to do that? Or do I need to learn a new skill to insert that into that. So those are all questions that we want to ask encourage the students to plan for and to ask along the way. And then of course, the final one is the final debriefing. When you hand something in, you get feedback both from your peers and from the faculty member. And in many online courses, you do have these little mini conferences where you invite alumni or experts or just friends in to say take a look at this and see what you think.

Rebecca: I like your framework of the briefing. And it’s actually one that I use in my classes pretty regularly.

Judith: Oh, great.

Rebecca: When I’m doing long term projects, I have students on a weekly basis do basically a little briefing of what did they do? What do they need to do? What are the planning steps? So not just like that big scope of the whole project, but on a very routine basis, checking in with their schedule and checking in with their plan and what they’re struggling with to demonstrate what they’re doing, and what their thought processes is as they’re working on it. So I asked them, “What were the big design decisions you made this week? And what did you base those on?”

Judith: Wonderful. In fact, I sometimes like to use the example of Mark Harmon, the actor in NCIS. I love those programs, actually. Like every morning, he kind of just drives into the office and says, “Okay, what do we have.” And each one of his team members have to then report “Okay, since we saw you yesterday, this is what we’ve done. And this is what we know.” And then from that briefing, decide on their next steps, “Okay, we need to do X, Y, or Z.” It’s a really kind of a nice example of planning.

John: Building it into the project just seems to make an awful lot of sense. If you want students to improve their skills, have them apply those skills and structuring it so that they’re doing it is a very reasonable way of doing this.

Judith: And I love the fact that, Rebecca, as you were saying is to ask the students to say what have you been thinking for? And what made you arrive at the decision that you’d like to do something a little different there? So yeah, again, verbalizing the thought processes, is part of the metacognitive abilities.

Rebecca: I think one of the things that surprises students with that assignment is that they don’t realize that they’ve made decisions.

Judith: Oh, interesting.

Rebecca: That happens in projects. But also, if they’re writing a paper, whatever, they’ve made decisions, but they don’t necessarily think of it like they’ve made a decision. They’ve just kind of moved forward. So it causes them to stop and pause and do that first thing that you were talking about, and think for a second before they move forward.

Judith: Yeah.

Rebecca: I do have to say, that since I instituted that, my students are far more articulate when they’re talking about their projects. [LAUGHTER]

Judith: When they’re doing their own projects, they get their passions involved. There was another thing I wrote recently on curiosity, how important curiosity is and how we want to really build that in. In fact, one of the things when I was doing a workshop, I suggested to faculty, I said, “You know, let’s get the students to stop answering questions. Let’s get them posing questions. And let’s give them problems that, in our discipline, we don’t know the answers to, because what fun is that? Ok, so we set up the situation that we the faculty know the answers, and then they have to figure it out. So switch it around a little bit and say, here are some problems and we don’t know the answers, how am I to approach this? And then we’ll give them the challenge.” And that really, particularly John, I’m sure you’ve seen this with the TIP program, the students come up with things that you never would have expected.

John: It’s one of the reasons I enjoy it so much.

Judith: Yeah.

Rebecca: So one of the things that I think can be a challenge is if you’re doing a big project throughout the semester, we don’t want it to end up being just one big high-stakes assignment. Are there methods or ways or strategies that we can manage bigger assignments to have some lower-stakes moments or ways so that there’s not so much pressure, and that they’re allowed to make mistakes and improve and learn?

Judith: Yes, and I’m glad you asked that. Actually, somewhere in a couple of tips online that I wanted to refer to. It’s, I think, tip… is it 38 and 60, that talk about project-based learning online… that’s something to think about. But I also have a chart that recommends the grading process for an online course. And so you assign points to each of the milestones in the project. So you assign points with the project proposal and selection, but you also then have smaller team-based events where it’s worth a little bit. Also, the discussion board is a really important aspect of online learning. But it’s hard. How do you evaluate and grade that? So I recommend that about 15%, even 20% on the discussion board. And it’s pretty much a given like the classroom discussion is… so long as students are reasonably consistent about following the rubric for the discussion boards. So you’ve got a little bit there, you have also shorter essays and shorter leadership opportunities in an online course where they might summarize a week’s discussion. So there’s other kinds of activities within an online course. At no point is everything dependent on that one big project, but it does require the students to invest time and energy in that.

John: Many people often think of a need to develop metacognitive skills most for our less able students, thinking of the Dunning-Kruger effect, and so forth… that those who know the least often overestimate their learning by the most. But I think those issues may apply for students at all levels.

Judith: Yeah, we assume that great kids, actually, automatically have these skills and think that way, and they don’t.

Rebecca: Which I think is also a really great thing to talk about, too, because we often talk about metacognition, and helping students who are struggling, do better. But it’s also a great way to challenge students who are already doing well, to do better.

Judith: Absolutely, a great point.

John: For the last 32 summers, I’ve been teaching in the Talent Identification Program (or TIP) at Duke University. And one of the things I’ve observed is that many of the students there have generally been able to breeze through their regular classes without ever having to really learn how to learn. So they sometimes face a little bit of a challenge when they arrive at TIP, and suddenly they’re faced with a challenge. But a really nice part about this is that it’s an ungraded program, so that they can develop their learning skills without worrying about what sort of grades they’re going to get in their classes. And it’s much better to do it there than it would be at some future point, perhaps in a physical chemistry class, or a differential equations class, or some other class later in the career, when they haven’t really had to develop those metacognitive skills that are going to be useful in their future. Developing metacognitive skills really are important for students all along the spectrum.

Judith: That’s a really good example too, John, it’s an interesting phenomenon to talk about, really.

John: How can we tell whether students have higher levels of metacognition? Or how can we tell when students have not developed their metacognitive skills?

Judith: Well, you know, this is obviously a great question. And so let me share just a little bit about my thoughts on the students. How do we know when the students are totally clueless about their thinking processes? And I think one really red flag, particularly in online courses, that these are the students who rather consistently post comments on the discussion board: “What are we doing now? What was the assignment about? When is this? Oh, there’s a rubric, I didn’t know that.” These comments often are the ones from students that they really haven’t taken the time to really read the assignment and to make plans on that. These are also the students that we know for online students that they’re trying to do too many things. They’ve got 1000 things going on with their families, and work, very likely. And they just simply don’t take the time. So I think… just simple reminders all the way along the way in an online course from the faculty member. In the assignment, to be really clear about the assignment and to say, “Be sure to think about the following.” For example, if an article has been assigned, that you as a faculty member say, “Okay, this is why I’ve selected this article. Here are some of the core concepts that are really important in this” and guide the reading to say, “Why do you think the person did this? Be sure to be able to answer these kinds of questions?” And then also to be clear about maybe what you want to do when you finish this reading assignment, to talk about it. If necessary, explain it to your 12-year old. See if you can explain it to that person. So being really clear in the assignment would be, I think, super helpful for all students in an online course, because again, it’s the kind of thing a faculty member would do in the classroom, you’d say, “Okay, I want you to read this article. And you know, this is one of my favorite articles. This is why I want you to do it” …and all the rest of it.” I think we need to do more of that in the assignments in the online course. That’s one thing.

The other students that are clueless are the ones that keep thinking that all they have to do is passively read and reread and reread. We hear that all the time from students that “Oh, well, I read it 15 times. I don’t know why I don’t understand it.” Without saying, while giving help and modeling, as you’re reading this, think about the following.

Just as an aside, I signed up to take a course on brain, dendrites, and synapses from the Hebrew University of Jerusalem, and oh, my gosh, lesson three, they said, “Well, you know, if you’re not familiar with the electrical circuits, you probably need to go into the Wikipedia and get all this information.” I’m thinking, “Oh, I’m lost right here.” But the idea was that there was some foundational content that I didn’t have. And so again, if in an online course, if some of their content is dependent on some of those other core concepts that they might not have, to remind students that, “hey, this is a difficult reading. And you may want to get some further help in X, Y, or Z.” So again, going back to that whole briefing, and using the assignment as a briefing and giving them clues how to do well in the reading. Some of those comments really have to do with whether students are struggling or not. Because we want to emphasize more clearly the reasons for why we make choices. When we design a course, we really make lots and lots of design decisions and selections as to why I want my students to read X, Y, or Z. And I think sharing that rationale and sharing those reasons, I think, really helps give insight into the metacognitive thinking of the faculty member as well.

Then John, you ask the question, where we talked about little bit about how even when students are doing well, they may not be thinking metacognitively. And I think that it’s important to recognize that these explicit thinking skills about thinking, about visualizing, and about planning, etc, that it would be a good idea to build those visualization and planning into the assignments.

Now, one of the challenges with online courses, and I’ve seen this for years, is the fact that some students don’t have good places to study, they can be living in very busy environments, they don’t have an office, they don’t have a really quiet place to go. And so one of the things that we can do is actually ask the students to post a picture of where they’re going to be doing their studying. It kind of gets them thinking, “Okay, where am I going to be doing my studying? Is it going to be a place that I can really concentrate?” There was one study hint… that I actually just pulled it out, because I gave it my granddaughters…. and it was called “How to study” …and the little hint in there was that when you are sitting down to study, what you do is you find, select or design, some kind of a flamboyant little hat… think Cat in the Hat kind of thing, you know… just flamboyant things, design some kind of a flamboyant hat so that when you put that hat on, you tell your brain and you tell the other people around you that you’re going internal now… you’re really going to think… you’re going to work, you’re going to study. We almost do that nowadays… when I go into my Starbucks, or my local coffee shop… that’s where I do my writing, by the way… I put on my Bose headphones, because again, that signals to the people around me that, “Hey, I’m working, I’m really concentrating.” So if we asked the students to really stop and think, “where am I going to study?” If I’m a family person, and I’m working, “When am I going to study?” That I have to schedule my week, and the times and places that I’m going to do my work and do my studying. And oh, by the way, I kind of have to get my family and my friends on board to say “Yes, John or Rebecca, they’re studying now I can tell they’re studying, you got to leave them alone, give them the time and the space to leave them alone.” For online students I think this is super important for them to build a schedule ahead of time. And again, it recognizes the fact that metacognitively takes time and it takes space in order to do it well.

John: That reminds me of a couple of our previous podcasts, a few episodes back Mathew Ouelett from Cornell, when we were recording, he mentioned that he has a drawing or a painting, I think he did of a tomato, I don’t remember if it was a painting or if he colored it, but he has a big poster with a tomato on his door that he puts up as a signal for faculty to leave him alone because he’s engaged in a pomodoro technique, and he wants to be just focused on this. In a much earlier podcasts, our very second one, Judie LittleJohn was here and we talked about a metacognitive cafe online discussion forum she and I had both used. And one of the things she uses in it, and Rebecca has introduced that in her classes too, is exactly what you suggested, having students describe their study space and perhaps post a picture of it. And then to address all those issues about how well it works, how they deal with distractions, and so on. This ties in nicely to some of our earlier discussions,

Judith: Well great, actually as I was in my Lucky Goat local coffee shop, actually getting ready for this podcast a couple weeks ago, it turns out this young business person came in and he had a briefcase and all the rest of it and I could tell he was kind of settling in… a little too close to me… but that’s okay, there weren’t many seats available. But anyhow, he was talking pretty loudly. And I thought, “Oh, he’s on his phone.” You know, there’s everybody who talks to themselves these days is on the phone, right? And anyhow, we ended up talking to each other partially because he was talking. He said, you know, what he was doing was he was talking to himself about what he was going to do during his time there. And obviously setting his own personal goal. And then he had learned that from his mother. [LAUGHTER] But that does remind me of something else I do want to share. And that is when I do sit down… my own metacognitive practice… when I sit down to do a task… say, I go to the coffee shop, and I got a couple of things I need to do, I write out a mini plan. And list the time I’m starting… list my first subtask, the second sub tasks with approximate time to completion, and everything else. And of course, it doesn’t happen exactly like that. But I do get done, and I do manage to check the pieces off. But then another really important metacognitive practice that I’d like to share is that when I finish that task, I say “What is my next important step?” In fact, David Allen and his book Getting Things Done on Stress Free productivity, thee whole environment, even in business. His primary question is, “What is your next step?” So before you stop where you are, particularly in a writing project, you write down what your next step is. Because it’s totally short circuits, that transition. Because when you sit down, “Yeah, what was I doing now? What do I have to do? What is my next step?” Hey, I can’t tell you the number of hours that that particular little hint has saved me in terms of really making progress and stuff. So that’s another little hint to build into all that project planning. “What is my next step? What do I have to have next?” And sometimes for online learners, particularly, it’s not sitting down and studying, they have to get a resource, or they have to get a book or they have to make an appointment or they have to do something. But then that’s something that doesn’t have to necessarily be done exactly in order. To kind of almost wanting to build a little calligraphy thing, saying “What is my next step?” is a really, really great little hint.

Rebecca: I think experience certainly teaches us that, but it’s something that students who have less experience don’t explicitly know to do. Because we all know that we’ve tried to cut corners and hurry through something. And then if we don’t do that… I know I’ve spent hours figuring out now what was I doing? Like it’s been a while since I’ve worked on this project. Now, where was that? What was my filing system?

Judith: Yes. And what was I thinking? And oh, dear, I wish I bought that along with this other thing with me. Yeah, exactly.

Rebecca: I also wanted to circle back a little bit to the workspaces too. One thing that I found with asking students to talk about their workspace is also to show them professional workspaces. And to talk about the different kinds of environments and how space can help facilitate certain kinds of activities, but also can short circuit certain kinds of activities as well.

Judith: I think that’s really, really helpful. I know, I can’t tell you the number of conversations I had with people when I was in a work environment, and management was making all kinds of decisions that were not conducive to good collaborative work or good independent work. I mean, it’s a real discipline to think about.

John: And you need both spaces, but you will often only have something that’s better for one or the other.

Judith: Exactly, exactly. For any kind of a course, as we’re talking about metacognition, we get overly focused on “what” the students are learning as opposed to the “how.” So just in a capsule comment, that as we are designing online our classroom based courses that we really include in our assignments.. in the design and the various activities… that we include both the “what” of the content and the “how…” How do I get there? And I think we started getting there when they start setting those personal goals. Because some of the courses now are starting to include a goal or a learning outcome that they want their students to think like a scientist. You’re not just learning biology, we want you to think like a scientist. Or we want you to think like an engineer, or an entrepreneur, or whatever. But getting this… it’s a different mindset. You just don’t want to learn what biology is and learn about the content of biology, but I love finding out about the biographies of like Einstein and a few other folks. It’s just fascinating to get into their heads as to the process that they use to do that. Eric Kandle, by the way, is another Nobel Prize winner. He’s got some fabulous book out about his thinking and his processes by which he actually investigated and learned about memory. So… fun.

Rebecca: I think that using biographies is a great way to introduce students to that a little bit.

Judith: Yes.

John: A number of software packages, such as Lumen Learning’s Waymaker package, Norton’s Inquiszitive, and some of McGraw-Hill’s and CENGAGE’s products include attempts at building student metacognition in their products. For example, they’ll ask students questions and they’ll also ask them about their confidence in their responses. The Norton Inquizitive package, in particular, sets it up in a somewhat game-like situation, where they get to bet points on how confident they are. And then it gives them feedback on how they did versus how they perceived they were doing. Do you think this type of approach might be useful?

Judith: I was just reading a research study about that, John, and the students… Who was that by? I would have to go back and find it, I’ll have to email it to you. But the results showed that the students who were less confident…

John: …did better.

Judith: Yeah. Who was that?

John: I don’t remember. I think it was on the POD list, but maybe not, it might have been on an economics list. Consistent with the Dunning-Kruger effect, the students who did relatively poorly, had relatively high self perceptions of how well they did that were not reflected in their test scores.

Judith: …So important to be asking the question: “What do I know?” and “What don’t I know?” Because that’s a core, isn’t it? If we can answer that question. In fact, one hint that’s in that book called Make It Stick… which is a real good one… one of the key things I took away from that was the technique or practice of having in a textbook, taking the heading and turning it into a question and then seeing if you can answer that when you finish reading something. So again, “What do I know when I start? What do I know when I finish? And am I able to answer that question? Or am I able to pose another good question based on that?” So explaining to ourselves what I know and what I don’t know, I wanted to go back to that study that we were just both talking about, because my question that occurred to me as I was reading this is that, you know, the problem, I think, is that the study really didn’t really give the students an opportunity to verbalize why they felt confident or less confident, which is, I think, a whole missing piece of that. And I don’t know how they obviously would make designing a study… actually, my dissertation, in fact, I will bore you with the title of it is “Fluent Readers’ Strategies for Assigning Meaning to Unknown Words in Context.” And the thing is that, half the time, they didn’t know that was an unknown word, they just assumed they knew the word. So again, if we don’t know we don’t know something, we can be very confident. [LAUGHTER] But anyway, in order to get the answers to that question of the study, I actually had the students talk out loud to me, they verbalized and I would go back and ask them about the word and say, “What were you thinking when you came to that?” …and all the rest of it. So they had to verbalize their thinking. For me, it was a good study, it really worked. So again, going back to the value of verbalizing,”What do I know?” and “What don’t I know?” and “What do I think I know?” And Rebecca, we got that when you said, “Well, you started talking about what to do, and then you realized you didn’t know anything.”

John: As you suggested before, a really good thing with any project is to think about where you’re going next. And we always end our podcast with the question, “What are you doing next?”

Judith: What a great question. Okay, what am I working on next? I did mention that I just finished a little video for the Distance Learning Conference in Madison in early August. On my back burner, and I’ve been saying this for a couple of years, I would really like to write a book on concepts. What I’d like to do is… I mentioned I love working with faculty, and when we design courses it so often on a topic-to-topic basis. And yet, as I started working with faculty towards the last 10 years or so, I started asking faculty to tell me what their core concepts of a course is. And, you know, faculty, that’ve been teaching for 10,15, 20, even 30 years, they would pause and they’d say, “Uhhhh, [LAUGHTER] you know, we just teach topics,…” as opposed to core concepts. And we think about core concepts are what stay with us when we finish a course, hopefully. So the question really is, what do you expect your students to know, five years, 10 years down the road from what you have been spending all this time and energy on? So I’d like to write a book about thinking about concepts and how to design a course, and focus on problems and concepts rather than topics.

Rebecca: I like that, I think that would be really helpful. Can’t wait to read it.

Judith: [LAUGHTER] I can’t either.

Rebecca: You gotta visualize, you gotta visualize. [LAUGHTER]

Judith: Thank you. You can give it right back to me.

John: We talk a lot about backwards design. But a lot of the classes that many of us teach were not designed in that way. They did not start with those major course learning objectives, and then work backwards to get to that point. And they’re just series of topics taught in the same way that they were taught to them when they were students. And they were taught in the same way as their previous generation taught them. And there’s not always a lot of thought going into that. And that sounds like a really good project.

Judith: Well, thank you, I may call you and see. I’ll need faculty to work with on that project. So I may contact you for that.

Rebecca: I’ll sign up.

John: Be happy to.

Judith: I’d be willing, God be willing that I get going on that. [LAUGHTER]

John: I think we all have a few projects like that. But eventually they often happen.

Rebecca: Eventually.

Judith: Yes, well, actually talking about it is a good thing. Because the more things we write down, and the more things we actually talk about are more likely to happen.

Rebecca: And I have just told the world so it’s gonna have to happen, right?

Judith: Oh, dear. [LAUGHTER]

John: Although if you change your mind, we can edit it out.

Judith: Scratch that…

John: I know I come up with some things after a podcast where I say I want to do this in my class next semester. And once it’s in a recording now, I pretty much have to do it. [LAUGHTER]

Judith: Well, John, before we break up here, when you do go to Duke, what do you teach?

John: I teach economics, introductory micro and macro economics.

Judith: Okay. Sounds great.

John: It’s been a lot of fun. I love doing it. The kids are just so amazing.

Judith: Well, kids are amazing at that age. They really are. It’s wonderful to see them evolving to young men and women. You know, I’ve got eight grandchildren. My oldest is now 19 and a half. In fact, she did microeconomics online, both one and two this summer.

John: Thank you for joining us.

Judith: Well, thank you very much. I really enjoyed being here.

Rebecca: This is a lot of fun. Thank you so much.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

87. Social Presence in Online Courses

Interactions between students and faculty in online classes are mediated through a digital interface. Students are more successful in classes, though, when they feel connected to their instructor and classmates. In this episode, Allegra Davis Hanna and Misty Wilson-Merhtens explore a variety of methods that can increase the social presence of all participants in online courses.

Allegra is an English professor and the department chair of English and Humanities at Tarrant County College in Fort Worth, Texas. Misty is a history professor and social sciences chair at Tarrant County College. Allegra and Misty have been running The Profess-Hers Podcast since October 2018.

Show Notes

John: Interactions between students and faculty in online classes are mediated through a digital interface. Students are more successful in classes, though, when they feel connected to their instructor and classmates. In this episode, we explore a variety of methods that can increase the social presence of all participants in online courses.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[MUSIC]

Rebecca: Our guests today are Allegra Davis Hanna and Misty Wilson-Merhtens. Allegra is an English professor and the department chair of English and Humanities at Tarrant County College in Fort Worth, Texas. Misty is a history professor and social sciences chair at Tarrant County College. Allegra and Misty have been running The Profess-Hers Podcast since October 2018.

John: Welcome.

Allegra: Thank you.

Misty: Thanks for having us.

John: Our teas today are…are you drinking tea?

Allegra: I am drinking Earl Grey tea.

Misty: I didn’t know tea was a requirement. I have coffee. [LAUGHTER]

John: Someone hasn’t listened to our podcast. [LAUGHTER]

Misty: Sorry!

Rebecca: We have this debate all the time. Nobody’s ever drinking tea with us. [LAUGHTER]

Allegra: I am!

Rebecca: So I appreciate it, yeah. We appreciate that there’s coffee drinkers in the world too.

Allegra: Yeah.

Rebecca: I’m drinking Christmas Tea today.

John: And I have Ginger Peach Black tea.

We’ve invited you here to talk a little bit about social presence in online instruction. While listening to one of your podcasts a while back, I heard you were presenting on this at a conference in Texas. Could you tell us a little bit about the importance of social presence in online instruction and what social presence is?

Allegra: Social presence is everything that’s non-instructional in an online class. And when we give this presentation, we start by saying, “I know what you’re thinking… that everything in an online class should be instructional. But everything in a face-to-face class is not instructional.” Everything that makes you seem like a real live human person with likes, dislikes, and interest is social presence. So there’s kind of two layers. One is the social presence of the faculty member, so that’s showing your students that you’re a real person, and the other is allowing students to create social presence so that your classroom becomes a community of learning and a place where students feel like they belong and can relate to each other both in the curriculum and outside of the curriculum. There are lots of strategies that faculty use to create online presence and so that’s really the focus of our presentations that we gave four or five times a semester at various conferences, some in Texas and some not in Texas. We went to Las Vegas, Colorado, and then a few places in Texas.

Rebecca: Can you give a couple of examples of social presence in an online environment, like specific ones?

Allegra: Oh, yeah, I can give you a lot. So, if you think about your in-person students, your in-person students get to see your face and facial expressions, they get to see your nonverbal cues, your body language, they get to hear your voice and your inflection, your tone of voice, and they get a sense of your personality. They know if you’re a funny or a not funny person and they know if you’re a serious or not so serious person. They see your office, they see your book bag, they see what kind of books that you have on your bookshelf, and your students get to see you make and correct mistakes when you’re speaking and when you’re writing, and so they get a sense of you as a real person. And so we try to teach our faculty to replicate the same kinds of experiences in an online class. And some specific ways of doing that, like the basic critical thing that you have to have is you have to let students know how long it will take you to respond to them and that reduces anxiety. Even if your answer is sometimes it takes me two days to respond to emails, letting students know what to expect, is absolutely critical. Obviously, I would recommend that you don’t take 48 hours to respond to student questions, but letting them know what your timeline is. And if you say, “I’m traveling this week, so I’m going to take a little bit longer to respond” … just to let them know and ease their anxiety. And it’s fine to say I’m traveling because again, you’re letting them know that you’re a real person and you have things that you do in your life. You need some kind of substitute for facial cues and personality indicators so we, on our campus, are really big advocates for bitmojis which are…

Misty: um….some people are…

Allegra: Misty doesn’t like them. [LAUGHTER] Misty is a very serious person. But some of us are really big advocates for bitmojis, which are like little avatars you can make of yourself. I use them all over my class, and a lot of people do. And if you want to make one, you just go to bitmoji.com, or you can download the app on your phone. You can download one that’s a little avatar view that says, “It’s Tuesday,” and then you can post it an announcement on Tuesday. And they have some reading books and things like that, that you can post in your class. Some people just use emojis and some people use words as substitutes for facial cues. Like they’ll just say, “JK” for “just kidding” or something like that.

Misty: And some of us use pictures. So my announcements have a lot of pictures of me at historical places… such as those me at Independence Hall.

Allegra: As Misty pointed out, we’re not all the same. And we definitely don’t advocate that all faculty take the exact same steps because the whole point is to show that you’re a real person, and so it should be authentic…

Misty: …and individual.

Allegra: In my introduction video, it’s really goofy and elaborate. And I show a picture of my child, I show them the books that I’m reading, I show them a picture of me on vacation. And some people aren’t comfortable sharing that much information with students and so it has to be authentic and it has to speak to who you are as a person. Because the point is letting your students know how approachable you are and what kind of person you are and what kind of professor you are. Whatever works for you is what will work for your students. And students are very, very savvy when it comes to being genuine and they know when a person is being inauthentic. They always can tell when a person is being fake. So it’s really what is most authentic for the instructor. And of course, beyond the basics, we have lots of things that we do training sessions on to teach faculty how to increase social presence incrementally, because we don’t say you have to completely revolutionize your class. But those are the basics.

John: You mentioned videos. I happen to have seen your intro video, and it’s really well done. And if you don’t mind, we’ll share a link to that in the show notes.

Allegra: Oh, absolutely. Yeah.

John:Do you use other videos in the class to provide feedback or instruction or other aspects?

Allegra: Absolutely.

Misty: For my class I have a lot of historical videos a little more like history.com, and they are more like me narrating and I use historical pictures and backgrounds and maps. And I know Allegra’s are a little bit more personalized than mine.

Allegra: I actually don’t use video. I don’t create video for my classes. My classes use curated videos from places like Ted-Ed. I use a lot of audio. We make a podcast, and I edit the audio for the podcast. And so I do a lot of audio for my classes. So my students can download… they’re like five-minute mp3s and they’re lesson introductions. When we start a new lesson on plot or on writing a research paper, I give them a rundown of what’s important as an mp3 file. Students could, if they wanted to, download that file and listen to it on their phones. I don’t know why anyone would ever want to do that. But when they open the class up in Blackboard, there’s just a play button so they can choose to read it, they can choose to listen to it, or they could choose to do both.

John: So you meet accessibility requirements.

Allegra: Yeah, and our instructional designers tell us it’s better to have a script. So, if you make a video or an audio file, just to start with a script and then you automatically have a transcript. And of course I find myself, as I’m talking, changing a little bit of what I’m saying or adding in an example or changing the way I wrote something. And so it’s really easy to go back and make five little changes. And then I have a transcript and I don’t have to transcript it after I do it. Plus, it sounds better if it’s planned out and it’s written and it’s scripted. We have a video studio on our campus because we’re a fully online campus. So we have a video studio for faculty to come and make videos. And the one thing our instructional designers say is, “Come with a script. Even if we change it, you need a script,” It helps take out a lot of the pauses and the “ums.” If you’re really nervous it helps to have a script, it kind of eases your anxiety…

Misty: …and it helps with your pacing.

Allegra: Absolutely. You don’t know in the moment whether you’re rambling or whether you’re on point. So if you have a script and you can stick to it, it makes it a higher quality video and of course easier to transcript for accessibility.

John: Do you use some type of teleprompter or big screen behind the camera,

Allegra: They have an iPad that’s dedicated to teleprompting, and they have an app on there. So they load up the word file and it, I don’t know how exactly how it works… but yeah.

Misty: So it flips it like a mirror, and it paces with you. And I have a tendency to talk really fast. So they’ll always say, “Slow down.” If the words are going too fast, they aren’t going to understand you.

Allegra: Yeah.

John: On most of the apps, you can adjust the speed as well. I’ve used Teleprompt+3… and there’s another one I’ve just heard about, I don’t remember the name, that actually syncs to your voice so it will recognize your voice and pause when you get to a new place or will keep up with you.

Misty: That’s what we use.

Allegra: Oh, wow… that’s cool, but kind of creepy. [LAUGHTER}

Rebecca: So social presence is really important to the learning. I think sometimes faculty don’t necessarily think of all these little details that aren’t part of the curriculum as being important. So can you talk a little bit about how students knowing you as an individual, and knowing that you’re a real person, impacts how they learn or how they perceive the class as a whole?

Misty: The first is it’s a requirement that students and faculty are interactive in a course. As you had on your podcast in April or May I think, someone was talking about the federal regulations for regular and substantive interaction. And so that’s where we start with faculty. I say, “This is not me being like a touchy-feely, Kumbaya faculty member. This is me telling you, you have to be interactive with your students or we could lose federal financial aid funding, not to mention that our accrediting body would also have a problem with you running a course that isn’t interactive.” Beyond that, it is important to students that they feel like they can reach out to you. And that’s the number one thing students say back to us when they watch our introductory videos, or they listen to a few of my audio files. They say, “I feel like you’re a real person, I feel more comfortable sending you an email.” And they also say that it really matters to them because they can tell that we took a lot of time to make these things for the course. Or they can see that we’re spending a lot of time corresponding with them in the course. And it matters to them. They take note of the fact that we’re doing what they perceive as going above and beyond. They say, “I really appreciate that. Because not everybody’s doing that.”

Allegra: The thing I get in my student reviews that I really like hearing online is, “I can tell she cares about us…”

Misty: Yeah.

Allegra: “I can tell that she cares that we’re learning.” And I think when I first started teaching online, I didn’t know how to do that effectively. And I get that pretty commonly now in my student evaluations.

Rebecca: Can you elaborate on that a little bit and talk about some of the things that faculty often miss or don’t do when they first start teaching online. Or where you found that you’ve tweaked things to get a little bit better at this.

Misty: Some of them are really, really easy. So welcome announcements, having a “start here” area on your online class so that students know exactly where to go when they first open it. Remembering that everybody’s online class looks different and students who are fully online students, which is about a third of our students, they’re taking four different online classes that all look and feel differently. So helping them with navigation and making things redundant. One thing that’s really easy that makes a huge difference with very high impact is using announcements. I post at least one announcement a week. I tell my students at the beginning of the semester, “You’re probably going to get tired of the announcements but you’ll also get used to them.” And so I use announcements, to remind them, things that are coming up that are due, to congratulate them on finishing a big project. If several people are commenting on the same thing in the discussion board, I might make an announcement and say “This is a really good topic of conversation and here are some things I want to point out.” I might say, “Everybody go read so and so’s point in the discussion board because I think it’s really, really important to the discussion.” I use them for keeping everybody on track and say, “We’re moving toward this big project, here are the things you want to keep in mind.” And if students are making a common error, if they’re six or seven students are making the same mistake or have the same misunderstanding, I can post an announcement, and correct that. Because if six students have a misunderstanding that I noticed, chances are, 15 students really are having the same problem.

Allegra: So, something that I do in my class is in the introduction week, I have them fill out a Google survey, and it populates it as a spreadsheet for me, and I tell them if there’s a name you want to be called, so if it’s Tim instead of Timothy…. So it populates into a spreadsheet for me, and I keep that on the side of my computer all semester. So every time I respond to them in a discussion board, it’s Tim, not Timothy. If they go by completely different name, they really notice. And the other thing that I do is halfway through the course, I send out a personalized email to the students who are getting A’s, because everybody corresponds to those students who are C or below. But I give special attention to the ones that are getting A’s and say, “This is what you’re doing well, this is why you’re getting an A in my courses, what’s working for you, continue with these strengths.” And if they respond I’ll say, “And these are things you can work on.” But I don’t put that in the initial email.

Rebecca: I’m sure students respond really positively about that. I think that’s true in face-to-face classes too. The students that are really excelling often are the ones that kind of get overlooked at some points during the semester.

Allegra: And discussion boards are just important places for interaction to happen. And I think a lot of times, people set the discussion board up and then they let students run the discussion. And the only time faculty look at it is when they go into grade a student’s participation. And it’s very hard for me as a chair or when I’m conducting these trainings to really push people and say, “You should engage in the discussion, you should respond. Now, can you respond to every student and every discussion board every single week? Probably not. But you should be responding to about five students per class per day.” And that doesn’t take very much time. Students know that if you’re constantly in the discussion board, that if something is a muddy point or two people are unclear about something that there’s a strong chance that you will be in the discussion within that week, and that you’ll see that and that you can help correct or clarify the point for them. Faculty really don’t want to have to do that because they say, “I read the discussion board posts when I grade them. And so I don’t want to have to read them twice.” But I think it makes a really big difference.

Allegra: Well, if two students in your in person class were debating, you wouldn’t just let them fight it out. You would step in…

Misty: We would hope. [LAUGHTER] Yeah, we would hope that you wouldn’t just let them argue and just watch. Yeah, that’s the equivalent. And, you know, everything that’s in your class is kind of your responsibility. So you should know what the ongoing conversations are. And I’ll say, when I started jumping into discussions I noticed that the discussion posts tended to be longer and more substantive. Because first of all, you’re setting a model for them, right? They see you talking and they see what kinds of things you’re saying and what kind of detail you’re going into. So you’re posting a kind of model of posts, but also, if they know you’re going to read them, they put them at a higher standard, at least in my experience.

Allegra: I do think early on, though, when they see you in there, it freaks the students out a little bit, because maybe they’re not used to professors doing that. And so it takes a minute for them to like, adjust.

Misty: Yeah, absolutely.

John: I know some faculty are reluctant to do that. Because sometimes when they’ve tried they said it tends to shut down the discussion when they come in, and maybe they’re coming in with perhaps too heavy of a hand in the discussion.

Misty: One thing I do is that I ask questions. I never just get in there… And this is what I think. And that’s it. I’m the professor, we’re done. It’s “Have you considered this?” Or “Have you thought about this?” Or “What about this point?” And it’s up to the students to lead themselves there. I’m just kind of putting the guide post up.

Allegra: Yeah, I think that’s a good point. The other thing you can do is you can read the discussions. And then you can do like a whole class response in an announcement so that students don’t feel like you’re directly responding to them. But you can just say, here’s some great things I read on the discussion board this week, and kind of highlight some comments in an announcement. And that way you’re not in the discussion, but students still know that you’re there responding to and interacting with them, and that might be a happy medium for people who don’t want to full fledge go into the discussion themselves. But, as Misty said, if we were doing an in-person class, and we had an in-class discussion, surely you would be facilitating in some way.

Misty: You hope.

Allegra: Yeah, we would hope.

John: …and nudging people sooner might be more productive than after the discussion has wandered far afield.

Allegra: Absolutely, yeah. And if you’re grading it, it’s after it’s over. So you have no chance to redirect the conversation at all.

Rebecca: For faculty who maybe are hesitant to do other things… we’ve talked a little bit about hesitation of being in discussion forums. Sometimes faculty are hesitant about having their face on screen and don’t want to do intro videos and things like that. Have you found other areas that faculty might be hesitant, but once they try something, they’ve been pleasantly surprised?

Allegra: If you watch my introduction video, you notice it’s not me talking, because I’m very aware of my facial expressions.

Misty: It is your voice.

Allegra: Yeah, it’s me talking.

Misty: Mine is not my voice.

Allegra: No, it’s my voice. But it’s not a video of me talking because I’m very aware of my facial expressions. So it’s a slideshow of pictures, and me narrating over it. So I was reluctant to speak on camera. And so we found a creative way for me to have an instructor video. And that’s the other reason I have a lot of audio files is because I don’t want to speak on camera. We have faculty who say, “I don’t want to put a picture of myself in my class.” And so then I just google them. And I say, I’ve just found 20 pictures of you by googling your name. So, your students can find out what you look like. We have professional headshots. So why don’t you just put a picture in the class? You’re not giving them top-secret information about yourself. But, absolutely, if you force faculty to do something, if we were to say you must create five videos for your class, some of them would be the most boring videos of all time because they would be forced. So what we would say is find what works and run with it. And so Missy has videos. I have audio. Other people have a combination of them. Some people make their own videos on their back porch using their iPhone. Some people do lecture capture. Absolutely, if we try to force one specific thing, then our faculty will comply, but it will be not as high quality, and so it won’t be the impact that we’re looking for.

Misty: So in my introduction video, I am aware that I’m very awkward on film. Like it’s awkward for me, it’s awkward for the students… everybody doesn’t want to see that. So mine is pictures of me, but other people are narrating it. And actually, Allegro is heckling.

Allegra: Yes.

Misty: And making funny comments during mine. But then when I’m speaking on historical topics, I can do that all day long. I just can’t talk about myself. So people will find what works for them if they’re given the ability to do so. One of our instructional designers who’s very good at working with reluctant faculty says everybody’s favorite subject is themselves in some capacity. So if you don’t want to share pictures of your family, which I understand… if you don’t want to talk about your vacations, that’s fine. Talk about your research, talk about what you’re reading. And if you don’t want to make a video, make an audio file. The software that we use to edit our podcast, which is what I use to edit the audio in my courses is free. It’s freeware… and so our school did buy us nice microphones. So that is an investment. But, for a long time, I was using a Logitech headset with a microphone. It’s not a huge monetary investment to make audio files, and students respond to it. So it’s whatever really works. And sometimes you need a little coaching to know: “What do faculty need? How can we kind of get them comfortable with the medium?” But we have people who said: “No way. Never. There’s not a chance…” and they watched a few videos, and they got to know the instructional designers who helped make the videos. And so they’re coming around and they’re like, “Okay, maybe I’ll make one for the fall.”

John: Do you have students do something similar? Do you have them share bitmojis or audio or video files?

Allegra: So we do have some faculty who use Flipgrid. The instructor will make a video on Flipgrid. And it’s basically a discussion board of little videos. Our speech faculty requires students make videos of them making speeches and presentations. And I asked students to post pictures in their introduction. And I say, if you don’t want to post a picture of yourself, post a picture of your dog or your favorite sports team, or a screenshot from your favorite TV show… just a visual that helps us get to know you. Sometimes I asked students in discussion boards to respond to things with names. So to add a little personality and you can just think about ways to make your discussion board a little bit more open. So, in my lesson about setting, I have a formal writing assignment where they analyze the setting of a short story. But then I have a discussion board where they just write about the setting in their favorite movie, and how the setting helps augment the theme or illustrate something important or relate to one of the main characters. And so I say tell us about the setting in your favorite movie, and then put a screenshot of the Hogwarts castle, or the stuff in Hunger Games. So then they’re like, “Oh, my God, I love that movie, too.” And so they’re talking about the subject matter. They’re relating to each other more personally. And so I don’t know that there are ways easily to do that in every subject matter. But I know that there are ways that you can give students less formal assignments sometimes that allows them to interact in that way.

Misty: So I do hidden bonus discussion boards. If you get all the way through my notes, there’’ll be a link, “click this,” and it’ll take you to a hidden discussion board and I do “favorite things” as one of them. So they go on and they get to post a picture of their favorite things. So I get a lot of like Dunder Mifflin logos. [LAUGHTER] I get a lot of memes, and it’s a reward for them for actually reading the work. And then they get to do something fun at the end, and they get bonus points.

John: It’s an interesting idea.

Misty: Yeah, we have a lot of Easter eggs in our online classes; a lot of faculty make use of that. And so at the very end of my syllabus… this is a very basic one… it just says, send me an email with this subject line and ask me a question… anything you want to know… and I’ll answer it and give you bonus points on your introduction. So, if they read the whole syllabus the first week of class, not only do they get this chance to get bonus points for reading the syllabus, but they’ve already sent me an email and once you’ve sent your instructor one email, it’s much easier then when you have a question to send them an email, because that line of communication is already established. And they ask me the goofiest questions. You know, they asked me like “What’s my favorite TV show?” Or do I think dragons are real? [LAUGHTER]. They they have fun with it.

Misty: Do you have tattoos?”

Allegra: Yeah, I mean, that’s in my intro introduction video because I got that question so many times. I’m like, “Yes, I’ll just tell you, I have tattoos. They’re obsessed with tattooed professors. So I just went ahead and let them know Yes, I have tattoos and they’re all related to books in fact. So it’s sort of related to the course.

John: Have you done the AMAsa on Reddit yet? [LAUGHTER]

Misty: We should do that. We should try it.

John: That could be a podcast episode with your students.

ALEGRA: Yeah. Oh God… [LAUGHTER]

Misty: I’m scared.

John: It could be dangerous. But, you can edit it.

Allegra: Yeah, that’s true. We do tell faculty to use humor if they’re actually funny. And what I say in presentations is if people don’t laugh at you in real life, they’re not gonna laugh at you online. So….

John: …or at least not for the reasons you want them to….

Allegra: Yeah, laughing at you. So I say if you’re funny, and you can do it well, absolutely use humor. You have to be careful that you’re not making fun of people, obviously. But self-deprecating humor is always a winner. So, I tell people that. I do advise them like “Don’t try if your jokes don’t land, they’re definitely not going to work online.”

John: Do you include any social media in your classes outside of the LMS?

MISSY: I have tried. It has been an abject falure.

Allegra: Missy is remedial at social media. But, I tell my students that they could find me on Twitter. The Twitter page that I have is a professional Twitter. So I post things about online teaching, or about our podcasts or articles about education, or about cool books or things just having to do with authors, so it’s professional related. It’s not like me posting about my favorite TV show. But I don’t use it for the class. So, students sometimes will follow me on Twitter, which I tell them, you’re going to be really bored, but that’s fine. But I don’t use it for the class. We do have instructors in the English department who use Twitter for their classes as a way to ask me a question or to get more information as just an additional contact method. We’ve had some teachers try to use it as a discussion forum. And they said that they just would rather use the discussion forum in the LMS.

Misty: Some of our government instructors have been able to do it pretty well, because it’s easier to share news articles on Facebook… and they put them in a closed group, then they kick everyone out of the closed group at the end of the semester and start a new closed group for the next semester. But government’s kind of unique in that way. I don’t know if it would work for other disciplines.

John: You’ve mentioned bitmoji. Are there any other tools you use to create content in your classes that perhaps faculty should explore?

Allegra: So audacity is the software that we use for editing audio files, and our instructional designers showed me how to use it in about 10 minutes. And so then I’ve gotten used to the tools and the buttons and how they work. He says it’s like a Fisher Price audio editing…. So he thinks it’s pretty straightforward and simple in terms of how to use it. I create a lot of graphics for my course. So I create banners. I create getting to know me things. I create things related to the subject matter and I use Canva that’s like Canvas without the S. It’s a free service. It’s a graphic design online tool. So if you wanted premium content, or better looking designs, then you could pay for those things, but it is free to use Canva as well.

Misty: Screencast-o-matic… I use that a lot to create where you’re talking over a PowerPoint video, or even pictures.

Allegra: Oh yeah, talking over a slideshow? Absolutely. Right now we’re using YouTube for videos. I don’t know what they’re using for video editing. I was trying to look and see if it was in my notes.

Misty: Camtasia

Allegra: Camtasia is what they’re using, but it’s not free, so I don’t recommend it to everyone.

Misty: Yeah.

John: For people who are on Macs or iPhones, there is iMovie. And there’s lots of Android editing tools that are free and there’s a few Windows ones as well.

Allegra: I would say the newest coolest thing to make videos is Apple Clips, which you can get on an iPhone or an iPad. And I don’t know if you’ve played around with it, but especially if you’re going to do like a talking-head video. You can change the background or you can make yourself look like you’re a comic-book character. And it’s auto captioning the same way that YouTube does. So it might be like 85% accurate and it’s very easy to go in and edit the caption file to make it 100% accurate. You can make a very cool looking, engaging, and dynamic video using Apple Clips and upload it to Twitter or to your LMS very, very quickly… very, very easily. And of course, the sound quality on just an iPhone itself with no microphone is pretty good. So if you’re in a quiet room, it’s going to sound really good and look really cool. Unfortunately, I don’t have an iPhone. So I’ve only played with it a little bit on the iPads at work, but I think Apple Clips is free, 100% free. And it’s a very cool tool, If you are an Apple person… and QuickTime you can also use on Macs to do screencast videos. I think that’s all my tools.

John: The nice thing about uploading things to YouTube is the captioning in YouTube has gotten very, very good. Is probably 97…98% accurate.

Allegra: Absolutely.

Misty: Unless you have an accent.

John: Yes, unless you have an accent or there’s a lot of background noise…

Allegra: …or you talk really fast. Yeah.

And something that is probably more for English faculty or people who have a lot of essays to grade, is you can do audio grading, which is you can record like a two minute you explaining to your student where they did well and what they could improve on. And I found that it helps me deliver information in a more softer personal way, the same way I would be able to do an in-person writing conference. In TurnItIn.com, which we use through our LMS, there’s just a button on the side of the paper that says record audio and I think can you can record up to three minutes. You have to ask students if they want to opt in or opt out of that because not all students respond really well to audio comments and some students need it to be written down. But it’s it’s a good way to be engaging and students hear from your voice and you can kind of use your tone and soften things and emphasize things, so audio grading is something we’re trying to get into more. Of course, you can do it in the LMS. You just have to record an mp3 and then attach it. So it’s a little bit more cumbersome.

John: And there’s a number of apps that you can use on iPads and other devices to do that on PDFs as well. And then just email them back or share them back.

Allegra: Absolutely, yes.

So we use a lot of Spotify playlists, and so Spotify is free, and students don’t need a Spotify account in order to listen to a Spotify playlist. They can just hit play in the LMS. So, I use them in three different ways. One, in my introduction, I just have a playlist of music that I like, and some students can really relate to you in that way. So I just like 15 of my favorite songs, and I might change it every now and again. And so I just there’s a way to embed Spotify playlists, you just get an embed code, and then you can embed it in an announcement or an item on your LMS. And so students can get to know you that way. When I teach metaphors and poetic devices, I have a playlist of songs that are like riddled with metaphors and poetic devices, imagery, symbolism… metaphors, of course, very prevalent in music. So I have a playlist of songs, and I link it into my lesson on poetic devices. And so then students can listen to songs. And hear examples, like, Collecting my Jar of Hearts, right? Like that’s a metaphor and a song that they all know. And so it helps them understand that concept in a little bit more of an accessible way than the Shakespeare sonnet that they’re going to read for that lesson. And then Misty uses them…

Misty: …for every historical era. So it helps them connect with the pop culture of the time.

Allegra: So, she’s a 40 playlist and a 50s playlists and a 60s playlist in her history class.

Rebecca: That sounds like a lot of fun.

Misty: I actually have a Civil War playlist.

Allegra: A Civil War play…. I don’t…

Misty: Yeah, marching songs.

Allegra: They’re free accounts of students want you they can connect to your playlist but they can just play them right through the LMS.

Rebecca: I think that’s an interesting option that maybe a lot of faculty haven’t considered.

It’s very easy. And Missy was the first person on our campus, I think, to think of using Spotify for teaching. So it’s really simple and straightforward. And students really, really…

Misty: Are you saying that if I can do it, anybody can do it? Because that’s kind of what it sounds like. [LAUGHTER]

Allegra: Yes, that’s exactly what I’m saying. [LAUGHTER]

And there are opportunities maybe to have students create Spotify playlists in certain classes. So, that’s an option as well.

Misty: I want to say one more thing. Make sure that your social presence doesn’t overwhelm the actual instruction in your course. Because we have seen that mistake a couple of times, where it’s so heavy on the means or it’s so heavy on the bells and whistles that they forgot to actually teach the material. [LAUGHTER]

Allegra: Yeah, I think that was really kind of an error. You know, we had a whole conference that was really about like increasing engagement and presence. And so I think a lot of people took away the message that that was really, really important, which it is. But, obviously, the subject matter instruction is what’s most important. And students can get lost in a sea of images. If you have a lot of stuff in there that’s not directly related to the content. So honestly, the best thing to do is to look at the way different people use different things and to find a good balance of what works for you, and really go with what students are telling you. So if students are getting lost in your class, if students are getting confused in your class, then you have to go back and make it a little bit more simple and easy to navigate.

Rebecca: Details, details.

Allegra: Yes.

John: But tying the social presence and the images and the playlist and so forth to the content reinforces the learning without distracting from the learning.

Allegra: Yeah, exactly.

John: How have students responded to your increase in social presence in classes. I’ll say about 50% of them have not mentioned it at all. So, we get feedback from students on student evaluations. So that’s like solicited feedback. And I have only ever taught online this way. So I don’t have anything to compare it to necessarily, but I get a lot of unsolicited feedback from students in the form of emails. A lot of them say I really don’t like English class. I was really anxious about English class. And watching your video or listening to the first lesson really helped me feel more comfortable. A lot of them say you seemed more approachable. I really feel like I can ask you questions. And it shows because students will send me emails halfway through the semester and they’ll just say, I don’t really even know what question I have. I just feel like I’m getting lost and I’m not doing very well. And I guess, can you just help me? And so a student will only send you that kind of email, if they’re really comfortable sending you that kind of like, “Just help me. I don’t know, am I doing okay?” if you’re an unapproachable instructor, if you are somebody who doesn’t consistently respond to emails, if you are somebody who seems like a robotic behind the computer grader, students don’t reach out to you with that kind of question. So, that tells me it’s important to cultivate this kind of sense of community in a class so that students feel comfortable when they are lost at sea. And they’re sitting at home all by themselves, they don’t have classmates they can turn to you and say, “Do you know what’s going on?” You have to really create that sense of community very intentionally. And it shows. I get about 15 to 20 unsolicited emails a week in the first six weeks of class when students are orienting themselves to where things are, and they all say the same thing: “I feel comfortable. I feel less anxious. I appreciate this.” And then on the evaluations, they say I can tell that she did extra work. She always responded to my messages, which it’s heartbreaking to me when students thank me for replying…

Misty: Yes….

Allegra: …to them.

Rebecca: Yeah.

John: Yeah, I know.

Allegra: Because I’m like, “Does that mean you have faculty who don’t reply to you?”

Misty: Yes, it does.

Allegra: But it does show… and I don’t mean this like in a bragging, like, “look at me, I get all this great feedback” way… But I do get a lot of great feedback. And it’s because of all of these things. It’s not because they all love reading poetry.

Misty: So, all the research shows that if you create community, students will stay in your course and will stay in college, and all of the research for years and years and years focused on in-person classes. So, we’re trying to take that research and adapt it to our online classes. And as chairs, you and I both get success rates every semester. And I can tell you, immediately when I look at the success rate I know who’s creating a social presence in their class and who isn’t because if a student feels connected to you, they don’t want to drop your course. And they want to try to do well for you. And the high success rates generally usually typically correspond to courses where the instructor’s engaged, involved, and has an actual dialogue with the students.

Allegra: Absolutely. Everybody has good semesters and bad semesters, including me. But if somebody consistently has a low success rate in an online class, then that is a person that we start to intervene. And we say, like, “Let me help you. Let me give you some strategies. Let’s talk about ways that you think you could do better, because my job is not to change the way you teach. But my job is definitely to make sure students are as successful as possible.”

Misty: And that doesn’t mean 100% success rate’s a good thing either.

Allegra: No, no. Just definitely not. [LAUGHTER] But we’re kind of sorting this out in terms of making our online classes as good as they possibly can be while at the same time evaluating our faculty’s online classes in a formal way, and also mentoring online faculty to improve their classes in a less formal way. And a lot of times they ask us, like, “How can my students just feel like disconnected for me? How can I fix that?” And I’ll say, “Why don’t you try… just post an announcement every week. Just start there. It’s very easy, doesn’t take very much time. And you’re reaching out to every single student and then we can talk about individualized emails, reminding students who haven’t submitted something, all those kinds of things. The other thing is, in an online class at a community college policies like I will never take late work under any circumstances, no matter what, I don’t care who died, it’s not going to work. And students perceive that from you. And to be that rigid and inflexible in these circumstances is a breakdown and that is what I number one thing I get student complaints about is: “I submitted it five minutes late,” or “I was in a car accident and my teacher didn’t care.” And those kinds of things we can’t accept anymore. That’s just not the nature of online teaching. And that’s not the nature of community colleges.

Rebecca: These are really good points. We want to make sure that our students succeed, and putting artificial barriers in their way is certainly not going to help that.

John: It’s a serious issue. As we’re getting a broader spectrum of society entering college, many of the students are ones who are on the threshold of deciding whether to go or not. And when they’re turned away with because of major life issues and they get discouraged, they often just disappear… and being welcoming and dealing with real-life situations in a realistic way (in the same way that they’d be dealt with in a workplace) isn’t really unreasonable.

Misty: Yeah, absolutely.

Allegra: That’s what I say to faculty. I’ve had a circumstance where a student forgot to attach the document and the faculty wouldn’t accept it. Even though the student submitted it, it was just blank… I attached the wrong document, and I can pull back an email from that same faculty member and say, “Here are three different times you sent me an email, and you forgot the attachment.” Be realistic, we don’t have to cut everybody a break. But like you said, people make the same kinds of mistakes in the workplace. And we don’t have this artificial rigid system where there are no exceptions, and zero tolerance for anything. And when there are students who are on the border of whether or not they want to continue in college, or whether they have enough support, or whether they feel confident enough to become successful, your attitude can make or break that student’s experience.

Rebecca: That really does tie back to this whole idea of social presence in a lot of ways because these are the things that aren’t really about the content of the course, but really about how it’s delivered. And that’s really what social presence is about.

Allegra: Absolutely and if you have a student who says “I felt anxious, and you’re silly video and your bitmojis helped me feel more comfortable,” that is a student who maybe would have dropped when they had the first difficulty with an assignment. But instead, they felt comfortable enough to reach out and say, I’m really struggling, I don’t have any idea what’s going on. And I can just explain it in a different way. Or say, actually, it seems like you really do know what’s going on. And you just needed me to kind of build you up a little bit. And that’s what my job is supposed to be. My job is not supposed to be to enforce a bunch of rules, and to be the arbiter of what’s on time and not on time. And to just sit in a room and grade your paper, like my job is to build you up and help you learn.

John: It’s nice to see two people who are department chairs using these techniques in their classes. [LAUGHTER] Because that sets a nice role model which we don’t always see in all departments at all institutions.

Allegra: It does help to be a fully online campus, so we have a whole campus culture. Our administrators support this, our instructional designers help us with all of this. There’s no way I could have made that video without them. And they really emphasize it and reward it.

Misty: Well, and to some extent, we’re still the Wild West, right? So we’re still getting to determine the culture, whereas brick and mortar campuses, maybe that culture has already been set. Maybe it was set in the 1970s. And that’s kind of hard to change.

Allegra: Yeah.

John: Or the 1870s, as the case may be, [LAUGHTER]

Allegra: Yeah.

Misty: Yeah.

John: Your podcast…. Tell us a little bit about how that got started.

Allegra: Our campus administration said, “We have all this equipment, and we want to make sure that it’s getting used.” Our campus President, I think, is the person who said somebody around here should make a podcast.

Misty: Well, no, what he said was, “You guys need to make radio shows.”

Allegra: Yeah.

Misty: …and I didn’t understand.

Allegra: So it was Misty’s idea, because she teaches history and I teach English and you can tell we don’t agree on anything or everything. But we do have shared passions for feminism and for social justice, and we’re both very passionate about the things we like. We don’t like the same things. [LAUGHTER]

John: It’s a great blend, though.

Allegra: So, I will talk about Grey’s Anatomy, and she will talk about the War of 1812. No… but it’s a great integrative learning model. So we, in almost every episode, are able to integrate history and literature, or history and information literacy. And we can also talk about how the same ideas of textual analysis apply to Grey’s Anatomy and Game of Thrones, or how there are historical figures who are similar to the figures that you see in Game of Thrones. That’s actually episode we’re going to record later today is about history and Game of Thrones connections…

Misty: We also want our students to see the connections between their subjects.

Allegra: Yeah.

Misty: Because we think that they leave a history class, they don’t see how it touches literature, or they leave a literature class or they don’t see out to just psychology and so having the podcast can help bridge that gap. And it can kind of wrap them in this world of the humanities.

Allegra: Absolutely.

Misty: I mean, we try math and science, too. But it’s not our strong…

Allegra: It’s not. So yeah, in our math episode we have historical women in mathematics. And then I’m like, “Here are some great books about women in mathematics.” But we the two of us are certainly not experts in math. And because we’re a community college, we don’t have like a gender studies program. So it’s a great way for students to get exposed to some of those ideas that if they’re transfer students to universities, that will be more prevalent on the university campus. So more cultural studies, more applications of history, English, sociology, and all those kinds of things together. And we sometimes have our Dean as a guest star on our podcast, because she was a speech professor and now she’s an administrator, and she has new perspectives to add as well.

ALLEGRA And the other thing… it lets our students see that were people, that we’re actual real people and they can hear us joke with each other and they can see the difference in personalities. So, I’ve started including these in my course, especially the ones that relate directly to a historical era.

Misty: Interestingly, our most popular episode is called “The Trouble with Tropes,“ which is about tropes of female characters in TV, movies, literature. And so obviously, that directly relates to literary analysis, and I teach tropes in literary analysis. And I think it’s hilarious that it’s one of the most academic episodes of our podcast, and it’s the most popular. But I definitely, when I talk about stereotypes and archetypes and tropes, direct students to that, and beyond that there’s a link to the podcast in my “About Me” section in my course. So students want to listen to it, they can have some students say, “You know, I listened to your podcast.” I’m not going to give them extra credit for listening to me talk for an extra hour because that seems a little self serving, but I do tell them about it and like Missy said, if it directly relate to the content, I will add it as an additional resource in that lesson. Absolutely.

John: I know we mentioned this at the beginning of the episode, but could you remind our listeners of the name of your podcast?

Allegra: It’s the Profess-Hers Podcast, and its history, literature, pop culture, sports, through a woman’s perspective and a feminist perspective.

Rebecca: And we can download it where?

Allegra: Everywhere you get podcasts: Apple, Stitcher, Google, all those places that you get podcasts. They’re in all of them. Yeah, it’s in a lot of places. I didn’t know how it got there.The same places you can get the Tea for Teaching podcast.

John: Are you on Spotify?

Allegra: Yes.

Rebecca: Well, they have to be, right, they’re promoting Spotify. [LAUGHTER]

Allegra: Yeah, I should be getting a check from Spotify any day now. [LAUGHTER]

Rebecca: Yeah. We all wish, right? [LAUGHTER]

Allegra: Yeah.

John: Our Spotify take up just doesn’t seem quite as high as the others. But we do get a few every month.

Allegra: Yeah, I think it’s 50% from iTunes and Apple.

John: We always end with: what are you doing next?

Allegra: Well, next we are recording two episodes of our podcast because our semester is coming to a close. So we will have a few weeks where we’re not on campus. So we’re also trying to record ahead a little bit so that we have the consistent podcast releases even while we’re not at work. I took Misty’s answer because as soon as we’re done with this we’re going to eat some nachos, and then record some Profess-hers podcasts…

Misty: …and beg our teachers to get their grades and on time. Please submit if you’re listening. Always submit grades on time. Thank you.

Rebecca: Public Service Announcement. Yes. From every department chair ever.

Allegra: …of all time. Yes, indeed.

Rebecca: It’s been really fun. Thanks so much for joining us.

Misty: Thank you.

Allegra: Thank you.

John: And I’ll keep enjoying your show. And Rebecca will be listening to your show.

Rebecca: Yeah, definitely.

John: It’s been a lot of fun.

Allegra: It has and I’ll get Misty to listen to yours. I’ve been listening to it.

Misty: New subscriber.

Allegra: Yeah, you’ve got one here.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

John: Editing assistance provided by Kim Fisher, Chris Wallace, Kelly Knight, Joseph Bandru, Jacob Alverson, Brittany Jones, and Gabriella Perez.

85. Small-Group Discussions

Small-group discussion activities provide all students, even the quiet ones, with an opportunity to actively engage with course material. In this episode, Dr. Dakin Burdick joins us to explore a variety of small-group discussion activities that can be productively integrated into our classes. Dakin is the Director of the Institute for College Teaching at SUNY Cortland. He has been active in professional development for almost 20 years, and has served on the Board of Directors for both the Professional and Organizational Development Network in higher education (the POD network) and the New England Faculty Development Consortium, where he was a president for four years.

Show Notes

  • Burdick, Dakin (2019). Small Group Discussion Protocols
  • Joan Middendorf — Teaching Resource Center Director at Indiana University
  • Middendorf, J., & Shopkow, L. (2017). Overcoming Student Learning Bottlenecks: Decode the Critical Thinking of Your Discipline. Stylus Publishing.
  • IUPUI — Indiana University – Purdue University Indianapolis
  • Angelo, T. A., & Cross, K. P. (2012). Classroom Assessment Techniques. Jossey Bass Wiley.
  • 84. Barriers to Active LearningTea for Teaching podcast (with Lindsay Wheeler and Hannah Sturtevant)
  • Larry Michaelsen — Professor of Management at the University of Central Missouri, pioneer of Team-Based Learning
  • Michaelsen, L., Knight, A., & Fink, L. (2005). Team-Based Learning: A Transformative Use of Small Groups in College Teaching. Stylus Publishing.
  • Team-Based Learning Collaborative
  • Elliot Aronson — Inventor of the Jigsaw classroom technique
  • Aronson, E. (1978). The Jigsaw Classroom. Sage. Chicago.
  • ZoomiOS, Android
  • Eric Mazur — Balkanski Professor of Physics and Applied Physics and Area Chair of Applied Physics at Harvard University
  • Teaching Professor Conference
  • David Pace — Professor Emeritus of History at Indiana University, Bloomington.
  • Pace, D. (2017). The Decoding the Disciplines Paradigm: Seven Steps to Increased Student Learning. Indiana University Press.
  • Pace, D. and Middendorf, J. (2004). Decoding the Disciplines: Helping Students Learn Disciplinary Ways of Thinking. Jossey-Bass.

Transcript

John: Small-group discussion activities provide all students, even the quiet ones, with an opportunity to actively engage with course material. In this episode, we explore how a variety of small-group discussion activities can be productively integrated into our classes.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[MUSIC]

John: Our guest today is Dr. Dakin Burdick, the Director of the Institute for College Teaching at SUNY Cortland. Dakin has been active in professional development for almost 20 years, and has served on the Board of Directors for both the Professional and Organizational Development Network in Higher Education (the POD network) and the New England Faculty Development Consortium, where he was President for four years. Welcome.

Dakin: Hi. Good to be here.

Rebecca: Today’s teas are…

Dakin: Yes, I am drinking Sleepytime Vanilla today.

Rebecca: That sounds yummy.

John: And a great way to start the day. [LAUGHTER] And I have Ginger tea.

Rebecca: And I have something different today. I have Strawberry Grapefruit Xue Long Flavored Green tea.

John: Okay.

Dakin: Nice.

John: We’ve invited you here to talk about effective ways of engaging in small-group discussions. You’ve done quite a few workshops on that. Could you tell us is about your shift to small group discussion protocols in your own classes and how you get started with using small group discussions?

Dakin: Sure. My method of instruction was lecture primarily. I started off in history and I did a lot of lectures. Some of them were good—and I’m proud of those few—but I was teaching a class at Indiana University Purdue University in Indianapolis at Columbus and it was a U.S. history survey, first-year survey. It was once a week, three hours long, and some of the students had traveled for more than an hour to reach the class after a full day of work. Some of them came in with their dinners, and I knew that lecture class was not going to get me through that class. Nobody would survive it; not even me. [LAUGHTER] So I worked with the Teaching Resource Center Director at Indiana University, Joan Middendorf. I selected several small group discussion methods: jigsaw discussions, role playing. I modified the debate system to create a evidence-based debate protocol. I used the just-in-time teaching method from IUPUI, and the classroom assessment techniques of Angelo and Cross, which I kind of regard as my Bible. The combination of those worked really well. The students remained active throughout the class, we were often surprised to find the class was over, everybody was still energized, I still had a protocol or two to go. Everybody learned each other’s names because we did random groups, and the class as a whole was tremendously successful. I was really happy with the results and I’ve used it ever since.

John: Whole-class discussions are often used but what are the advantages of small-group discussions relative to a whole-group discussion?

Dakin: I actually advocate both of those. I advocate lecture, small-group, and whole-group discussions for different purposes. The large group for me is one where I would often find faculty having the usual suspects were the only ones talking. You had three or four students in a class of 20 to 30, no one else was talking, and the faculty member would usually come to my office and ask, “Well, how can I change this? How can I get more students involved?” and often, that’s where the diagnostics began. What I found was, first of all, they needed to have preparatory homework, the students needed to do it, it needed to be graded, and if it was graded and it’s frequent assessment in order to reduce faculty load, they had to grade this lightly, and place the effort onto the students and not onto themselves. And if they did that, usually things improved. The advantage of the small groups is that if they’ve done all that work, then the students wants to talk. If you get to a large-group conversation and you’re not talking, it’s pretty boring for the students that aren’t talking. For the faculty member, it sounds like it’s a really good conversation because they’re the center of the wagon wheel, they’re the center of the hub, and so they’re constantly talking with those three or four students, but they’re wondering what’s happening with the rest of them. And that’s a good thing to wonder about, frankly. If you use small groups, you have the advantage that more people are talking at the same time. So instead of having one person talk at a time, you can have six people in the room talking at a time, so there’s a lot more conversation taking place and hopefully, more change in learning, which is important. Students in small groups feel more free to talk, there’s less risk in a small group, they can gain confidence from that talking, and they’re more active in the classroom at the same time because there’s more people talking. It also gives them the chance to practice disciplinary skills that the faculty member has put into that assignment. So the assignment shouldn’t be about declarative knowledge or facts, it should be about how can you do something in the field? How can you emulate the skills of an expert? The other piece of this is that the small groups have been demonstrated to be effective. Students in the 1920s said they preferred this sort of discussion—at least large-group discussion at that point—and then by the 30s and 40s, there was research and social psychology showing that small groups were more effective in promoting change and student learning. And from there it went on and since the 50s and 60s, a lot of different types of protocols have been invented and developed. There’s just a lot of advantages.

John: Could you tell us a little bit more about how you ensure that students come prepared to actively participate in those small group discussions?

Dakin: The main thing is grade it. The rule is that students—according to the Carnegie unit—are supposed to study for two hours outside the class for every one hour in. Well, the Study Study at Indiana University showed they weren’t doing that. They were studying one hour outside of class for every hour in, and it was usually on Sundays. That means that we kind of have to take that knowledge and make use of it. We know they’re going to do their work on Sundays. So okay, the assignments going to be due Sunday night, 11 o’clock, 11:55. But you make sure that they work harder. You don’t feel guilty about putting more work on them because more work means more practice. All of them could use more work reading, all of them could use more work writing, so that’s what I have them do. And then I make sure they turn their assignments in on Sunday night, I grade them Monday morning—which is a principle of just-in-time teaching—it’s preparatory homework, I read that, and then I modify my class based on what the students bring to it. And so I can see—first of all—their weaknesses. I can see their misconceptions. I also can see their strengths. Occasionally they have real strengths they bring to the class that would be totally invisible if I hadn’t done this work. And my example for that is I had a class where I was teaching the My Lai Massacre—about Vietnam—and I had in the class two very strong students. One was a G.I. who had fought in Vietnam, and one was a First Lieutenant who had taught the rules of land warfare at Fort Benning for three years. Both of these guys were A, smart; B, aggressive; and C, constantly fighting with each other because it was enlisted versus officer. So they dominated the class very often. And when I got back their feedback, they told me their knowledge and I hadn’t seen that knowledge before. I did not know that these were their backgrounds. So I spent an extra two to three hours reading about the rules of land warfare, came to class prepared, and instead of a class that would be a trainwreck for me, what happened is they came in and the Lieutenant said, “Everybody knows the rules of land warfare. So they’re all guilty, and they are all responsible,” and the G.I. says, “No G.I. is going to read a 100-page field manual on the rules of land warfare.” And the Lieutenant says, “Well, there is no 100-page manual on the rules of land warfare,” and I said, “Well, actually, there’s three. [LAUGHTER] There’s the 1956, 1965 and the 1973 (revised on the basis of My Lai).” Okay, so that stops that conversation. Then I turned to the GI and I say, “Okay, but every G.I. has those little plastic helmet liners, right? …with the 10 rules of land warfare on them.” “Yeah.” “Okay. So we’re agreed; they knew the rules of land warfare. Some follow them, some didn’t. Now, let’s talk about why,” and at that point, the conversation became really useful. First of all, all the other students could participate, because they now had the background, and the two people that were real experts in the room could help us kind of determine why people followed or did not follow those rules. And again, if I had not done that preparation—just two extra hours—that class would have been ruination.

Rebecca: What are the kinds of questions that you have students respond to that maybe elicited some of the information that helped you? What are the keys to asking good questions for that preparatory work?

Dakin: I think the keys to that are knowing your subject. So, everybody that is a content master—every faculty member —has their own expertise, and it’s pretty impossible for me to name the prompts that they might use effectively. But they probably know them, they’ve probably seen them in their graduate work. They know that these are the elements that made up their dissertation exams, their qualifying exams, and they’re probably pretty smart about what are those major issues in their field that need to be discussed, and to be prepared, and the students need to be prepared. The big thing is making sure that we’re talking at a high level of cognition. So in Bloom’s taxonomy, talking about analysis, talking about evaluation, those are the levels you want to get at. And those are almost impossible to get at with multiple-choice questions or tests, so that means there has to be conversation, there has to be writing. Those are elements that are important.

John: Earlier you mentioned that you use random assignments for small-group activities. Do you do change the groups on a daily basis or do you have more persistent groups?

Dakin: Occasionally, if I’m doing long-term group work, I will do some sort of pre-test, find out what the strengths and skills of the students are, and then place them mindfully into those groups, so that they construct useful groups because they’re going to be in those for half a semester. I’ll do a swap halfway through, but that’s a long time to be in a single group. For the random groups, I definitely do that and I do that on a daily basis. The students originally complain about that, but they get used to it pretty quickly and they’re ready for it. And the advantage is that they get to meet everybody in the classroom. They get to be in a group with everybody else and that builds trust and it builds community. And that allows them, by halftime through the semester, they know everybody, they’re comfortable with everybody, they trust that other people have their best intentions at heart, and then the conversation just escalates from there because everybody’s now willing to talk.

Rebecca: In our previous episode that we just released last week, we discussed some of the issues that can come up when you’re using evidence-based practices for the first time. A lot of people know or buy into the idea of small-group discussions and might just go for it without necessarily having a good plan in place, and things might go awry. Can you talk a little bit about ways to be prepared for trying something new, the kinds of things that might go wrong, and how we might adjust ourselves a bit as faculty members as we’re trying new things?

Dakin: The thing that I find usually is that people just don’t give the new techniques a chance. It’s scary. Now there was a study back in the late 90s out at Brigham Young and they asked faculty two questions. They asked them first, “What do you think are the most effective teaching methods?” and then “What do you do?” and they were diametrically opposed. [LAUGHTER] And the reason was time management, people are very busy and the stuff that’s effective takes a lot of time to do—or they think so. So I view my job as an instructional designer when I’m helping them to reduce that amount of time and make sure that they can do that. So first, make it time manageable, so that you can do the task and you can feel comfortable. Secondly, trust the system. Trust the change you’ve made. You made this change for a reason, trust it. And third, trust your students. Your students want to succeed, they want to learn. Trust that and have them help you make this successful. Tell them what it is you’re doing in the classroom, why you’re making this change, why you think this is going to help them learn better, and then also use feedback from them to get it. So I typically will use something called a stop, start, continue—What do you want me to stop doing? What do you want me to start doing? What do you want me to continue doing?—and use that student feedback to then modify the class. So it’s kind of like a mid-semester evaluation, but I feel like doing it whenever I do… it is just fine.

John: Now earlier you mentioned that whole-group discussions have a place. In what sort of sequence might you use or in what combinations would you use small-group discussions and then whole-group activities?

Dakin: My process is basically four-part. One, preparatory homework. There has to be preparatory homework and it has to be graded—lightly graded—and it should be moderately challenging. Next, they come to class, there’s a brief lecture and the lecture introduces the material, frames the questions we’re going to talk about today, maybe corrects some of the errors that were made in that preparatory homework, also celebrate successes from that preparatory homework. Once that lecture is done, maybe 10, 15 minutes, then move them into small group work. Small group work can be anywhere from one to two minutes in a lecture hall to 40, 50 minutes—and you might do a whole session on the rest of that piece, maybe a debate or some large-scale exercise—usually though, about 10 to 15 minutes in small group. Then when you hear the sounds rising, that means they’re talking about things they enjoy, which means their social life, [LAUGHTER] and so it’s time to stop them. You’ll also see sometimes that there will be a student—maybe all the A students somehow got at the same table—and they’re done three to four minutes before everybody else. Well, the point of putting them into small groups is to build energy and confidence and you don’t want your A students to be bored. So if you have a group that’s done first, you appraise how much of everybody else got through, “Can I stop this now?”—usually you can—and you bring them back to the large-group discussion. And in that large-group discussion of 10 to 15 minutes, you do debriefing and you find out what they think they know, maybe use a classroom assessment techniques from Angelo and Cross, and you evaluate and you build feedback that you can use later. And then once you’ve got that, then you move back to the lecture, and you clean up the misconceptions, you explain and reframe the next issue, and then it’s just a cycle. So it’s lecture, small-group discussion, large-group discussion, and continually like that.

Rebecca: What are some strategies that you use in small groups to make sure that everyone participates or is engaged and stays on task?

Dakin: First, make sure they’ve done the homework. Secondly, randomize so that I’ve got some good students and some poorer students in the same groups, so that we have people that can interact—also, so that people can learn about each other. To keep them on task and walk the room: first of all, be engaged with them. Listen to what they’re saying and if it’s on task, you just congratulate them and move on, if it’s off task, okay, now start working with them—and there’s going to be one group that’s off task, certainly. Other pieces are… that you might encounter a small group where there’s a number of dominant individuals. So there’s a couple of people that are really assertive, and they’re talking all the time, and they are just dominating the whole piece, and the other people aren’t getting heard. And so in that point, then you start introducing other discussion protocols that will allow more inclusivity: so things like expense account, talking stick, things where other people’s voices are valued. Another one would be Larry Michaelsen’s Team-Based Learning that also does that.

Rebecca: Can you talk through each of those, for those that aren’t familiar with each of those?

Dakin: Sure, let’s start with talking stick. Talking stick is very simple. You have an object—usually a pencil or something—and one person gets that stick, and is able to talk for one minute without being interrupted, or any comments from anybody else. And then you pass it to the next person, for one minute they get to talk, and it goes around the room that way. And then once it’s gone around once, everybody can talk at once and kind of work out what it was that they heard said, but everybody’s voice is listened to and heard during that time. That’s a rather formal way. Another less formal way is expense account, which is maybe you give them three—or however many pennies you want—three tokens. And they pass those tokens in each time they talk. So the assertive ones are going to spend their pennies very quickly. [LAUGHTER] And the less assertives are going to then have a chance to spend their pennies. And when everybody has spent their pennies, you all get your pennies back and now you can start again. But again, that’s a way to give people a chance to speak. But people can choose when they want to speak, rather than having this turn where it’s coming around. And it’s very set. Larry Michaelsen’s Team-Based Learning is much more complex. Larry started this in a lecture hall. And so he has basically an IRAT and GRAT. And the IRAT is an Individual Readiness Assessment Test and that GRAT is a Group Readiness Assessment Test. So he has them take an IRAT first, and as an individual give their answers, turn that in—that’s a grade—and then he has them do the GRAT. So as a group, they now turn in their group grade. And he also uses the scratch off cards, the if/at cards, that sort of thing. Initially, the assertive ones—again—are giving the answers. But as they discover that they don’t have the right answers all the time, then the quieter ones in the group suddenly become more important to the group because their grade is dependent on this. So they’ll start asking, “What did you get for this? You seem to get A’s all the time. Can you please help us?” And so that’s his method of doing that inclusivity.

John: And in that approach though, I believe he recommends persistent teams over the course of the semester, so that they develop that sort of team dynamic.

Dakin: Yeah, very much so.

John: Are there any other small group activities that you like to use?

Dakin: I have a lot of protocols that I’ve gathered over the years—probably got 40, 50 protocols—and the ones that I select are the ones that are low risk. So I’ve kind of classed them as low risk, medium risk, and high risk in terms of how much risk does the student feel when they’re in the classroom doing these… and I like low-risk things which are usually small group where they’re by themselves and they’re talking, and it’s not in front of the faculty member, and they are not having to answer to the whole class in front of a large group. So, some of the pieces I like are jigsaw—which comes out of Elliot Aronson’s work in the 70s—the idea that you break up an assignment into five pieces, and each of the students in a group will do one of those five pieces, and then they will talk in class and share out what they’ve learned from each of those five pieces. So it’s a great way to synthesize a lot of data that maybe you don’t want all students doing. So when I was teaching my Middle Eastern history class, each student was responsible for a different country and they had to do a lot of reading on that country. But if I had all the students do all that reading, it would have been far too much. So instead, I can have these various countries sit at a table and then have a conversation, and the student representing Israel can talk about Israel’s point of view, and the student doing Jordan can talk about Jordan’s point of view, that sort of thing. So that’s one method I love and I even do a double jigsaw. But I only do a double jigsaw maybe twice a semester and they’re at moments where there’s so much content, that there’s absolutely no way we can cover it. And the best example of that is U.S. history survey, first day, which is the dawn of time to 1492, which I think is horribly disrespectful to everybody that was in North America before 1492. So we do a double jigsaw, which is where you have a jigsaw that creates experts at each table and then those experts then are now experts in five different topics. And those people then go off to create super jigsaws. And that works well, but it takes a lot of time. The other one I love is role playing. Role playing… just because it’s my age… I grew up with role playing, but I’ve done a lot of different styles of role play. The one that I think I use the most in first-year history is Articles of Confederation. Everybody takes a representative to the Confederation and talks about what it was that person was like, and why they voted the way they did, and what were their goals. And then we skip ahead to the Constitutional Convention and we talk about who’s still there, who’s not there, why are they not there? If they’re still there, do they still have the same opinions? Are they still voting the same way? Why are the results different at the Constitutional Convention as opposed to with the Articles of Confederation? So that’s a good one. Other classics are the Oregon Trail… everybody loves the Oregon Trail. And unlike the computer game, what you learn is not many people died on the Oregon Trail. People who died most were the Native Americans who are along the trail, everybody else pretty much made where they were going, but that had to do with who those people were. The other one we did was Cuban Missile Crisis. Did the Cuban Missile Crisis and role played the various operatives in the Cuban Missile Crisis. And then next week we talked about Watergate and again looked at those same operatives and where they were now in the Watergate plumbers. So that was also useful …those kind of things. There’s lots of different ways to use that though. I’ve seen people use that with theorists. So in psychology, different theorists are represented by the students and they argue their different theories and try to figure out how these things go together. Role playing is obviously one I love.

Rebecca: Can you talk a little bit about how you set the role play up? You mentioned what some of the topics are and when you use it, but can you talk a little bit about the logistics of setting that up and how you have students prepare for that?

Dakin: And those vary a lot. When we’re doing the Articles of Confederation, I just have a list of representatives and I asked them to choose one and then we go from there. So my prep on that is zero, they are the ones responsible for that prep. On some of the others, there’s a lot of prep. With Oregon Trail I worked out, I took a K-12 game that had been done for Oregon Trail, and then I made it much more complex and they had to purchase their gear so I had a full list of gear, I had a list of where they were going to stop, how they were going to stop, and what the mortality rates were. So I basically created this whole game around it and then they played through that. With the Watergate and Cuban Missile Crisis, it was kind of halfway between there. I made cards with each of the people they would role play and on the back—like a Clue card—it tells you who this person is and what their role is and then I gave those to them. And then from there, they again generated most of the data.

John: You mentioned you have these organized by levels of risk. How would you recommend using the different levels? Would it make sense to start with low-risk activities, and then as more trust is built, build the higher ones, or would that be affected by the level of the class that you’re teaching, whether it’s introductory or more advanced?

Dakin: Yeah, it definitely depends upon the purpose of the class. I tend to teach introductory classes so I build a lot of trust, I use a lot of low-risk pieces, and I’ll move to maybe medium risk by the middle of the semester—or maybe I won’t ever use medium risk, it’ll all be low risk—because I’m trying to get them to get used to college and figure out what that’s involved in. If I am teaching a class that’s kind of a gateway or portal class that’s going to lead on and it’s supposed to cull out people, it’s supposed to find out who the best people are, then maybe it makes sense to start doing some of those high-risk pieces, but I probably wouldn’t do that until at least the third year. Build a lot of confidence, a lot of trust, and there’s a lot of learning that has to take place before that, before you get to that point. Traditionally of course, if you look at law school or medical school, they have a lot a lot of high-risk protocols, because there’s a lot at stake and people have to do well. And I remember when I started working with the med school that I read academic medicine, and one of the articles was, “We should abuse our students less.” [LAUGHTER] Not, “We shouldn’t abuse our students,” but, “We should abuse them less.” So, that kind of gave you a sense of what we were dealing with.

Rebecca: Can you talk a little bit about some of the small-group techniques that you use in online environments?

Dakin: Sure. Online environments—actually, the small groups—I usually leave that up to the groups themselves. So if there are groups of students that I’m having work on particular topics, I’ll have those students organize, say, a synchronous conference where they get together on Zoom, and they talk about these things. So they get to pick whatever tool they want—I’ll recommend Zoom because it’s free and you can have up to 40 minutes free, and you can record it. It’s very simple—but they will do that work by themselves. If we’re dealing with, say, a discussion forum, what I’ll generally deal with is ways that students can interact kind of more of at a large-group level, because there’s really no need for a small group when you’re on the discussion forum. But what I do want to do is get rid of the old “post one, reply two” because after you’ve taken two or three online courses, you’re pretty bored with that protocol. And so giving them different ways to think about it and moving the jigsaw into it, moving a debate into it, moving role playing into it, those are all really useful.

Rebecca: Can you pick one of those more complex ways of using a discussion board and talk through how you set that up or organize that?

Dakin: Sure. I think the main thing I do is really—it’s not so much about the organization of the board when I’m doing it—but building student activity. I do a big sales job in terms of talking about what is the value you get from an online course. Now, if it’s just teacher to student, I think that’s a really limited amount of value because there’s a lot of good books out, you can read, you can train, you can look at YouTube, there’s all sorts of great ways to learn. But a real value from an online course for me is who is in that class with you and finding out what their strengths are and what they can bring to it, and that’s where a large part of the education comes. So I don’t use this “post one, reply two” but I do want them to make sure that they are responding weekly to their colleagues, but at a level they feel is appropriate. So don’t say something if you think it’s totally pointless. But if you have a comment and you feel it’s worthwhile, say it, because we need to hear it. That’s the largest part of this. In terms of the organization, the only pieces I’ve done in terms of organization have been very slight. So, with an assignment, you turn in your first post Wednesday, and you turn in your final post on the piece, on Friday, Saturday, or Sunday. So the initial post is what your response is—out of a think-pair-share, this would be the think part—that you’re doing your initial writing. And then the second part of the week is simply the sharing part. So now you’re responding to those students. Now, if you’re in Canvas, you can do this with setting up the initial one as your due date, and the second piece as your until date, so you can do it within one assignment. Unfortunately with Blackboard, you can’t do that, you have to have two separate assignments. But that’s the only real difference.

John: What about larger classes? What techniques do you recommend there?

Dakin: In large classes, I often talk about Eric Mazur and his peer instruction, simply because I can send them to the videos he’s got on YouTube, and he’s got a lot of videos there. He’s got a lot of publications. So that’s great, I have a lot of resources I can send them to that they can start working on. But Eric’s technique is largely one that applies to an interactive lecture. It’s not really small-group work per se, it’s a way to maintain activity by the students and also makes sure that you’re getting feedback back on what they’re understanding. But since Eric uses multiple-choice questions, he’s really not getting beyond that understanding- or application-level question. So, the issue really with small-group work and large classes is really not about the size of the class, it’s about the furniture in the class. So, you can do small-group work with a very large group as long as you’ve got movable tables and chairs. So, I did this at the Teaching Professor Conference a few years ago. I had 110 people in the room and we did value line, and we did jigsaw, and we did all these different things, and it’s very easy to do as long as you’ve got the furniture that allows you to do it. The hard part about a “large” class is really it’s about the lecture hall and the furniture in it. So if you’ve got furniture that’s fixed, if you’ve got a table that’s fixed, if you’ve got chairs that are fixed, it’s hard to have more than two to three people working together at any one time because they can’t turn around—they can’t do anything else. Also, since you’re in a large lecture hall, there’s a lot of noise. So again, you don’t want to get more than three people because you won’t be able to hear the others. If in a lecture where students can turn around, then you can have a larger group of say four to six. So you have two to three in the front row, two or three in the back row, and they’re talking together in that small group. And I’ve seen small-group work in lecture halls with as many as 160 people, so I know it works. It does take some effort in terms of arranging it. Usually they don’t do random small groups every day—because that would be chaos—but they do long-term teamwork and the faculty member who did this was David Pace at Indiana University—he was very good at this, he’s the one who taught me how to do much of this—he does a pretest, he organizes the students, he puts them into these long-term teams, and then in those teams in the lecture hall, they have the seating arrangement where they’re sitting. And then when he wants to do small-group work, he’ll do his lecture, and he’ll do small-group work, then he’ll do a debrief, same sort of pattern.

Rebecca: What do you find your role is, as an instructor during small-group work? You want to put a lot of the onus on the students, but what’s your role during all of that and how does that scale up to a big class?

Dakin: My role is—as an instructor small-group work—is essentially challenging, adding to, and supporting. Making sure that they know they’re encouraged and they’re doing a great job and going around doing that sort of thing as I walk the room. A lot of the work I do is really the preparation. Making sure that those things are well thought out, that I have a lot of idea of which directions they can go, and to, after the class, make sure I’ve done my reflection: I’ve written down all the weird places they went so that I know that those are possibilities and I can be ready for those, or maybe I just work towards those. Maybe those were better ideas than the ones I came up with—which is actually one of the big advantages of small-group work because you are paying more attention to the students, the students have a bigger role in the class, and your life isn’t as boring. If I was doing the same lecture 20, 30 years later, I would be bored to tears. But as it is, since I’m using these, every semester is different because every group of students is different. So my life is constantly interesting. And it’s almost like doing improv, really, in a way. You have to be a little brave about it, you give them opportunities, but there’s a lot of trust, you trust the students are there to help you. And everything goes well, even with apathetic classes that when I’ve walked in, the class has just been dead, they don’t want to do anything. After a week or two of this, they start getting into it. And by the end of the semester, they’re the same as every other class, and it’s going very well. So it’s highly enjoyable. So I think that’s it, make the class fun, get them to trust and encourage them to do their best work.

John: And in large classes if you have TAs, you could have TAs going around and doing the same thing, just so that you get more of the room covered.

Dakin: That, or if you’ve got a tight space to deal with, you could also have a backchannel going, so people in the groups are reporting out and the TAs are looking at that backchannel through Twitter or something else and kind of getting those ideas and feeding those back to either the students or the instructor.

John: Earlier you mentioned that light grading be used. Could you elaborate on that a little bit?

Dakin: I think that’s the hardest thing for faculty to do is light grading. Faculty members really want to mark everything. If they see something wrong, they will mark it. And I must admit, myself, when I’m posting to Facebook and somebody writes something and spells it incorrectly, I have to respond. It’s annoying, but I have to do it, and it’s the same way with grading. People will try to grade everything and they will eat up their lives giving these huge responses back that the students really aren’t going to listen to. Nobody has time to make all those corrections. So the smartest guy I ever saw was Bob Ferrell, who was a professor of history. And Bob was highly published—he had 50 plus books—and he still had a line out the door of students that he talked to every day and that was highly admirable as far as I was concerned. And so I wanted to find out how he did this, and what he did is… I took a readings class with him and I handed in a paper a week, and we worked through that. And every paper, the first time he got it, he marked it up pretty heavily to show, “You need to work on your grammar and I’m watching you.” But after that, every week, it was three things. He’d mark… circle one, flip a couple pages, circle another, flip a couple pages, circle another, “There you go,” out the door, you’re done. And so for me it felt like, “Oh, I only have three things to change. This is great, I’m really close to getting that top grade.” And next week it would be another three. And next week it would be another three, and so on. So, he was doing light grading, he was giving me feedback—feedback that was useful to me—feedback that was moderately challenging. I didn’t feel at sea, I felt I could do it. Great. And so I would do it. And that’s the way I come to this. The way I implement it is, say if I’m in a freshman class, I will have the students writing say 1000 words response every week, which for a freshman class seems like a lot, but I want them to work and I want to hear their voice. I will tell them not to use any quotations, I want to hear their voice, I don’t want to hear somebody else’s. I want to hear them thinking, and if they don’t agree with the text, argue with it—that’s fine. If you don’t agree with me, argue. That’s what you should be doing. You’re trying to construct your ability to speak and write. So, when they do that, they then turn these pieces in, and I grade them but I grade them lightly, which means I’ve got now 40,000 word essays I’m supposed to be grading, that will take me about 40 minutes. I spend about a minute on each. I just kind of flip through it, I can tell if somebody’s done the reading or not, I can tell if there’s a major issue or not, and then I write down my responses but I don’t give them to the students. I just give the students grades. And when I get to the class, I’ll do a group grade. So at the beginning of the class, I will then do a couple things. One, I will celebrate some people, and I’ll talk about that in a minute, but I also make corrections. I’ll do grammatical corrections, will say “Here’s the five grammatical errors of the week,” and by about mid semester, I’m still showing some of those grammatical errors up on the board and the girl who’s done it says, “Oh my God, it’s me again!” So they get it and they’re trying to reduce them and that’s fine. The other thing is I talk about misconceptions. Say somebody has a misconception about a particular piece, I’ll say, “A couple people had a misconception about X.” Now it’s not a couple people, it’s Joe. It’s always Joe. Joe’s in the back room, Joe never does the reading, Joe’s having trouble. But Joe knows he’s not doing the reading and Joe knows he’s not getting a good grade, he doesn’t need to have his name called out in front of the class. So I say, “A couple people had this issue.” I talk about that and address it. And then the next part, the celebration. So, in order to make them feel better about what just happened, I then say “Now then, I wanted to talk about some of the great things that were done this week. So first of all, Jenny had this fantastic response, it was just so meaningful. I want to share it with you, because I think it’s really worthwhile listening to. And Bob said something that no one has ever said in this class before and so I think it’s important to address that.” And then maybe I talked about Jim, “Jim really did a very deep reading of the text, he brought up some serious issues that I did not bring up myself, and I think we need to explore those today. So that’s part of our discussion today, it will be based on what Jim has talked about.” So that’s the celebration, but every week, it’s a different three. It’s never the same three, it’s never always the A students. Over the course of semester, I find a way to celebrate each and every student in that class, including Joe. And Joe is hard. Joe’s really hard. So I’m always watching every week to see what Joe is talking about and if Joe says something good it’s like, “Yes, I can now celebrate Joe! Good. Check.” I’m celebrating. And that’s the way light grading works for me, it allows me to spend more time interacting with students, less time interacting with their work.

Rebecca: I’m sure we can all take advice on reducing grading, right? [LAUGHTER]

John: When we talk to faculty about using group discussions in class, one thing they often raise is a question of when students are teaching each other—in general with peer discussion or peer activities—there’s a concern that perhaps it may reinforce misinformation. How can you be sure that that doesn’t happen with small-group activities?

Dakin: Well, I don’t think you can be sure it doesn’t happen, but you can certainly set up a system to check for that and make sure it’s not happening or that if it’s happening, you’re correcting it. So the way to do that would be use some ungraded assessments, those classroom assessment techniques from Angelo and Cross. In the large group during the debriefing, some of those may come to light again, and you can then use lecture to correct those misconceptions once they become apparent. I agree that small-group work builds confidence, but it can really be like the blind leading the blind sometimes, especially if the students haven’t been doing the preparatory homework, and especially if the groups aren’t randomized.

John: And if you do that sort of pretesting, where you’re getting the initial feedback, you can tell what those misperceptions are, so that you can be prepared to address them during the class, which should help reduce that issue.

Dakin: Sometimes… yeah. I have to know which questions to ask, and often I don’t. So it’s that ungraded assessment where they toss back an answer that completely takes me by surprise. Oh, I am so surprised. Now I know what your misconception is. But I couldn’t have guessed at it.

Rebecca: I think that’s important to remember too, that [when] you’ve been teaching for a long time, the misperceptions that you might have come across five years ago are really different than the misperceptions that you might experience this year, because the experiences of our students change and the group of students change, and all of that influences prior knowledge and prior experience that influences how they might interpret material.

Dakin: That is so important. Over the 30 some odd years I’ve been teaching, my students have changed a lot, not only in their content knowledge and what they know and what they’ve experienced, but also how they think and how they behave. And again, that’s the strength of using small group work, because you get to see how they think and how they behave. And they’re not just sitting there in rows in front of you and you imagine that’s the same class you were teaching in 1987. [LAUGHTER]

Rebecca: So we always wrap up by asking, what’s next?

Dakin: I’m collecting all these protocols for my own use and also to help others, so it’d be great if people listening to this podcast could send me some new ideas, send me some more protocols, so I can share those out. The way to do that is to send them at teaching@cortland.edu. That’s our email address. In the meantime, we’ve got a new Institute for College Teaching down here, we finished up a faculty needs survey. We’ve got our advisory committee in place, and we’re just about to start setting up priorities for next year. So, there’s a lot happening, I just don’t know what it is yet.

John: Because you’ve just taken over that position fairly recently, right?

Dakin: Two months ago.

Rebecca: Oh, the surprises you might find, right? [LAUGHTER]

Dakin: I have been very pleasantly surprised so far. I have found a lot of really skilled and dedicated faculty, and I’ve just really been enjoying talking to them. I know I enjoy this because it’s a challenge, and I love a challenge. And they are so well-educated already. It makes me work very hard.

Rebecca: Which means you’ll never be bored, right?

Dakin: Exactly, and that that’s why it’s so important to me.

Rebecca: Well thank you so much for joining us today. It’s been really interesting, and I think will help faculty as they plan for their next teaching adventure.

John: Thank you and we will share some of the resources that you’ve provided in the show notes as well.

Dakin: Thank you. I’ve really enjoyed our conversation. Thank you so much.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

John: Editing assistance provided by Kim Fisher, Chris Wallace, Kelly Knight, Joseph Bandru, Jacob Alverson, Brittany Jones, and Gabriella Perez.

71. Small Teaching Online

Face-to-face classes have been offered for centuries. Online instruction, though, is relatively recent and many faculty that teach online have little prior experience or training in online instruction. In today’s episode, Flower Darby joins us to explore some easy-to-implement teaching techniques that can be used to help improve the learning experiences of our online students.

Show Notes

Transcript

John: Face-to-face classes have been offered for centuries. Online instruction, though, is relatively recent and many faculty that teach online have little prior experience or training in online instruction. In today’s episode, we explore some easy-to-implement teaching techniques that can be used to help improve the learning experiences of our online students.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

John: Today our guest is Flower Darby an Instructional Designer an Adjunct Instructor in several disciplines and the author (with James Lang) of Small Teaching Online, which is scheduled for release in June 2019. Welcome Flower.

Flower: Hi John. Hi Rebecca. Thank you for having me. I appreciate that. It’s good to be here.

Rebecca: We’re really glad that you’re joining us as well. Today our teas are:

Flower: I am drinking Builders tea. Good, strong cuppa here.

Rebecca: Sounds yummy.

John: We have some of that next door. I am drinking ginger peach gree n tea.

Rebecca: I have my Golden Monkey again today.

John: We ran a faculty reading group here in the Fall semester of 2017 based on Small Teaching. Many faculty found that to be highly inspirational and we had over 100 people participate in that. One of the things that came up quite a bit is how this might be applied online. So there’s a lot of people interested in your forthcoming book. Could you tell us a little bit about how this book came about?

Flower: Sure. So Jim Lang came to my campus—Northern Arizona University—in January 2018 and delivered a talk on Small Teaching and as we know, the book has been very impactful for faculty around the country and around the world. And while he was at our campus, when it came time for the question and answers, somebody raised their hand and said, “Sure, but how do you do this online?” And Jim’s immediate response was, “That’s the first question I always get at every talk that I give,” and he said, “I don’t know. I would need a co-author because I don’t know how to do this online, but that would be a great book.” So I thought about that for a few days and then I approached him and I said, “Pick me. I would love write that book with you. I can see the value of it, I can see the need for it.” So that’s how the conversation began.

Rebecca: How does this extend the approach that was used in Small Teaching?

Flower: Well, it follows the same principles for certain that there is learning science that we can draw on to help us make the everyday decisions in our teaching and learning that have really an outsized impact on student learning and outcomes. So there are little things that we do on a day-to-day basis and we can draw from the research to discover what will have the most impact. Again, understanding that in order for faculty to really be able to implement something new, it’s got to be feasible. It must be doable. The daunting overhaul of a major course redesign is so off-putting that most faculty won’t get around to it, myself included. When I have gone to multiple workshops and conferences and sessions or read about an approach. And I, “That is a great idea,” and I spend about five minutes thinking about how I might incorporate that into my class and then I say, “Too much work. Too much time. I don’t have that time available. I don’t want to implement something that’s only half baked,” and the idea gets left out. So in our online classes, there are so many things that we can do that are on that small scale but will have that outsized impact on our students’ engagement and their learning. And so that’s what this book sets out to do, is to explain a lot of those principles and draw on the research that we have to show faculty how they can make these changes in their online classes.

Rebecca: We’ve talked many times on our podcast about the lack of preparation for faculty teaching in general and that’s certainly true for online teaching. You might have taught a face-to-face class, and then all of a sudden, now you’re teaching an online class and boom, you have to figure it out. Can you help us think through what are some things that faculty can do as they’re new or getting used to being an online teacher?

Flower: Sure, and I think that’s really the point here. Centuries, millennia, compared to the way that we teach and we coach and we mentor face to face, or even as we’re doing here using video conferencing software, but it’s a real-time interaction. Well, online teaching is very, very recent, say 20 years or so. And faculty don’t have the experience that they bring into the physical classroom. You may have heard of the phrase of the apprenticeship of observation coined by Dan Lortie. And this is the idea that by the time a teacher steps into a classroom to teach, he or she has had years and years of experience in a physical classroom being a student and observing what happens and how things go and thinking, if somebody chooses to be a teacher, then they’ve clearly put a lot of thought into how they want to teach. Well, we simply don’t have that for online. I do expect this to change in coming years. But the fact is right now that most of our faculty have either never taken an online class or if they have, it may be a very limited experience, not the years and years that they came out of K-12 with. And the same, quite frankly, is true for our students. They’re also pretty inexperienced at an online classroom. And the way this pans out is that literally faculty and students both don’t know what’s supposed to happen in an online class. They don’t have the social norms, they don’t know what the classroom looks like. If you think about it, when you walk into a physical classroom to start teaching, you know what’s in the room and you know what’s supposed to happen. You see the desks or the tables, you see a lectern at the front, you see a whiteboard or a projection screen, and students and faculty understand what is supposed to happen. Students go and sit in the desks, they face front, they wait for the faculty to come to the podium. It’s rare that a student would walk into a classroom and at the beginning of the hour, just step into the lectern. Students know that’s not what they do. But my argument is we don’t have that kind of social norming convention for online classes…yet. I think it’s coming, but right now many of the people who find themselves in our online learning environments go into that space, and they don’t know what things should look like, they don’t know where the light switch is, they don’t know where the desks are, where the whiteboard is. So just that whole lack of experience is rather disconcerting. And it’s hard to know what to do. Faculty don’t have experience—they have haven’t seen models, students are equally unprepared—so there’s a lot of work to be done here just to understand what should happen in an online class, what the furniture is, where it should be to facilitate learning. That’s where those gaps happen for faculty. You ask, “How can faculty prepare themselves?” I could talk for days about that question. It’s a growing need and some institutions are beginning to recognize the importance of doing a much more thorough job of preparing faculty to teach online. But I will argue that those institutions are still pretty few and far between. I would say, based on my research and my experience, the vast majority of faculty who are teaching online have not had specific development in that area. They have not observed peers’ classes. In fact, what can happen is a negative effect. Very commonly, when faculty begin teaching online, they are handed somebody else’s content. We’ve seen that happen and that’s a mercy in a way because that way faculty who are new to teaching online don’t also have to develop the course. But what can easily happen is that the content that might be given to a new faculty member might not actually be exemplary in the design and the delivery of that material. So then what happens is the only experience that faculty get is observing the content and the structure of a less than ideal example and then that’s the model that they have and they think, “Oh, I guess this is how it is”. So work can be done on developing better exemplars, better development programs. I believe, as faculty are coming out of online graduate programs down the line a little way, I believe, will have better experienced faculty and students. A lot of research going on in this area, but that work is all to be done.

Rebecca: As you were talking, I thought, you provide a nice model, it’s a nice way of thinking about it, you don’t know where the furniture is.

Flower: Mmm-hmm

Rebecca: It sticks with me. I was thinking about that the experience that a lot of faculty and students have is more in the realm of social media and so they’re looking for cues that are similar to those kinds of environments. The activity that’s happening in those environments is really different than the kinds of activities we would expect to happen in an online platform for learning.

Flower: Right, that’s a great point. We interact with other people so much online and on our devices using social media and what’s interesting to me is that we can really engage with people in those online spaces. Somebody tweets something that’s a little bit incendiary or provocative and you get all kinds of people jumping in and commenting and you know, sometimes things get heated, or a really heartwarming moment is tweeted or shared on Instagram, and people are all over that post. But the opposite is kind of true in our online classes. Indeed, I feel like we could bring in some of the techniques from social media into online classes. I’m not saying that faculty should all have a component of Twitter or Instagram in their online classes, but what I’m saying is that it’s possible to deeply engage people in online interactions. And that’s not a feature that, I would say, generally characterizes online classes—we usually hear the opposite, that it’s not engaging, it’s difficult to drum up those discussion posts—and I feel like if we could draw some of those principles from how we interact with people online, in social media, of using our devices, if we could bring those into the online classes right away, we’ll see more engagement and engagement precedes learning. Students have to want to be there in order to learn when we’re engaging them and if you could imagine posting a discussion post and then you can’t wait to see what people are responding. We do that all the time on Facebook or Twitter sending something out and then, “Oh let me see! Did people like that? Did people say anything?” And we just naturally are drawn into those spaces to check and see what are people’s reactions? Well, if we could design that kind of a discussion board for online classes, where it’s so interesting and engaging that people want to rush back and see who’s talking to them, who’s replying to them, that would go away way to improving the online learning experience for both faculty and students.

John: That’s not an experience though that many people teaching online find in their discussion forums. Are there any hints or tips that you can give people to make their discussion forums a bit more engaging so that students don’t wait until the last minute to do the standard three posts or whatever is required in that course?

Flower: Great question, John, and a big one. And again, thinking about Small Teaching ways of making small changes, I heard of an example recently where faculty asked students to reply to their peers posts using a GIF that just represented—one of those funny moving little images that sort of expressed—their reaction. And that’s an example of bringing in new ways of engaging and it’s not rocket science. It’s also perhaps a little more fun, which is important to bring into an online class. A great way of sort of getting students to think differently. But if that idea doesn’t resonate with you, maybe you might want to try offering options in your discussion board questions. I’ve supported over 100 faculty, I might even say, hundreds of faculty in the design and development of their online courses and what I see sometimes is one question for students to answer and oftentimes it’s kind of black and white. It’s hard to discuss a question like that. So first of all, craft questions that are discussable, that there’s some debate around that you can make different arguments or points of view. Tie those questions to students’ experiences. How is the content impacting them personally? Where do they see these concepts in their own life and experience? And, even better, provide three or four different questions that students could choose to respond to and then ideally, everyone isn’t all talking about the same question, so that’s more of a natural way of fostering some conversation in an online discussion.

John: One of the nice things about tying it to personal things, I would think that that would also help build more of a sense of community within the group because the students get to know each other a little bit better, which may affect their engagement in other activities,

Flower: Right. Anything that we can do to increase the value and the relevance of what we’re asking students to do online is hugely impactful, and it doesn’t have to take much. I have a colleague who teaches an online First-Year Seminar course, which in a way is a bit of an oxymoron because First-Year Seminar courses are often designed to really hook in our first-year students who are transitioning to university life, but she was tasked with developing and teaching a really highly engaging and supportive Freshman First-Year Seminar class. And one of the things that she does is she brings in a discussion board and one of the prompts is, “If you could be a superhero, what would your superpowers be?” And again, maybe on the surface some people might think that’s a bit trivial, but what she’s doing is she’s getting students to talk about character traits and hero qualities and concepts that rely and relate to the material that they’re engaging with… yet in a fun and a more personal way. And it certainly does a lot to foster those relationships that are so important for online classes to build that community. Absolutely.

Rebecca: I think one of the methods that we hear a lot about in terms of online learning is the ability to do quizzing and retrieval practice and interleaving through quizzing. But are there some other ways that we can integrate some of these evidence-based practices that aren’t maybe the typical solutions that we tend to think of online?

Flower: I think one of the most underutilized functions of the Learning Management System is what we call adaptive release or conditional release. And I actually want to pause here and say that these Learning Management Systems have come a long way in recent years, and they still have a long way to go. [LAUGHTER]

Rebecca and John: Yes. [LAUGHTER]

Flower: For many faculty and students, the functionality is lacking, the furniture is stark, they’re not attractive places to be and as I said earlier, engagement precedes learning. If you were to ask yourself for online faculty who are listening, “Do you want to be in your online class?” I suspect many faculty would struggle to answer with a resounding “Yes.” And so here’s a shoutout to our LMS developers to think about space design and the experience of students and faculty in these spaces. Having said that, there is some very interesting functionality that is oftentimes underutilized and I would argue that’s because, again, faculty may not have the preparation and the exemplars to begin teaching online. With adaptive or conditional release—it’s called different things in different systems—you can set a task that then opens up the rest of the content in that module. And I love to use this. You can use it equally effectively at the end of an online module or at the very beginning to open the next module. Now what you can do with this is you can embed retrieval practice exercise. Or, you know, drawing from Jim Lang’s book, Small Teaching, a predicting exercise works equally well. A curiosity provoking exercise, and all it really has to be is an assignment where students submit whatever it might be. A two sentence summary of what their big takeaways were from the previous module, or predicting what might be in the coming module or posing some questions… this can be written, it could be a recorded submission for students who might find it easier to talk through their ideas. Once students submit that element, then the rest of the module opens. Before they do that they can’t access any of the content. These things don’t even have to be graded, you can just set them to be worth zero points, but they are mandatory because the students can’t proceed with the content until they submit them. So when you think about that feature, there’s a lot of creative things that you can do that don’t impact faculty grading time. That’s a big tenet of the new book is we can’t overburden faculty with grading and yet tie into those practices that we know from the research are effective.

John: One of the chapters of your forthcoming book is on fostering student persistence and success. Could you give us perhaps a strategy or two that might be useful in encouraging student persistence? Because I know one of the problems in online classes is they often have higher drop, fail, and withdrawal rates than face-to-face classes. What are some techniques that faculty can do to help improve student persistence in the class and the program?

Flower: That’s right, great question. As you point out, the attrition rates in online classes are remarkably higher. And we also find that for students who are less prepared for higher education, if they don’t succeed in that class, then the odds increase dramatically that they won’t actually persist and attain a college degree, and that’s a problem. But as I was saying earlier, a global concern is that online classes are not nice places to be. And if your listeners have any pushback on that, please feel free to reach out and engage with me on that assertion. But what can we do to just make the place a little more pleasant? How can we be warm and friendly and supportive and encouraging? How can we allow our humanity—even our personality—to show through? I was speaking with a good friend and a colleague of mine just a few months ago when I was delivering a little talk about this book and he was telling me though he’s been teaching online for 10 years, that he’d never thought of just being himself in his online class. And he explained to me that he loves teaching in person—he’s quite a character, super dynamic, very engaging, funny, loves to interact with his students in the classroom—and yet, he told me when he goes into his online class, it’s like a robot. There is no trace of his personality. And other people are saying this too, just be yourself in those online classes and make a deliberate effort to infuse warmth. But a specific strategy that people might want to try is to assign a goals contract as one of the items that are due in the opening module—or the orientation module—and a goals contract, you’ll see different kinds of variations around, but here’s the two pieces that I really like. A lot of people are talking about assigning sort of a memo of understanding or a contract where students agree that in this online class, they should schedule set times, they should plan on X number of hours per week, they should reach out immediately if they have questions. People are doing that. I like to embed a different element as well, which is to require students to set a couple of goals and it can be literally two. What are two goals that you have for your learning, or your success, your ability to earn an A in this class? And then an interesting twist is to ask students to identify one potential challenge. It’s still the case, I have my students all the time saying, “Well, my computer is in the shop, [LAUGHTER] it’s sort of all of a sudden, it busted and now it’s at the technician and I can’t do my online tasks.” So helping students to think in advance about a scenario such as that and of course, in that particular case, many campuses have computer labs or libraries where students can go and access another way to get into the course but maybe they haven’t thought about it in advance. So in the goals contract, ask students to set two goals, identify one potential challenge that might come up, and identify a strategy for how they can address that particular challenge. And certainly, identifying one challenge is not going to cover the range of things that happen in life during the course of an online class, but I think it sets the tone to get students thinking that one little hiccup doesn’t mean that we’re all done with this online class and we just have to sort of fade away and stop participating. And then what you can also do, periodically throughout the class, is you can ask students to revisit those goals that they set for themselves. How are they doing with that? What kind of progress are they making? Are there some strategies that aren’t working for them? Do they need to recommit to the intentional and deliberate scheduling of their class time? Just helping students be very explicit about what their plan is to succeed and finish the course.

Rebecca: What I like about what you’re saying is, it switches from really having the faculty member impose everything, and have the students be co-authors of the class to some extent, and they have some ownership over the space, which generally means that they’ll probably commit more.

Flower: What we know about online learning is that students must have a higher degree of self regulation, self direction, they must be more motivated, and be able to manage their time well. And if students don’t have those things, it’s much less likely that they’ll persist and finish an online class. And yet, when you think about it, online classes work directly against a student’s ability to do those things and here’s what I mean. When you are teaching in person, when you’re a student in an in-person class, you know that every Tuesday and Thursday at 9:30 you’re supposed to be in the classroom and it’s a natural way to help students hold themselves accountable for doing the work. Now I know sometimes students come to classes and they’re not fully prepared, but there’s still that built in mechanism where they’re going to be in the same room with their faculty member with other students. There’s a social element of accountability that’s like, “Well I know I’m supposed to show up and I should have my stuff done,” or “There’s a test next week and I need to be ready.” Well those real time interactions and those interactions with physical people don’t tend to happen in the typical asynchronous online course. Very often—I would say 99% of the time, probably—an online student is sitting at home by himself or at the coffee shop by herself. If she has a quick question about something, she can’t do what she does in the classroom and say, “Hey, did you understand what we’re supposed to do on that particular assignment?” or “Hey, faculty member, can you just re-explain that? I’m not quite there yet.” There’s no way to get that immediate response, that immediate quick guidance that might take two minutes in a physical classroom. So, students don’t have the accountability, they don’t have the physical presence of the instructor or the student, and so we have to go above and beyond in our efforts to build in structures that help students develop the kinds of self-regulated skills, the kinds of self-directed learning skills. Many of our students are not coming in with those skills already but we know students who do have those skills will be much more successful, so let’s build that into our curriculum. Let’s help them develop some of those, let’s talk to them about the importance of monitoring their own learning, and let’s structure exercises that will help them to do this. I’m pulling a lot of this material from Linda Nilson’s book—It’s called Creating Self-Regulated Learners—Although that book is not necessarily focused for an online environment, I think it can be hugely helpful to our online students to be very transparent with them about the importance of developing these habits, these behaviors for success. And as I said, structuring exercises and graded assignments that help them to do that, to hold them accountable.

Rebecca: Following up with what you just said, there’s a chapter in your forthcoming book called “Creating Autonomy.” Can you talk a little bit about small ways that we can give students autonomy in the classroom and in an online space?

Flower: Sure. And again, let’s be sure to keep that focus on small, doable, feasible changes, things that you could do in maybe a 15-minute work session and have it rolled out for your online class. One thing that we could do is to develop a self-enroll group structure. Many online faculty like to bring in collaborative learning tasks to, again, foster that community and the peer to peer instruction and learning that is so important as we know, but I think oftentimes we sort of assume that what we should do is purposefully group students, and there’s certainly value to be found in designing purposeful groups. But what can also be very interesting is to allow students to enroll themselves in groups that might cover a range of different topics. For example, sometimes I teach Educational Technology online classes. And if I were teaching that class today, I might offer five different groups that students can sign up for on a first-come first-serve basis. And one might be virtual reality, and one might be mobile learning, and one might be writing in digital spaces. So students could naturally choose a topic that they’re more interested in pursuing and when students have that level of autonomy, to make that choice of what their going to focus on, that’s one way of embedding just an opportunity for students to exercise that autonomy. Another even easier way I’ve already mentioned here is to offer students a choice between whether they want to submit a written task or whether they prefer to record on video or audio. Students carry these amazing devices in their pockets all the time with high- tech recording equipment embedded right in them. And students love the freedom of just being able to talk through their ideas, their responses, you can get a much more authentic response from students. Teach them how to use the recording software, or how to upload the video or the audio clip into the LMS and now you’ve got an easy choice that you can give students. If you prefer to write this, go ahead. If you prefer to record it, do it that way.

John: One thing that struck me is I used VoiceThread last year in an online class and I expected they’d actually use the video option with it very often. I gave them the choice of whether they use just voice or voice and video or use a video recording and yet none of them ever presented on video, which surprised me, given how common that is in social media. Why might that be?

Flower: Well, sure. I also require video discussions in some of my classes. And what I have learned is that people are nervous, especially in an academic setting about how they come across on camera. I feel like audio is a little bit less threatening, but sometimes people don’t like the way they look. And, you know, faculty too. [LAUGHTER] A lot of faculty are uncomfortable with recording on a video, and yet, it’s the way of the future. So right now, currently, I’m teaching my graduate level class on technological fluency and leadership. I require those video discussions and I say to them, “Are you nervous about doing this? Well, I want you to do it anyway,” because video interviews right, over Skype, or Zoom, as we’re doing here today, or video resumes. These are a thing that are happening and helping people to get more comfortable with showing their face on camera. I also talked to them a lot about the importance of seeing their peers faces and how much we can learn just from that. In the program that I teach now, students tend to take classes with the same people. But in my class, they always say, “I’ve never put a face to a name, how nice it is to see you,” and it makes a huge impact in terms of that community element. But I talk to my students very explicitly. Now, it’s also really important to think about situations where a student may not want to represent their face and there can be very good reasons. I had a tragic situation just last year where a student did not post the video, she posted a static picture of herself. I came to find out at the end of the semester. When she did that I was like, “Oh well, dock a few points, whatever. That was weird. Why’d she do that?” I later found out that she had been in a domestic abuse situation and she was ashamed of the way that her face looked because it was still very visible—the damage—and it just struck me to the core. An arbitrary decision that I made that it’s so important to talk to each other and look each other in the eye and she had a really, really strong reason for not wanting to do that. So back to that topic of offering a choice, what I do now is I tell my students, “If there’s a really good reason that you don’t want to show your face on the video, please send me a quick note. You don’t even have to tell me details, but just explain that you’re going to choose to do this other thing instead,” and posting a static picture is still pretty effective. So I think it’s very important to remember that our online students are people. They have lives and we need to be thinking about the decisions that we’re making in our teaching and how that might come across to a student… how it might induce anxiety in ways that we never anticipated.

Rebecca: One of the things that I wanted to follow up on and see discussed, the self-enrolling groups and collaborative work online. I think we have clear ideas about how that might work in a physical classroom, but not always a good clear way of how we can coach students through collaborative learning online. So even small, quick things that came up in Small Teaching, like Think-Pair-Share, you can envision how to do that in a classroom, but maybe have no idea how to do that in an online classroom.

Flower: It’s a great question, Rebecca. And I know that there’s actually a lot of pushback from online students and sometimes online faculty about the value of collaborative learning activities. It just so happens that my husband is in an online Master’s program right now and so I’m living with the student experience. And it’s frustrating to our online students—many of whom are not traditional 18 to 24 year olds, they might be returning adults—and one of the reasons (in fact, a primary reason) that our online students choose that modality is because they have busy lives. A big percentage of our students have jobs, families, obligations, and they need to do their work when they have time. That might be 8 pm, that might be 11 pm after all the kids are in bed. It might be 6 am, I like to do my online class at 6 am. When you require students to work in groups in an online setting, you’re removing that degree of scheduling flexibility that students value in an online class. So if you choose to require online activities, I have certainly moved towards lower stakes and opportunities that don’t require real-time meetings between students online. And you mentioned a great one. Think-Pair-Share can be set up in an online class. So there’s lots of ways that you can do this but the first thing that came to my mind is you could set up groups of two, and you could auto-enroll students in a group of two, and then they have their own individual discussion boards. In most Learning Management Systems when you have groups you can have kind of a private discussion board where students can interact with each other there, or I’m a big fan of letting some of the learning come outside of the Learning Management System. So let students know who their buddy is, have them exchange phone numbers, and they can just talk on the phone. Sometimes we forget those simple solutions. But a Think-Pair-Share—and so many ways that you could set this up, you could change it from module to module so people are always working with somebody else—just share an idea, discuss something, take it offline, come back and just write or record a quick summary of how that interaction went. When it’s not such a high stakes assignment, students can better engage in those opportunities. It’s so much easier to find 15 minutes to talk with one person than it is to find an hour with four working adults who all have family obligations. So I love the idea of lowering the stakes and embedding lots of little opportunities for students to work in pairs or in groups of three where it’s easier to coordinate. There’s less pressure about the online group member who never does the work—sorry, but that’s a thing—and just help students see other ways of interacting. Now, with my instructional designer hat on I want to remind us of the importance of making sure that online collaborative work aligns with the outcomes of the course. Very important to think about why you’re asking students to work together. Does this actually relate to what you want them to learn and get out of the course? Very important to pause, ask yourself some of those questions before you randomly assign group work because we should have group work, which I’m guilty of doing. [LAUGHTER] It’s an easy thing to do, “I guess we should have group work,” but really pausing to think carefully about the purpose of that. And then again, maybe thinking creatively about those lower stake ways of connecting students and facilitating some more authentic interactions. Maybe they’re going to text each other. That’s fine, they’re talking. We do a lot of talking on text these days. Help students connect in ways that are not so stilted, which is often what we see in the use of the discussion board and the LMS.

Rebecca: I found that too, I use Slack a lot in my classes, because it’s a common platform for designers and people in that realm to communicate professionally, and they love it. It’s convenient, it’s on their phones, takes it away from a clunky interface…

Flower: Sure.

Rebecca: .. some of the LMS’s have and it’s really productive. And they’re able to do that midnight chat with each other.

Flower: Yes, absolutely. Again, let’s think creatively about tools that students already have. I honestly believe that a lot of Learning Management Systems actually raise barriers to student learning because most of them—although this is getting better—most of them don’t have a super robust mobile app and so a student, really to engage with coursework, has to find a place where they can sit down and log into the computer and access the course and jump through a million hoops before they can even get to where the learning is. Whereas if we take some of that learning into apps that they’re already using or things that they’re doing on their phone anyway where it’s in their pocket, we can communicate in real time. Now I need to exercise caution here because many faculty think, “Oh great. I’ll do Slack, and I’ll do VoiceThread, and I’ll do Flipgrid, and I’ll do Twitter, and I’ll do Pinterest, and it’s just going to be so interesting and fun.” Well, if there’s a reason for using some of those tools, absolutely. If those tools are just shiny entertainment—bells and whistles—then you may want to think again. Another important consideration if you’re asking students to use tools that are not in the Learning Management System is whether those tools are fully accessible for students, whether there’s any fee that’s involved, whether students might have to set up a new account with a new password, that might just be a hassle. So really you want to think carefully about what you’re asking students to do. Are the tools fully accessible and usable and cost friendly? Do they support your learning outcomes? And yet, if a tool that you’re thinking about using passes all those tests, then by all means jump right in. This semester I’m using Remind which is the simplest tool on the planet and the most effective. [LAUGHTER] It’s more in use in K-12 currently than in higher ed. It’s simply a text app that anonymizes people’s phone numbers. So I invite my students to sign up for my Remind list. I don’t require it. But then I can easily send a quick little 140 character reminder, “Don’t forget this assessment is due on this particular day,” or “New content has just been released. Login when you get a chance.” The message goes right to where the students are and because I make it optional, nobody is required to have the annoying instructor on their phone all the time. But students who want some additional support with managing deadlines and the class experience really appreciate the use of the simple tool called Remind.

Rebecca: I think one of the things that we know from a lot of evidence-based practices and books that have come out—including Small Teaching—is that frequent feedback is useful. But we also know that frequent feedback can seem really daunting to a faculty member, and time consuming. So are there ways that you would suggest managing some feedback opportunities online, but keeping it easy, quick, and reasonable?

Flower: Sure. Another great question. Another underutilized approach—at least in my experience supporting the faculty that I work with—is the ability to embed feedback into auto-graded multiple choice or true- false types of quizzes within the Learning Management System. So in most of these systems you can design feedback that will show up for students as soon as they submit the quiz. You can set those quizzes to show students which questions they got right or wrong and in the wrong answers you can embed feedback that says, “Please review pages 32 to 35 of this chapter. That is where you’ll find this information.” Similarly, you could encourage or embed challenging feedback and by that I mean, “Great, you totally know this material. If you’re interested in learning more, you may want to check out this website or this resource,” to offer students a range of experiences and engage students at their different levels of experience with the content. To be fair, setting up that kind of embedded feedback takes a little bit of time in the first place, but many of us teach those online courses over and over again, and once you’ve done that work, you can benefit from it time and time again. If you’re not sure how to do that in your Learning Management System, just about every institution has a Learning Management System support team with instructional designers or system admins, help desk folks who can walk you through the creation of that kind of embedded feedback. And it’s timely, it’s right there when the students are thinking about that problem in the first place, it’s relevant, and it’s a great way to automate some useful feedback for student learning.

John: You have a chapter in this forthcoming book on developing as an online instructor. Are there some general suggestions that you can give to faculty who’d like to improve and develop new skills or improve skills as an online instructor? Besides buying the book, of course. [LAUGHTER]

Flower: Right. Great question. Again, what this comes down to for me is that it’s just new. It’s just new for a lot of people. And to be honest, I suspect that many online faculty didn’t really set out to be great online faculty and many faculty are not finding the experience quite as rewarding as they might find the classroom experience. In fact, I have some data to back me up on that. The 2017 survey of faculty and information technology from EDUCAUSE Center of Analysis and Research found that of over 13,000 faculty respondents, 91% said that they don’t prefer to teach online. 9% said, “Great, I love to teach online.” That’s 91% of us who would rather teach anywhere else. [LAUGHTER] So how can we cultivate that joy, that buzz that we get in the classroom? We love teaching. If we didn’t, we wouldn’t be doing it because we don’t get paid enough. How can we cultivate that for ourselves? Now a barrier or a common challenge is time. Who has time to go and learn how to do a whole new skill? It’s different than teaching in person. But there are, again, small things that we can do to increase our awareness. One of the most effective things that you can do as an instructor is to seek an experienced and a thriving online instructor and ask to shadow that class. Ask to be added into that class shell and just observe. How does that person interact with students? What are the structures? What is the teaching? What happens while the class is in session? That can be hugely impactful, it’s usually free, [LAUGHTER] and faculty can invest the amount of time that they have. In fact, this is how I first got started with online teaching over 10 years ago, is before I was going to teach a class. Luckily, this offer was made to me the semester prior to my first online class, just to observe another class and see what happens in there. Simple structure could easily be set up for faculty who are scheduled to teach a new class in the Fall, have them observe or shadow a class in the Spring or the Summer, and yet an often overlooked solution. Certainly there’s lots of online resources. There’s podcasts like this, there are blogs that people are writing about innovative things that they’re doing, but sometimes just finding a thriving online faculty to interact with, shadow, observe, be mentored by, can be the most effective way to learn how to do this better.

John: I even sometimes encourage faculty to join a MOOC, because often you can find some interesting practices there that scale without necessarily requiring much effort on the part of the instructor.

Flower: That’s right. That’s one of my other recommendations and I hope I haven’t given all of the book away here. [LAUGHTER] But one of the other recommendations in that chapter is just to take an online course in whatever form that you can. Whether it’s a MOOC, a lot of organizations like the Online Learning Consortium, Quality Matters, offer online professional development opportunities for faculty. Even if it’s not about teaching online, just go take a class that is online. Or maybe personal interest. Sign up and take Spanish online. And having the experience as an online student is hugely impactful to help you understand what your students are going through. Even as a faculty if you’re taking a course and you’re reading the instructions going: “Now, what am I supposed to do with that?” Immediately, you have much more clarity about what your students might be experiencing and then you can take steps to address those kinds of gaps or areas of concern that might be in your own class… that you may not have previously seen before.

Rebecca: I think the recommendation of taking a course outside of your normal domain or area of expertise is key because you’ve got students who are in an environment they’re not familiar with, with a topic they’re not familiar with. And so to kind of simulate that, I think is key.

Flower: Right?

Rebecca: I know I’ve done that in the past and it’s like, “Oh yes, I forgot what it was like to be a beginner.”

Flower: Absolutely. In fact, I had a really interesting process or experience this past fall semester where I was supporting a redesign in a large cap biology class of liberal studies—or general education biology class—large enrollment. My background is in English literature… the humanities. I don’t think I ever took a hard science class in college because I did an honors program where we could do more sort of ethical concerns related to science. But I went to that class frequently throughout that semester and I clearly remember the first day. 240 students and me and I was sitting in the lecture hall with the students and it was just very, very impactful. Putting me in a situation that was foreign to me—I don’t teach large cap classes, I don’t know a thing about biology—I do now, I know a little more [LAUGHTER]—But I was a novice learner in a very foreign environment and that’s what our students are in our online classes, which is really quite anxiety producing if you think about it. Going into an unknown space, not knowing what’s expected, you don’t know how to get ahold of your faculty member a lot of the time. So just being intentional about helping students be more comfortable and more at ease in our online classes—be more available to them—can make a big difference. And again, you get that insight differently when you choose to place yourself in a situation where you’re a novice, and you’re not really sure what to expect. That’s a great point.

John: Are there any other topics that we should address that we haven’t raised yet? Anything else you’d like to emphasize?

Flower: You know, really only one thing comes to mind and that is an insight that I had literally this past week, which is that I feel like sometimes online faculty—myself included—have somehow developed the notion that we don’t really need to talk with our students. And let me explain what I mean by that. Again, I’m teaching an eight week—it’s an accelerated graduate level course right now—I’m busy. My students are busy. And on a whim a couple of weeks ago, I said, “Well, I know you have this assignment coming up by Sunday night, I’ll be available on Saturday between the hours of 1 to 5pm.” I don’t like to work on Sundays. I tell my students that if you want to just pick up the phone and call me on Saturday, go ahead. So that weekend, I did. I had a student who called me and she was a chatty Cathy, and we stayed on the phone for quite some time, but she got a better understanding of the assignment and how to be successful. Well two weeks later, which was this past weekend, it was my daughter’s 11th birthday and I was right in the middle of finalizing all the food preparation and everything else. And lo and behold, there’s my phone ringing and I can tell that it’s not a connection of mine. And I went, “Uh-oh, it’s one of my students,” [LAUGHTER] because I had said Saturdays 1 to five and that same student who had called me a couple of weeks prior called and we had a great conversation. 15 minutes, I was able to keep chopping the carrots while I was talking with her. And it just occurred to me, that wasn’t really a convenient time for me personally because I was doing that final party prep, but so what? The student needed help in that moment and just taking the time to answer the phone and talking through a couple of quick questions, it was helpful for her, and it just got me thinking about how, you know what, I don’t think a lot of us really talk to our online students, like, literally talk on the phone. I know some faculty have the online office hours, I know people are using video conferencing systems, I’m available, but one of the things I’ve started doing is just saying, “Hey, if you have a quick question, just call me. We’ll talk it through.” And sometimes a five-minute conversation can ease that student’s anxiety and answer a few questions. This happened to me again yesterday where a student was like, “Before I submit tonight, can I please just check in with you?” I talked with her while I was commuting to campus and it’s just a way of talking person-to-person, humanizing the online learning experience. But like I said, I think somewhere along the line personally I had formed this opinion that we don’t actually talk to our online students. And I don’t know why that’s a perception because if you’re teaching in person you talk with your students. If there’s somebody who has a question after class, you stay a few minutes after and answer those questions. But I think for online faculty somehow we’ve missed that connection and it can be a powerful and so simple solution to helping our students thrive and succeed. I think faculty and students both overlook some of those simple solutions. It doesn’t have to be a long, tedious, written interaction in a discussion forum. It could be a phone call, and so much can be conveyed through the tone of voice and emphasis, just as I’m doing here today. And as we all do, when we’re teaching live. Just picking up the phone and calling the students or inviting them to call you. Simple, powerful.

Rebecca: I think you’re pointing to something that I know I’ve experienced even though I don’t teach online regularly. It’s just online communication is always written and it feels daunting and it feels really time consuming. And it feels like, “Oh I got to sit down and dedicate time to do this.” So it’s nice to be reminded that there’s other ways to respond.

Flower: Just in my own work somewhere along the line, I forgot about the phone in my day-to-day job. My full-time job is as an instructional designer and it seems like we never just pick up the phone anymore. It’s always email. And as you said, it just takes longer, especially if you have a little bit of confusion and you’re going back and forth on email. I literally in the past few months, I’ve just remembered how to pick up the phone and call somebody. Have a five-minute conversation, you get your questions answered. And just reminding ourselves of the importance of real- time interactions sometimes, and moving away from the requirement that everything needs to be written all the time. I’m a big fan of video announcements, I do that all the time in my online classes and again, the reason I do it is because tone of voice, inflection, emphasis, and funny faces sometimes, or just emphasis where I might just kind of widen my eyes a little bit to explain that, you know, “This is really important. Pay attention and focus.” Just finding these other forms of communication apart from writing can make a big difference in the online learning experience as well.

John: We always end with the question, what are you doing next?

Flower: Well, I’m not quite done with this project. [LAUGHTER] So I’m wrapping up this book development. But what’s really making me passionate now is to really focus on being a crusader for online education. It’s undervalued. It’s under-supported. I know that faculty don’t see the joy of teaching online and I know that students approach it the same way like, “Well, I have to get this degree and I guess this is a convenient way to do it.” I just want to advocate for how online learning and teaching can be impactful, can be rewarding, and joy giving, and you don’t see that reflected even in the coverage of teaching in higher education. Most of the time, the focus is on what we’re doing in the classroom and that’s so important, but there’s a big gap. What are we doing in our online classrooms? I just want to move into that space and encourage people to think about how they teach in person, and how to do those things in their online classes in ways that are not so daunting that they never get around to it.

Rebecca: This has been really great. I’m looking forward to picking up your book and maybe thinking about teaching online. [LAUGHTER]

Flower: That’s right. And if you don’t mind, Rebecca, I’ll just pick up on that, which is that again, I think a lot of faculty don’t say, “Hey, wow, what a cool opportunity. I totally want to teach online.” For many faculty it’s a daunting prospect, “I don’t know how to do this.” But it can be a really great way to reinvigorate your teaching—to find new ways of finding and addressing those challenges. Keep in mind institutions have the support professionals, instructional designers and such, who can help if you’re thinking about moving into online teaching. Talk with some of those faculty support folks, talk with your colleagues, and jump right in. It’s more fun than a lot of people think.

Rebecca: Well thank you so much for joining us today.

John: Thank you.

Flower: Thank you. What an absolute privilege and honor to be here. Thank you.

[Music]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

John: Editing assistance provided by Kim Fisher, Chris Wallace, Kelly Knight, Joseph Bandru, and Jacob Alverson.

63. Building a Campus Culture of Accessibility

Colleges and universities, as well as individual faculty members, are legally required to meet federal accessibility requirements for all digital content that is posted online or used as learning materials within face-to-face, hybrid, or online classrooms. Most faculty, however, have received little or no training in how to create accessible materials. In this episode, Sean Moriarty, the Chief Technology Officer at SUNY-Oswego, joins us to discuss how our institution is working toward assisting faculty in creating materials that are accessible for all of our learners.

Show Notes

Transcript

John: Colleges and universities, as well as individual faculty members, are legally required to meet federal accessibility requirements for all digital content that is posted online or used as learning materials within face-to-face, hybrid, or online classrooms. Most faculty, however, have received little or no training in how to create accessible materials. In this episode, we examine how one college is working toward assisting faculty in creating materials that are accessible for all of our learners.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

John: Today our guest is Sean Moriarty, the Chief Technology Officer at SUNY Oswego and Chair of the SUNY Council of Chief Information Officers. Sean is the author of the recently published Educause Review article, “Building a Culture of Accessibility in Higher Education.” Welcome, Sean.

Sean: Thank you, John and Rebecca.

Rebecca: Welcome.

Sean: It’s great to be here.

Rebecca: Today’s teas are…

Sean: Well I’m having my Tim Horton’s coffee. I usually have my tea after dinner, so it’s too early for my tea. [LAUGHTER]

John: And I’m drinking Christmas tea with cinnamon.

Rebecca: I have my lucky English afternoon tea.

[LAUGHTER]

John: It’s not just for afternoons.

Rebecca: No, it’s all day long.

John: And it never has been, I guess.

Rebecca: Yeah. Before we jump into our conversation, first, can you define what accessibility is?

Sean: Well, accessibility is the idea that every user of the content has a similar experience. They’re not gonna be able to have exactly the same experience… So if you think of people who might have blindness, the content that they access on a website or in a document should be able to give them the same knowledge and understanding in terms of they would hear the content or have it read to them so that they would gain the same knowledge and understanding of what’s there. The disabilities that we have vary from people to people and you also have different issues in the way that content is provided; people who are blind can’t experience a picture in the same way, so there’s an expectation that you would explain what’s inside of an image so that they can understand what other people are seeing.

John: Accessibility issues have been around for a long time, but it seems that campuses are starting to pay more attention to this. What has prompted this increase in attention to issues of accessibility.

Sean: It’s an issue that has really raised in prominence over the last 15 to 20 years and has become a large issue for us here in New York state over the last couple years. So I’m originally from Canada, and I would say that accessibility and digital resources has been an issue there easily for 10 to 15 years and we spent a lot of time at the last institution I worked at, which was the University of Windsor, in terms of making our website accessible and meeting the accessibility laws and guidelines that the Canadian government has put in, and a lot of resources and time were put into that. When I moved to the United States, and particularly here at SUNY Oswego… that would have been five and a half years ago… I think it was less of an issue and people didn’t necessarily realize the need for accessibility and the effect that it had on others. The reason that it’s really come to more prominence is that some individuals have gone and worked towards making everyone aware of the law. So there are a couple of laws in the United States, and one would be the American Disabilities Act, and the second a law that really came into effect over the last couple years, has to do with digital resources and the requirements for them to be accessible for people. Now, one individual in particular has gone and put complaints against universities that their websites weren’t accessible and it really kicked off an awareness in terms of how people wanted to do it. At SUNY Oswego and throughout the state of New York—actually all the SUNY schools had complaints brought against them two years ago—it was really largely around the websites that were inaccessible and most of the SUNY schools got together and we looked at ways to go and comply. Now many of us were really not that far away from being a hundred percent compliant on the website. To go and to remediate most of the website isn’t that difficult when you start talking about items such as the HTML. It gets a lot more complex once you start looking at documents and PDF documents… and no one, I would say, is really a hundred percent compliant. Understanding the complexity of the issue once you start working on it, you really start to see how the issue—if you just try to go in to remediate it and fix it it becomes next to impossible, really. The only way to go and work and to become compliant and to really design the experience you want for the end user is to go and get in front of it to do it. Well, that’s one part of it is the legal issue, but part of it also is a social justice issue. I think when you want to go and start to think about how you want to design your website and make it attractive to all end-users you have to understand that there are people that need these accommodations and have different needs and you have to go and design your website to go and to make it accessible to them, and I think when you start to go and think of it from the social justice issue rather than meeting the requirements it just changes your whole way of thinking in terms of why you want to do it, how you want to do it and how you can get more people to buy in.

John: And when we’re talking about accessibility it goes far beyond just a website; there’s also EdTech tools and there’s also teaching materials and resources. Could you talk a little bit about those issues in higher ed and what we’re trying to do to deal with those?

Sean: A lot of the focus does go on websites, and particularly at the very beginning, I would say, in terms of when we go and try to meet accessibility from a digital point of view from an IT department, but there are a number of other items—we have digital content on PCs throughout the campus and run all kinds of applications and mobile applications. There’s an expectation that those will be accessible by all users as well. So one of the issues is that we have applications that are running on mobile devices… PCs… and our goal would be to have those accessible for all end-users as well. Really to go in, to manage that we have to look at how we procure those items and ensure and work with the people who want those applications that they’re going to be accessible… and ensure that the vendors that we’re dealing with are making it a priority to go and to make their applications accessible… and I think particularly there’s a couple of in-state systems that have done quite a bit of work and that would be the California State System… the Washington State System have done quite a bit of work in terms of going and making accessibility of applications a priority, and I think with the SUNY system joining in we can have quite a bit of power with the amount that we purchase and accessibility can even raise to a higher awareness with the vendors and we can push it forward from there. The other area where it really becomes an issue is inside the classroom; we’re delivering far more electronic resources to students than we have in the past and I think that’s partly because the experience is a more online and there are online classes that are delivered totally digitally or with an instructor helping, but accessibility becomes a larger part as we work there. But also as we deliver content to students through the computer as opposed to handing pieces of paper to them we have to go and think accessibility upfront. As we go and expand our markets… as we become more aware of students that have accessibility issues—we are having more students who come to school and have these requirements and it is going and adding a lot more requirements to go in to help those students succeed.

John: One of the nice things, though, about a move to digital materials is the content is already in digital format which makes it easier to convert as long as provisions are made for that; the old text-based systems were a lot harder—you had to have people either read materials to people or other types of content back in the earlier days. It creates opportunities as well as some challenges.

Rebecca: I mean the web, in general, was designed in a way from the beginning to be accessible to all; it has that power and capability as long as it’s used correctly. So one of the things that I know that we’re working on with this campus is helping people understand how to use all of these platforms more effectively to make the content accessible, because if you design things with accessibility in mind from the beginning it’s a lot easier, it’s a lot more effective and it’s a lot more powerful than trying to fix everything afterwards, which we’ve certainly experienced here; it’s a lot more expensive and time-consuming.

Sean: Yes, for sure. I think we have also tried to look at using the right medium for delivering the message. So, I would give examples on the website, particularly where people might go and make flyers and they’d create a PDF document that they go in and stick on bulletin boards around the campus and then just go and stick that same PDF onto the web which immediately isn’t accessible unless they have done it (properly). The proper way to go and to use the medium of the web is to go and create a website or a web page that would go and deliver that content. It’s more effective for people when they go and do it… that extra little step… and don’t take the shortcuts and it also helps them to go in to market their materials in the right way.

John: Economists often make the same argument; it’s called a putty-clay analogy that when you’re designing technology it’s like putty; you can shape it in many different ways, but once you bake that clay and turn it into ceramics you can no longer alter it as easily—it’s much more costly and you often have to start over, but it’s very malleable at the start when you’re designing things, like making curb cuts, where it’s fairly expensive, but now when new curbs are built they’re automatically including those curb cuts and that’s really not any more costly to build than the old system was but it was much more costly to go back and rebuild things and to start over, which was the argument you were making, I think.

Rebecca: I think curb cuts is a great topic too—it goes back to what Sean was mentioning earlier in the difference between checking a box to say that I’m compliant versus really thinking about what it means to have a curb cut. There’s an example that I often use when I give presentations on accessibility that’s a curb cut to nowhere, it’s a curb cut to some grass that doesn’t go anywhere. It’s compliant because there is one, but it’s not usable. So, I think that’s the key thing that you have to think about when you’re dealing with accessibility issues, that it’s not just ticking boxes off but you’re really thinking about the real people who it’s meant to impact.

Rebecca: I think one of the things that’s really exciting too is that not only does it help people with disabilities get the content and have an equitable experience but it also means that people that are using different kinds of devices or might be in noisy situations or other kinds of circumstances also have a better experience overall. From a design point of view, when it’s accessible the user experiences has just improved for everybody.

John: Before I got an iPad Pro with a higher volume level, when I was watching videos while flying I often would turn captions on because it was sometimes easier to read the captions than to hear over the noise of the jet and that applies certainly to students watching multimedia content in quiet places where they can’t play audio out loud or students in noisy environments who might not be able to hear the audio.

Rebecca: Or non-traditional students who might be around their kids or whatever and might need to control things like that.

Sean: Yeah, there’s many examples of technology that was brought in to help people with accessibility that become really mainstream that help everyone’s life.

It brings up the conversation or the thought that having the tools to do what you need to do and then actually using those tools appropriately and in the best way… and I would say that in many ways with accessibility at this point, some of the tools that are required still aren’t there to make things easy. We’re still working on having those tools and I think as we move forward that we’ll go and we’ll develop the tools and make it easy, but I think that’s really the stage of maturity that we’re at right now.

Rebecca: Going back to what you’re saying about the tools that we need don’t really exist yet to some extent. Using the tools that we do have to do the things that we can do, still makes a big impact. So, even using Microsoft Word to make assignment sheets and things but using the styles that are built in so that you’re identifying what’s a heading, what’s a subheading, et cetera, makes a huge impact and that takes care of a large percentage of the material, but then there’s that smaller percentage of a more complicated content and multimedia that’s a little more difficult to deal with… especially when there’s interaction as well as motion and some of these other things… but there’s still a lot that we can do with what we do have.

Sean: Yes, why then I think it goes back too to a skills issue and then part of it being knowledge and skills. So, people are used to using Microsoft Word for 20-plus years the way that they use it… and they’ve found their own shortcuts to just meet their own needs… But to go and to deliver and use a tool at the highest effectiveness you really need to have this additional knowledge and understanding of having templates that you can use and marking images that need to have a tag with them too. So we do have the tools but we also need to give people the skills and knowledge to understand how to use them effectively for this.

John: On past episodes we talked about how faculty coming through grad school generally don’t receive much training in how to teach, although that’s been changing a bit. But virtually no graduate students, I would suspect, has received much training in graduate school on creating accessible documents, so there’s a lot of inertia to overcome.

Rebecca: Not even in fields that deal with accessibility as part of their background—they might not even have that experience either. So, like computer science, design, et cetera… that’s something that’s just starting to bubble into curricula now.

John: One of the things, Sean, you and Rebecca have both been working on is developing an accessibility fellows program here at Oswego. Could you talk a little bit about that program… what it is and what’s the purpose of it?

Sean: Rebecca and I were talking about this earlier… and looking at it from an institutional point of view, I think if we want to go and to create this culture of accessibility, you’re really gonna have to go and put resources towards it and make it a priority… and I think here at Oswego we’ve tried to do that in a number of ways, and one would be to bring on an intern that Rebecca had trained and had excellent skills and we could go and work to remediate courses, for one item… and then to build a culture of accessibility here… and the only way I think to go and to build a culture is to go and to build it from bottom up… and show people it’s important by putting resources towards it… making time available for people to go and to work on it. So, the accessibility fellowship that we’re starting this year does that… and it does it in one way in terms of giving Rebecca some time to go and to provide the leadership that she does in terms of accessibility and it fits in with the work that she’s doing and the priorities that she has… and it also set some time aside for faculty to go and to work on accessibility and for them to become advocates for going and spreading the word as we move forward… and I think by going and putting the resources in, it’ll make a difference at the beginning, but the real difference will be four or five, six years down the road when we have a number of people and the person sitting next to you says to you, “Oh, you could make that more accessible if you did this…” and it just becomes part of the culture that everybody’s working on it. Rather than just Rebecca going and starting we got to make the triangle much larger.

John: The fellows are receiving a course release to free up time so that they can work on these activities.

Sean: Right, and with the expectation that they’ll have training… they’ll understand what it means to create accessible courses. They’re going to create accessible courses. They’ll have an opportunity to travel and go to a conference with accessible related material, become advocates for it as well…

John: We’ll also ask them to give some workshops for their colleagues. People are much more likely to show up for a workshop when it’s someone from their own department or area so by doing this across the campus we’re hoping that this will start spreading a bit more rapidly.

Rebecca: It’s important to note that there’s a wide variety of fellows from different disciplines. We have people from Business… we’ve got people from Science… people from English… people from Political Science… people from Education… people from… Sean: Comm studies…

Rebecca: Comm studies. Did I get them all? Oh… no… and Health, Promotion and Wellness.

Sean: So we were hoping to have four originally and we have seven. So, I think we’re very happy that people were interested and wanted to go and spread the word… and I think also as Rebecca says with the wide number of fellows that we have, we’ll be able to go and do some work… So particularly, like in the sciences there’s a lot of questions around accessibility and how do you go and create the accessible content? I think the person that we have will be able to go and to start some of the work and help it go in to build a knowledge base and be able to pass it on to others as we move forward.

Rebecca: I think that’s really key because there’s definitely some holes in the knowledge of the team that’s been working on these things as soon as it starts getting more specialized.

John: That person in the sciences is Casey Raymond, who is on our podcast on the first and third episodes.

Sean: Yes.

Rebecca: Uh hmm. Sean, one of the things that we’ve talked a lot about is building it from the ground up versus retrofitting or remediating. Can you talk a little bit about the difference in the workload and resources needed…

Sean: Right.

Rebecca: …for those two different approaches?

Sean: I would say one item that we’ve seen really over the last couple years, particularly as we’ve started to work on it, is the amount of time that we’ve had to go and spend remediating courses… and we do put a lot of focus in terms of online classes and we’ve just seen a tremendous growth in the amount of classes that need to be remediated. We have processes inside (Banner) and we’ve written applications inside Banner and create reports to go in and to identify students who are taking classes that are online that are going to go and be remediated. Where we might have been doing a couple or a few courses a semester before… the number has grown five hundred to a thousand percent more than it was before and that really required us to go in to create a position for an individual to go and to work and basically try to stay a couple weeks ahead of the course material for all the students that we’re dealing with… or at least all the courses that we’re dealing with for these students… and actually I would say with the growth and with the students that we have coming in this solution is not scalable. We’re not going to be able to hire enough people to go and to do it… and I’d say within a couple years if we keep doing it, we just won’t be able to keep up. It’s getting to that point. We have an accessibility committee on campus that would consist of people from the President’s office, our Diversity and Inclusion Officer, our communications, our web people, student disabilities, Rebecca, from the academic point of view… our web developer and Extended Learning, who do a lot of the online classes, and we spend a lot of time in those meetings. First of all, they start with the remediation that has to be done and when we have discussions around it, we realize it feels like the hole that we’re digging around accessibility just keeps getting larger and larger… and at this point our goal would be to stop the rate of the hole getting as large as it is. At some point maybe we can even it off and then get to the point where we can start filling it in, but I think the only way we’re gonna go and fill it in is over many, many years and when we redo classes they’ll be designed with accessible format as we move forward – going back and remediating all the work, it’s just not doable.

Rebecca: One of the things that I think you’re highlighting, Sean, is the difference between accommodation and accessibility. Accessibility is much more proactive where we’re actually going in ahead of time, making sure that when we’re designing content, it’s set up so that it’s accessible no matter what device you’re using it’s gonna work; whereas accommodation is… you register through the office of disabilities or whatever you have on your campus and you get a specific accommodation letter… the accommodation letter is given to the faculty member and then you’re given those accommodations and that office might provide the resources to convert a text or whatever might need to be done. This is much more front-loaded, but it helps more students and it also helps students who don’t want to identify as being disabled, especially if they have a hidden disability that they’d prefer to keep private. One thing that’s also different is that students who might have hidden disabilities or disabilities in general have always had the burden of getting the materials or asking and having to take all of the extra steps. In this case it’s the content generators with (the responsibility for) accessibility, so that’s a key difference between the two.

John: You noted that some students might choose not to report learning disabilities, but we should also note that some students might have undiagnosed learning disabilities. Those students can also benefit from the creation of accessible materials.

In order for our campus and other campuses to become fully accessible, it’s going to require the teamwork of quite a few people. Could you talk a little about how that process has been going here?

Sean: We’ve done a good job here at Oswego and we have a really good mix of people that are really interested in this topic and want to move it forward… so I think of our web developer, Rick Buck and how he’s gone and redesigned our website (although it was very compliant to begin with, let me say)… but he’s gone and put in the extra features that go and work to going to keep us compliant and he’s also spent considerable time with his team to educate our content editors who go in… and in any university you would have a very diverse group of people who would develop content in their specific department or area to keep the information relevant… but they need to understand their responsibilities inside of it… so going and training them and giving the knowledge and the tools. So, from the web point of view, I think we’ve done a lot, but also we’re lucky to have a mix of people here in the academic area who want to go and and do this. So, for example, with Rebecca and with the work that she does, first of all in the class and in the area of accessibility… we’re really lucky to go and to be able to tap into that and to put the resources necessary to move the whole project forward… and I would say that goes right up to the President here at the university and the Provost and them making it a priority and ensuring that we put resources towards this to move the project forward.

Rebecca: I would also add that without Sean really being the advocate for the entire process, I don’t think a lot of the things that we have in place would happen. He was the convener of the committee and some of these other things that really got the ball rolling… and it got rolling quickly. [LAUGHTER]

Sean: Why I do think it really helps being proactive and going and looking at it from a systemic point of view and going and trying to change the system and starting at the bottom; otherwise you just spin your wheels all the time and the hole gets deeper and deeper.

Rebecca: That leads us to: What next, Sean?

Sean: Well, I think we’ve covered a lot of the things that are coming up for us. You earlier referenced that I’m the Chair of the SUNY Council of CIOs. So, inside the SUNY system we’ve done a lot of work and tried to work with the CIOs to share knowledge in terms of what we’re doing, whether it be on our website and with applications that we’re purchasing and implementing. A couple of the other schools are doing even more. So the University of Buffalo is actually doing quite a bit and they’ve implemented a new procurement process that will go and put better, I would say, guardrails around how we go and purchase application software and I would imagine a lot of the schools will adopt what they’re doing… and the SUNY Provost is about to come out with a accessibility statement or policy and inside that statement and policy will be the need to have someone responsible for accessibility at each school, and how a school is going to need to have a plan in order to do it… and I would say that we’re among the leaders in terms of doing that. We’ll have a plan in terms of how we want to go and move it forward… and really the next part of it is I would say at this point is to go in and implement and let it grow and let the people do their work and share the knowledge that our fellows will have over the next period of time and then look where we want to go for that—we’ll need to go back and assess how we did this year and then I would say just guide ourselves through those waters and decide how we want to go and grow the program and share it with others.

John: Thank you. It’s always a pleasure talking to you.

Rebecca: Yeah, thanks for joining us, Sean.

Sean: Thank you for having me.

[Music]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

John: Editing assistance provided by Kim Fischer, Brittany Jones, Gabriella Perez, Joseph Santarelli-Hansen and Dante Perez.

48. The Culture of EdTech

As faculty, we engage with education technology as it relates to our classes but rarely consider the larger EdTech ecosystem. Dr. Rolin Moe,  the director of Academic Innovation and an Assistant Professor at Seattle Pacific University, joins us to discuss the politics, economics, and culture of EdTech.

Show Notes

Transcript

John: As faculty, we engage with education technology as it relates to our classes, but rarely consider the larger EdTech ecosystem. In this episode we examine the politics, economics and culture of EdTech.

[Music]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[Music]

Rebecca: Our guest today is Dr. Rolin Moe, the Director of Academic Innovation and an Assistant Professor at Seattle Pacific University. Welcome, Rolin.

Rolin: Thanks for having me.

John: We’re glad to have you here. Our teas today are…Rolin, are you drinking tea?

Rolin: I am John.

Rebecca: Yes!

Rolin: I am having the Maui Up Country blend that I picked up on a on a vacation that I had brought for the office, and we ran out. So I am drinking the wonderful Keurig inspired Celestial green tea today. But I am joining you guys over there. [LAUGHTER] What are you guys having?

Rebecca: I think it’s a green tea day. I’m having black raspberry green tea.

John: …and I have a ginger peach green tea.

Rolin: Excellent.

Rebecca: We’re all in sync without planning, so that’s nice.

John: We invited you here to talk a little bit about your April 2017 EDUCAUSE Review article (which has created a little bit of a stir) where you were talking about the growth of educational technology in higher ed. What types of EdTech in particular were you talking about?

Rolin: So, John that’s a good question… and a little bit of preface on the article itself. I wrote that with George Veletsianos, who is Canada Research Chair in Innovation and a Professor of Education and Innovation at Royal Roads University in British Columbia. We started this project in 2013 at a time when MOOCs had just come into conceptualization. Laura Pappano noted that the year before had been the “Year of the MOOC.” John Hennessy at Stanford said that the MOOCs were going to be a “tsunami that was going to wash away higher education as we knew it.” Clay Shirky compared higher education to a rotting tree that was in need of a lightning strike and this was going to change it… and so, this very optimistic (to the point of Pollyanna) thought on educational technology. And George and I both, as people who are scholars and practitioners in educational technology, were a little taken aback by this. The promises that were being related to educational technology didn’t match the literature. The history of educational technology didn’t match the present and the future track of these innovations, based on their previous experiences (kind of Silicon Valley startups) was not a positive one. As I mentioned, we started writing this in 2013 and the landscape kept changing. Ownership would change, or business models would pivot, and we had to rethink what we were doing. So we kind of, instead, came back to this more systematic review of what is educational technology, or EdTech, and we thought of it in socio-cultural terms as a phenomenon. So, thinking about that, it’s not necessarily a product that we are providing critique for but it’s more of the idea that by bringing products in, whether they be cloud based softwares, learning management systems, apps, learning technologies interoperability, or LTI, or outsourcing it to a third-party vendor, whatever that vendor may be. That approach cannot be thought of as altruistic in and of itself, but it is built in society that is usually, at best, tangential to education, but often completely separate… being brought in for profit bearing reasons, whereas our institutions, by and large, are education-bearing institutions that are looking to gain enough profit to continue operation. So, what EdTech are we looking at? We really want to be creating a more critical consumer of all EdTech. And you can definitely see that today in privacy issues that are coming out with Facebook and algorithmic issues that are happening with Twitter, and discussions of what constitutes free speech or hate speech on these platforms. When we wrote, we were much more thinking about the technology that’s getting into schools, but even there, some of the things that are happening in K-12: the data from these students is not necessarily protected, whether it’s getting hacked and sold to other places or if the companies themselves have connections to other products and other vendors. So, it’s a really meta piece to be thinking about. I don’t necessarily have an axe to grind with any particular software. That’s why we were very software agnostic when we were writing the piece. We just really want to be much more conscious of how we’re using technology in our teaching practice and what is happening because of the technology we’re bringing into our classrooms.

Rebecca: Thanks for laying down that groundwork. I think that foundation is gonna give us a good ground for discussion today and will help our listeners know exactly where we’re starting.

John: A lot of these things, where people were really optimistic about the introduction of MOOCs and so forth, we’ve seen all this before. Television was going to do the same thing. Before that radio was, if we go back further, printed books were going to have this big impact. So, these are issues that have been around for a long time. But, you focus on several issues that, perhaps, are more pressing now. One of the things you talked a little bit about is how colleges have been pressured by economic circumstances, by rising tuition costs and pressure to keep costs lower, to rely more on these external vendors. Could you talk a little bit more about that aspect?

Rolin: Absolutely. I need to preface here again, John, I appreciate you bringing up television. Because there’s a time that a lot of institutions invested in broadcast studios, with the idea being that we were going to be able to amplify education and we’re going to be able to have closed-circuit educational opportunities at senior centers and satellite campuses. And so you have in many land-grant colleges these forgotten studios, that in some cases are now being turned into teaching and learning centers where you have a green screen and you can show what you’re doing in Canvas, or Desire to Learn, or Blackboard, or whatever the system is that you may use… Moodle, I don’t want to leave anybody out. But, to think about my experience as an educator, I have a connection to this particular podcast. I cut my teeth as an educator in my first career, which was in film, at Duke University’s Talent Identification Program where I got to know John Kane, who has been kind of very foundational in how I think about teaching and learning. So John, thank you for that, and it’s wonderful to be on your show. We’ve seen all of this before and we failed to learn our lessons in education. So, we didn’t get out of television what we thought… what we thought we’d get out of radio we didn’t get. It’s important to look back and see “Well, what didn’t happen that we expected to happen? What did we plan for? What was the consequence? What were the unintended benefits? and what were the unintended pitfalls?” The problem, or the big difference today, is a lot of the technology is being looked at from an efficiency standpoint. So, television and radio and even if you go back, like you mentioned with the printed books, you go back to correspondence courses and using the Penny Post in order to be able to give keyboarding instruction for secretarial jobs. So, those technologies were based on much more inclusivity in education. You had a technology that made education available for more, and you had an opportunity to get away from geographic distance as what was keeping people from school. With digital technology what we’re seeing now is almost an inverse relationship that “Yes, we have this opportunity and we sell it.” So, the MOOCs were sold as an opportunity to democratize education for everybody. But, this is really framed in a cost-cutting perspective. That we’re going to bring in technology to keep costs down. That’s very important, costs in education, and higher education especially have skyrocketed, and to think about how we can be looking at this. But it’s disingenuous to say that our digital technologies are going to democratize education for all when we want to use them to save money more so than grant access. We have to look at both critically. We have to put the same research behind both. Moreover, what’s happening when our use of technology is in the gaining of data analytics that could be used, at best, in our spaces, but at worst by third-party vendors that we’ve signed contracts with that we don’t truly understand where they’re going or where they’re taking these things. So, I started with your question and went in a lot of different directions I’m realizing. But, I think it’s important to do that historical review and think about all those places because there’s a desire there, with what education’s supposed to be, if you want to think about Enlightenment-based thinking on education. But, we are at a different point now than we were with what someone like Soren Nipper would have called generations of technology. The first generation being radio, the second television, the third digital. This fourth kind, of web 2.0, has a much greater economic impact, both on the institutions as well as the whole purpose of education. That’s something that we don’t see a lot of in the literature and something that compelled George and I to write this article.

Rebecca: I’m hearing you talk about the the desire for more access but then also these rising costs. If we’re using EdTech, are students actually just getting more access? or are we just making things more expensive at the cost of actual learning?

Rolin: Yes. [LAUGHTER] It’s difficult because in some cases there is an upcharge on taking the course online. And there’s good reason for that because in order to teach a course online, if I’m an administrator, I now have to think about a faculty member who’s going to be working through that course. I have to think about any licensing that I need for contents. So, making sure that my reserves in the library can be easily flown into my LMS and that I have the rights for reproduction in that space. I have to think about instructional design, I have to think about information technology. I have this much larger infrastructure that’s involved, depending on what I’m doing: if I’m going to be using an anti-plagiarism software; if I’m going to be using an online proctoring software, a special grader, a video library of contents. There are four or five different buckets of LTI and those are the general ones, not anything discipline-specific. So, that brings this cost up. At the same time, if you think about Moore’s law, and as technology is increasing and the capacity to do things continues to increase, traditionally we have seen costs go down in this model. That hasn’t happened with education. So you have a space where students are presented in media and, I would say in a lot of cases by schools themselves, that this online efficiency opportunity to engage is going to bring your cost down, but then your cost is becoming more, because the cost on the institution is more. All of that is to say, at some point, if you’re gonna be selling both cost savings and access, that’s not a recipe for success. In many cases, we have the access, but it’s not to people, it’s not to a high impact educational experience that you have come to think with a stereotypical higher education space. I think of the Sally Struthers ITT Tech, you know, where you can do the courses in your pajamas. So we’re giving access in real time to curriculum and to materials, are we necessarily giving it to really engaging learning activities? In some cases, yes… but I don’t think the literature would say that those brightest cases of access are meeting that romanticized version of what it means to be a student in higher education. In many cases the most successful institutions in creating access and bringing costs down are the ones where faculty have been replaced by kind of quasi-administrators who work as admissions support specialists, tutors, retention specialists, program developers, and fundraisers. Kind of doing all of that from an office space, and that looks remarkably different from what we see in cinema, as somebody who works in film studies… what we see in cinema as that college experience. So, we’re gonna have to rectify what it is we think college is supposed to be with what it is we’re selling it as.

John: Might some of that be that, with new technologies… giving an example from economics… when steam engines were first introduced, we didn’t see any real improvements in productivity for decades after that. When the internet was first introduced and people shifted businesses to that, it’s taken decades before we’ve seen much of an increase in productivity. Is part of it that we try to use the new tools in the same way that we traditionally taught and we haven’t learned how to use it more efficiently, or is it something inherent in the shift to more digital media that limits the interaction between the instructor and student and may limit learning somehow.

Rolin: John, thank you for bringing that point up. If you think about professional development technology, the stereotypical overhead projector that is used to present material is then replaced by the PowerPoint…and what was interesting is, in some cases, the first uses of PowerPoint in classrooms (because of bandwidth issues) were printouts of PowerPoint slides that were then put onto overhead transparency. So what we see in many cases today what constitutes online learning is the lecture based approach the “sage-on-the-stage” model of teaching where we’re using our learning management system to do what we’ve traditionally done, and it’s what I would call a mediocre middle. It both misses the point of improving education and also misses the point of utilizing the technology, but it’s what we do. My fear is that there has been a financial success in doing things in this way, or at least creating a media culture that equates formal education to the lecture. So you think about a TED talk, or you think about a Coursera lecture… this idea that it is a faculty members responsibility to share their wisdom as the person who’s speaking through it. A podcast is another space, we’re people who are talking in a space. Now that doesn’t mean there’s not a space for podcasts and there’s not a space for lecture, but it’s easy to package that content and put it into a learning space that you’re hoping to monetize. For learning to be effective online and bring down costs, probably requires a pretty seismic shift in how we think about business as normal. Some of the early critiques of online education were that it would turn us into a fordist space, where it was gonna be the assembly line production. That was gonna get away from a faculty member as kind of an auteur, somebody who has the course from its implementation to its full assessment. With online that’s almost impossible to do for the sanity of anybody. So, in some cases, that model is going to need to change in order to be successful. We haven’t figured out what that looks like yet and the human capital costs of doing it right so far outweigh the benefits that you get from allowing students to be able to take classes from a distance and increasing your enrollment, hopefully through online. We haven’t figured out how to weigh the human labor that goes into that. And I think some of it is also we haven’t changed… I’m gonna get radical here, the expectation of what it means to be a professor is still the same as it was 50, 60 years ago, but what we consider is knowledge has changed pretty significantly with Ernest Boyer’s thoughts on scholarship. What it expects to be a faculty member… so the expectations of teaching at even teaching heavy institutions have gone up but the expectations on scholarship or service have not changed. So instead of it being a triangle of scholarship teaching and service it’s this odd triangle that is morphed into a parallelogram with no extra time given to these spaces. So, we’re gonna have to think about our governance structures and our infrastructure if we’re going to be successful. There’s an article in The New York Times this week we’re recording this in mid-September talking about what the next financial bubble may be, and it points to student loans that the cost of education has gone up fourfold over the last 30 years, outpacing everything, including healthcare… and the student loan debt has over the last five years, overtaking credit card debt. It’s the largest amount of debt that exists in any industry. That cannot keep up. Y et costs continue to rise. So another thing; in the next 7 years, that traditional college age, students 18 to 22, is going to decrease in 2025 because of demographic shifts. So, there’s a lot that’s going on at this point, and John, you mentioned the steam engine and how it took decades… Well, we keep saying we’re the Wild West and we only have years until we get to the cliff, and many people would say we’re already past that point; we’re at the point of no return. I like to be a little more optimistic than that.

Rebecca: I’m gonna go back to a little bit of discussion about access. Some of the things that I hear you describing is that the technology is allowing us to have access to information or the distribution of information. Which is why the lectures, the podcasts, et cetera are easy to package and deliver the access to that information. But, what I’m not hearing is access to learning or the access to becoming a scholar, or a way of thinking or being in the world. And I wonder if some of the movements in OER or the open education resources are trying to push the envelope or push the technology and access more in that direction, or if it’s really still emphasizing the ability to just deliver information.

Rolin: Rebecca, you bring up a really great point. And I’ll touch on OER because it’s a fascinating case study in this space, but if you look at the history of distance education with technology, the focus was on bringing people together… that the content operability was not the key point… but it was being able to bring people from disparate geographies or cultures or climates together to learn. And so it is based in constructivism and constructionism and social learning theory and activity theory and all of the wonderful progressive learning theory that is moving teaching and learning today. And the technology that is predominantly used stands much more didactic, maybe behaviorist, in approach because it’s easier to measure that than it is to measure the much more engaging work that happens when you bring people together. So I had an opportunity (I’ll try and not give away any disclosing information on this), but I had an opportunity to work with a group on a MOOC in after the first wave of MOOCs—this was 2013–2014. They were on a major platform and they had created a course, and it was not a traditional STEM course; this was an arts-based course that they had created. And the platform came to them at the end and said, here’s what happened in your class and had this ream of analytics and they said “Well, wait a second. We had a Facebook group, we had meetups, we had a lot of people create artifacts. Where does that fit into this?” And the platform just kind of shrugged their shoulders and said, I don’t know. We can tell you how long someone watched the video and they were saying, “That’s not what’s important to us. What’s important is what were the conversations that were happening and how is that gonna relate to where they’re going further.” We’re in a time of measurement today, yet our measurement structures are much more basic than our capabilities with technology. And so we’re engineering the technology to perfect those measurement techniques. We can’t do much more with bringing people together and engaging more progressive emergent learning theory with technology. I think what George and I were arguing is the technology, as it stands today, doesn’t feed that because that’s not what’s getting the clicks, that’s not what’s moving the needle, whatever metaphor that you want to use in that space. MOOCs are a fascinating space to look at this because the MOOC acronym actually comes from an experiment in social connectivist learning from 2008 with George Siemens, Stephen Downes, Dave Cormier and the great Canadian contingent. And then Sebastian Thrun didn’t even talk about it when he became the father of the MOOC in 2011. He was looking at a bold experiment in distributed learning at Stanford. It was a New York Times reporter Tamar Lewin who made the link between what George Siemens had done and what Sebastian Thrun had done and called it a MOOC. And it kind of stuck and that’s where we went with that. So it’s very interesting to look at the hype versus the research and why the hype is what’s pushing the cart when in academia we like to say it’s the research that does. Now you mentioned OER. I want to focus on that because this is a really fascinating space that in the last couple years you’ve seen this remarkable push on open educational resources, open textbooks, and I am a longtime advocate of open education… been attending the open ed conferences that David Wiley has been putting on since 2013. I ran the unconference there last year. So I’m advocate for what they’re doing. But it is interesting to think about their success and what their advertising is. Their paramount success is really focused in textbooks. So while you have the opportunity to edit a textbook and you have the opportunity for a faculty member to build artifacts of knowledge with students and cross collaboration, that’s not what’s moving the conversation today. What’s moving the conversation are these static textbooks that bring costs down for students. And I like to be the voice that’s saying, don’t forget about these places, because I worry that we’ll see something, and you can even see a little bit of it happening now with publishers who are wanting to open wash or green wash or astroturf what open is and say, “Oh, you know, here we are over here at Pearson or McGraw Hill and this is our contribution to the space.” When you look under the hood it looks remarkably different, but if the focus remains on this static text book in that adoption, it’s easy for that to co-opt. So, to answer the question in a more broad sense, I think in general we have research that’s telling us one thing and we have marketing and public relations and cultural ideology that’s saying something else. I don’t want to say we’ve done a poor job, but the two are very incongruent right now and usually it’s that media PR machine that’s pushing things and we’re playing catch-up and it’s easy to lose track of the research in that.

Rebecca: As a public institution like we are, obviously access as in all people should have access to the information is really important, but I always get concerned about the people who are generating the technology pushing it in the wrong direction and people who value everybody having education and learning not being able to push the envelope or push the technology in the direction that we want to push it in. They’re kind of butting heads in some ways.

Rolin: I would absolutely agree with that. And accessibility, it’s really wonderful to see accessibility being brought forward in terms not only of contents but also of learners, and so the stigmatism of having learning disability or an emotional or physical or some need to engage with content, that now is going to be supplemented by an institution. And that we are designing with that in mind. We’re designing a universal access and UDL that we’re engaging in this space, and that’s a really wonderful change that has happened in higher education. When people talk about the cost of higher education, it’s important to note that things like that are bringing the cost up, and I don’t think any of us would want to get rid of any of those pieces. The problem, of course, becomes “What is the historical understanding of this place?” and “What is our institutional objective and our institutional memory versus these changes that are happening in how we think about teaching and learning?” And I’ve done as much as I can locally at Seattle Pacific University to start conversations and meet people where they are and I think we’ve had some some pretty remarkable success in rethinking some of our structures, but we’re a private liberal arts institution not dealing with the state bureaucracies, not dealing with a state system, not dealing with tens of thousands of students, and it becomes difficult to navigate all of that. Bureaucracy is the least worst tool that we have in order to work with that. But it’s also a great straw man or easy fall guy for any problems that come up, and too often problems continue to exist rather than being tackled because it’s tough to think about what the benefit would be going forward.

John: In your article, you talked a bit about the increasing reliance on private vendors, outsourcing tasks from institutions to vendors on the grounds that that opens things up to the free market in some way, but when we look at the provision of most of these platforms, it’s a fairly unstable market. We’re seeing so much concentration in the market where many small publishers have disappeared, and many of the innovative educational technology providers have been bought up by other large firms. We’ve seen many providers disappear.

Rolin: I’m glad you bring that up, John, because if you think back… and John, you and I have a background in K-12 and it’s really fascinating to think about this from a K-12 perspective because in the 60s and 70s, the heyday of educational film, it was the job of the media resource specialists at a K-12 library to work with faculty to be able to understand how these pieces fit together, and so they were working with Encyclopedia Britannica and World Book and Disney and ABC and NBC and the different content providers of the time, who were making educational titles. It’s a fascinating, fascinating time. The computing craze in the 1980s came at the same time as a recession. And the idea being for people to think about how this was all going to fit together. When this was created the idea was that that role was going to be vital, and the change that happened was we got rid of the media resource specialist and believed it will be up to institutions and collaborations to grow this, to make this go further. Educational film died because it became less expensive to make it and the belief was more and more people would make it. What we instead make are lectures and YouTube videos, and there’s value to both but the great expectation that we had on what these contents could be is gone and we’ve lost that. And so there’s an opportunity… I think that if you think about learning as this contextualized and locally defined space… there’s an opportunity to be able to create these contents. But there’s a lot of risk that goes into that. There’s a lot of quality control that we we didn’t necessarily expect. And there are a lot of other costs that came in and so we output to these third-party vendors, hoping that we hit pay dirt with somebody. In many cases those companies are folding regularly or they’re being absorbed into others, the learning management system ANGEL, which was a rather popular system in the early 2000s and early part of this decade got bought out by Blackboard, and a lot of the people who liked ANGEL liked it for the reasons that it wasn’t Blackboard. But to think about, in that perspective, it’s almost impossible today for institutions to take this on their own. There’s just not a return on investment that works for that, so that means you either have to create these partnerships across institutions that historically have been at war with one another, or you invest in the promises of third-party vendor, either a small one that’s telling you what you want but may not be around in a month, or a large one that you have a lot of trust issues… best-case scenario, trust issues on the kind of service you’re going to receive; worst-case scenario, what does it look like what’s happening to your data, what’s happening to your analytics, what’s happening to the ownership of what you’re producing.

John: Going back to ANGEL a little bit, we used to use ANGEL here and in many ways I loved it; it had some really nice features that Blackboard is a ways away from getting. It had automated agents and so forth, but ANGEL was actually created at Indiana University. And one of the problems they had was that in the 2007 recession, state support for Indiana University was cut significantly and they owned this big cash cow that they could sell off… and so we lost a fairly viable provider in large part because we see in general a decline in federal and state support for higher ed and it puts institutions in a difficult bind where they often outsource more and more.

Rolin: Absolutely and ANGEL is a good example of that. You can go into the 60s with Plato. It was a Midwest State school that was doing Plato. I think about Quest Atlantis was another great thing that gets mentioned in all sorts of progressive educational research that was funded by grants and the funding dried up and there was no way to sustain it. The MEK Corporation, the people who created Oregon Trail and super munchers and that educational software, where is that today? And I work in educational film, I think about it from that perspective. How have we lost those film providers and now we just think that content will fit in for what was historically this really rich and vibrant place to engage, but we’ve lost it on the software side and the teaching and learning side, and we’re outsourcing so much of what we already do to the free market. Certainly there is benefit to that, but at what cost? And I don’t think there’s been enough analysis of what that cost has been.

Rebecca: So, you’re really bringing up the idea that EdTech is not neutral and that there’s competing goals. So, technology companies are obviously trying to make money and then we’re trying to have students learn, ideally. How do we help those things become more aligned? What needs to happen so that we’re not at odds but that we actually find alignment and essentially make the world better which, in theory or in PR, is what’s being said?

Rolin: I think for the first piece, Rebecca, is understanding that EdTech is not neutral, and once we have that foundation, that we understand what we’re using and what it relates to, we can be much more thoughtful about how we use it. So, I am a faculty member but I am primarily an administrator and I use our learning management system here on campus. I could go off the grid; I could try and do something completely different, but it’s important to show support of what we’re doing with an understanding of how that works, and so we have our LTI, whether it’s anti-plagiarism software or proctoring software and all these pieces, and as a scholar I can have criticism of that. So, as a practitioner, how do I help my students understand what they’re getting into with this and making informed decisions about that space. So, I think it really comes into this idea of understanding the learning environment and what my job is: to control… to create pathways for students to be able to learn and to scaffold that and to fill knowledge gaps and help people expand their zones of proximal development, to go Vygotsky on us. I need to cede some of the “management control” that goes into: “Well, we use this, and this is what’s going on.” But, let people make thoughtful decisions about what’s happening with the technology that they’re using. My son in K-12 can opt out of state standardized testing and that’s a decision that’s made as a family. Dealing with college students, we don’t give them the same rights to opt out of some of the technologies that are being used. So, I think about the proctoring technology that was out of Rutgers that was running in the background on computers using retinal scans to engage people and that’s just what you get when you sign up and there’s no informed decision or consent. There’s not even a Terms of Service that you have to read through and then click a button that you don’t actually end up reading. Can we have more of these conversations? Can we be more informed? Because, if we have that information, we’ll be much more thoughtful in the decisions we make on what vendors we choose. The vendors will then have to respond to that market in making software that is more open or more transparent in its use and the application of its data. People have to make a profit. Education has to make a profit. We can marry those pieces together and have a somewhat vibrant marketplace that is serving the learning of students. I think the issue is, right now for EdTech, the student is the customer, not the buyer, and so there’s a gap there that if we have students much more involved in all aspects of that and involved in those conversations, that becomes part of learning experience. I think that that could see some more direct improvements than just generally saying, “well, we’re thinking about this and we’ll continue to think about this going forward.”

Rebecca: I think one of the things I’m sorry I was gonna pick up on the threat of audience but okay

John: You mentioned keeping students in the zone of proximal development. One concern with standard lecture based teaching is that students are pretty much forced to move along at one pace. What’s your reaction to adaptive learning? Is that something that could help, or are there some limitations that we should be concerned with there?

Rolin: I mentioned Plato earlier, the first personalized learning network—basically adaptive learning. I think that there’s a wonderful opportunity for adaptive learning platforms and for being able to bring in competency-based education into spaces. Thomas Edison University has an amazing program that is built on the idea of competency-based education. Alternative pathways and moving away from “seat time…” there’s definitely viability for that. It just has to be thoughtfully executed… and what is the purpose of the learning that is happening in that space? So, if I think about a School of Health Sciences, I think about nursing… if I’m going to get a degree in nursing, there are really specific things that I need to do. I need to pass very specific exams that are proctored in very specific ways that expect me to maneuver in very specific fashions. The seat time is important for that, and that space there needs to model what I’m going to be getting into in an industry. So, I can’t be an intrepid change agent saying, “No, this needs to be social learning theory,” it needs to be what takes off in nursing. No, nursing students need to be able to be successful in the expectations of their field. There are the places that adaptive learning can fit into that. You see it in foreign language in many cases and the supplements that are happening there. Keyboard instruction is another one where that comes in. So, how could we use the best of that to be getting into other spaces. I think some things that we could explore there, as we rethink disciplines and what works for economics or film studies or education. I think there’s some places with that critical thinking… that soft skills, 21st century learner stuff… where the adaptive learning could come in…. so, misinformation, media literacy, fake news… big hot topic and I wrote an article in 2017 that got a lot of attention (not all positive) saying that fake news wasn’t the problem; it’s not what’s ended up resulting in Brexit or the results of the 2016 election. But it was a small part of a landscape that had been neglected and was suffering from blight for a long time because of how we teach this stuff. And I wonder if thinking about digital literacy, which we’re all expected to incorporate into our classrooms, if that could be served by an adaptive learning platform that engaged content, theory, criticism and evocative video to be able to move somebody on a pathway. That’s a place where all of us could come together because there’s no discipline that owns information literacy. It’s built out of information literacy in libraries. But librarians often are the most flexible in thinking about how their craft is going to change. Places like that, critical thinking, the stuff that we’re all told needs to be imparted to our students, but it’s just kind of this hooray concept of “Oh yeah, let’s have this.” Maybe those are the places to really focus on the successes of that and then the research can help define how economics could engage adaptive learning or film studies or education or cell biology.

Rebecca: One of the things that you said earlier is that students aren’t the audience of or aren’t the buyers of the technology. And I wanted to shift that a little bit to thinking about audience and who things are designed to and I think you’re right in that tech companies are selling to administrators who are the ones that are doing the buying and the purchasing who are trying to facilitate certain things, keep cost down, et cetera. How do we shift that conversation so that tech companies start to see the end users who are really students and faculty as the audience of their marketing, of their conversations, and actually shift things so that they focus on the research around learning and improve learning rather than just facilitating something?

Rolin: The key part of what you said, Rebecca, you kept going back to learning, and I think that’s what’s missing in these vendor conversations. We have this idea of what learning is and if I’m a vendor and have mounds of data I can point to achievement and I can point to the things that I measure in my platform that lead to that achievement, and for most instructors that’s not evidence of learning. That might be a small part of it but there’s a much larger picture. And we do a poor job of amplifying that research. That research doesn’t play well in mainstream media, so how do we do a better job of sharing that research. What constitutes learning? What makes learning happen? I love going to YouTube and looking up “do-it-yourself how to fold a fitted sheet,” ‘cause I don’t do a good job of folding a fitted sheet. And I’ve tried numerous times and I still struggle, so that video isn’t the piece that I need to be able to move me there. Now, there are other pieces, potentially making something for dinner that I would be able to replicate in that space, but replication again is not learning. So, even an understanding of: What is learning? What does that mean? How do we define what it is to have learned something? What it is to be a learner? “Lifelong learner” is a commodified term at this point when it really should be a state of being for, I would say, pretty much anybody. How do we engage those conversations? That’s a really complex question. In terms of an institution, how do we bring more student voices into these spaces? and not in a placating fashion of, “Well, we now have a student sitting on this committee.” But to really understand how that student can canvass and caucus with their peers to be able to provide us information. In the same way that if I’m serving on a faculty committee so that I’m meeting my service requirements, but if I’m getting something out of that and I’m giving back that’s a wonderful experience. A student serving on a committee… how can we provide them what they need for their CV or for their graduation in a way that what we’re asking from them they can provide us? …and not just sitting there and saying we’re listening to what they’re providing but often not doing that. So, more student voices in those decision-making processes… more research that’s going to be shown to the vendors… and I think we need to be more thoughtful about those vendor conversations. One thing we do here at Seattle Pacific University, we actually have… with our faculty… we provide entry points for vendor assessment when we do test demos. What are some of the things that faculty who are very interested in being part of these conversations but are coming in the middle of it… what’s happened so far and what are questions they can ask we’ll be able to draw out their expertise and what we need from the vendor? The more of that that we do, the better. I know the California State University systems doing something similar on automating a great deal of the pre-production that goes into assessing vendors so that the stakeholders who are asked these questions have that information in a repository and can access it very easily to make an informed decision, rather than it being brought down from higher administrators… lots of information that’s tough to digest in a small period of time.

John: What do you see as some of the most promising areas where EdTech has some potential?

Rolin: Excellent. My wife loves to say it’s very easy to show why you’re against something, but you get into this business to be for something. Get in education to really share the diffusion of knowledge and help people rise to heights they didn’t know were possible. Fall in love with things they don’t yet know exist as Dr. Gary Stager would say. So, what are some of the positive things that are happening? I really think there’s a chance for a revolution in multimedia. Here’s this podcast that is happening in an interdisciplinary fashion in SUNY Oswego bringing in a faculty member from a completely different perspective who serves an administrator having this conversation. More and more of this is happening. Before we went on the air, John, you were talking about editing your two channels and making sure the sound was right and all of these skills that were picked up that don’t come when you get your PhD in economics. So, as these pieces are coming in how do we value that and so you see more administrations and more governance bodies that are providing value to that. We were talking, Rebecca, about open education. The University of British Columbia now will recognize the editing of OER materials as part of promotion, tenure, and review for their School of Education. That’s a phenomenal change that has happened in how we think about the role of the faculty member as a distributor and conveyor of knowledge. I think people are being more thoughtful at this in this day and age. But, you did ask specifically about technology, so I need to pivot back there for a second. I love some of the stuff that’s happening in virtual and augmented reality. Some of the really interesting research that’s happening there. I like the drop-in classes that are happening around special interest topics that often, in many cases, are informal or non-formal learning spaces. Museums putting on areas where you can come in and learn in a certain time. Kind of a gap between a human experience and the MOOC but you’re kind of doing both at the same time. I think that the opportunities that we have with free and ubiquitous devices… and I don’t mean free as in cost but I mean free as in access to… and especially in the West with broadband capabilities, what’s going on with video and how we can better engage that and as more people learn about nonlinear editing and cinematography and camera and sound. What are some of the resources we’re gonna build there? Opportunities for students to share their knowledge is the main thing that comes forward for me. WordPress, which runs, what, a quarter of websites in the world is getting incorporated more and more into courses. You think about the WordPress camps. There’s a great thing happening in New York City coming up on managing the web and how you can work with students to be able to be creators and owners of the knowledge that they’ve created and what the implications are in that space. It is kind of a tough time to be bullish on technology if you think about Facebook and Google and Apple and Amazon and antitrust that’s going on in all of those spaces. And so a lot of the stuff that I’ve mentioned here is somewhat renegade, somewhat guerrilla even. So where are those opportunities to engage with environments through online? It comes back to community in that space. How do you find and foster that in your networked identity. There are opportunities and more and more that’s going to be happening. I think that we’re in this storm and after this there will be, not a calm, but there will be an opportunity to look at what’s been broken and how can we build and improve going forward, and I think that we’re getting to that point sooner rather than later.

Rebecca: We generally wrap up by asking what’s next. You talked a little bit about what’s next in EdTech, but what’s next for you?

Rolin: What we’re doing at Seattle Pacific University around academic innovation; we have been offering seed grants to faculty for the innovations that they see as necessary, whether that’s in a classroom, in a department, in a college across the entire campus working out in the community. We provided 45 of those over a two-year period, so almost a third of our faculty directly affected by those and it was very powerful, so we’re taking that a step further and engaging at a school or college level and finding innovations that we can then potentially put into day-to-day operations. So, one of the things we’re thinking about actually are adaptive courses. What would it look like for a course in nonlinear video editing to be almost entirely online. And you think about that with lynda.com. I can go to lynda.com and take a tutorial in using Final Cut or Adobe Premiere. What am I getting out of being in a higher education institution that I can’t get off of Lynda? That’s what we’re exploring: what does it look like to have that scaffolding and support that’s directed toward a greater understanding of knowledge? Other things are definitely around social justice. We are seeing at Seattle Pacific an increase in first-generation and historically underrepresented students who are coming in with the same scores as their peers but, once they get here, we’re seeing a discrepancy between where we would expect them to score and where they are scoring. And we have statistically significant research showing that that is the first-generation student demographic. So, what are some pieces we can put into play to be able to help them with their success? Because it’s not a matter of not being able to do it; it’s a matter of the structure and the culture is not befitting them. So, we have a program called the Bio Core Scholars where we are working with tutoring and mentorship on research, community, and knowledge gaps to be able to move these students. We’re in our fifth year of this program, we’re looking at expanding it. But we have brought the students up a full standard deviation in their scores, and we had an 86 percent success rate in graduating people to pre-professional health programs, which is just a remarkable number. Personally, I’m really big on what we can do with educational video. What are some of the things instead of it just being a lecture? I love Skunk Bear on NPR, taking a topic and in three minutes doing an entertaining, evocative dive into that topic, but again, that’s Oliver Gaycken would call “decontextualized curiosity.” How do we take that and actually put it towards learning? So, I’m looking at what does it look like to have lecture mixed with a very product based assessment mixed with more evocative filmmaking to move people into learning? How does that all go forward? It’s a very exciting time to be in higher education, even with all of the things that are looming on the horizon.

Rebecca: Certainly doesn’t sound like you’re gonna be bored any time soon.

Rolin: Not at all.

John: Thank you for joining us. We look forward to hearing more about this.

Rolin: John, Rebecca, thank you guys for having me.

Rebecca: Thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts, and other materials on teaforteaching.com. Theme music by Michael Gary Brewer.

43. Social media

Have you ever considered using social media in your courses but have fears of things going awry? Social media can provide rich opportunities for learning and public discourse. In this episode, Brian Moritz, an Assistant Professor of Digital Media Production and Online Journalism at SUNY Oswego, joins us to explore ways of using social media that engage students and discuss policies and procedures you can use to protect student privacy and provide a safe and supportive learning environment.

Transcript

John: Have you ever considered using social media in your courses but have fears of things going awry? Social media can provide rich opportunities for learning and public discourse. In this episode, we will explore ways of using social media that engage students and discuss policies and procedures you can use to protect student privacy and provide a safe and supportive learning environment.

[Music]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[Music]

Rebecca: Today our guest is Dr. Brian Moritz, Assistant Professor of Digital Media Production and Online Journalism at SUNY Oswego. Welcome, Brian.

Brian: Thank you guys for having me.

John: Tody our teas are:

Brian: I have Earl Grey. Twinings Earl Grey.

Rebecca: Excellent. I’m going with my standard Twinings English afternoon tea.

John: …and mine is Irish breakfast from the same company.

Rebecca: It’s a Twinings afternoon.

Brian: You should get a sponsorship deal out of this.

John: I know. We should.

Rebecca: That hasn’t been the first time that’s been suggested.

We invited you here today to talk a little bit about using social media to enhance or augment learning. Can you talk a little bit about what social media platforms you think work best for learning and why?

Brian: Yeah, I think it’s a fascinating topic, one I’m really interested in… and I think… a couple different angles here… one, I think it really depends on your discipline and it really depends on the types of classes you’re teaching. I teach in our journalism and our broadcast units. They are very outward-facing… very naturally fit social media… something like Twitter. I’ll talk a lot about how I use Twitter in class… that’s a natural for me to use in my classes because that’s what our students are going to have to use when they get out in the job market. They’re going to be expected to have some kind of fluency in using Twitter and using social media as reporters… as media members. But, I think you can also broaden out our definition of social media. I mean it’s something I think we in Communication Studies think about a lot is “What is a social media platform? Is YouTube considered a social media platform? Is something like Medium or blogging software? How does that fit into the social media?”

It really does depend, I think, on the course material… on how you are going to be having your students using it. I tend to mostly use Twitter in terms of teaching for a couple of reasons: Number one… if you’re going into journalism… if you’re going into broadcasting… if you’re going into media… a presence on Twitter and use of Twitter is critical… for the profession… for starting out. Especially for my news writing classes or my journalism classes, Twitter is very newscentric and journalism-centric in a lot of ways. But, I tend to use that a lot. I’ve experimented with some of the other platforms in my skills classes. I’ve experimented with using Facebook a little bit… a little bit with Instagram and Snapchat. With those platforms, I try to let the students drive that because those are the most popular ones I found with my students.

Every semester I asked in these classes: “What social platforms are you on?” …just trying to figure out where our students are. What I found is very interesting. Most of them are on Facebook, but they don’t really use Facebook. That’s where their parents and grandparents are. They don’t want any part of that… and it’s also kind of the first one you start out at. I think you’re 13, allegedly, when you can legally start on Facebook, so that’s where you start but then you move off of it. Some of them are on Twitter; some of them are not. That kind of varies from year to year. But, the most popular ones are Snapchat and Instagram, and we talk about why that is… and we talk about how we can use those both personally and professionally… and a lot of times, how I choose to use the platforms is really trying to understand where media and where journalism are headed via the use of this platform. It’s not necessarily about using the specific platform (like tips for increasing your Twitter following or getting more likes on this Instagram story or whatever). It’s a lot more thinking how audience members are using these platforms to get news… and to follow what’s going on… and to react and interact with journalists… and what the students have to know and should know on a bigger picture level than just the actual skills involved with a specific platform.

Rebecca: It sounds to me like it’s really important for a faculty member to be aware of where the professionals in their discipline are. Because, whether or not it’s popular with students, if it’s popular with the professionals in the discipline that’s what we would want to train our students to go towards.

Brian: Absolutely. Well, absolutely with a caveat on that. Ithink it’s very important to know what actual skills journalists are going to use. Journalists don’t use Pinterest professionally on a wide scale. I’m not going to spend a lot of time thinking about introducing Pinterest into my courses just because that hasn’t taken off in my discipline the way it might let’s say…

Rebecca: …in design

Brian: …in design [LAUGHTER] …and in photography. Yeah… graphic design something like that, where you would probably really benefit much more from a Pinterest board and using Pinterest than using Twitter or anything like that. But I also do think it’s important. Our students are young, and again speaking from a journalistic point of view I don’t use Snapchat. I’m sure I have an account, but I’ve deleted the app several times. It’s inscrutable to me. I cannot figure that app out to save my life. But, my students are on that, and they’re using that, and I think it’s important for them to figure out “Okay, now, how are you gonna use this app?” This app isn’t necessarily widely used in journalism, especially at smaller papers, but a lot of that is because it’s old people like me who are in charge, and they may not get Snapchat and you, as students, you kind of intuitively get that… So, I tell them… it’s one of my big rah-rah speeches in my classes… but you get to design what this is gonna look like… what journalism on these platforms is going to look like… You know how you use it… and I think that’s empowering for students but also important for them to not just “This is what I need to get a job, but this is how I can build a portfolio and help create a new generation.

John: In terms of Snapchat, though, I would think that couldn’t work very well in this area, simply because of its ephemeral nature… that nothing there is kept very long.

Brian: That is true, but I do think one of the things that Snapchat has done… and there’s a whole other discussion on the economics and how long they’re gonna last, but if you go on the discover tab, where you will have media companies who will have Snapchat stories. ESPN is doing some really interesting things in the sports world, where they’re reinventing Sports Center. The 30-minute highlights show that a lot of us grew up watching is now reimagined as a two-minute Snapchat story on that discover tab. Well, that’s really interesting. How much do you watch that? What can you do on the platform like that? So, yes there’s definitely, I think in all social media, there’s always this balance of the ephemeral nature of it versus… and of course with something like Snapchat… where for listeners who don’t know, the content disappears as soon as it’s viewed or, I think, within 24 hours.

John: With some things, but even the stories, I think, are only kept for a limited period.

Brian: Right, and the same with Instagram. So, I was actually just reading a piece in the Nieman reports about how I believe it was the Cincinnati Enquirer is using Instagram stories and that’s really interesting. But again, that’s a new paradigm you’re bringing up… that it disappears after a while. it’s not like a story in the daily paper that you can read days on end. So it is interesting, and these are things that we have to think about when we’re using this as a pedagogical tool… the permanence of it… the empowerment of it… what the audience is for it… where it’s going… and I think this is what makes it both frustrating and exciting to teach the stuff and use this stuff. Because it’s not set in stone and it does change really quickly. I can remember live streaming… So, your Facebook live and before that before that Periscope, Meerkat (may it rest in peace)… a Twitter live video which is folded in with Periscope. When I started at Oswego, my first semester was fall of 2014, and live-streaming didn’t exist. Periscope and Meerkat, if they existed, they were like in private beta they weren’t out there. It was 2015 that they were first introduced at SXSW, and by April that year we’re figuring out how to get this into our curriculum and in our classes. It can move that fast.

John: Yeah. Before that, I think there was Livestream and Ustream. but Meerkat took over that whole market followed quickly by Periscope and others.

Brian: Right. When I say live stream I mean like the mobile live start where you can do it on your phone and immediately broadcast it out on Twitter or Facebook… whereas Ustream was a little bit more… I want to say… un-user friendly… but Facebook Live you literally click your screen twice and you’re there.

Rebecca: What about platforms that are a little more old-school for professional stuff like LinkedIn?

Brian: I don’t talk much about LinkedIn in my classes. I probably should, but I don’t. It is incredibly valuable for students to have as they’re entering the job market. LinkedIn is where you put your resume… it’s where you put links to your websites… and to your portfolios… and to the work you do… and you can create a really good network. I think it’s very valuable for job search. It’s very valuable for that. I don’t teach that as much [as] a skill to have in reporting and publishing. I guess I kind of focus a lot of my teaching on straight journalism practices and what you would do day-to-day in your job rather than the getting a job on LinkedIn I think most of our students… most of mine… anecdotally at least… they’re on LinkedIn, and they know they need to be on LinkedIn. They’re real professional place in their professional space.

Rebecca: Can you talk about some examples of how faculty can effectively use social media as a teaching tool?

Brian: Yeah… and again, it directly probably relates to the courses you’re teaching… your teaching outcomes… you’re learning outcomes… and the discipline that you are in. Somebody in organic chemistry is going to have a very different use case for social media than I am. The nature of what we do is different. But, I do think using social media as a tool can be effective for anybody going into a media profession, I think. It can be valuable for anything as a promotional tool. I can differentiate between writing courses and the more lecture courses that I teach, because they’re very different in terms of outcomes… in terms of what students have to do. In the skills-based courses, I have my students do a lot of stories… cover events… cover games… different things like that. Everything they write, every story they write, is published publicly online. We’ve used medium, which is a blogging platform. It’s a very simple, very straightforward WYSIWYG blogging program. Everything is published…not behind a password… not behind a protective thing… it’s online. One of the reasons we do that is we want our students to get used to “You’re a journalist. You’re a broadcaster. You’re in the media. You put your work out there.” That’s what we do… and I think that that’s valuable. I use social media as a way to: You publish a story… now you get used to you’d tweet out that link. It’s a basic journalism practice now… to get students in that habit… I write something I publish it I send it out to followers.

One thing that I do… I teach media law is one of my standing lecture classes which is not a skills course, unlike a lot of the other stuff I’m talking about, which is very skills based and hands-on experience. This is a traditional lecture law course. One thing that I do that I’ve found interesting, and with some success, is before an exam I will hold twitter office hours. What I do is… the night before the exam, let’s say the exam is on a Monday, and I tell the students this ahead of time. From 8:30 to 9:00 p.m., the night before the exam, I will be on Twitter. Everything else is closed… answer any and all questions you have about the coming exam… just rapid fire… fire away. Sometimes I have more questions than others, but there’s usually a pretty good collection of students asking questions… lurking (which means passively taking part in the conversation you’re watching it without taking part in it)… and I retweet every answer with a comment and they can follow along with a class hashtag so BRC 319 in this case. You can follow that even if you’re not on Twitter. You don’t have to follow me to do that. You can kind of watch at a distance. I found that to be incredibly useful. It’s 30 minutes and then, at the end of it, I send out five questions; three of them are actual questions so they can prepare one, and there’s two that are thrown in there and then at nine o’clock I say “Okay, the store is closed. Good luck on the exam tomorrow. No more questions.” I find that to be really useful and fun and helpful for students, I think. It’s not like a blackboard discussion forum where it’s so asynchronous that you can get lost in a thread… and when did I post this? …and you forget to go back to check it… or you don’t have alerts setup or something like that… because it’s a half hour, it’s more rapid paced. There’s a little bit of energy to it.

One of the important things I think the social media can do, is it can help connect with students in a better way and a little more personal way in an environment where maybe they’re a little more comfortable. We all have our loves and hates with Blackboard… but it is not the most inviting welcoming environment… I found at least; whereas Twitter, especially when you’re going back and forth with somebody, it can be it can be a little bit more personal, and that’s a fun cool way to use it in a class that doesn’t necessarily lend itself to using traditional social media.

Rebecca: Have you had people other than yourself chimed in to those conversations?

Brian: Alumni will check in and start either taunting me or taunting the students or like remembering past questions or something like that… and it’s usually very obvious that they’re having fun with the students and very obvious that they’re having fun with me. But, for the most part, it’s mostly the students who check in and there is a decent amount of engagement beyond just clicking into the actual social media aspect of it.

John: Have you had any cases where there have been people trolling the students in the class? and how do you deal with that?

Brian: That’s a really important question. It’s very important to say, in everything that I do with social media in a class, I am a straight cisgendered white male. I’ve got all the privilege. What I can do on social media is not the same experience that an LGBTQ person can do… or a person of color… or person from another minority group could be able to do… and I absolutely acknowledge that. I’ve had a limited experience with trolling, but it has happened. There was one time, speaking of a live-streaming… this was a few years ago and we were doing a unit in my online journalism course on Periscope. What I had the students do was get up out of class and go walk around campus using Periscope… basically just kind of wander around… get used to talking to your phone. This was a few years ago when students weren’t necessarily as naturally comfortable with it as they might be now… So, get used to the app… get used to how you can do it… get used to what you can do… you can watch different feeds on Periscope and so I was bouncing around… I went to one student… and normally they have like two people watching… three people watching… maybe they get up to six… and a young woman in my class had hundreds of people watching… and all of a sudden you can see the comments on the bottom of the screen… and I can start seeing comments come in about her and about her appearance… and it was typical gross online male behavior… and she shut it down… like she was interacting with them and she did not seem to be upset about it… she was kind of tossing it off as though whatever… and ignoring them and then she shut it down and then went away… and I’ve thought about that a lot… and that I didn’t react in a way that I should have reacted… which is then to jump in as the professor and say “This is a student… this is student doing an assignment. Knock it off. Stop it. This is inappropriate.”

If I see any trolling, I would report it to the social media platform. I made sure to talk with the student afterwards to make sure that she was okay… and she was… But, it’s something I think about… even reporting it. There’s a controversy going around on Twitter these days of what you report doesn’t necessarily get the person in trouble. There’s certain alt-right tweets now that are not polite society… I’ll tread lightly… but the person isn’t banned or doesn’t get in trouble for them… but I do think about it a lot. I think about it when I have a lot of young women in class or people of color in class. There are some ways that I’ve tried to scale back the use of social media in class… just in a way to limit any potential trolling and limit any potential negative impact that my students could come with. Because again, I think it can be really easy for someone of my status and my stature and the privilege that I bring to the classroom to think “Yeah, it’s important. You need to know Twitter… and the trolls… just ignore them” and blah blah blah blah blah blah. but it’s also important I think for us to recognize the dark side of Twitter… and the dark side of social media… and there’s plenty of dark side. That doesn’t negate its usefulness to students or its usefulness for pedagogy or a research community. But, I think it’s something we always need to be aware of and always ready to jump in. What it comes down to is keeping the students’ health and safety… and mental health… physical health… safety… well-being… all of that…number one. Everything else falls below that.

Rebecca: That raises some questions about privacy issues. Some students maybe already have a private Twitter account that they’re using and maybe have a persona established that your class assignment might not fit in with it. It could be a student who’s undocumented who really needs to protect themselves… or there’s a wide variety of circumstances. Maybe it’s personal safety. How do you handle those situations if you’re really focusing on social media as a way to communicate out and establish this larger community when we certainly know that there are people who need to be protected in those environments?

John: …abusive partners and so forth.

Rebecca: Yeah.

Brian: Absolutely… and that’s something, again, it has to be at the forefront when you think about these platforms. So, speaking kind of individually, and how I do it, they can create a Twitter account specifically for a class that they’re taking. So, it might be you know JohnSmith319 (the course is JLM 319) and that’s fine. I tell them you can create your own account for this site for this class. You don’t need to tell me your own personal Twitter account. It’s one of the reasons why I really only use Twitter… because it is easier to create a professional accounts on that… and it’s one thing that I’ve struggled with. Because, as I said earlier, I want them to think about using Instagram and using Snapchat as journalism tools. I think that’s really important for them. I think it’s really interesting for us as a news industry. I don’t want to follow them on in those platforms… and they don’t want me following them… and I don’t want that… like from privacy… just to don’t want your professor seeing what you’re up to and I don’t want to see that… and I do take that very seriously. So, it can come down to “Create your own accounts for this site.” I’m always open and I try to tell my students this and this conversation is making me realize I probably need to be more explicit about it. So, thank you for that. But, I do think it’s important to say “I don’t need to know any details, but if there’s a situation… domestic abuse… some sort of issue like that… obviously, don’t have to tell me you’re undocumented… but, if there’s something that’s going to prevent you from comfortably using your identity, I’m open to having a conversation and want to have a conversation with that.” ‘Cause at the end of the day, student safety is much more important than “Hey, you did this Twitter assignment well.” But, I do think that it’s important to navigate. it’s important to negotiate that. The online world can be a really scary place for people who don’t look like me, to be blunt.

Rebecca: I think the other challenge can also be maybe they’re comfortable telling you that they need to have a special circumstance set up, but then what did they tell the rest of the class, or how do you protect an identity to the rest of the class or that circumstance, when they’re involved in this really public discussion?

Brian: On Twitter, you can create lists, and I try to create lists of everyone’s Twitter handle on class, so that people can follow each other and interact with each other. But, if [a] person has a special instance that they need to create a more anonymous Twitter handle for class, that’ll just go on the list, no questions asked. I don’t bring it up. I don’t necessarily call them out on it. I’ve been fortunate. I’ve never had this come up, but it’s good to think about, and it’s good to kind of have in mind. The larger point would always be as a professor, and this gets in a wider pedagogy… the idea of flexibility and the idea that to be student safety student centric is first… and that’s got to be first and foremost in our decisions and in what we do… and I think there’s just some level of compassion and empathy that has to go into what we do in all these decisions… and I think social media and using it fits right into that.

Rebecca: I think sometimes our own privilege prevents us or blinds us from thinking through all the potential circumstances like you mentioned before. I know that the first time I really started thinking about this sort of thing was when a student didn’t want to publish basically a little biography assignment in my web design course. They didn’t want their information in a public realm like that and I hadn’t really considered that before. Well, what does it mean? Well, if you don’t make it live, then you don’t know how that process works. like how do I make sure that they can do all of those things?

Brian: So, what did you do in that situation?

Rebecca: I made a special circumstance. But what I do now, more so, is make sure that there’s a… not so much a policy, but it’s kind of a policy. I put in my syllabus… about being civil in the classroom… what that means… what the expectations are… and also bringing forward some of the issues that people might experience that people might not be aware of… and just putting that out there. A person might have this circumstance or that circumstance or this other circumstance and we need to protect everybody and we all need to have a safe place to learn. So, I write it in the syllabus and I also talk about it in a way that I never had done before.

Brian: I do think acknowledging it like that I think is such an important good dialogue to have with students. Because you’re right. It forces us as professors, but it also forces students, to confront their own privilege. That builds empathy… that builds understanding of “Oh, I see. I’ve never thought of it that way.” Well, of course you didn’t. Your experience is very different. But now we see the world through different lenses… and that’s good…and I think that that’s a really good way of looking at it and of thinking about these things.

Rebecca: Can you talk about a moment when you’ve used social media with your students where you’ve seen a big moment of learning? I was remembering some of what we had talked about previously about interacting with speakers who have come to campus or other things.

Brian: What I have seen is, I teach a sports writing course so I have a lot of guest speakers come in from the industry that I know from my career and it is always wonderful when you see a student after they come in several weeks later and they’re working on a story or they’re working on a final project or something like that, and they connect with a person that they had talked to. They came into the class, they tweet at them, or they ask them a question and there’s this connection and interaction. I do love seeing that because it shows they’re paying attention when they guest speaker was in, which is always a roll the dice, but it does show, I think, one of the things that benefits especially from a journalism standpoint that social media can do it’s that connection which is for the audience but with sources and so now I can get in touch with this person who writes for The New Yorker or who writes for ESPN even though I’m a college student at Oswego I can still do this, I can still connect with them. I’ve moved away from using Twitter a lot that’s more auxiliary than central in the course. One of the assignments that I have my students do in my online journalism course is a social media scavenger hunt. I give them a list of eight to ten things and they have to create a story only on social media. It started on Twitter, I’m branching that out because it’s a much more visual story so it can be an Instagram thing. But I had one student, and it’s my first year teaching it, and it’s a Tuesday Thursday class, so what are they an hour 15, an hour 20? They have to complete this whole 10 item checklist in an hour 20 which is quite a deal because you got to go to the lake, go across campus and do all this stuff, it’s a big thing. What the student did was, and I still hold this up as the standard, they didn’t just go through and get a photo of this, photo of a student, photo of a professor, photo of the lake, photo of academic excellence, or whatever. He actually thought through and crafted together an entire narrative to the whole story and so when he presented it later it wasn’t just this collection of individual tweets structured on those shot sheets, he had told a story about it. I found that to be just really enlightening, wonderful for me, but enlightening because I hadn’t thought of it even in the way that he did. So it was wonderful to see a student take this and create an actual story and use this as a storytelling medium.

John: One of the things we often encourage faculty to do is to use social media to develop personal learning networks where we encourage people to follow influential people in the disciplines on Twitter or on Medium, or on their blogs, or other sources, and I would think in journalism, as you’ve mentioned, that could be really useful. Might that be more generally applicable though across many disciplines?

Brian: Oh I will defer to you guys on the other disciplines. But I do see that coming from a conference, I was just at the AAMC conference in Washington, and that includes journalism broadcast and communication studies and a whole lot of different disciplines. I do see incredible value in that from a scholarly perspective, so it’s not just more journalists weeding out the news or tweeting out reaction to what Trump said or something like that. We’re talking about when you have a network, and I’ve been lucky. I’ve developed a lot of friends who study online news, online journalism, sports communication, and from a scholarly perspective. What’s really great is you see reaction to news events from that scholarly perspective in real-time in social media. So it’s not just this thing happened and reacting to it now we can kind of understand it from a framing Theory perspective, from a uses and gratification point of view, or a sociology of news this is why it happens. And I do think it is incredibly important and useful for faculty in all disciplines. You can use social media to connect, to see what people are working on. There’s a movement about more public scholarship, more open scholarship, in progress scholarship, what you’re working on now. It does help me stay on top of the field a little bit and keep current a little bit instead of waiting for the next journal to come out every two months, or something else to see what people are talking about; it informs my current research. I’ve lost track of the number of study ideas that have come about because somebody says something on Twitter, somebody responds, I respond, and we go back and forth for like five minutes. Somebody says we should do a study on this, and we’re like, yeah let’s do it. And you connect and sometimes it works out sometimes it doesn’t work out, but I think that can be incredibly useful and I’m sure across disciplines you can still do that where you’re talking to people and it’s kind of like, at its best, then we’ve talked a lot about social media at its worst. But at its best, it can be like that hotel lobby at the conference, after everyone’s done and everyone’s kind of hanging around talking, and it’s the social hour. But now you have this, without having to spend your travel budget. You can do it you can keep up and talk through ideas and see what people are working on.

John: One of the things I’ve seen the last four or five years, is that a lot of conferences will have apps where for each session they’ll have not just a conference hashtag but they’ll also embed the specific session so that people can see in real time what’s happening in other sessions. I’ve been at sessions where I heard about something really cool happening another session where I’ve just snuck out the back and walked into another session because sounded much more interesting. You can’t always tell from this short abstract to what’s going to happen in a session and that ability to see in real time what’s going on, and to share that globally, where once you get access to that you can then see who the presenters were. Generally more and more conferences will have the Twitter usernames of the people who are presenting and then you can send them a tweet or contact them through email and ask for copies of the papers, so it does give you a lot more options for connections.

Rebecca: I was going to say, it’s really interesting that a lot of those conversations happen in private before right but now it’s public discourse that’s happening. And so it’s interesting to me to expose our students to that and invite our students into those conversations that we’re having with our colleagues so that they’re not just having conversations with us or their faculty at the particular institution that they’re at, but now they’re having conversations with faculty at multiple institutions and scholars or practitioners in the field which I think it can be really powerful especially if those individuals are willing to engage with your students as well.

Brian: Right. And John, getting at your point, the conference I was at I was had a session yesterday, and it was a panel discussion and I streamed it on my Facebook page, I should have done it on Twitter to get a bigger audience but I did it on Facebook. It was specifically requested, I had friends of mine from other institutions who weren’t at the conference, who knew this panel was going on, and say would somebody stream it? And I did. I think that’s incredibly useful especially at the conference set up because we’ve all been to conferences and they’re great and they’re fun but how many times does it feel like, to you guys, that the research presented just dies in the room? Not in a bad way, but like you present and you have a discussion, but doesn’t always travel beyond those walls or it doesn’t have an audience beyond who’s in the room. And whether you’re streaming it through a live stream or you somebody’s live tweeting it using a conference hashtag, something like that. I think that especially when we look at the rising travel costs and rising conference costs, and Rebecca, you make a great point about bringing our students into these discussions as well. They get experience they get to see the work we’re doing as scholars and they get introduced to these ideas, again this is social media at its best. That democratization of information that’s not just, hey I got accepted to this conference and I have the travel budget, I can go and hear these big ideas, now everybody can hear those big ideas and build on them.

Rebecca: Such as the democracy of ideas, either it’s providing this access or a secret handshake into the community, if it’s a discipline that you don’t know that much about or how to get into it, platforms like this can allow a doorway in for someone who might not otherwise have access.

John: And this isn’t just restricted to traditional research. I have several musician friends who when they’re in the process of writing in new songs will sometimes livestream a recording of it and get some feedback from people immediately which you wouldn’t hear otherwise until they released the final product a year or two later often, it can be a lot of fun.

Rebecca: How do you see social media use in the classroom impacting the relationship between students and faculty?

Brian: That’s a really interesting question and a really good one. Again, I come at this like most straight white cisgender male. I have seen really nothing but positive impact on it. I think it helps when you’re active on social media, now it should say, my Twitter is much more professional place, so I do a lot more journalism, a lot more sports talk stuff there, so my students follow me, I follow my students, especially for class and that happens. The other platforms, Instagram and Facebook, I do not friend students. If students friend me and I know them from several classes, and especially if they’re juniors or seniors, sometimes I will friend them while they are still in school after they graduate it will go back and forth. I never friend a student, I never send a friend request to a student on Facebook or Instagram. I think that’s crossing a line that I’m not comfortable crossing and I don’t think they would be comfortable crossing as well. But I do think not just being on social media but being active and being willing to have a conversation with students, this is very similar to the ideas that were in the small teaching book from last year. The five minutes before class, where you talk to students about the weekend or about the movies that are out or music or the game over the weekend or whatever and just make them comfortable, get them in a setting for learning I think that that extends well on social media. And I think that I’ve been lucky with the students I’ve had, but I also do feel like it does help build that connection and build that rapport with them. I’ll post pictures a decent amount of stuff about my daughter on Twitter. I do that because I’m that annoying proud dad who thinks his daughter is amazing and weeds out stuff about her all the time. But I also do think I’ve thought about this professionally and I think it is important, I teach a sports writing class, that’s a lot of guys in that class that’s a lot of men in that class and I do think it’s important that they see a man who’s into sports who loves sports a lot of these traditional masculine ideals, playing with his daughter talking about musical theater, talking about these non sports things, I feel like that’s an important part of what I can bring to the table and I think that can help build relationships and show students that just because you’re into sports doesn’t mean you have to absorb this toxic masculinity that we see in sports a lot. I have developed good relationships with students through Twitter and then that carries over. I will say, I haven’t thought about this you analytically, but I do believe the students that I get along with well on social media are the ones I get along with well in person. I don’t know, there’s not a lot of the online disinhibition effect, where students are gun shy is class but are outspoken on social media, but if you allow yourself to be active and be open on social media, it doesn’t have to be all personal stuff either, you don’t have to post pictures of your kid. But if you post pictures, post the stuff you’re working on or the stuff you’re interested in. I think that that’s just a natural bridge to students. Anything that helps them see us as people and not as this professor-type person in front of the room was in charge of their grades, but we’re people as well. That’s what creates a good relationship. I think used properly, always the caveat, but used properly, I think social media can help do that.

Rebecca: It’s kind of interesting over the last few episodes that theme has bubbled up unintentionally; the idea of demonstrating your humanness as a faculty member in a wide variety of contexts, but that students are able to learn better when they can see you as a person, and you’re a person that makes mistakes, that you experiment etc., and you also learn.

Brian: Right, exactly. There’s a certain transparency to it too. I’m not hiding behind the curtain of what I’m doing, this is what we’re working on, this is what we’re gonna be talking about in class today, get ready for it. Or something like that.

John: Do you want to talk a little bit about the meme war?

Rebecca: I was surprised that when we asked what you do in your classes you skipped over it you didn’t mention it.

Brian: You save something for the end of the podcast, I figured. The meme war is an all credit to this idea goes to my good friend, Dr. Nick Koberstein, who teaches at Keuka College in the Finger Lakes. Our kids were Montessori classmates, that’s how we got to know each other, and we follow each other on Twitter. I saw him doing this and I thought it was a really fun idea and so I co-opted it myself. If you go to Twitter and search for Moritz meme war you will see this. So, it starts from the premise of by the last week of the semester everyone’s kind of miserable, right? Especially, I found the fall semester, there’s no real break. Like November’s just a slog, you get the Thanksgiving and then you come back and there’s like a week before classes, the weather’s starting to turn and Christmas is in sight but it’s just that time of semester where everyone’s ready to end it, and so I always tell my students, okay so what’s your motivation level right, what’s your confidence level how you feelin, and everyone’s kind of like what’s your stress level? Everyone’s like, 14 a scale of 10, and so I introduced this Moritz meme war it’s just the thing I do on Twitter to have fun. The rules of Moritz meme war are, they have one week the last week of classes, in each semester, and they have to post two memes to Twitter with Moritz meme war. One of them has to be at least somewhat tangentially related to the course material ideally, it is something straight out of the course, but there’s a lot of leeway. The other one is wild card, literally that’s all I tell them, wild card. And they have to post two memes to Twitter with that hashtag. And again, they can use a professional account, they don’t have to use a personal account. If they’re not on Twitter and don’t want to do it they can email it to me and I will post them with the hashtag as well so it breaks that barrier if you’re not involved with it. Any student who does that gets three points on their lowest grade at the semester. That’s the carrot at the end of the stick; you post it you get three points. I do this across all three of my classes. The one tweet that gets the most engagement; the most retweets, the most likes, that person gets five points on it, to kind of encourage a little more creativity and give it a little more stakes. You can look at it, I mean it is a lot of fun. They use that wild card too, I think as the kids would say, drag me a little bit. There’s a lot of mocking my love of the Avett Brothers on there. Apparently I talk about them a lot and they mention that. They bring up verbal tics I have in class that I didn’t realize I have or I didn’t realize that they noticed or something like that. At the end of the day it’s really something just to ease the tension, like it’s that last week, it’s finals, everyone is stressed out. Hey, you get an extra credit and you get to have a little fun on it. And Nick and I, Dr. Koberstein, the creator of meme wars, we actually presented a paper on this at the Blended Learning Conference at Bryn Mawr Pennsylvania, from our College, earlier this year, back in May and we talked about it, we’re actually considering writing a journal article about it. The kind of hook on it, and I did hear at the conference I was just at, about some research about this, that 10-week,10 to 12 week part of the semester, there is a noticeable drop in student engagement, in student motivations. I think Nick called it the third quarter drop off. Or, like, you’re excited at the beginning, you kind of plateau, and then you get around like the middle of November in the fog or with craters like that and so this is a way to combat that. We can overthink it a lot, again it’s a way to have a little bit of fun, it’s a way to engage with them, it’s a way to let them have some fun. They’ve been with me 14 weeks at this point you can have some fun with it. And one of the interesting things that I found on this, is I did it in one of my classes, you know, it’s just one of those classes that was really kind of quiet. We’ve all had that right? For some reason there wasn’t a lot of back-and-forth in the class. It was a quiet group. It was frustrating to me. We did the meme war and that class just took to that like a duck to water. I mean they were all over it. And so what I started thinking of is that in a way this presented this idea of latent engagement, which is a term I just made up. they were into the course they were just quiet or there wasn’t that one or two students who brought the class out of its shell and led them in discussion, but they were super into the material and I found that to be an interesting thing and again, we get back to this idea of privilege. I don’t know if a woman of color could do a meme war in class where they invite students to have a wild card, that’s just asking for trouble that straight white guy, me, doesn’t have to think about, and I acknowledge that. But it has been fun and not only do I have current students doing that but alumni will chime in, where was this when I was taking the course? Oh, can we have an alumni division on it? And they’ll post and my friends will get in on the act as well. Having them see me as a person and having that freedom to engage and freedom to talk about things, and then it’s not just very serious course material. This might be self serving on my part, I like to think it’s a good recognition on my part that, hey, this is a really stressful time for you guys, and I see that and I understand that, and yes, you still have your project to do and I’m not compromising on the work you have to do or on your deadline on this but, hey, I see that this is a hell week for you guys and that you’re probably not sleeping a lot ,and that you’re probably not eating well, or probably not exercising, you’re at your breaking point, let’s throw a little fun at this part of the semester.

Rebecca: So we always wrap up our podcast by asking, what are you gonna do next?

Brian: What am I going to do next? Why I should probably get started on my syllabi for the Fall since the semester is starting. In general, what I’m doing next is, research wise, I’m very interested in the website, The Athletic, which is a sports news website, which is an only subscription model; no advertising on it, and there’s no free access, you have to pay to read stories on that and so I’m working on several studies with that. In terms of looking at social media, I am very interested in what Instagram is going to become and turned into as a social platform. It was bought by Facebook several years ago so it’s copying a lot of what snapchat does and doing a lot of that. But the use of the story feature and Instagram, the use of this very visual medium, and it again, kind of getting back to what we were talking about at the start, it’s where our students and our recent graduates are. That’s the social media that they’re using. In news and in journalism we talk and think a lot about Twitter. Only about 20% of the internet population in the u.s. is on Twitter. It’s an incredibly small number when you compare it to other social media, and I just think, for me, where social media is going is what you see with our students when we talked about this earlier the “ephemeralness” of it, the visual nature of it. I’m fascinated with seeing what Instagram is becoming, how news organizations are using it, how students are using it. Are they using it to get news and to get information? I’m really interested in seeing and developing using Instagram more for news and seeing what can be done with that platform.

Rebecca: Well thank you. We’re glad that you’re able to join us to talk social media.

Brian: Thank you guys for having me this was fantastic.

John: Oh thank you. One other thing I’d like to add, as an addendum is, in terms of keeping up with professional development things, we do have the Oswego CELT Twitter feed which is good for keeping track of our releases of podcasts as well as providing live streams for most of our workshops.

Brian: Mm-hmm I’ve watched a few of them through your Twitter feed.

Rebecca: At least we have an audience of one. [Laughter]

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts, and other materials on teaforteaching.com. Theme music by Michael Gary Brewer. Editing assistance from Nicky Radford.

42. Flipping the classroom

Flipping the classroom is one way to dedicate class time to active learning. In theory it sounds great, but how do you flip a classroom without flopping? In this episode, Dr. Dominick Casadonte, a Chemistry Professor at Texas Tech University, joins us to discuss research and best practices related to flipped classrooms.

Show Notes

  • Camtasia
  • Mediasite
  • Bergmann, J., & Sams, A. (2014). Flipped learning: Gateway to student engagement. International Society for Technology in Education.
  • Sams, A., & Bergmann, J. (2013). Flip your students’ learning. Educational leadership, 70(6), 16-20.
  • Bowen, J. A. (2011). Rethinking technology outside the classroom. Journal of Music History Pedagogy, 2(1), 43-59.
  • Bowen, J. A. (2014). The Teaching Naked Cycle: Technology Is a Tool, but Psychology Is the New Pedagogy. Liberal Education, 100(2), n2.
  • Bowen, J. (2012). Teaching naked: How moving technology out of your classroom will improve student learning (ed.). Jossey-Bass
  • Belford, R. E., Stoltzfus, M., & Houseknecht, J. B. (2015). ConfChem Conference on Flipped Classroom: Spring 2014 ConfChem Virtual Poster Session. Journal of Chemical Education, 92(9), 1582-1583.
  • Stoltzfus, J. R., & Libarkin, J. (2016). Does the room matter? Active learning in traditional and enhanced lecture spaces. CBE—Life Sciences Education, 15(4), ar68.
  • Stoltzfus, Matthew (2016). Engaging Students in the Flipped Classroom (video)
  • Coats, H. J. (2016). A study on the effect of lecture length in the flipped classroom (Doctoral dissertation).
  • Casadonte, D. J. (2016). “The Effectiveness of Course Flipping in General Chemistry – Does It Work?” ACS Symposium Series, “The Flipped Classroom”, December 2016 (Book Chapter) The Flipped Classroom Volume 2: Results from Practice, Chapter 2, pp 19–37, Chapter DOI: 10.1021/bk-2016-1228.ch002, ACS Symposium Series, Vol. 1228, ISBN13:9780841231627eISBN:9780841231610,
  • POGIL.org

Transcript

Rebecca: Flipping the classroom is one way to dedicate class time to active learning. In theory it sounds great, but how do you flip a classroom without flopping? In this episode we discuss research and best practices.

[Music]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[Music]

John: Our guest today is dr. Dominick Casadonte, a chemistry professor at Texas Tech University. Dr. Casadonte is recognized as a global leader in flipped learning by the Flipped Learning Global Initiative.
Welcome.

Dominick: Thank you very much.

Rebecca: Today our teas are:

Dominick: Well, my usual afternoon beverage is an iced green tea with three pumps of raspberry, but since I’m getting over a cold, today I’m drinking a hot green tea with vanilla, lavender, and honey.

Rebecca: That sounds really nice. Finally, a tea drinker.

[LAUGHTER]

John: I’m drinking Irish Breakfast tea.

Rebecca: …and I’m drinking chai today.

John: You’re recognized as a an expert on flipping the classroom, and you’ve been doing it for a while. Could you tell us a little bit about what a flipped classroom is?

Dominick: Sure. The usual paradigm, if you think about it with regard to teaching, is lecture, homework, lecture, homework, lecture, homework, tests, lecture, homework, lecture, homework, and so on… and the problem with that format is that it’s not conducive to deep learning… with the exception of maybe very bright students or very bright asynchronous learners. Trying to keep up with a lecturer is often difficult. A student, for example, may not have gotten down everything that they wanted to write down… they may not have gotten it down correctly… or it might be fragmented… or perhaps they just didn’t understand well enough to write it down in a meaningful way, or a way that’s meaningful for them. Then they try to go home and they try to do homework, but since they didn’t really understand the lecture in the first place, the homework is again difficult and they might only be able to work part of it. So then, the very next day, there’s a new lecture and a new topic. The normal sort of didactic approach to education often leads to what I’ll call fragmented learning, in the sense that there isn’t enough time in class to practice many of the active learning strategies that work so well because faculty are so concerned with getting the lecture done. In the flipped model, on the other hand, we flip the homework-lecture-homework paradigm so that the students’ homework is to watch a lecture online. Now it can either be PowerPoint or a video and different people use different techniques. It can be done on Camtasia, it can be done through Mediasite, it can be done through a variety of different platforms. It could be done on YouTube for example. So, they’ll watch usually a video or a lecture online before they come to class, and then they may or may not do online homework prior to coming to class as a part of the pre-class experience. Then, once in class, time can be spent, for example, checking the students knowledge… clearing up muddy points or any misconceptions they might have… working advanced problems. But now, in this particular case, class becomes more of a discussion and you can use a lot of the active learning strategies that really engage the students in learning the material. By flipping the classroom, we freed up time to really engage and interact with our students and it helps with their learning in significant ways which I can talk about later.

John: So, in a traditional class, you tell students what the content is in class, and they come in with very different backgrounds and some of them are able to pick it up, others get lost along the way, and then they’re sent out to do homework… where students seem to have the most difficulty on homework or tests… and we’re pretty much leaving them alone to do that. But, here in the classroom, you’re able to work with them and help them through some of the issues.

Dominick: Right… and so, for example, in the classroom with homework, now they have a mentor who can help them work through the more difficult problems to help guide them along. There are models of the flipped classroom where there are peer mentors in the class who can help and walk around and mill around as well. So, there are opportunities for group work. There are opportunities for group discussion. You can engage the topics in a much deeper way than you can by just simply lecturing at students. So, it’s a very very non-passive way of teaching.

Rebecca: What prompted you to get into a flipped classroom model?

Dominick: Desperation, I would say. [LAUGHTER] I first started teaching an online class in the fall of 2007 as part of a multidisciplinary science master’s program of which I was a part here at Texas Tech… and getting everyone on the same platform at the same time, my thinking was that lecturing to them live online was a waste of time, basically. The question that motivated me was the same one that motivated John Bergmann and Aaron Sams around the same time at the high school level up in Colorado. Namely, what could I do to use my classroom time more effectively? What could I do to use my online time more effectively? …and I thought, “Well, let’s take the lecture out of the classroom.” So, I pre-recorded my lectures. I had the students watch the lectures before we got together in the online environment, and then we spent the majority of our time having discussion and working problems…. and these were teachers at the time and they were very very enthusiastic about the ability to actually discuss the material that they were trying to learn… and so then I thought “Well, hmm, if that works really well on an online format why don’t I try it face to face?” …and so then, starting in 2008, I adopted this to my general chemistry class. The following summer, a high school teacher that I had as part of a workshop said “Oh, I see you’re flipping your class” and I said “Flipping, what’s that?” ‘Cause at the time, there were a lot of different terms for flipping. It was called: time-shifted instruction, reverse instruction, blended instruction, all sorts of things. Flipping is a term that’s really sort of stuck.

So, I started out of a sense again of “How can I engage my students more effectively in the classroom?” and once I realized that it worked swimmingly in the online environment and then I said “Well, okay, will this work in the face-to-face?” …and it worked even better there. By that point, there are pockets of people around the country who are doing this, and they used all sorts of interesting terms. Jose Bowen at SMU, who’s an art professor, used the term “naked teaching” because it can be unsettling when you walk into a classroom and not have the comfort of your lecture notes to be able to project or read to the students. So, very often I will walk into the classroom and say “What are we going to talk about today? or “What would you like to talk about today?” You can’t do that unless you feel comfortable about the subject material and you have some expertise, but it’s a great way, in the long run, to really, really impact students.

Rebecca: You mentioned both doing this in an online environment and also in the classroom. Is there a difference between your experience in both?

Dominick: Yes, it’s so much easier face-to-face. To be able to walk around to gauge what’s going on in the classroom, their level of understanding, and how learning is happening. The power of direct peer-to-peer contact should never be underestimated, I think. Now, in the online format, my focus was more on the development of a learning community working on a particular topic, rather than in peer-to-peer mentoring and things like that. So, they’re very different approaches, but you do develop a sense of community in both, I think.

John: Now, with your online classes are they synchronous or asynchronous?

Dominick: My online classes are synchronous, in the sense that everybody meets in one place at one time. We have various software programs that allow us all to be in the same place. Yeah, so they’re all together at one point, and that’s kind of interesting because I have people from all over the country who are taking these classes. They’ve never actually physically met, at least for the first class that I teach. It’s interesting trying to, in the discussions, get a sense of the personalities of the people who were providing discussion.

John: Are they participating in video formats or is it just audio or text?

Dominick: I’ve done both. I’ve done video and audio and depending on the bandwidth and the number of students in the class both can work well.

John: How large are your classes?

Dominick: Well, my online class had 24 students in it. So, a fairly large, I think, from an online perspective class. It wasn’t one of these very very large classes like you might see at MIT, for example, but 24 is a good class in terms of bandwidth… trying to get everybody in the same room at the same time… and my face-to-face classes… they’ve ranged anywhere from a low of 25 to a high of 150.

Rebecca: You mentioned two different techniques that you use both in online versus in person. So, online you mentioned community formation and then in person you mentioned peer to peer. Can you expand upon each of those?

Dominick: Yeah, my first adage for teaching is know your audience, and in the face-to-face environment I was working largely with in-service teachers who were trying to develop a more significant content knowledge of chemistry, and so there the idea was the development of a supportive community where these teachers could bring their ideas to the table in terms of not only the content that I was teaching them, but also how they could then apply that content in their own classroom settings… and in that regard they were able to help teach each other techniques that they could use in the classrooms based on what they were learning in terms of the content. There really was a community focus, sharing knowledge as opposed to just gaining knowledge. In the face-to-face classroom, it’s more a sense of the students trying to understand the content at a deep level. There I found that it is true that when you teach something you really hopefully really understand it and so peer-to-peer mentoring is much more effective there. So, we tend to work in groups… we tend to work with dyads… two people working next to each other… and then sometimes I will just have people go to the board… but once again it was in that context of community because I think it’s very important, if you’re going to do flipping, and do it well, that it’s an active, encouraging, engaging classroom experience. If my students go to the board, whether they get the problem right or wrong, the class gets into a habit very very quickly of applauding the student for their attempt… whether or not it’s right or wrong… and then we debrief. We talk about what works… what doesn’t work… So, it really is both peer to peer and community building there as well. But, the emphasis is more on the individual in the face-to-face classroom, I think.

Rebecca: It sounds to me a little bit like the choices that you’re making online and in-person aren’t necessarily because of the medium, but rather who’s in those particular classes. Am I hearing that correctly?

Dominick: That’s right, and one of the nice things about flipping is that it is such a rich environment in which to work. As I mentioned earlier, the pre-class videos can be video lectures, they can be audio lectures (if that’s appropriate), they can be PowerPoint presentations, they can be any number of things. In the in-class experience, it’s an active learning environment. so you tailor it to the people in the classroom. For example, if you’re trying to teach in a flipped environment of the class of 24, there you can do all sorts of things that promote individual learning in ways that it’s a little bit more difficult to do in a class of 300, for example. But, I have a good friend, Matt Stoltzfus at Ohio State, for example, who routinely flips like general chemistry class of 600 students, and he’s able to give them as close to a personal learning experience as one can, I think. The point that I’m trying to make is that the flipped environment is a very rich one and it allows you to tailor the learning experience to your class specifically.

John: Do you create your own videos or do you use ones created by other people?

Dominick: I actually create my own videos. I have my own recording studio in my office… I have a Mediasite setup…. I have a video camera… I have a document camera… and I have a wonderful microphone…. and so every couple of years or so I re-record all of my videos. Now, I do use a mixture of other formats. So, for example I do have post-video homework that the students have to do online before they show up to class… and that’s done using an online learning platform that we have here at Texas Tech through a national distributor. The advanced problems that we work in class come both from the textbook that we use and also from problems that I develop. So, it’s sort of a hybrid. But, the pre-lecture videos I actually produce…… and one of the things that studies have shown is that students develop a certain sense of identity with regard to the person teaching the class. Some people, when they’re starting to flip, might want to just use Khan Academy videos, for example, or things like that. But the studies show that the class wants to see folks on the videos (or your voiceovers if you’re using PowerPoint with voiceover)… they want to see the professor who’s teaching the class, because that’s their professor… and so they develop ownership, if you will. Plus if you’re using other media, for example a Khan Academy, they may not be teaching it exactly the same way that you want to teach it, and so then you have to either reteach or undo. There’s a quality control issue there. So, it’s just easier, if you’re gonna do flipping, to make your own videos… and there are so many different ways of doing that now that there’s really no excuse.

Rebecca: That had been my experience as well when I’ve done videos in my classes. The students really liked the quirkiness or knowing that it’s the same person that they had in their classroom and if you try to slip in something else occasionally they really didn’t like it.

Dominick: …and a lot of people have a perfectionist tendency and really want their videos to be really super perfect. Well, once again, studies have shown that that’s not really what students want. They want to see the foibles. They want to see you as you are. If they know that you’re going to say “um” or “uh” in the classroom then if you don’t say “um” or “uh” in your videos, then they’re gonna say “Is that a robot teaching the class that looks like my professor?” So, it’s okay to be human when you’re doing the pre-lecture videos. But, I think one of the things that often hangs up people when they’re starting to do flipping is this notion that it has to be perfect, and it really doesn’t.

Rebecca: I think they really appreciate when you make mistakes and things, too. I know that my students did when I do like a coding mistake, I’m like “Whoops, I made a mistake..” and go back and fix it and explain what I did and why it was wrong. We all make those kinds of slips and errors and things and we would do it live. So, it’s kind of nice to do it in videos, too.

John: It makes you seem more human by doing that.

Dominick: One of the nice things about them seeing you make mistakes is that it gives them permission to make mistakes. They don’t have to be perfect. I’ve had experience with students in classrooms where they come in and they’re intimidated… they’re shy… they’re just afraid that they can’t master the materials. So, seeing somebody make a mistake who is an expert gives them permission to make mistakes… and one of the things that that really does is it empowers them to learn, because at the end of the day when somebody’s trying to learn they’re going to make mistakes and I give my class permission to make mistakes. In fact, I tell them you have permission to make mistakes while you’re learning. After you’ve learned something, that’s a little different. If you’re an engineer, for example, and you’re building a bridge, I don’t want you making mistakes. But while you’re learning… absolutely, make mistakes. Part of education is this movement from novice to expert and in that process one makes mistakes. So, I told my class “You have the right to make mistakes” and I use an example. So, let’s say you’re a five-year-old and you’re trying to learn how to ice-skate you fall down, what does a five-year-old do? They laugh, they brush themselves off, they might giggle a little bit, they get up and then they just skate some more. Now, imagine you’re an eighteen year old and you’re learning to ice skate and you fall down. Most of the time, people stand up and say “Did anybody see me?” and they worry about what people are gonna think, instead of just getting up, laughing, and moving on. So, what often happens is the 18-year old never learns to ice skate, whereas the five year old, who’s willing to make mistakes, learns. So, I tell them it’s okay to make mistakes while they’re trying to learn… and also it’s about empowering students to be able to have confidence in themselves… and we talk about this a lot. We did a study of what motivates students in the flipped environment, and part of it is the confidence… the autonomy… that they develop in the flipped environment. When they really think they’ve got and they really understand, there’s a certain level of “Geez, I understand this. I can understand the next thing…” and so on and so forth. That sense of confidence really improves their educational experience.

John: How long are your videos? Do you tend to have very long ones or do you chunk them up into smaller chunks? and what would you recommend in terms of video length?

Dominick: We did a study a few years ago on the optimum length for flip videos, and it came about because our book dealers: McGraw-Hill, Prentice-Hall, Cengage… those are the top three that we have here at Texas Tech… were telling us that they were creating videos and they’re creating these five to seven-minute videos… and I said why are you making five to seven-minute videos?” and they said “Well, everybody knows that the Millennial generation has a five- to seven-minute attention span and so they want five to seven minute videos.” I said: “But, what is best for learning and improving learning outcomes? I don’t care what their preference is. What’s best for them to learn?” He said “Well, we don’t know.” I said “Well, do you have any data or evidence that shows the five- to seven-minute videos are really great for learning?” and they said “No, but we would be interested if someone would do a study and tell us.” So, I had a graduate student who embarked on a study of lecture video length. We set up essentially short video people… those are people to watch five to seven-minute videos… and we did this with master videos, so each video was probably 40 minutes to an hour long. We put stop signs in the video and when they hit a stop sign they would stop. They would work some online homework and then they could pick up again… or they could go off and do something else. but the short videos were five to seven minutes and then we had a long view group, as it were. We allowed them to decide which videos they wanted to do and not surprisingly, 62% decided to do short videos. So, I have no problem with the book dealers’ notion that Millennials prefer shorter videos. But, then we let the semester go on and we didn’t force them to stay into one group or the other. We let them move and we watched their video habits. We weren’t video stalking them, but we could watch their lecture habits using the Mediasite analytics down to the millisecond.

What we found was that 60% of that short video group switched to the long video length, which is very surprising to us, and we did also a variety of assessments. We looked at online homework grades. We looked at quiz grades. We looked at exam grades. We looked at final exam grades. We looked at the American Chemical Society standardized tests that we give as a pre-post and what we found was that there was a subgroup of the long-view group that watched the video as a long video, but then they stopped at specific points to either have a snack with a friend, go to the bathroom, whatever they needed to do… and we called them the long pause people. It turned out that in every assessment that required global understanding… so final exams, ACS exam individual exams… the long-pause viewers actually scored one standard deviation higher than the short viewers. In fact, the short viewers had the worst learning outcomes of all three groups. Then we gave them Likert scale questionnaires, and we also gave them open-ended questions, and we said “Why did you make the switch? What do you find?” and they said “Well, it just got too fragmented to look at these short videos and we couldn’t take what we saw in video A and connect it to video B and so on and so forth, especially if several hours had gone by, because we then had to go back and watch video A again to remember what we forgot. But, if we did the long videos we were able to just put it all together.” Also in that we found that the best optimum video time. So, what constitutes a short video versus a long video for Millennials is 20 minutes or less is short, 30 minutes or more is long. So, 20 to 30 minutes is the sweet spot for video length. That’s what the study showed us and we’ve just submitted that for publication.

Rebecca: Have you adjusted how you’re teaching based on that information?

Dominick: Yes, my videos are roughly in the range of 30 to 40 minutes, but I tell my students “Take the time you need. Take breaks. It’s going to help your learning outcomes.” I also share with them the results of our studies, because I think if you’re going to, in my case if you’re gonna be a scientist, you should be data-driven. So we want our students to know that we’re not just telling them this because it’s something anecdotal, but rather it comes from data that we’ve collected.

John: Have you thought about controlling for self selection and randomly putting students in groups? Because one concern I’d have with that is that it could be the case that those students who select the short videos might have done less well no matter which group they were in or vice versa… although you do have switchers in there.

Dominick: Yeah, I’ve actually been very lucky in my studies that I teach our honors general chemistry sections… and so I look at the SAT scores… I look at their previous class performance… and it’s a very very, as much one can have, a homogeneous group. So there’s really not much of a selection bias, I think, as far as the study goes.

Rebecca: You’ve also done some research on the flipped classroom approach in general, not just the video length. Can you share some of your findings?

Dominick: Sure. We found out a lot about the flipped environment over the past 10 years or so. As I mentioned a minute ago, I’ve been very lucky in that I tend to teach very bright students. I did a five-year longitudinal study on the effect of flipping which has been published in American Chemical Society monograph and we found that the average exam grade increased by 9.2 percent over that five-year period, and that the largest gains in learning came during summative assessments (for example during final exams and externally developed independently normed exams like our ACS exam). We also have done work on what motivates students to do well in the flipped classroom and we just recently presented at the biennial conference on chemistry education regarding the effectiveness of peer mentoring during the flipped classroom. The results there were very astounding to me. It shouldn’t have been because peer-led team learning has been around for more than 15 years, but nonetheless, in trying to tweak the classroom, the addition of the peer mentor took what was already much better than had been before and improved it dramatically. I’ll give you an example. On the American Chemical Society end-of-term exam, without the peer mentor present… So, I give my students incentives if they score above the 95th percentile on that exam, and it’s a challenging exam, they get an automatic “A” in my class. They don’t have to take the final because this exam is normed against thousands of students around the country in a variety of different university settings. Pre-flipping, I had zero to one student scoring above the 95th percentile; post-flipping the average was roughly nine. So, it increased tremendously. With the presence of the peer mentor, the number went from 9 to 34 and so almost a six-fold increase in the number of students scoring above the 95th percentile. The only difference being, since I used to run the discussion sections that I subsequently allowed the peer mentor to do, that was really the only difference in the environment as far as I could see in terms of controlling for the different factors, except for the obvious one of different students. But she did this in the fall of 2016 and the fall of 2017 and there were 34 in one in the fall of 2017, 33 in the fall of 2016. The percentages of the class actually increased. This is kind of reproducible, if you will. So, we’ve looked at a variety of different things, and with regard to motivation we looked at that from self-determinacy theory and found essentially three things that really sort of motivate people: one is autonomy, second is pace, and the third is responsibility.

In the flipped environment, this sense of autonomy… the sense that “Oh yeah, I am really learning something” is very important to the students. The pace, the fact that they could watch the videos in their pajamas, for example, was very important to the students as a motivating factor… and responsibility, the fact that they had to take responsibility for their own education as opposed to being sort of spoon fed in a lecture format was something that motivated them as well. That student just graduated in December, so we’re now preparing that for publication. So, we looked at a variety of different aspects of flipping.

Rebecca: Can you clarify about your peer mentor model? The students are watching videos outside of class, and then they’re coming to a class with you, and then also recitation session with another student?

Dominick: They watch a pre-lecture video. They do online homework. We have a class discussion… work problems… and then there’s a separate recitation section… and historically I have done all of that. I had a very bright student who really wanted some teaching experience and she said “Would you let me run your recitation?” and I, like many faculty perhaps, don’t really want to give up control of my classroom environment. So, it took a lot of cajoling on her part to get me to do that…. and I said “Well, let’s look at it and see what happens.” She took over the recitations and… talk about a motivated young lady… she would provide review sheets for them… she would do all sorts of things that I would do, but the way she would do it, I think, spoke to the students so much more effectively than I was able to do. I think that’s one of the real reasons why their scores went up.

Rebecca: She knew how to meet them where they were at in a way that, as we become more of an expert in our field, we lose touch with that.

Dominick: Yeah, that’s exactly right. So, one of the things that I’ll be interested in following is that there was a recent study that Prentice-Hall published about the Millennials versus the Gen Z students… and one of the things they noticed is that, while there was about a sixty or so percent “like” amongst the Millennials for using computers and computerization and video and things like that, that number was almost half for the gen Z population. It’s almost as though it’s such a normal part of their life, the gen Z population, that there’s nothing special… there’s nothing unique about it… there’s no value-added to doing videos… it’s the sort of normal expectation. So, I’ll be very curious to see how this sort of flipped environment works over the next 10 to 15 years when the expectation is that they’ll be seeing videos at some point either prior or post classroom experience.

Rebecca: …definitely an interesting question.

John: You’ve organized several symposium on flipped classrooms. What are some of the biggest takeaways from those symposia when you bring people from many different disciplines together? Are the results pretty similar across disciplines or do they vary substantially?

Dominick: Well, I think the first thing that struck me with regard to these symposia is how diverse the flipped environment really can be. Since active learning occurs during the classroom time, there’s almost as many different active learning strategies as there are teachers, and so no two flipped classrooms are the same… and that’s the first thing that I learned. The other thing that I learned is that you have to be committed to flip. You can’t do it half-baked. If you try to do flipping, there was one example of a professor who said “Well, all this is is what we’ve always done. You tell the students to read the material before they come to class and then we have a discussion.” So, he said “Okay, I’m going to ‘flip my classroom’ and just have them read the textbook before they come to class and then we’ll have a discussion.” He found very quickly that the students weren’t reading the textbook, so there was very little discussion going on, which frustrated the professor and frustrated the classroom and set up more of an adversarial relationship.. and it was the worst teaching experience he ever had and he said “I’m never going to flip my classroom again.” So, one of the takeaway messages, and this was reported at one of the symposia, is that if you’re really going to flip your classroom, you’re in for a dime, you’re in for a dollar. You do it as well as you can and be very concerned about what you’re putting in and what you’re expecting to get out or it can be a very very bad experience. Now, I will say this, that almost everybody when they get up on board the flipped bandwagon, especially if you’re using technology prior to classroom, it’s hard at first. That’s the other real take-home message. It takes a lot of time to flip your class the first time. But, once you do it, it actually is much more enjoyable. It’s actually easier, I think, than the regular didactic approach. Those are some of the take-home messages.

Rebecca: Can you talk a little bit more about some of the other challenges faculty might face if they’re doing it for the first time?

Dominick: Sure, yeah. The first and biggest challenge that people have is time. Don’t decide you’re gonna flip your classroom two weeks before the start of a semester. It can be the most horrible experience you’ve ever had as a teacher, because students have an expectation that each lecture is going to be there for them. As we all have various things come up or university requirements… meetings… things like that… and you may find yourself at 3 o’clock in the morning trying to record a video for dispersal at 8 o’clock in the morning. So, don’t wait till the last minute. That’s the biggest sort of thing. That’s one of the reasons why people are sometimes a little bit risk-averse with regard to flipping their classroom.

Other things that have come up: saying “Oh, I can just use Khan Academy videos or videos that are on the web” …and they haven’t previewed them, for example, and then they find that the students have a very different concept of the material than the professor has and then you end up spending a lot of time: “Well, which one do we believe? Do we believe the video that you showed us? or do we believe what you’re telling us?” and so it can create an environment which doesn’t propagate trust in the learning experience. Other issues are: online homework versus homework that you put together for the students… what are you gonna do during class time? how are you gonna fill that time. If you’re not familiar with active learning strategies, that can be very daunting. For example, you walk into a classroom and the students have already watched a video… they’ve done some homework… So, what’s your value added? If you’re not used to active learning strategies, that can be very difficult the first time that you’re doing it…. and then do I need to change my assessment strategy based on the fact that now I’m using a different kind of pedagogy? So, there are a lot of different moving parts and I think putting all those moving parts together can somewhat be inhibitory for people who are trying to flip for the first time.

John: What types of active learning strategies do you use? You’ve mentioned some group work on problems, but could you give a few examples of types of activities you use during the class sections?

Dominick: Sure, there’s group work first of all. I send students to the board. I’ll pass out file cards, for example, and ask the students to put down one thing that was unclear in the video or something that they really would like to learn about in addition to the video. So, it’s not just muddy points, but it’s also how do we expand and extend. Because in my case it’s an honors class and I want to give them a little bit more than the normal amount of material and experience, and so those are some of the things that we do. We have to make molecules and structures and do all sorts of things, and so I use human atoms. I have volunteers come up to the front of the class and they have to then make molecules. They have to develop particular structures. They have to show how they bond, how they vibrate, how they move. What they do. So, they have to actually sort of insert themselves into the molecular dynamic, if you will. They’re trying to understand that, as an atom won’t understand its environment. The first couple of times, students aren’t used to that level of kinesthetic learning, but once they get it, then I usually have a fair number of students who are willing to volunteer and come up. Because, while they’re doing that, we’re also discussing, and I’m asking the class: “Okay, so why is it that this particular atom won’t bond here? What’s wrong with this?” and so it’s a real discussion… but now using human beings as the models rather than just making stick figures or things like that.

So, I try to move students through a variety of different learning environments that engage them not only visually, auditorily, but also tactilely. and kinesthetically, and that’s somewhat unusual, I think, in chemistry classes. Because, once again, most people don’t think of chemistry as a visceral activity in many cases.

Rebecca: Actually, it sounds like a lot of fun.

Dominick: Well, and it is, and I’ll tell you I walk into my class the very first day and they’re all very respectful, because Texas students typically are very respectful and they’re honors students. So, they really want to make a good impression. I usually start my class laughing, telling them this is the last time this class will be quiet. A noisy class is a learning class, a quiet class can be a sleeping class, I don’t know. So, yeah, my class is always very, very engaging, I hope.

Rebecca: Have you ever had the moment when you’ve asked your students “What do you want to talk about today?” and then not have anything they want to talk about?

Dominick: Yes, I think every faculty member has that “Oh, my gosh” moment. I always come prepared with questions, so if they don’t have anything to talk about, then I’ll ask them “Well, what did you think about this particular part of the video?” or “Did you really understand this?” or “Let’s take this concept and move it farther” because one of the things I never do in my classroom is just do a rehash of my video. I figure they’ve watched the video. So, I might say “Well, okay, you saw this but how could we apply this in this other setting?” …and then if they really didn’t understand it, then I’ll be able to tell in a heartbeat whether or not there are real questions because they really don’t have a good sense of understanding… and then I can go back and say “Okay, at what point is this breaking down for you? How did this not work?” Silence kind of tells me that there is usually a breakdown somewhere… and so I try to address what that breakdown is and try to correct it. So, that’s what I meant earlier when I say one of the things I do during my class is try to clear up misconceptions… try to address muddy points… and just make sure that they really understand the lecture part as well. That can take anywhere from five minutes to 45 minutes. My classes are an hour and a half long. Depending on how difficult a lecture was… on what their level of understanding is… So, I want them to have deep understanding of the content and so if they’re coming in silent then I worry that that depth is not there.

John: When they see the videos, you have them take tests. Are the tests the same for each student? or do you vary the questions? Is there some randomization there?

Dominick: Well, no. So, we give departmental exams, so the exams are the same for every student, basically. I know many universities have a format and they can vary the numbers that are put in, for example, but no, my students really… they’re fairly separated when it comes to the exam, so I don’t really feel the need to give each one a separate numerical set of calculations.

John: …and it sounds like many of your students are honor students where that might be less of an issue.

Dominick: Right, and we have an honors code through the Honors College, and I tell them the first lecture if you’re cheating you’re out of here. If you’re cheating you’re out of the University… and I’ve had the unfortunate occasion to have students suspended from universities… not at Texas Tech, but at other places I’ve been… and so they understand that I’m very serious about that.

John: On those tests, do they have multiple attempts or just a single take on the test?

Dominick: Well, my tests are usually set up so that they’re half multiple choice, half free response. Because at the end of the day, I tell my students “Qe don’t live in a multiple-choice world… A. agree, B disagree… you know, we don’t… and so I need to know how you’re thinking. While multiple choice exams are expedient in terms of grading, they don’t let me know what you know. So, I give them both because some students like multiple choice exams. They think they’re really good at them. Some students really want the free response. So, it’s a mixture of both. I try to give them a rich assessment environment as much as possible.

Rebecca: So, to follow up on what John was asking, are your homework assignments kind of a multiple attempt to help learning? or is it a one attempt kind of thing?

Dominick: It’s a one attempt. Yeah. Now, what I do allow them to do after they’ve provided their answer, is that I’ll allow the question to be open so they can go back and review it, especially if the answer is wrong…. and I allow them to do that to help them review for the exams as well.

John: So, they can go back and retake it, but only the first attempt counts towards their grade?

Dominick: Right. So, they have to think about what they’re putting in there before they put it in. Because in some cases, I’ve heard stories of students who put a wrong answer in purposefully and then the online learning environment gives them hints or tells them how to work a problem just like that… and then they go back and they have another problem with just different numbers but they’ve already been coached essentially in terms of how to answer the problem. Once again, perhaps it’s because I think you have to do things right eventually at the end of the day, I really want them to get it right… and these are… once again… they’re relatively straightforward pre-class questions. Their designed as just-in-time or warm-up questions. They’re not multifaceted. The questions we’re getting in the class are really challenging problems. They’re challenging problems using an honors book. So, hopefully they differentiate between those.

John: Are they graded on the problems they do in class as well?

Dominick: They’re not. Because part of that environment, once again, is to have groups… have community… have a mentoring process… and so, the ultimate goal in that whole process is the solution of the problem. So, I’ve already tested them in the online learning environment. I’ll test them on the exams. I’ll test them on quizzes. But, in the class I want the process of how to solve the problem come forth and not the grade be the most important thing.

Rebecca: So, we always end or wrap up our podcast with the question: what are you gonna work on next?

Dominick: Well, I have a pretty active and diverse chemical education research group and with regard to flipping, specifically, I mentioned that I had a recent PhD who looked at motivation in the classroom and what we found there were there were basically three reasons that motivates students to want to do well: autonomy, pace, and responsibility. Through the flipped environment they learn how to develop confidence in their ability to learn, and secondly they liked that the class is largely self-paced and they get to watch the videos in their pajamas if they want to, for example… and finally they really appreciate the fact that they are responsible for their own learning. So, we’re going to be looking at the role of metacognitive intervention as an autonomy motivator in the flipped classroom. That is to say, if we help them think about how they’re thinking during the early parts of the flipped classroom, do they proceed to confidence in their ability to learn that much faster… and we’ll also be looking at how the flipped classroom, especially with community building activities and community building learning strategies can improve the learning outcomes among historically underrepresented communities in the sciences… though especially communities where the notion of family and community is so important in their lives… that are not necessarily in the classroom. So, those are the two areas that we’re going to be moving into with regard to flipping… and I have a number of other projects that are not related to flipping as well. So, it’s a very diverse group of questions that we’re trying to answer, but once again I think that the flipped environment is a very value-added environment for both the students and the faculty… and so I think it’s a mature pedagogy in the sense that we talk about process oriented guided inquiry learning (POGIL) being mature and peer led team learning activities (PLTL) as mature pedagogy. Service learning is another mature pedagogy that has matured over the last 20 years or so… and I think it’s now safe to say that flipping is a mature pedagogy. In fact, at the biennial conference on chemistry education, there was a wonderful paper doing a meta-analysis on flipping and the presenter showed that in terms of looking.. I think he looked at 18 or 19 different papers on the flipped environment… and he found that, in general, there’s about a 30% improvement in student learning outcomes and it’s even better in organic chemistry than general chemistry (which was surprising to me). But, nonetheless it really does improve learning for students and that, in the final analysis, is what we’re trying to do.

Rebecca: It sounds like some really interesting projects. We’ll be looking forward to finding out what you find out.

Dominick: Thank you.

John: Well, thank you. this has been fascinating.

Rebecca: Yeah, thanks so much for spending some time with us today.

Dominick: Thanks, I’m gonna have another sip of tea. Thank you.

Rebecca: Thank you
[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts, and other materials on teaforteaching.com. Music by Michael Gary Brewer.

37. Evidence is Trending

Faculty are increasingly looking to research on teaching and learning to make informed decisions about their practice as a teacher and the policies their institutions put into place. In today’s episode, Michelle Miller joins us to discuss recent research that will likely shape the future of higher education.

Michelle is Director of the First-Year Learning Initiative, Professor of Psychological Sciences, and President’s Distinguished Teaching Fellow at Northern Arizona University. Dr. Miller’s academic background is in cognitive psychology. Her research interests include memory, attention, and student success in the early college career. She co-created the First-Year Learning Initiative at Northern Arizona University and is active in course redesign, serving as a redesign scholar for the National Center for Academic Transformation. She is the author of Minds Online: Teaching Effectively with Technology and has written about evidence-based pedagogy in scholarly as well as general interest publications.

Show Notes

Rebecca: Faculty are increasingly looking to research on teaching and learning to make informed decisions about their practice as a teacher and the policies their institutions put into place. In today’s episode we talk to a cognitive psychologist about recent research that will likely shape the future of higher education.
[Music]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[Music]

John: Our guest today is Michelle Miller. Michelle is Director of the First-Year Learning Initiative, Professor of Psychological Sciences, and President’s Distinguished Teaching Fellow at Northern Arizona University. Dr. Miller’s academic background is in cognitive psychology. Her research interests include memory, attention, and student success in the early college career. She co-created the First-Year Learning Initiative at Northern Arizona University and is active in course redesign, serving as a redesign scholar for the National Center for Academic Transformation. She is the author of Minds Online: Teaching Effectively with Technology and has written about evidence-based pedagogy in scholarly as well as general interest publications.
Welcome, Michelle!

Michelle: Hi, I’m so glad to be here.

Rebecca: Thanks for joining us.
Today’s teas are:

Michelle: I’m drinking a fresh peppermint infused tea, and it’s my favorite afternoon pick-me-up.

Rebecca: …and it looks like it’s in a really wonderfully designed teapot.

Michelle: Well, thank you… and this is a thrift store find… one of my favorite things to do. Yeah, so I’m enjoying it.

John: I have Twinings Blackcurrant Breeze.

Rebecca: …and I’m drinking chai today.

Michelle: Pretty rough.

John: We invited you here to talk a little bit about things that you’ve been observing in terms of what’s catching on in higher education in terms of new and interesting innovations in teaching.

Michelle: Right, that’s one of things that I really had the luxury of being able to step back and look at over this last semester and over this last spring when I was on sabbatical… One of the really neat things about my book Minds Online, especially now that it’s been out for a few years, is that it does open up all these opportunities to speak with really engaged faculty and others, such as: instructional designers, librarians, academic leadership, educational technology coordinators… all these individuals around the country who are really, really involved in these issues. It’s a great opportunity to see how these trends, how these ideas, how these innovations are rolling out, and these can be some things that have been around for quite some time and just continue to rock along and even pickup steam, and some newer things that are on the horizon.

John: You’ve been doing quite a bit of traveling. You just got back from China recently, I believe.

Michelle: I sure did. It was a short visit and I do hope to go back, both to keep getting involved in educational innovations there and, hopefully, as a tourist as well. So, I was not there for very long but I had the opportunity to speak at Tsinghua University in Beijing, which is a really dynamic institution that’s been around for about a hundred years. For a while in its history it specialized in things like engineering education polytechnic, but now it’s really a selective comprehensive university with very vibrant graduate and undergraduate programs that are really very relatable for those of us in the United States working in similar contexts. My invitation was to be one of the featured speakers at the Future Education, Future Learning Conference, which was a very interdisciplinary gathering of doctoral students, faculty, even others from the community, who were all interested in the intersection of things like technology, online learning, MOOCs even, and educational research (including research into the brain and cognitive psychology), and bringing all of those together… and it was a multilingual conference. I do not speak Chinese but much of the conference was in both English and Chinese and so I was also able to really absorb a lot of these new ideas. So yes, that was a real highlight of my sabbatical semester and one that I’m going to be thinking about for quite some time.

I should say that part of what tied in there as well is that Minds Online, I’ve just learned, is going to be translated into Chinese and that’s going to come out in May 2019. So, I also got to meet with some of the people who were involved in the translation… start to put together some promotional materials such as videos and things like that.

Rebecca: Cool.

John: Excellent.

Rebecca: So, you’ve had a good opportunity, as you’ve been traveling, to almost do a scavenger hunt of what faculty are doing with evidence-based practices related to your book. Can you share some of what you’ve found or heard?

Michelle: This theme of evidence-based practice, and really tying into the findings that have been coming out of cognitive psychology for quite some time, that really is one of the exciting trends and things that I was really excited to see and hear for so many different quarters I visited in different institutions… and so I would say definitely, this is a trend that is continuing and is increasing. There really does continue to be a lot of wonderful interest and wonderful activity around these real cognitively informed approaches to teaching, and what I think we could call scientifically based and evidence-based strategies. One form this has taken is Josh Eyler’s new book, called How Humans Learn: The Science and Stories behind Effective College Teaching. This is a brand new book by a faculty development professional, and a person coming out of the humanities, actually, who’s weaving together even from his humanities background everything from evolutionary biology to classical research in early childhood education to the latest brain-based research. He’s weaving this together into this new book for faculty. So, that’s one of the things that I’ve noticed and then there’s the issue which i think is another great illustration of best-known practice which is the testing effect and retrieval practice.

John: One of the nice things is how so many branches of research are converging… testing in the classroom, brain-based research, and so forth, are all finding those same basic effects. It’s nice to see such robust results, which we don’t always see in all research in all disciplines.

Rebecca: …and just breaking down the silos in general. The things are all related and finding out what those relationships are… exploring those relationships… is really important and it’s nice to see that it’s starting to open up.

John: We should also note that when you visited here, we had a reading group and we had faculty working on trying to apply some of these concepts, and they’re still doing that… and they still keep making references back to your visit. So, it’s had quite a big impact on our campus.

Michelle: This wasn’t true, I don’t think, when I first entered the teaching profession… and even to the extent when I first started getting interested in applied work in course redesign and in faculty professional development. you would get kind of this pushback or just strange looks when you said “Oh, how about we bring in something from cognitive psychology” and now that is just highly normalized and something that people are really speaking across the curriculum… and taking it and running with it in a lasting ongoing way, not just as a “Oh, well that was an interesting idea. I’m going to keep doing what I’m doing” but really people making some deep changes as you mentioned. This theme of breaking down silos… I mean I think if there’s kind of one umbrella trend that all of these things fits under it’s that breakdown of boundaries. So, that’s one that I keep coming back to, I know, in my work.

So, the idea of retrieval practice, drilling down on that one key finding which goes back a very long ways in cognitive psychology. I think of that as such a good example of what we’re talking about here… about how this very detailed effect in cognition and yet it does have these applications across disciplinary silos. Now when I go to conferences and I say “Okay, raise your hand. How many people have ever heard of retrieval practice? How many people have ever heard of the testing effect? How many people have heard of the book Make it Stick (which really places this phenomena at its center)?” and I’m seeing more hands raising.

With retrieval practice, by the way, we’re talking about that principle that taking a test on something, that retrieving something from memory actively, has this huge impact on future memorability of that information. As its proponents like to say, tests are not neutral from a memory or from a learning standpoint… and while some of the research has focused on very kind of stripped-down laboratory style tasks like memorizing words pairs, there are also some other research projects showing that it does flow out to more realistic learning situations.

So, more people simply know about this, and that’s really the first hurdle, oftentimes, with getting this involved disciplinary sometimes jargon riddled research out there to practitioners and getting it into their hands. So, people heard of it and they’re starting to build this into their teaching. As I’ve traveled around I love to hear some of the specific examples and to see it as well crop up in scholarship of teaching and learning.

Just recently, for example, I ran across and really got into the work of Bruce Kirchhoff who is at University of North Carolina – Greensboro and his area is botany and plant identification. He has actually put together some different really technology-based apps and tools that students and teachers can use in something like a botany course to rehearse and review plant identification. He says in one of his articles, for example, that there just isn’t time in class to really adequately master plant identification. It’s just too complex of a perceptual and cognitive and memory test to do that. So, he really built in from the get-go very specific principles drawn from cognitive psychology… so, the testing effect is in there… there’s different varieties of quizzing and it all is about just getting students to retrieve and identify example after example. It brings in also principles such as interleaving, which we could return to in a little bit, but has to do with the sequencing of different examples… their spacing… So, that’s even planned out exactly how and when students encounter different things that they’re studying. It’s really wonderful. So, for example he and his colleagues put out a scholarship of teaching and learning article talking about how this approach was used effectively in veterinary medicine students who have to learn to identify poisonous plants that they’ll see around their practice. This is something that can be time-consuming and very tough, but they have some good data showing that this technology enhanced cognitively based approach really does work. That’s one example. Coincidentally, I’ve seen some other work in the literature, also on plant identification, where the instructors tagged plants in an arboretum… they went around and tagged them with QR codes… that students can walk up to a plant in the real environment with an iPad… hold the iPad over it… and it would immediately start producing quiz questions that were are specific to exactly the plants they were looking at.
So, those are some of the exciting things that people are taking and running with now that this principle is out there.

Rebecca: What I really love about the two stories that you just shared was the faculty are really designing their curriculum and designing the learning experiences with the students in mind… and what students need and when they need it. So, not only is it employing these cognitive science principles, but it’s actually applying design principles as well. It’s really designing for a user experience and thinking about the idea that if I need to identify a plant, being able to identify it in this situation in which I would need to identify it in makes it much more dynamic I think for a student… but also really meets them where they’re at and where they need it.

John: …and there’s so many apps out there now that will do the plant identification just from imagery without the QR code, that I can see it taking it one step further where they can do it in the wild without having that… so they can build it in for plants that are in the region without needing to encode that specifically for the application.

Michelle: I think you’re absolutely right once we put the technology in the hands of faculties who, as I said, they’re the one to know: “Where are my students at? Where are the weak points? Where are the gaps that they really need to bridge?” and that’s where their creativity is giving rise to all these new applications… and sometimes these can be low-tech as well… or also things that we can put in a face-to-face environment… and I’d like to to share just some experiences that I’ve had with this over the last few semesters.

In addition to trying to teach online with a lot of technology, I also have in my teaching rotation a small required course in research methods in psychology which can be a real stumbling block… the big challenge course… it’s kind of a gateway course to continued progress in our major. So, in this research methods course, some of the things that I’ve done around assessment and testing to really try again to stretch that retrieval practice idea… to make assessments really a more dynamic part of the course and more central part of the course… to move away from that idea that tests are just this kind of every now and again this panic mode opportunity for me to kind of measure in sorts of students and judge them… to make good on that idea that tests are part of learning. So, here’s some of the things that I try to do. For one thing, I took time out of the class almost every single class meeting as part of the routine to have students first of all generate quiz questions out of their textbook. So, we do have a certain amount of foundational material in that course as well as a project and a whole lot of other stuff is going on. So they need to get that foundational stuff.

Every Tuesday they would come in and they knew their routine: you get index cards and you crack your textbook and you generate for me three quiz questions. Everybody does it. I’m not policing whether you read the chapter or not. It’s active… they’re generating it… and also that makes it something like frequent quizzing. That’s a great practical advantage for me since I’m not writing everything. They would turn those in and I would select some of my favorites I would turn those into a traditional looking paper quiz and hand that out on Thursday. I said “Hey, take this like a realistic quiz.” I had explained to them that quizzes can really boost their learning, so that was the justification for spending time on it and then I said: “You know what? I’m not going to grade it either. You take it home because this is a learning experience for you. It’s a learning activity.” so we did that every single week as those students got into that routine.

The second thing that I did to really re-envision how assessment testing and quizzing worked in this particular course, was something inspired by different kinds of group testing and exam wrapper activities I’ve seen, particularly coming out of the STEM field, where there’s been a lot of innovation in this area. What I would do is… we had these high stakes exams at a few points during the semester. But, the class day after the exam, we didn’t do the traditional “Let’s go over the exam.” [LAUGHTER] That’s kind of deadly dull, and it just tends to generate a lot of pushback from students… and as we know from the research, simply reviewing… passing your eyes over the information… is not going to do much to advance your learning. So, what I would do is… I would photocopy all those exams, so it has a secure copy. They were not graded. I would not look at this before we did this… and I would pass everybody’s exams back to them along with a blank copy of that same exam. I assigned them to small groups and I said “Okay, here’s your job. Go back over this exam, fill it out as perfectly as you can as a group, and to make it interesting I said I will grade that exam as well, the one you do with your group, and anything you get over 90% gets added to everybody’s grade. This time it was open book, it was open Google, it was everything except you can’t ask me questions. So, you have each other and that’s where these great conversations started to happen. The things that we always want students to say. So, I would eavesdrop and hear students say “Oh, well you know what, I think on this question she was really talking about validity because reliability is this other thing…” and they’d have a deep conversation about it. I’m still kind of going back through the numbers to see what are the impacts of learning? Are there any trends that I can identify? But, I will say this: in the semesters that I did this, I didn’t have a single question ever come back to me along the lines of “Well, this question was unclear. I didn’t understand it. I think I was graded unfairly.” it really did shut all that down and again extended the learning that I feel students got out of that. Now it meant a big sacrifice of class time, but I feel strongly enough about these principles that I’m always going to do this in one form or another anytime I can can in face-to-face classes.

Rebecca: This sounds really familiar, John.

John: I’ve just done the same, or something remarkably similar, this semester, in my econometrics class which is very similar to the psych research methods class. I actually picked it up following a discussion with Doug McKee. He actually was doing it this semester too. He had a podcast episode on it. It sounded so exciting, I did something… a little bit different. I actually graded it but I didn’t give it back to them because I wanted to see what they had the most trouble with, and then I was going to have them only answer the ones in a group that they struggled with… and it turned out that that was pretty much all them anyway. So, it’s very similar to what you did except I gave them a weighted average of their original grade and the group grade and all except one person improved and the one person’s score went down by two points because the group grade was just slightly lower… but he did extremely well and he wasn’t that confident. The benefits to them of that peer explanation and explaining was just tremendous and it was so much more fun for them and for me and, as you said, it just completely wiped out all those things like “Well, that was tricky” because when they hear their peers explaining it to them the students were much more likely to respond by saying “Oh yeah, I remember that now” and it was a wonderful experience and I’m gonna do that everywhere I can.

In fact. I was talking about it with my TA just this morning here at Duke and we’re planning to do something like that in our classes here at TIP this summer, which i think is somewhat familiar to you from earlier in your academic career.

Michelle: That is right we do have this connection. I was among, not the very first year, but I believe the second cohort of Talent Identification Program students who came in, I guess you would call it now, middle school (back then, it was called junior high) and what a life-transforming experience. We’ve had even more opportunities to talk about the development of all these educational ideas through that experience.

John: That two-stage exam is wonderful and it’s so much more positive… because it didn’t really take, in my class, much more time, because I would have spent most of that class period going over the exam and problems they had. But the students who did well would have been bored and not paying much attention to it; the students who did poorly would just be depressed and upset that they did so poorly… and here, they were actively processing the information and it was so positive.

Michelle: That’s a big shift. We really have to step back and acknowledge that, I think. that is a huge shift in how we look at assessment, and how we think about the use of class time… and it’s not just “Oh my gosh, I have to use every minute to put such content in front of the students.” Just the fact that more of us are making that leap, I think, really is evidence this progress is happening… and we see also a lot of raised consciousness around issues such as learning styles. That’s another one that, when I go out and speak to faculty audiences, 10 years ago you would get these shocked looks or even very indignant commentary when you say “Ok, this idea of learning styles, in the sense that say there are visual learners, auditory learners, what I call sensory learning styles (VAK is another name it sometimes goes by). The idea that that just holds no water from a cognitive point of view…” People were not good with that, and now when I mentioned that at a conference, I get the knowing nods and even a few groans… people like “Oh, yeah. we get that. Now, K-12, which I want to acknowledge it’s not my area, but I’m constantly reminded by people across the spectrum that it’s a very different story in K-12. So, setting that aside… but this is what I’m seeing… that faculty are realizing… they’re saying “Oh, this is what the evidence says…” and maybe they even take the time to look at some of the really great thinkers and writers who put together the facts on this. They say “You know what? I’m not going to take my limited time and resources and spend that on this matching to styles when the styles can’t even be accurately diagnosed and are of no use in a learning situation. So, that’s another area of real progress.

Rebecca: What I am hearing is not just progress here in terms of cognitive science, but a real shift towards really thinking about how students learn and designing for that rather than something that would sound more like a penalty for grade like “Oh, did you achieve? Yes or no…” but, rather here’s an opportunity if you didn’t achieve to now actually learn it… and recognize that you haven’t learned it, even though it might seem really familiar.

John: Going back to that point about learning styles. It is spreading in colleges. I wish it was true at all the departments at our institution, but it’s getting there gradually… and whenever people bring it up, we generally remind them that there’s a whole body of research on this and I’ll send them references but what’s really troubling is in my classes the last couple years now, I’ve been using this metacognitive cafe discussion forum to focus on student learning… and one of the week’s discussions is on learning styles and generally about 95 percent of the students who are freshmen or sophomores (typically) come in with a strong belief in learning styles… where they’ve been tested multiple times in elementary or middle school… they’ve been told what their learning styles are… they’ve been told they can only learn that way… It discourages them from trying to learn in other ways and it does a lot of damage… and I hope we eventually reach out further so that it just goes away throughout the educational system.

Rebecca: You’ve worked in your classes, Michelle, haven’t you to help students understand the science of learning and use that to help students understand the methods and things that you’re doing>

Michelle: Yes, I have. I’ve done this in a couple of different ways. Now, partly, I get a little bit of a free pass in some of my teaching because I’m teaching the introduction to psychology or I’m teaching research methods where I just happen to sneak in as the research example will be some work on say attention or distraction or the testing effect. So, I get to do it in those ways covertly. I’ve also had the chance, although it’s not on my current teaching rotation… I’ve had the chance to also take it on as in freestanding courses. As many institutions are doing these days… it’s another trend… and what Northern Arizona University, where I work, has different kinds of freshmen or first-year student offering for courses they can take, not in a specific disciplinary area, but that really crossed some different areas of the student success or even wellbeing. So, I taught a class for awhile called Maximizing Brain Power that was about a lot of these different topics. Not just the kind of very generic study skills tip… “get a good night’s sleep…” that kind of thing… but really some again more evidence-based things that we can tell students and you can really kind of market it… and I think that we do sometimes have to play marketers to say “Hey, I’m going to give you some inside information here. This is sort of gonna be your secret weapon. So, let me tell you what the research has found.”

So, those are some of the things that I share with students… as well as when the right moment arises, say after an exam or before their first round of small stakes assessments, where they’re taking a lot of quizzes… to really explain the difference between this and high stakes or standardized tests they may have taken in the past. So, I do it on a continuing basis. I try to weave it into the disciplinary aspect and I do it in these free-standing ways as well… and I think here’s another area where I’m seeing this take hold in some different places… which is to have these free-standing resources that also just live outside of a traditional class that people can even incorporate into their courses… if say cognitive psychology or learning science isn’t their area… that they can bring in, because faculty really do care about these things. We just don’t always have the means to bring them in in as many ways as we would like.

John: …and your Attention Matters project was an example of that wasn’t it? Could you tell us a little bit about that?

Michelle: Oh, I’d love to… and you know this connects to what it seems to be kind of an evergreen topic in the teaching and learning community these days, which is the role of distracted students… and I know this past year there just have been these one op-ed versus another. There’s been some really good blog posts by some people I really like to follow in the teaching and learning community such as Kevin Gannon talking about “Okay, do you have laptops in the classroom? and what happens when you do?” and so I don’t think that this is just a fad that’s going away. This is something that the people do continue to care about, and this is where the attention matters project comes in.

This was something that we conceptualized and put together a couple years ago at Northern Arizona University with myself, and primarily I collaborated with a wonderful instructional designer who also teaches a great deal… John Doherty. So, how this came about is I was seeing all the information on distraction… I’m really getting into this as a cognitive psychologist and going “Wow, students need to know that if they’re texting five friends and watching a video in their class. It’s not going to happen for them.” I was really concerned about “What can I actually do to change students minds?” So, my way of doing this was to go around giving guests presentations in every classes where people would let me burn an hour of their class time… and not a very scalable model… and John Doherty respectfully sat through one my presentations on this and then he approached me and said “Look, you know, we could make a module and put this online… and it could be an open access within the institution module, so that anybody at my school can just click in and they’re signed up. We could put this together. We could use some really great instructional design principles and we could just see what happens… and I bet more people would take that if it were done in that format. We did this with no resources. We just were passionate about the project and that’s what we did. We had no grant backing or anything. We got behind it. So, what this is is about a one- to two-hour module that, it’s a lot like a MOOC in that it there’s not a whole lot of interaction or feedback, but there are discussion forums and it’s very self-paced in that way… so one- to two-hour mini MOOCs that really puts at the forefront demonstrations and activities… so we don’t try to convince students about problems with distraction and multitasking… we don’t try to address that just by laying a bunch of research articles on them… I think that’s great if this were a psychology course, but it’s not. So, we come at it by linking them out to videos, for example, that we were able to choose, that we feel really demonstrate in some memorable ways what gets by us when we aren’t paying attention… and we also give students some research-based tips on how to set a behavioral plan and stick to it… because just like with so many areas of life, just knowing that something is bad for you is not enough to really change your behavior and get you not to do that thing. so we have students talking about their own plans and what they do when, say, they’re having a boring moment in class, or they’re really really tempted to go online while they’re doing homework at home. What kinds of resolutions can they set or what kind of conditions can make that that will help them accomplish that. Things like the software blockers… you set a timer on your computer and it can lock you out of problematic sites… or we learned about a great app called Pocket Points where you actually earn spendable coupon points for keeping your phone off during certain hours. This is students talking to students about things that really concern them and really concern us all because I think a lot of us struggle with that.

So, we try to do that… and the bigger frame for this as well is this is, I feel, a life skill for the 21st century… thinking about how technology is going to be an asset to you and not detract from what you accomplish in your life. What a great time to be reflecting on that, when you’re in this early college career. so that’s what we try to do with the project…and we’ve had over a thousand students come through. They oftentimes earn extra credit. Our faculty are great about offering small amounts of extra credit for completing this and we’re just starting to roll out some research showing some of the impacts… and showing it in a bigger way just how you can go about setting up something like this.

Rebecca: I like that the focus seems to be on helping students with a life skill rather than using technology is just a blame or an excuse. We’re in control of our own behaviors and taking ownership over our behaviors is important rather than just kind of object blaming.

Michelle: So, looking at future trends, I would like to see more faculty looking at it in the way that you just described, Rebecca, as this is a life skill and it’s something that we collaborate on with our students… not lay down the law… because, after all, students are in online environments where we’re not there policing that and they do need to go out into work environments and further study and things like that. So, that’s what I feel is the best value. For faculty who are looking at this, if they don’t want to do… or don’t have the means to do something really formal like our Attention Matters approach, just thinking about it ahead of time… I think nobody can afford to ignore this issue anymore and whether you go the route of “No tech in my classroom” or “We’re going to use the technology in my classroom“ or something in between… just reading over, in a very mindful way, not just the opinion pieces, but hopefully also a bit of the research, I think, can help faculty as they go in to deal with this… and really to look at it in another way, just to be honest, we also have to consider how much of this is driven by our egos as teachers and how much of it is driven by a real concern for student learning and those student life skills. I think that’s where we can really take this on effectively and make some progress when we are de-emphasizing that ego aspect and making sure that it really is about the students.

John: We should note there’s a really nice chapter in this book called Minds Online: Teaching Effectively with Technology that deals with these types of issues. It was one of the chapters that got our faculty particularly interested in these issues… on to what extent technology should be used in the classroom… and to what extent it serves as a distraction.

Michelle: I think that really speaks to another thing which I think is an enduring trend… which is the emphasis on really supporting the whole student in success and what we’ve come to call academic persistence… kind of a big umbrella term that has to do with, not just succeeding in a given class, but also being retained… coming back after the first year. As many leaders in higher education point out, this is as a financial issue. As someone pointed out, it does cost a lot less to hang on to the students you have instead of recruiting more students to replace ones who are lost. This is, of course, yet another really big shift in mindset of our own, because after all we did used to measure our success by “Hey, I flunked this many students out of this course” or” Look at how many people have to switch into different majors…our major is so challenging…”

So, we really have turned that thinking around and this does include faculty now. I think that we did used to see those silos. We had that very narrow view of “I’m here to convey content. I’m here to be an expert in this discipline, and that’s what I’m gonna do…” and sure, we want to think about things like do students have learning skills? Do they have metacognition? Are they happy and socially connected at the school? Are they likely to be retained so that we can have this robust university environment?

We had people for that, right? It used to be somebody else’s job… student services or upper administration. They were the ones who heard about that and now I think on both sides we really are changing our vision. More and more forward-thinking faculty are saying “You know what? Besides being a disciplinary expert, I want to become at least conversant with learning science. I want to become at least conversant with the science of academic persistence…” There is a robust early literature on this and that’s something that we’ve been working on at NAU over this past year as well… kind of an exciting newer project that I like very much. We’ve started to engage faculty in a new faculty development program called Persistence Scholars and this is there to really speak to people’s academic and evidence-based side, as well as get them to engage in some perspective-taking around things like the challenges that students face and what it is like to be a student at our institution. We do some really selected readings in the area we look at things like mindset… belongingness… these are really hot areas in that science of persistence… in that emerging field. But, we have to look at it in a really integrated way.

It’s easy for people to say just go to a workshop on mindset and that’s a nice concept, but we wanted to think about it in this bigger picture… really know what are some of the strengths of that and why? Where do these concepts come from? What’s the evidence? That’s something that I think is another real trend and I think as well we will see more academic leaders and people in staff and support roles all over universities needing to know more about learning science. There are still some misconceptions that persist, as we’ve talked about. We’re making progress in getting rid of some of these myths around learning, but I will say… I’m not gonna name any names… but, every now and again I will hear from somebody who says “Oh well, we need to match student learning styles” or “Digital natives think differently, don’t you know?” and I have to wonder whether that’s a great thing. I mean, these are oftentimes individuals that have the power to set the agenda for learning all over a campus. Faculty need to be in the retention arena and I think that leaders need to be in the learning science arena. The boundaries is breaking down and it’s about time.

Rebecca: One of the things that I thought was really exciting with the reading groups that we’ve been having on our campus… that we started with your book, but then we’ve read Make it Stick and Small Teaching since… is that a lot of administrators in a lot of different kinds of roles engaged with us in those reading groups, it wasn’t just faculty. There was a mix of faculty, staff, and some administrators, and I think that that was really exciting. For people who don’t have the luxury of being in your persistence scholar program, what would you recommend they read to get started to learn more about the science of persistence?

Michelle: I really, even after working with this for quite some time, I loved the core text that we have in that program, which is Completing College by Vincent Tinto. It’s just got a great combination of passionate and very direct writing style. So, there’s no ambiguity, there’s not a whole lot of “on the one hand this and on the other hand that.” It’s got an absolutely stellar research base, which faculty of course appreciate… and it has a great deal of concrete examples. So, in that book they talk about “okay, what does it mean to give really good support to first semester college students? What does that look like?” and they’ll go out and they’ll cite very specific “Here’s a school and here’s what they’re doing… here’s what their program looks like… here’s another example that looks very different but gets at the same thing.” So, that’s one of the things that really speak to our faculty… that they really appreciated and enjoyed.

I think that as well we tested good feedback about work that’s come out of the David Yeager and his research group on belongingness and lay theories, and lay theories is maybe a counterintuitive term for kind of a body of ideas about what students believe about academic success and why some people are successful and others are not and how those beliefs can be changed sometimes through relatively simple interventions and when it happens we see great effects such as the narrowing of achievement gaps among students who have more privilege or less privileged backgrounds… and that’s something that, philosophically, many faculty really really care about but they’ve never had the chance to really learn “Okay, how can I actually address something like that with what I’m doing in my classroom, and how can I really know that the things that I’m choosing do have that great evidence base…”

John: …and I think that whole issue is more important now and is very much a social justice issue because, with the rate of increase we’ve seen in college cost inflation, people who start college and don’t finish it are saddled with an awfully high burden of debt. The rate of return to a college degree is the highest that we’ve ever seen and college graduates end up not only getting paid a lot more but they end up with more comfortable jobs and so forth… and if we really want to move people out of poverty and try to reduce income inequality, getting more people into higher education and successfully completing higher education is a really important issue. I’m glad to see that your institution is doing this so heavily and I know a lot of SUNY schools have been hiring Student Success specialists. At our institution they’ve been very actively involved in the reading group, so that message is spreading and I think some of them started with your book and then moved to each of the others. So, they are working with students in trying to help the students who are struggling the most with evidence-based practices …and I think that’s becoming more and more common and it’s a wonderful thing.

Rebecca: So, I really liked Michelle that you were talking about faculty getting involved in retention and this idea of helping students develop persistence skills, and also administrators learning more about evidence-based practices. There’s these grassroots movements happening in both of these areas. Can you talk about some of the other grassroots movements that are working toward, or efforts that faculty are making to engage students and capture their attention and their excitement for education?

Michelle: Right, and here I think a neat thing to think about too is just it’s the big ambitious projects… the big textbook replacement projects or the artificial intelligence informed adaptive learning systems… those are the things that get a lot of the press and end up in The Chronicle of Higher Education that we read about… But, outside of that, there is this very vibrant community and grassroots led scene of developing different technologies and approaches. So, it really goes back for a while. I mean, the MERLOT database that I do talk about in Minds Online has been trove for years of well hidden gems that take on one thing in a discipline and come at it from a way that’s not just great from a subject-matter perspective but brings up the new creative approaches. In the MERLOT database, for example, there’s a great tutorial on statistical significance and the interrelationship between statistical significance and issues like simple sizes. You know, that’s a tough one for students, but it has a little animation involving a horse and a rider that really turns it into something that’s very visual… that’s very tangible… and it really actually tying into analogies, which is a well-known cognitive process that can support the advancement of learning something new. There is something on fluid pressures in the body that was treated for nursing students by nurses, and it’s got an analogy of a soaker hose that this is really fun and is actually interactive. So, those are the kinds of things. The PhET project, P-h-E-T which comes out of University of Colorado, that has been around for a while… again, faculty-led and a way to have these very useful interactive simulations for concepts in physics and chemistry. So, that’s one. CogLab, that’s an auxiliary product that I’ve used for some time in like hundred psychology courses that simulates very famous experimental paradigms which are notoriously difficult to describe on stage for cognitive psychology students. That started out many years ago as a project that very much has this flavor of “We have this need in our classroom. We need something interactive. There’s nothing out there. Let’s see what we can build.” It has since then picked up and turned into a commercial product, but that’s the type of thing that I’m seeing out there.

Another thing that you’ll definitely hear about if you’re circulating and hearing about the latest project is virtual reality for education. So, with this it seems like, unlike just a few years ago, almost everywhere you visit you’re going to hear that “Oh, we’ve just set up a facility. We’re trying out some new things.” This is something that I also heard about when I was talking to people when I was over in China. So, this is an international phenomenon. It’s going to pick up steam and definitely go some places.

What also strikes me about that is just how many different projects there are. Just when you’re worried that you’re going to be scooped because somebody else is going to get there first with their virtual reality project you realize you’re doing very very different things. So, I’ve seen, for example, it used in a medical application to increase empathy among medical students… and I took a six or seven minute demonstration that just was really heart-rending, simulating the patient experience with a particular set of sensory disorders… and at Northern Arizona University we have a lab that is just going full-steam in coming up with educational applications such as interactive organic chemistry tutorial that is is just fascinating. We actually completed a pilot project and are planning to gear up a much larger study next semester looking at the impacts of this. So, this is really taking off for sure.

But, I think there are some caveats here. We still really need some basic research on this… not just what should we be setting up and what the impacts are but how does this even work? In particular, what I would like to research in the future, or at least see some research on, is what kinds of students… what sort of student profile… really gets the most out of virtual reality for education. Because amidst all the very breathless press that’s going on about this now and all the excitement, we do have to remember this is a very, very labor intensive type of resource to set up. You’re not just going to go home and throw something together for the next week. It takes a team to build these things and to complete them as well. If you have, say, a 300 student chemistry course (which is not atypical at all… these large courses), you’re not going to just have all of them spend hours and hours and hours doing this even with a fairly large facility. It’s a very hands-on thing to guide them through this process, to provide the tech support, and everything else.

So, I think really knowing how we can best target our efforts in this area, so that we can build the absolute best, with the resources we have, and maybe even target and ask the students who are most likely to benefit. I think those are some of the things that we just need to know about this. So, it’s exciting for somebody like me who’s in the research area. I see this as a wonderful open opportunity… but those are some of the real crossroads we’re at with virtual reality right now.

Rebecca: I can imagine there’s a big weighing that would have to happen in terms of expense and time and resources needed to startup versus what that might be saving in the long run. I can imagine if it’s a safety thing that you want to do a virtual reality experience, like saving people’s lives and making sure that they’re not going to be in danger as they practice particular skills, could be a really good investment in these… spending the resources to make that investment… or if it’s a lot of travel that would just be way too expensive to bring a bunch of students to a particular location… but you could virtually… it seems like it would be worth the start-up costs and those are just two ideas off the top of my head where it would make sense to bend all of that resource and time.

John: …and equipment will get cheaper. Right now, it’s really expensive for computers that have sufficient speed and graphics processing capability and the headsets are expensive, but they will come down in price, but as you said, it’s still one person typically and one device… so it doesn’t scale quite as well as a lot of other tools or at least not at this stage.

Rebecca: From what I remember, Michelle, you wrote a blog post about [a] virtual reality experience that you had. Can you share that experience, and maybe what stuck with you from that experience?

Michelle: Right, so I had the opportunity, just as I was getting to collaborate with our incredible team at the immersive virtual reality lab at NAU… one of the things I was treated to was about an hour and a half in the virtual reality setup that they have to explore some of the things that they had… Giovanni Castillo, by the way, is creative director of the lab and he’s the one who was so patient with me through all this. We tried a couple of different things and of course there’s such a huge variety of different things that you can do.
There’s a few things out there like driving simulators that are kind of educational… they’re kind of an entertainment… but he was just trying to give me, first of all, just a view of those… and I had to reject a few of them… I will say, initially, because I am one of the individuals who tends to be prone to motion sickness. So, that limits what I can personally do in VR and that is yet another thing that we’re gonna have to figure out. At least informally, what we hear is that women in particular tend to experience more of this. So, I needed, first of all, to go to a very low motion VR. I wasn’t gonna be whizzing through these environments. That was not going to happen for me. So, we did something that probably sounds incredibly simplistic, but it just touched me to my core… which is getting to play with Google Earth. You can spin the globe and either just pick a place at random or what Giovanni told me is… “You know, I’ve observed that when people do this, when we have an opportunity to interact with Google Earth, they all either go to where they grew up or they’ll go to someplace that they have visited recently or they plan to visit. So, I went to a place that is very special to me and maybe it doesn’t fit into either one of those categories neatly, but it’s my daughter’s University… her school… and I should say that this is also a different thing for me because my daughter goes to school in Frankfort, Germany… an institute that is connected to a Museum. So, I had only been to part of the physical facility… the museum itself… and it was a long time ago… and part of it was closer to the holiday. So, this is my opportunity to go there and explore what it looks like all over… and so, that was an emotional experience for me. It was a sensory experience… it was a social one… because we were talking the whole time… and he’s asking me questions and what kinds of exhibits do they have here… and what’s this part of it. So, that was wonderful. it really did give me a feel for alright, what is it actually like to be in this sort of environment?

I’m not a gamer. I don’t have that same background that many of our students have. So, it got me up to speed on that… and it did show me how just exploring something that is relatively simple can really acquire a whole new dimension in this kind of immersive environment. Now the postscript that I talked about in that blog post was what happened when I actually visited there earlier in the year. So, I had this very strange experience that human beings have never had before… which is from this… I don’t know whether to call it deja vu or what… of going to the settings and walking around the same environment and seeing the same lighting and all that sort of stuff that was there in that virtual reality environment… but this time, of course, with real human beings in it and the changes… the little subtle changes that take place over time, and so forth.

So, how does it translate into learning? What’s it going to do for our students? I just think that time is going to tell. It won’t take too long, but I think that these are things we need to know. But, sometimes just getting in and being able to explore something like this can really put you back in touch with the things you love about educational technology.

Rebecca: I think one of the things that I’m hearing in your voice is the excitement of experimenting and trying something… and that’s, I think, encouragement for faculty in general… is to just put yourself out there and try something out even if you don’t have something specific in mind with what you might do with it. Experiencing it might give you some insight later on. it might take some time to have an idea of what you might do with it, but having that experience, you understand it better… it could be really useful.

John: …and that’s something that could be experienced on a fairly low budget with just your smartphone and a pair of Google cardboard or something similar. Basically, it’s a seven to twelve dollar addition to your phone and you can have that experience… because there’s a lot of 3D videos and 3D images out there on Google Earth as well as on YouTube. So, you can experience other parts of the world and cultures before visiting… and I could see that being useful in quite a few disciplines.

Rebecca: So, we always wrap up with asking what are you going to do next?

Michelle: I continue to be really excited about getting the word out about cognitive principles and how we can flow those in to teaching face-to-face with technology… everything else in between. So, that’s what I continue to be excited about… leveraging cognitive principles with technology and with just rethinking our teaching techniques. I’m going to be speaking at the Magna Teaching with Technology Conference in October, and so I’m continuing to develop some of these themes… and I’m very excited to be able to do that. I’m right now also… we’re in the early stages of another really exciting project that has to do with what we will call neuromyth… So, that may be a term that you’ve turn across in some of your reading. It’s something that we touched on a few times, I think, in our conversation today… the misconceptions that people have about teaching and learning and how those can potentially impact the choices we make in our teaching. So, I’ve had the opportunity to collaborate with this amazing international group of researchers who’s headed up by Dr. Kristen Betts of Drexel University… and I won’t say too much more about it other than we have a very robust crop of survey responses that have come in from, not just instructors, but also instructional designers and administrators from around the world. So, we’re going to be breaking those survey results down and coming up with some results to roll out probably early in the academic year and we’ll be speaking about that at the Accelerate conference, most likely in November. That’s put out by the Online Learning Consortium. So, we’re right in the midst of that project and it’s going to be so interesting to see what has the progress been? What neuromyths are still out there and how can they be addressed by different professional development experiences. We’re continuing to work on the Persistence Scholars Program on academic persistence. So, we’ll be recruiting another cohort of willing faculty to take that on in the fall at Northern Arizona University. I am going to be continuing to collaborate and really work with and hear from John and his research group with respect to the metacognitive material that they’re flowing into foundational coursework and ways to get students up to speed with a lot of critical metacognitive knowledge. So, we’re going to work on that too… and I like to keep up my blog and work on shall we say longer writing project but we’ll have to stay tuned for that.

Rebecca: Sounds like you need to plan some sleep in there too.

[LAUGHTER]

John: Well, it’s wonderful talking to you, and you’ve given us a lot of great things to reflect on and to share with people.

Rebecca: Yeah. Thank you for being so generous with your time.

John: Thank you.

Michelle: Oh, thank you. Thanks so much. It’s a pleasure, an absolute pleasure. Thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts, and other materials on teaforteaching.com. Theme music by Michael Gary Brewer. Editing assistance from Nicky Radford.