192. Skim, Dive, Surface

Digital texts and materials have been increasingly used in college classes. In this episode Jenae Cohn joins us to explore some of the affordances of digital texts and discuss strategies for effectively engaging with digital material. Jenae is the Director of Academic Technology at California State University Sacramento and the author of Skim, Dive, Surface: Teaching Digital Reading, which has been recently released by West Virginia University Press.

Shownotes

  • Cohn, J. (2021). Skim, Dive, Surface: Teaching Digital Reading. West Virginia University Press.
  • Christina Haas (1997). Writing Technology: Studies In The Materiality Of Literacy. Mahwah, NJ: Lawrence Erlbaum Assoc., 1996
  • Smale, M. A. (2020). “It’s a lot to take in.” Undergraduate Experiences with Assigned Reading. CUNY Academic Works. 1-10.
  • Smale, M. A., & Regalado, M. (2016). Digital technology as affordance and barrier in higher education. Springer.
  • Hypothesis
  • Perusall
  • Power Notes
  • Kalir, R., & Garcia, A. (2019). Annotation. MIT Press.

Transcript

John: Digital texts and materials have been increasingly used in college classes. In this episode we explore some of the affordances of digital texts and discuss strategies for effectively engaging with digital material.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together, we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[MUSIC]

Rebecca: Our guest today is Jenae Cohn. She is the Director of Academic Technology at California State University Sacramento and the author of Skim, Dive, Surface: Teaching Digital Reading, which has been recently released by West Virginia University Press as part of the superb series on teaching and learning, edited by James Lang. Welcome, Jenae.

Jenae: Thank you, Rebecca. Thanks for having me.

John: We’re glad to talk to you again.

Jenae: Such fun.

John: And we’re really glad to see your book out. When we last talked to you, you were finishing it up but we didn’t actually get to see it. So this time, we’ve had a chance to actually read it before talking to you.

Jenae: Oh, I’m so thrilled you’ve had a chance to read it. It’s so exciting to get to talk to people about it, finally.

John: Today’s teas are… Are you drinking tea?

Jenae: I am drinking tea today. I’ve got an English Breakfast tea.

Rebecca: I’ve got a Scottish afternoon tea. So, do you have something for the evening, John? [LAUGHTER]

John: No, I actually have English Breakfast tea from Tea Pigs, which is a new tea company for me. It was a gift.

Rebecca: That’s an unusual choice.

John: It’s very good, actually.

Jenae: I’m always up for new tea recommendations. I have a whole tea shelf. I was really born ready for this podcast. So I am wishing I had some Sleepy Time now to complete the full…

Rebecca: I know, right?

Jenae: …section of daytime to nighttime. That’s alright, it’s still morning here for me. So, I wasn’t quite ready for that yet. [LAUGHTER]

Rebecca: I go straight for the afternoon, even in the morning. So we’ve invited you here today to discuss Skim, Dive, Surface. Digital content has been really increasing in our college classes for some time. And there are some affordances of digital content that print content doesn’t have, like OER and some accessibility features, etc. Can you talk a little bit about some of the affordances of digital content?

Jenae: Sure, I’d be glad to. And I love that we’re starting from this place of affordances., ‘cause I think often enough in our teaching, we can make choices about what we use based on our prior experiences, or what we found comfortable. And I would love to see us having a measured conversation about what we get when we make these choices, to be really mindful about the kinds of choices that we make. So, to me, one of the greatest affordances of thinking about adopting digital text is their flexibility. Digital texts can be modified and they can be transformed on different kinds of devices and using different kinds of applications. So when you’re encountering a printed book, something that publishers and writers really love is that you can really control the experience. And sometimes there’s real pleasure in seeing that really controlled experience. But, for a student, for a teaching context, being able to modify the size or the shape of the text, to modify the spacing, to be able to cut and paste and remix things, that can really be of tremendous benefit on the learning side of things. Rebecca, you mentioned equity-based concerns around digital reading as well. And I think that’s, to me, the hugest motivation to doing this work. We know that, according to EDUCAUSE data that’s been collected for years, we know that mobile device usage in college classrooms is nearly ubiquitous at this point. Mobile devices are not a luxury device, they are the standard device that students use. And they’ll often choose to use a mobile phone for their learning more than a laptop, more than buying scores of heavy textbooks. So the more that we can make our learning experiences accessible on mobile, the easier it is for us to be able to reach students who, again, may not have access to more than one device or who may not have the budget to be buying all their books, who might be doing a lot of their learning on a bus on their way to campus, for example. When people start repopulating campuses, one thing I think we’ve learned in the Covid-19 pandemic is that mobile phones were often a more stable source of WiFi internet connection than home wireless access was. So we also knew that from a kind of a download access perspective too, mobile really provided a lot of touch points that made access to materials even easier. But I sometimes struggle to read on a mobile phone. That’s not how I learned to read. But there are some things that I read all the time on my mobile phone. So the more that we can think about, again, what’s possible in those spaces, the transportability, the adaptability, the flexibility, the more we can start to think inventively about how we’re distributing and thinking about access in those spaces.

John: You mentioned mobile devices as a platform for student reading. And that’s especially true for first-generation students and students from lower income households, who face some of the greater challenges in being successful and continuing their studies. So I think that adds to that equity component, And one of the reasons we’ve been pushing for this on our campus… and I think this is true everywhere… is that, in general, text in digital format is easier to distribute to students through the LMS so they have day one access, where if you have physical textbooks, generally students have to pay for them, and sometimes that’s a bit of a struggle for students in coming up with the funds to require textbooks. And certainly with OER, but with digital materials in general, you can have them there so that all students start from an equitable standpoint.

Jenae: Absolutely. It’s a great point that often our OERs are digitized, which makes them more affordable when we’re concerned with student budgets. Not all digital texts are affordable, but the other piece I’d like to mention here, that I think I always appreciate underscoring is that a lot of libraries have way more access to digital collections through the kinds of publication packages that they purchase. I think we forget about the amazing resources our librarians are thinking about. And so many of our librarians are educators who are being really thoughtful about what they’re procuring online, there’s also this real potential if we’re willing to accept that good, deep, close, mindful reading can happen on screen that we really get this world of new things that might be opened up to vis-a-vis collaborating with our librarians, and thinking about what kinds of types of texts or resources might be really well suited for the kinds of educational goals we might have.

Rebecca: I think one of the things that I discovered from doing some interviews with students about their experience learning during the pandemic, is that access to textbooks was actually a really big problem, because some of them depended on course reserves and things physically in the library. And then when they went home during remote learning, and then maybe even any online courses afterwards, they just had a lot less access, because, previously, they might have shared a physical book with other students even so that it was more affordable,

Jenae: Right, absolutely. I think libraries had to be really creative in giving students that access that maybe we took for granted, when we were thinking about the campus from a brick and mortar only perspective. And especially when it comes to books and reading, we kind of come by the attachment to the printed books quite honestly. Decades of survey research suggests that students and faculty alike prefer and find, or at least think that, they read more effectively by print. Librarians have researched this, literacy scholars have researched this, neuroscientists have researched this, and they’ve all basically found the same result. So I think there’s been a lot of behavior that has been driven around that data. And I don’t mean to suggest that we should ignore that data, I think there’s probably lots of people who do read more closely and more analytically when they have a paper book in front of them. I don’t think that data means that it’s impossible to read in a digital space effectively well, we really just have to be thinking about strategies that work for it and assignments that are aligned.

Rebecca: As a designer, I appreciate the physical artifact of a book. And I was really, really, actually very resistant to reading online, but wasn’t for pleasure, which is really weird, because I’m a digital designer. I design websites, I design apps, that’s the kind of design I do. And I was really resistant to that for all of those kinds of emotional reasons probably. And it wasn’t really until the last couple years that I started using a digital format for more scholarly work or research. I don’t know why I didn’t do it sooner. I’m discovering all of the affordances that I should have known as a designer who designed things digitally, [LAUGHTER] it’s just you get into habits and you don’t think of these things. So can you talk a little bit about some of the reasons why students find reading digitally more challenging than in a print format?

Jenae: Sure, there are a number of things that come up when students read online. One of them is what rhetorician Christina Haas studied a long time ago, back in the early 90s, actually. So we’ve been thinking about digital reading for quite some time. But she found in some small scale studies of student reading behaviors online that students lost what she coined “text sense” this ability to sort of locate and recall information based on where they appeared spatially. So one real challenge is when you read online, and you’re moving from kind of the logic of a codex, a traditional printed or bound book, which sort of moves from left to right in a certain kind of way, is a linear narrative order. When you move from that to what is typically sort of a scroll when you read on a screen, that creates a different sense of spatial awareness of where you might find that information. So it can be harder to remember, for example, where a certain key point was made, where you don’t have the materiality of paper to dog ear a page, for example, to create a kind of tactile difference in where you find information. That can be a challenge. So you do have to come up with some new strategies for simple memory and comprehension recall. The other research in this space, again, especially from cognitive psychology and neuroscience has demonstrated that in small time studies people of all ages, young and old, do tend to remember information better from print, again, especially if it’s short recall, because of that text sense, that ability to really quickly and nimbly place where information might be found in a book. Another challenge to reading on screen that students might have that they might have been used to in print are some strategies around annotation as well. I think that, in a lot of contexts, students have learned how to use a highlighter or a pen to underline or mark where important information is on a page. And it’s not always immediately obvious where you might do that annotation work online, unless you have learned about tools available for markup. So I’ve always been surprised when I’ve worked with students at all kinds of institutions… every place I’ve been in, there’s always this range of what students just know about how to markup or read digital documents. Some students know all about PDF editors and readers. Some students know about browser extensions or add ons that might allow them to annotate web pages. But many don’t. Many think that the only way that you can mark up a text is by printing it out. And this isn’t just students, faculty, professionals, people all over are still learning. I don’t know that, for whatever reason, there’s necessarily widespread awareness of what it really can look like to manipulate texts that are not designed to be manipulated,…again, especially documents like PDFs that are stable, that are designed not to be necessarily changed. So there is a certain amount of scaffolding that we would need to do with students to help them understand exactly how they can directly engage with or build upon that affordance, and as we discussed at the beginning of this conversation, to have that real flexibility to modify and engage with the text and make it their own.

John: And students at some point in their educational career had learned how to use highlighters, and they were given highlighters by their parents at some point. But as you said, they’ve never been taught how to mark up digital documents. One of the things you suggest is that that’s probably something that we should work with them on in our courses. Are there any suggestions of where that should occur? Or is that the conversation, perhaps, we should all have with our students when we’re giving them digital text?

Jenae: Right, I think there’s a couple things we’d want to engage with students on and not take for granted. And I would maybe even take one step back and just engage students in conversation about what it looks like for them when they read in academic context. To your point, John, I do think that many students have been equipped with some of the skills to do basic markup in print. But some didn’t even get that. Maura Smale, who’s a librarian and researcher herself,has a great article about reading, and she surveyed a bunch of students and the quote that still really stands out to me, she talked to one student who said “In college reading is your problem.” And that quote, really still just sticks out to me, because it just goes to show that, I think,as instructors in a college setting we can take for granted that students have learned this academic skill to be able to figure out what to do with the reading. And as instructors, I think we need to be challenged to think really critically about what we also want students to be doing with that reading. Do we want students to read for content uptake? Are we wanting them to learn key terms, critical definitions, concepts? Are we asking students to do what a lot of humanities faculty call close reading, which is trying to unpack language and see what we learn from language choices? Are we wanting students to read like writers, that is, are we wanting them to read to emulate certain conventions in the discipline or the field? So there’s a lot of reasons why we need students to read. Sometimes we don’t always articulate this. So I would say that one thing we could do with students is to make explicit what our intentions are for the reading task as well. And to also ask, “What have they done? What strategies have worked for them? What have they found useful?” Just as you might ask them to do the same when they’re starting a new writing project, we want to think about the genres of what they’re reading and how those genres might shape the kind of actions that they take. Then when you start thinking about media on top of that, then we can start to open up to what strategies, tools, or resources might make those ways of reading possible. So just as an example, if you’re wanting students to read closely, just read for language moves, to do a close reading, those kinds of markup and annotation tools might be extremely useful for, say, color coding a document for certain kinds of moves or patterns that they’re noticing in the language. But if you’re wanting students really to read in a more curatorial way, that is wanting students to read for research, pull out a bunch of main points, put them together, come up with their own argument or analysis, maybe that highlighting is still useful, but there might also be tools like citation managers, bookmarking tools, heck, even a really good word processor, using the sort of capacity of the word processor to copy and paste and bring things over to make a kind of collage of new ideas. These are other kinds of tools we can leverage as reading tools. But again, we’ll have to think about why those tools might be serving our purposes successfully. And it won’t always be obvious to students what those hacks are. Sometimes they’ll come up with new things and ways to do it, but until we make explicit the ways that we are inviting this reading work, it won’t be clear how to really adapt the media in any way.

Rebecca: And I think one thing that comes up in your book, too, is the idea that there’s a lot of tools to handle a lot of these different techniques, some only work on one platform, which might not be the most optimal choice. But sometimes that’s all you have, and that you need to find a suite of options that are available across different platforms and things like that, because we don’t want students who have to read, perhaps, on their phone to feel like they’re not included or that they don’t have access to things and that there are tools available but they may not be aware of them. I’m always surprised even for students not realizing that there’s an Acrobat reader for their phone and that they can have things read out loud to them with a pretty easy free tool.

Jenae: Yes, text-to-speech applications are so transformative for so many students, text-to-speech applications are the perfect example of “accommodations for some” are “accommodations for everyone.” As long as we, to your point Rebecca, make those options really visible, we can really empower students to figure out what works well for them, that we don’t need to get too rigid in our conception of what’s possible. I was worried that some readers would see all those tool options in the book and think, “Oh, that’s so overwhelming. I don’t want to have to learn how to use six different things, so I don’t know how to recommend to students a whole suite of things that I barely use any of them myself.” And so I do encourage readers or listeners who are feeling that way, or having that reaction, to just know that they’re not alone in doing this work. I would say there are resources on your campus that you can tap into to learn what some of the options are. A lot of institutions do have some really good local tools and solutions that go beyond the kind of private or free options that are more well known and well recognized. So I really tried to steer away in the book from naming particular tools where I could, that’s one really good way to date your book, and make it not very useful after a small sliver of time. But I do have an appendix with some contemporary options in case people really just want the list of tools. But I would encourage collaboration, not just with other colleagues in your department or your discipline, but again, I’m really pushing hard for libraries today. [LAUGHTER] Libraries are really great places to talk to about these tools, IT offices, teaching and learning centers. And I suspect that listeners to this podcast are already tapping into those resources. But it’s a good reminder that staff and faculty on campus can really partner on some of these initiatives. And these offices are there to do the research, to create the infrastructure that makes these different options available to everyone.

John: One of the things that economists have often noted is that when new technologies appear to do things that were done in a different way, in the past, people generally try to do the things in the same way. So when, for example, water power was replaced by internal combustion engines, and then later by electric power, and so forth, people initially were using the same basic systems where there was one central mechanism transmitting power to different locations in the building. And it took decades and in some cases, centuries, to fully exploit the new technology. I think the same thing happens when we have new ways of teaching. When people first started teaching online, they initially tried to replicate all the things they did in the classroom, whether they worked well in the classroom or not, they tried to come up with equivalents, and it took a while for us to come up with more effective ways of teaching asynchronously. I think maybe the same sort of thing is happening here. And that initially, the first thing people wanted to do were to be able to highlight and to be able to put bookmarks in digital text. But as you’ve suggested, there’s a lot more that you can do when text is in a digital format. What are some of the ways in which digital reading environments can transform the way in which we engage with content more effectively than occurred when it was in a fixed print format? You’ve mentioned a little bit about that. But I think there’s several other things you talk about in your book.

Jenae: Yeah, I have the most affection for the chapter where I cover 1000s of years [LAUGHTER] of media history, which was also the hardest and most painstaking chapter to write, because I was terrified that I would misrepresent all the complexity of book history. But in any case, we can get back to that at some other point.

John: Before we leave that, though, that was one of the things that really struck me, where you mentioned talking about how when people were first reading, they were reading aloud as the normal default mode of reading, because that’s how communications had taken place in the past. And there was concern that reading silently would result in learning less than by speaking the text aloud. And it struck me that that’s happened so many times with any new technology in education or ways of engaging with content.

Jenae: Yes, I think it’s really easy to forget that history. And to forget that books are a new technology. Books themselves, as a ubiquitous technology, are only a couple hundred years old. That’s so mind blowing. I could not stop geeking out over that [LAUGHTER] as I was working on this book, to realize that so many of the assumptions about reading and writing I have held so dear, are very contemporary assumptions that in… gosh, just like the 16th century, the 17th century, orality was really the primary means of distributing information, of comprehending information. Memory was the most valued component of being a literate individual… that is so different in the moment we’re in now where we want to sort of ossify ideas in a very linear form, which is really what a Codex, the printed book, privileges as a technology. There’s a very iterative relationship between media technologies and what we value in our thinking. And something that struck me in writing this book are the cyclical patterns in which our technologies and assumptions we make about our technologies change our assumptions and values about what good learning is, or what acceptable sociability is, or what acceptable learning behaviors look like. And so the same thing is happening in a digital moment where because reading on screen looks different than reading on print, it’s less linear, it’s less controlled, it is less bound… there’s a pun there… is less bound to a certain isolated knowledge space that the author kind of creates. Those things seem like they are less rigorous and less scholarly, when, again, those perceptions of what rigor is and what good reading is. It’s a social construct that’s bound up in the material conditions of how we learn.

John: But even going back further, the book itself was seen as something that would cause us to lose the memory skills that people had from trying to memorize things directly. People objected to books, they objected to reading silently. And we’re seeing exactly the same objections to digital reading. I thought that whole section of your book was fascinating. And I learned a lot from it.

Jenae: Oh, thank you, I’m so glad. [LAUGHTER] Again, it was the portion of the book that I feel like was definitely the last practical part of the book. But maybe as a humanist, in my own training, I really enjoyed that process of getting to tell a very, very, very slivered slice of that history, because really, there’s no way I could really capture centuries of scholarship. But I felt like we needed to have some context to recognize that what we’re struggling with is not new, I think it’s easy in narratives about technology to just focus on the novelty, to focus on what’s shiny and different. And as a technologist, I resist that too. That really, when we’re thinking about technology, I like to shift the conversation more into thinking about space, and about behavior, and about activity, and less about what’s the latest, greatest gadgetry for the sake of gadgetry? I realized I never answered your question. It got us started on this about what we could do differently with digital reading. So I’m happy to go there.

John: So what are some of the new ways of engaging with content provided by digital formats.

Jenae: So I think there’s a handful of things that are really, I’d say, uniquely possible in digital environments. And I’ll frame what I’m about to describe in terms of the digital reading framework that’s really at the heart of this book. And so there are five strategies for digital reading, that they’re broad strategies and, in many ways, the strategies that you could use for reading in any media, but I call them strategies for digital reading framework, because I think you can uniquely map some affordances in digital environments to the strategies. So for example, one thing that’s really unique about digital environments is how easy it is to curate… curation is the first part of my framework… how easy it is to curate lots of different pieces of information, and bring them together. You can, of course, do curatorial activities in print by, say, organizing index cards, or putting together a filing cabinet of articles and information. But online, you can curate even more of a detailed level. So, for example, there are activities I really like to do with students where we use things like tags, you know, metadata, that users generate to create clusters of information. So, if you invite students to tag, for example, a collection of articles they’re finding for research, they can start to see what key topics or terms might be shared across sources they might not have otherwise seen, if they were just trying to index that. You could put together broad buckets of information under those tags much more easily with citation management tools, for example, or you could go even a little bit more old fashioned and use bookmarking tools for this in your browser. You have bookmarking tools where you could create folders that are basically topical tags to sort things. You can even do it on a desktop if you want to do this offline, you could create folders that are organized by subject headers or tags to put things together and create collections of resources. That’s one thing I think is unique is its ability to bring a lot of information together. The other thing I think is really unique and exciting about working online is the second part of my framework, which is connection, which is this easy ability to link lots of different pieces of information together. Again, you could do this in print when you look at the references section of a printed out article or the works cited of a book. You can find them there, but when you’re online, it’s so much easier to generate and follow hyperlinks from one website to the next or to look at a citation trail and see who has cited whom and see how particular ideas are connected to each other, or even at the sentence level to see whether a reference to a particular person or place can be connected to encyclopedic information about that person or place to deepen your knowledge of things that are referred to in the text itself. Let’s say there’s also a description of an image or a graph, you could find the illustration of that and make that connection between the visual and the textual to create a more multimodal experience as well. Again, all possible in print, just easier and uniquely accessible to do when you’re doing this work digitally, I’ll say one more thing that I think is unique about working digitally. And I’m gonna veer a little off from the framework here, but we can return to that if you’d like, but that reading digitally can be even more nimbly social, and more easily shareable. With print, the best ways that we can share ideas are by talking about this, as we’re doing now. Of course, if you go to a used bookstore, you might find some good books that have written annotations of people of yore in them, which always feels like a wonderful discovery. But online, there are all kinds of tools where you can annotate together in real time. So this can be done in something as simple as a Microsoft Word document with Track Changes where you can share back and forth, a Google Doc, a lot of people use now as a really easy way to annotate in real time, and of course, there are specialized tools that make social annotation visible as well, Hypothesis is a very popular one, Perusall, is another popular one, Power Notes is another popular one. There’s a whole suite of things now that are really encouraging students and faculty to work together to make their thinking really visible and social in one text. And I think all those movements have such transformative potential to spark conversation, because reading really is about having a good conversation.

John: I’ve been using Hypothesis in a couple of my classes now for the last three years and students have just found it so incredibly engaging, and that they’re reading things so much more deeply and having conversations right in the text, which is so much more informed than when they were working on a discussion forum online talking about it, or even when we had class discussions about it. My students have generally responded extremely positively to that social annotation process.

Jenae: That’s wonderful. I’m glad to hear it. There’s good scaffolding that needs to make that happen. Your social annotations can turn into a discussion board quite easily. Without the framing, there’s a potential to highlight part of a text and have someone comment and someone else say “I agree.” But, the book actually offers some strategies. It sounds like you’re doing this brilliantly, John, if you’re getting really good results from your students. I’d be curious to hear how you’re framing it because that’s always, I think, the challenge. And in the book, I do talk about some things you could ask students to look for, simple prompts, not just highlighting moments that are important, but also inviting students to ask questions, or inviting students to look at which parts are sort of popular when you do look for things that are important or interesting. So there’s a lot of different ways you can frame that task.

Rebecca: I did that trick with my syllabi during the pandemic, to get students to make sure they’re looking at the syllabus and doing a careful reading of the syllabus and see if there was any policy questions and things and encourage questions about it. And we ended up having some really great conversations as a result of essentially annotating the digital version of the syllabus.

Jenae: Yes, that’s a great assignment. Remi Kalir has some great articles about annotating the syllabus. I don’t know if that was part of your inspiration. And Remi Kalir and Antero Garcia also just wrote a great book about annotation from MIT Press that I think is really… someone’s listening to this and thinking, “Oh, I want to learn more about annotation.” My book is one starting point there. But their book is a much deeper dive into just annotation as a learning practice.

John: We’ll include the citation for that in the show notes.

Rebecca: When we start talking about social annotation, one question that may arise for folks is privacy issues and ethical issues about sharing and making something that historically we might be thinking of as being a private experience more public. So can you talk a little bit about some of these ethical issues around digital reading?

Jenae: Yes, I’d be glad to. And in the third part of my book, I address this conversation in a lot more depth. So this will be sort of a thumbnail sketch of thinking about the real ethical dimensions, as you put it, to digital reading. So, when it comes to social annotation, in particular, we have to be, I think, really thoughtful in our framing about what we’re asking students to share. One thing I would suggest is, as instructors, if you’re going to ask students to use any kind of annotation-based software, (A) to make it really clear to students who will see it. So with most social annotation tools, you can control the privacy settings to make sure that certain annotations might only be visible to the class community. But as an instructor, there is, I think, a little bit of responsibility on you to do that research and to make sure you understand before you ask for mandates and tools, that you know, where students data is going, when they enter it into any kind of cloud-based platform or internet-based platform, in particular. I think this is where tools like Google Docs, especially, get into very dicey privacy-based territory, because Google, in particular, we know has a track record of… especially if you’re using an instance of Google Docs not managed by your institution… that data is owned… all of your written data is owned by Google and is used for optimizing their ad services. So I think before we just sort of uncritically adopt these tools, we have to think about the implications of what we’re doing and give students the option to opt out. Social annotation can be really powerful and really transformative. But there always needs to be ways for students to contribute if they don’t want to have their words online or they don’t want to use a platform. Even if it is private to the class, we still always need to let students make evidence of their work private, because ultimately their thinking is their intellectual property. But it’s also just we want to make sure students have the agency to decide where and how their thinking is made visible. So I would say the other thing we want to think about with digital leading too is where we’re asking the students to read. I think we can forget that every website we go to on the internet is tracked, whether that’s the browser based cookies, if we’re using a university proxy network, a VPN, the University knows [LAUGHTER] where we’re going on the internet. Again, that sounds a little scary, but it’s true. That’s just the reality of the connected world that we live in. It’s not necessarily dangerous, but it could be. There’s always sort of potential for data to be weaponized in ways that we need to be cognizant of. So I would just say that, for as many possibilities as there are, there are also risks that we need to assess and be mindful of. And I realize one reaction to this risk is let’s just go back to paper [LAUGHTER] and forget about it. Why put ourselves into the surveillance network that is the internet for our learning. But there are real risks to reading in print too. There’s less permanence. If I spilled my tea on this book, this book work is no longer accessible to me. It’s like paper’s actually a very fragile technology that way. There’s a reason that some people’s whole jobs are to be preservationists of print materials. So we have to kind of weigh the risks and affordances. And again, give our students choices where we can. So that might just mean, again, as an instructor, letting students for example, if they don’t want to annotate publicly, they could probably easily do the annotation in a Word document and send that to you privately to have it be an offline document, they can even expand their thoughts on a print book and take a picture. If they’re really insistent on doing that, that’s still a kind of digital reading, in a way, even if they’re using a print-based technology to do the optical work of scanning the words on a page, they can again, snip a picture, send it to you, and keep the digital infrastructure intact. And I think encouraging questions… If you as an instructor don’t know what the privacy policies are on the technologies you use, again, partnership with your IT office that looks into information security concerns all the time, your accessibility office that might also be thinking about the risks associated for students who might not always be able to use particular technologies, these are all things that can start to be thinking about when we design these activities and work in these spaces. It might not all happen at once, and that’s okay, too. I think it’s always good to experiment and think about what’s best for maintaining an active learning environment. But these are considerations that we don’t want to ignore, and it might just take our own continuous learning and our own continuous digital literacy development to really make sure we’re understanding just what we’re doing when we’re asking the students to work online.

John: You mentioned that that’s especially a concern with Google tools that are personal Google tools that you might ask students to use. But when you work with Google Apps for Education, there’s generally an agreement where the educational institution owns the data, which provides more privacy protection…

Jenae: Yes.

John: …and Google agrees not to use that in any commercial manner.

Jenae: Yes, that’s a great point. And so it’s certainly worth, if you don’t know, if your institution has a Google for Education license, this is just something to look into. Because to your point, John, the kinds of licenses your institution manages centrally may impact the ways in which student data is used. And yet another example of this… if your institution matches certain tools to protect logins behind Single Sign On authentication for your tool, so students have to log in with their university username and password, that also usually suggests a greater level of security than say a student has to create new accounts and logins to use the tool. Even more risky is if certain tools invite students to create an account with their Facebook username or other social media kinds of connections. If you’re looking to expand your students’ reading behaviors to some tools, it’s always worth just thinking about, “Okay, what are the access points my students will have to engage in to use this? To what extent is it disconnected from our university’s existing infrastructure? And what are the risks of moving further away from the infrastructure or using it?” And again, if you don’t know and you have questions, this is really what a lot of experts on campus are happy to talk to people about to understand those choices more clearly.

John: And even if there is a Google Apps for Education agreement, not all the apps that are provided may be subject to the terms of that. I know, in the SUNY system, there was a core set of apps that were negotiated. And then many other apps such as YouTube were not part of that agreement. So, use of that, or at least at SUNY, is not subject to the same set of protections as are the core apps of the educational platform, though, it is worth exploring, as you suggested.

Jenae: Yeah, I know, it’s kind of in the weeds. And sometimes it’s like, “Oh, gosh, all the legal and technical stuff is super complicated, it’s kind of frustrating.” But I think there’s also really, again, exciting potential to learn with your students. The world we live in now is a world where we both have access to so much more and once more things open up more risks just emerge. just kind of part of living in an interconnected world. And so I think that being curious is a really great habit of mind. And so sometimes I get down these conversations, I too can feel a little bit like, “Oh, it’s so annoying that we have to ask all these questions.” And yet I try to approach it from a perspective of curiosity. And that was part of my motivation for writing this book, too, was just being really curious about imagining what would happen if we really developed a clear understanding of what we get when we do our operations in digital spaces. What’s possible there, and how do we explore that in ways that are engaged and thoughtful and attuned to the material conditions of the world we’re in?

John: One of the nice things about your book is you include a set of activities that you can use in classes to help students engage more effectively with digital content. Could you share, perhaps, a couple of those?

Jenae: Sure, so this can kind of bring us back to our framework a bit. So maybe I’ll share a couple activities that we haven’t talked about yet. So a third component of the framework is “creativity.” And so these are activities that really inspire students to create new ideas based on what they’ve read. We know that reading is mentioned to inspire new thoughts and develop new ideas. So one activity that I think has a ton of potential is one that I call “visualize that” where we ask students to create some infographic or a map of what they’ve read and invite them to really take a step back. Again, doing this online isn’t possible in print. You could have someone draw an infographic. But there’s a lot of tools where students can easily create shapes, create maps, you could do this in your cyber tools, you could use this in explicitly designed mind mapping tools. And if you have students who can’t use these visual tools, or for whom visuals was not an especially effective way to learn, I found a good workaround is actually students create a spreadsheet, like an Excel spreadsheet, where they map connections between ideas to take a step back from the reading itself. So I think that’s one activity that is really exciting for reading digitally. Another one is in the contextualization section of the framework, which really invites to think about not just like how a text exists on its own, but why it exists, who wrote it, etc. So there’s one really simple activity that I call “the journalistic investigation,” gathering the who, what, where, when, why… which, again, you could do this in print, but what’s really nice about doing online is you could have students basically create a shared resource where they work together to gather: “Okay, what do we know about this author? Who are they? Where do they come from? Why do we care about them? Why did they write it? What are the contexts in which this book, or this article, or this piece of research exists?” …and to really inspire students to see text, not just kind of as a floating isolated thing that came from this author’s genius brain, [LAUGHTER] but that exists in a particular context. And that can really shape the way they understand that past.

Rebecca: Thanks for all those great ideas, Jenae, and really thinking through all of these different considerations of reading online and reading digitally. I know that everyone that picks up a copy of the book will find many nuggets within the pages that are far beyond what we talked about today. But we always wrap up by asking: “What’s next?”

Jenae: Yes. So one thing relevant to this book that’s next is that I will be at the Distance Teaching and Learning Conference hosted by the University of Wisconsin – Madison in August. I’m really honored to be one of the invited speakers of that conference where the theme is what’s next. And the topic for me is “what’s next is text.” So making the argument that as we think about futures of online learning, after a year of working remotely, that we really can take a step back to be thinking really critically about what we do with text in online spaces. I think a lot of folks got really into video and audio and the online moment, all of which is wonderful. And yet text is one of the most accessible, flexible, ways that we distribute content and engage with learning and learners if students don’t have access to high bandwidth, internet speeds using chat and using text-based tools really has tons of potential. So I’m thinking about expanding some of this work into, I would say, an even broader conversation about low-tech online learning is kind of where I’ve been really interested in going next with some of my work and thinking about how we kind of strip out the, I think, intimidating overhead of really high-tech gadgetry when we talk about teaching grant technology to remind ourselves that teaching with technology actually involves a lot of tools that are extremely low bandwidth, extremely easy to use, and can be really transformative and have a really high impact. So I don’t know what my next big project is, but I think I want it to have something to do with like low tech, high impact. I haven’t decided how yet. But immediate next is that conference. I hope to see some people there.

John: It’s great talking to you and we hope when you do come up with that next thing you want to address, that you’ll join us back on the podcast again.

Jenae: Oh, I hope so too. Thank you so much again for having me, always such a pleasure to speak with both of you, John and Rebecca. Thank you.

Rebecca: Thanks for your time, Jenae.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

183. Student Workload

College students throughout the country have reported substantial increases in their workload during the 2020-21 academic year.  Few faculty members, though, intentionally increased student workloads during this challenging year. In this episode,  Dr. Betsy Barre joins us to explore some reasons for student perceptions of increased workload.

Betsy is the Executive Director of the Center for Advancement of Teaching at Wake Forest University. In 2017 she won with Justin Esarey, the Professional and Organizational Development Network in Higher Education’s Innovation Award for their Course Workload Estimator.

Show Notes

Transcript

John: College students throughout the country have reported substantial increases in their workload during the 2020-21 academic year. Few faculty members, though, intentionally increased student workloads during this challenging year. In this episode, we explore some reasons for student perceptions of increased workload.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist&hellip

John: &hellipand Rebecca Mushtare, a graphic designer.

Rebecca: Together, we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[MUSIC]

Rebecca: Our guest today is Dr. Betsy Barre. Betsy is the Executive Director of the Center for Advancement of Teaching at Wake Forest University. In 2017 she won with Justin Esarey, the Professional and Organizational Development Network in Higher Education’s Innovation Award for their Course Workload Estimator. Welcome back, Betsy.

Betsy: Thanks. It’s great to be back.

John: It’s great to talk to you again. Our teas today are:

Betsy: So, I’m not drinking tea. I’m having many cups of coffee today. [LAUGHTER]

Rebecca: Well, it’s still warm&hellip

Betsy: Yes, that’s right.

Rebecca: &hellipstill warm, and still caffeinated. [LAUGHTER] I’m drinking Irish breakfast today.

John: And I have ginger peach green tea.

Betsy: Nice.

Rebecca: &hellipan old favorite. So we’ve invited here today to talk about your recent blog post that addresses the impact of pandemic instruction on student workload. Can you talk a little bit about how the pandemic has affected student perceptions of their workload?

Betsy: Yeah, sure. So this issue has cropped up for many of us. I’m sure anyone who’s listening to this podcast has&hellip maybe in the spring, but particularly in the fall… and I think that’s really interesting to that in fall it became an even bigger issue than it was last spring&hellip that we started to hear from students in our online courses, and in our blended courses&hellip not just online&hellip that workload was overwhelming, perhaps even double. And we heard it at Wake Forest. We started hearing it anecdotally. And then I would talk to my colleagues at other institutions who, of their own initiative would bring it up, that they had heard it anecdotally as well, we saw on Twitter folks talking about this. And then we at Wake Forest did an all student survey where we didn’t ask about workload&hellip we probably should have. But it was the number one thing that came up in their open ended comments when we coded those. And so it just reinforced this idea that clearly this is a universal challenge. And it was a challenge across our schools to, so it wasn’t just our undergraduate students, We were hearing in our Divinity School and our law school and our business school. And so something was going on. And it was really intriguing to me, because clearly students felt like the workload was overwhelming. But, and this is what we’ve all said. It’s not as if all of us just sat down and said, “We want to give students a lot more work this semester.” So I was fascinated by it, talked to a bunch of people about it, was thinking about it. I know you all have been thinking about it, and just decided to write some of my thoughts in a blog post. One of the great things in the response to that blog post is lots of folks have come up with other ideas that I think are just as plausible too.

Rebecca: Do you think faculty believe that they’re giving more work to their students?

Betsy: That’s actually a really interesting question, because that sort of premise of my blog post is that, and this was Jody Greene said “No one sat down to give more work to students.” But since I’ve written it and talked to some faculty, there are some faculty who are like, “Yeah, maybe I did, maybe I did give a little bit too much work.” And that’s worth noting. But there are just as many faculty, maybe more faculty who say “Actually I have given less work this semester, and I’ve tried to dial it back and lower the stakes than I have in the past.” And so the fact that there’s that large body of faculty that think they’re doing the opposite, and then the student perception is something different. It’s really interesting.

Rebecca: One thing that you just said, Betsy, about the lower stakes piece, raises an interesting question, because a lot of professional development about going online and using effective teaching practices talks a lot about low-stakes assignments and the ability to check in on things more often. But maybe they’re smaller assignments. Do you think that’s happening more?

Betsy: Well, I think it’s a good thing that it is. And my guess is, that’s part of what’s causing the problem or the challenge&hellip maybe it’s not a problem, but just is causing this sort of disconnect… is that our faculty, particularly many of our institutions, in the summer did a lot of professional development around good online teaching practices, and just good teaching practices in general. And also really emphasized&hellip at least at Wake Forest&hellip we really emphasize this is a pandemic, our students are struggling, let’s lower the stakes on things, let’s be understanding. And so one way to do that is by having smaller low-stakes assignments, so instead of a big midterm, you have multiple weekly check-ins. But of course, our students can interpret that as, “more work,” because if you’re just counting work by counting the number of assignments, then it is, by definition, more work. So, instead of one midterm, you now have five short assignments, that’s five times the amount of work. And so instead of counting in terms of how much time the assignments take, they could be counting and just the overwhelming number of assignments seems like more work. And I think that’s what’s going on, or at least part of what’s going on. And I’ve said to some people that this is actually a good sign that change did happen over the summer, because we didn’t hear as much about this in the spring. People kept their one midterm and their final&hellip at least I didn’t hear about it as much, maybe you two did, but I didn’t hear as much about it in the spring. But then they redesigned their courses in the fall. And the fact that we’re all hearing about this suggests that people actually did things differently. Now, again, it still could be better, but that’s kind of a good sign to me. Now, the question is, how do you dial that back? And how do we communicate with students about it&hellip all really complex, but I do think it’s that breaking big assignments into smaller assignments is part of a contributing factor here.

John: . And we know that students tend to do a lot of cramming, they tend to do mass practice, but we know that spaced practice is more helpful and that we know the benefits of retrieval practice. And that’s something I think that most faculty development centers emphasized with faculty. And I know at our campus, we had more faculty participate than we’ve ever seen. We had more people participate in professional development workshops than we generally see over a four- or five-year period. For the people who were resistant to professional development in the past, they were learning about the benefits of retrieval practice and space practiced, and learning about the benefits of using low- stakes exams, as you were just talking about, and I agree that that’s a good thing. But we know that the practices that students use to study tend to be mass practice, they tend to do repeated rereading, and now they’re being asked to retrieve information. And we know that students believe that that’s less effective, and it’s certainly more work for students.

Betsy: So your point about retrieval practice, and we know students believe it’s less effective to be engaging in this continual retrieval practice, I think is really interesting. And I think that’s what we’re seeing when our students say, “We have more busy work.” So it’s not just that there’s more work, but that’s actually more busy work. And part of what’s going on there is that they think that that practice that they’re engaged in is not valuable, if you are giving assignments that are about practice. And as students see it as busy work, that’s part of us communicating the value of this work, and helping our students understand how they actually learn, and how it will help them on the later exams, I think is really important. That’s not the only challenge. I think busy work isn’t the only kind of challenge. It’s also, I think, for those of us in the humanities, I think what we’re seeing is that the new tools we have available to us make it easier for us to hold our students accountable for doing all the reading, when typically, they wouldn’t do all the reading. And typically students wouldn’t say it’s busy work, but there’s more reading that they have to do than they ever had to do before. And so that’s one hypothesis as well. But I think another point about the busy work and the retrieval practice, moving one exam to 10 short assignments is, and I talk about this in the post as well, is that there is a sense in which that could be adding to your work, in that they have to keep track of it all. And I think our students are not used to having to keep track of so many assignments. So typically, as a faculty developer leading a teaching center, I may have a faculty member come to me that wants to redesign their course. And I make all these suggestions, and they do it and it’s fine. And the reason it’s fine is because, yes, it’s a little bit more work and a little bit more stressful for the students. But it’s only one course. But I think what we saw is that all of a sudden, our students were moving from five courses where there were three assignments to five courses where there are 15 to 20 assignments or more. And that was even more compounding the exponential growth that they felt. So I teach with lots of small assignments, I always have. Students would sometimes say this is more work than in a typical class, but they weren’t upset about it. They didn’t feel overwhelmed by it. That’s because again, it wasn’t five of their courses that were doing it. So it is a really interesting question of when we go back post-pandemic, do we want all of our courses to work this way? And how do we help our students readjust to this is the new workload? or this is going to be the new experience of the new workload? Or do we not want to do that? And I think that’s an interesting conversation for all of us to have moving forward.

Rebecca: I know one of the things that I’ve had in conversations with students, just anecdotally, but also in some of the formal research that I’ve been working on related to students with disabilities, is the time management piece and just trying to manage and organize all the moving parts that are on all these different platforms is complex, but also that moving with more materials online has resulted in more reading and writing&hellip

Betsy: interesting.

Rebecca: &helliprather than other modalities that we might typically use in a face-to-face class like face-to-face conversation, which to them seems really much more time consuming. And it may actually be more time consuming, especially if you have a particular kind of disability.

Betsy: Right. So there are a couple of things to say there. So I did say one of the things I noticed is when you read student concerns about this, they will often say things like “It took me this much time to do a discussion post.” And that’s, I think, really revealing for all of us to understand. We often think, “Okay, the discussion posts are going to take the place of the discussion in class.” But right now, I’m just talking to you two, and I’m not thinking very hard about what I’m saying. And in fact, if you created a transcript of this, which you guys probably will, I’ll be embarrassed to read it, because I don’t think it’s as coherent as I want it to be. And if I were writing a discussion post, I would think very carefully about how I formulate my thoughts and my arguments, and even proofread. And it’s gonna take a lot more time, if I’m actually writing it out. And I think that’s really important for us to acknowledge that discussion posts and a discussion are not a one-to-one replacement. Or if we want it to be a one-to-one replacement, then we need to tell our students, we expect you to treat it as if you’re not actually writing something that’s meant to be thoughtful, we just want to hear your opinions about this. So that’s one piece. But then in terms of your point about disabilities, I think it’s really interesting in that all the best practices for Universal Design for Learning, we can revisit, and I didn’t talk about this in my post, but I should have, so thank you, Rebecca, for sharing this wrrinkle. Because I think it’s an important part of it is that giving students options for how they can do this work will also empower them to do things that they think are most efficient for their time. So if they can do a VoiceThread or make a video, or one of the activities that some of our faculty have found very successful as an asynchronous replacement for discussion, is to just put students in groups and tell them, in your own time, you get together, have a Zoom discussion about the material, record it and send it to me ,that you’ve had that discussion. So they actually have a discussion. It’s just sort of asynchronously done. But in general, giving students options, it’s not going to solve every problem, but it does empower them to have choice, because there will be some students who prefer to write than to speak. But there may be something like “I’m tired of writing, I want to actually just speak.” And then in terms of the material, I think there was this recent meta analysis that just came out like last week about video versus text, which was really interesting. And as a humanist, I’m sad to see this, but it’s not surprising that sometimes video can be better for student learning than a text can be. Because I often think, “Oh, I’ll just give them something to read, and that will be the replacement for a lecture.” But maybe sometimes there’s a way in which they’d rather watch somebody talk about that material, rather than read about it.

Rebecca: Or by extension, just listen to the material, like in a podcast or something.

Betsy: Yeah, podcasts are a great opportunity. And we’ve heard students say, when I’m walking around campus, or when I’m working out, and it allows them again, to expand their schedule where they have more time to do things and no screen time, which is something they really appreciate because there’s so much Zoom fatigue, that being able to listen to something where they don’t read online and then have to watch online, they can just listen to it is a real relief for them. Absolutely. Unsurprising you all like podcasts.

Rebecca: Anything that gets us off the screen, actually, is something that I work a lot to do with my design students, because whether it’s a pandemic or not, we spent a lot of time on the screen.

Betsy: Yeah, fair enough. So you’re an expert at this. Yeah. You’ve thought about this. That’s great. Yeah, for sure and I think we need to think about that more.

John: But I know even for people who are teaching asynchronously before, some people have started using new tools. On our campus, for example, people who used to give students readings as a basis for discussions now are having students use hypothesis for the discussions, which means students actually have to open the reading [LAUGHTER] and actually respond to the text, which can take a lot more time than just skimming over the abstract and responding to it. And similarly, I’ve been posting videos for 20 some years in my classes, but now I’m doing it where there’s questions embedded in it, which means they actually have to watch them now for a small portion of their grade. So I think some of the tools that people are using may provide more learning, may provide more engagement, but also is going to take a lot more time than how people use them before. And you noted in your blog post that many students would be able to get by and coast to get the grade they want without doing a lot of the things faculty assume that they did. [LAUGHTER] But again, I’m not sure that’s a bad thing. But it does require more time on average.

Betsy: Yeah, it’s a complicated question. It’s a self report, so it could be even lower than this, but just general self report on how much time students spend each week studying, it’s about 15 hours a week, on average, prior to pandemic, and that is for a full-time student. So imagining 15 credit hours they’re studying, it’s one to one, and many faculty assume or hope that it’s more than one to one. [LAUGHTER] But students are very strategic, they’re learning an important skill and figuring out what does need to get done and what doesn’t need to get done to be able to be successful in a course. And so certainly I appreciate that. But I think recognizing this disconnect is important because it helps us understand why faculty didn’t think they were giving more work, but students actually did have more work because faculty were mistakenly assuming that students were spending 30 hours a week studying when really they were only spending 15. And so being aware of that now helps us have a much more honest conversation about well, what do we expect the standards to be for students, and there are differences across different institutions and different programs. So our graduate professional programs are for folks who are working full time, have different sorts of informal expectations, I think, than others. And so it’s worth it for all of us to come together and to talk about that. But I will say I do think it’s just important to say&hellip I probably said this in the post… but we do know that the more time students spend on a task, the more they will learn. So it’s not just like we’re piling on the hours because we want to punish them or we think that’s just really what rigorous teaching is. It’s that actually we know you’ll learn more if you spend more time thinking about a text or practicing the problems, as you said, John, that this will help you learn more. So you obviously don’t want to expect so much that they can’t do other things they have to do in their life. So that’s the tension. I think my recommendation always be if you have to have a full-time job, you shouldn’t be a full time student, because that’s like too much work. So thinking about how do we calibrate the courses that students taketo how much time they’re actually able to put into it is really important. So yeah, I do think that that’s happening. It’s not the only thing. Again, I also think there are faculty who probably expect too much as well, because we’re not good at estimating how much time it takes for students to do things. I think Hypothesis is a great example. I use Hypothesis in my class, I love it. If you’re a humanist and you haven’t used, or if you have assigned readings and you haven’t used Hypothesis or Perusall go look it up and find it. It’s pretty amazing. But I think that remembering that, yes, it will make them read. So that’s extra time because they’re actually gonna have to read and they’re gonna have to read carefully enough to have good questions. [LAUGHTER] So they can’t skim it, as you said, John, but then all the time it takes to actually read everybody else’s comments, really remembering that and that’s where I as a newbie to online, that was like an aha moment for me when one of my colleagues who’s an expert in online teaching was like, “It’s not just the time it takes for them to write their own discussion posts, it’s also they have to read everybody else’s. There’s extra reading that’s involved.” It’s not just the text itself, but it’s also reading everybody else’s responses and so putting them in groups where they’re responding to fewer people or reading fewer people is a really useful tool. Again, I think probably all of these hypotheses are going on. And it’s worth us being honest about all of them, instead of saying, “Oh, it’s definitely the students,” or “it’s definitely the faculty,” it’s like we’re all in this together, and let’s figure out how we move forward.

John: A nice thing, perhaps, would be to give students information about how much time these tasks take. And it would be nice if there was a tool for that, [LAUGHTER] which I believe that you have created.

Betsy: So yes, we have a tool that actually we made pre-pandemic. But one thing I want to say, because a lot of people have used this tool, and I think sometimes people use it in ways that are asking you to do more than it was intended to do. And that it is very much an estimator. It is not meant to be a calculator, that is the exact amount of time that your students are going to spend on something. And it’s very broad. It was essentially just something that I was interested in creating as I was thinking about how much work I assign students in terms of reading and writing. And the original version of it is very much tilted towards reading and writing. So oftentimes, we hear from STEM folks like “What about problem sets?” And that’s and that’s just the Wild West in terms of how much time students spend on that, it’s much harder to get a handle on it, so it’s not there. But there are places in this estimator where you can add a new assignment that isn’t captured by reading and writing and just give your own estimates for how much time you think students will spend. And the main value of this estimator, I think, is that I found that many of my colleagues, myself included, are just not good at the head math required, we just keep adding these assignments, and we think we have a good sense, but literally sitting down and writing out like “Okay, they have to go to the library to get the source.” Well, it’s gonna take him some time to walk to the library and walk back&hellip like literally things like that, realizing how much time you’re asking your students, and then adding it up can be really valuable. And I would do it sometimes on the back of an envelope, but it was chaos. And so I thought, why can’t we just have a calculator that does that, So we have an old version of the calculator, we have a new version that my colleagues in online education at Wake Forest, Allen Brown, helped us work on to add in discussion posts and video lectures and other things so that it’s a little bit closer to what asynchronous online courses might involve. And it can be a tool for overall assessment, but also individual assignment assessment of like, how much time might it spend for them to do this type of reading or to do these types of videos. And if you disagree with what the estimator says, my favorite feature of the estimator is, you can manually adjust it. So you don’t have to get in arguments with us. Whatever your own assumptions are, you can go in there and put that in, and you’ll still be surprised with what the total amount is probably, at least I often am, that I’m giving more than I realized and I have to go back and make some hard choices. So hopefully, it’s a useful tool for everyone. But as John, you said, one of the best things about it is that allows us to better communicate with our students about what we’re expecting as well. And we’ve heard from so many students who have found it super helpful in the courses that have done this, both students who are struggling, but also students who are crazy overachievers, and who will spend 20 hours on a one-page paper. It’s a real relief to them. Even if they only spend four hours when they’re supposed to spend one, at least it’s four, and not 20. So it helps them manage their time as well.

Rebecca: One of the things that I’ve done, at least on longer term projects, that has worked really well for me and my students is having them keep a timesheet and asking them to divide out tasks. And I pose it to them so that we’re in the design field. So it’s to help them think about how they might price something in the future, so they know how long it takes them. So that’s how you get the buy in. But what it helps me do is see how long it takes them to do certain things. And realize it’s like, “Why did you spend this amount of time doing this thing that was really not important, as other thing was much more important?” And then you can coach the group on those sorts of things, which can be helpful. And along those same lines, one of the things that I run into, and this may fit more into the idea of problem sets or things like this is how much time students will try to problem solve a technical issue that they just aren’t problem solving in the right way at all. And so they could spend hours trying to do something that if they just asked a question… [LAUGHTER] &hellipit would have taken two minutes.

Betsy: Like ask for directions…. [LAUGHTER]

Rebecca: Yeah, so I’ve been reminding my students, especially since the fall, when we’ve been doing much more online,that, if you’re spending more than 15 minutes trying to solve this technical problem, A. take a break, you’re just going in circles, maybe come back and try again. But if you’re spending much more time than that, then that’s a good clue that you need to ask for help.

Betsy: That’s really smart. And really, I think, super helpful. And I think getting feedback from our students about how much time they’re spending is not just good at the individual level of coaching. It also is great formative feedback for adjusting our own expectations. Again, and it corrects the estimator, maybe you put it in the estimator, and has happened to me too. And I realized&hellip because one of the things about the estimator, it’s best about reading, usually, in terms of its reading estimates, but one of the central insights from the reading literature is that the difficulty of a text is just as much about students’ vocabulary as it is about the text itself. So I would guess “this is a pretty easy text for my second year students at Wake Forest.” And then if they’re all taking a lot longer, what I realized is that actually, I misjudged their familiarity with these concepts that would be in this book. That this book is actually harder than I thought it would be. So I need to up it in terms of the estimator to say “Actually, there are more new concepts than I realized that the students are engaging with and it’s going to take more time.” So asking the students is just as important as you communicating with them. It’s a two-way street for sure to get that formative feedback. I also think telling them about time management and struggling with time management. I’ve seen some really good strategies. I know our learning assistant center, who works with students, has some good counseling that they do with students about how do they create a master syllabus or kind of a calendar for when they’re going to do things. And I also saw somebody, I think, shared it on the POD listserv, but a strategy of creating a Google calendar with basically time slots for all of your activities in your course. And then students import it into their Google Calendar and move those around. So you would set it up like two hours for reading this text. And then they could move it in their calendar. And so that works for them. But they basically see the blocks of time that they need to set aside. And if they did that for every class, it would be even better, they could see “Oh, wow, this is 40 hours in a week, I need to set aside time to do this work.” And frankly, we should be doing that even before the pandemic. But we’re learning this lesson now of how to help our students manage time and due dates, and all of that, because it is a little bit more. And again, I also want to emphasize too, not just all the cognitive load of multiple assignments, but learning new tools also takes time. This is kind of your point about troubleshooting, Rebecca, like, if a student has never used the video function on Canvas, they may find themselves spending 45 minutes trying to get the video function to work, when that’s not in any of our calculations of their assignment. We’re assuming they’re just going to record the video and upload it. So being mindful of the time it takes them to learn a new tool in this scenario is also really important.

John: You mentioned the issue of reading tied to students prior knowledge and vocabulary. But that’s going to vary a lot across students. So I know a lot of people, when they include estimates from the calculator, will say this is an estimate of what this is, your mileage may vary and keep track of how long it takes you to do these things, and use that to adjust your future estimates of the time requirements for these tasks.

Betsy: That’s a nice idea too, to say you students adjust. So that’s really smart. I like that a lot. For sure, it varies across students. And especially, I mean, even thinking about students with disabilities is an even more interesting challenge. And there is an interesting question, I’ve had some good conversations about to what extent, if we’re putting that estimate… the average&hellip in the syllabus does that create problems for students who may be slower, they think that there’s a deficit. So you need to be thinking about how you frame it, I think is really important. And to be up front that saying it is expected and that is the normal course of things that we’ll all have different rates and this is a ballpark average. You can even put a range&hellip might be an idea too&hellip of ballparks there, but recognizing and saying it’s totally understandable that there’ll be jeans taking a different amount of time, because again, prior knowledge, not just ability, it’s all sorts of other things. How often have you read in the past? How often have you worked with technology in the past? Any of these things, they’re gonna make a difference.

Rebecca: One of the things that conversations about perceptions of workload lead me to is I wonder what the perceptions of learning are?

Betsy: Yeah, I think this is a great question. Because when we think about how students got “got by” in the past by doing less work, what they meant by “get by” was successfully complete the course and get the grade that they desired. If we actually ask them about how much they learn, I don’t know. I mean, that’s a really interesting question, would they say, “Oh, well, it takes more to get my A now&hellip” so that’s duplicating the workload&hellip “But, oh, by the way, I’m also learning more.” It’d be interesting to see. I mean, it depends on f the primary issue here is that students doing less work before and now they’re doing all the work we expected of them, then I think you would expect a lot more learning. But there could also be these issues of the pandemic, I’m in crisis, I can’t work as quickly. If those are the issues, or I’m overwhelmed by the multiple assignments, and I can’t keep track, then there may not be as much learning happening. So my guess is there’s probably equal levels of learning, it’s totally a guess. But in other words, that there are challenges to this moment that students learn less. But there are also things that we’re doing better than we have in the past that make up for that. But I hope that we get some good empirical data on some of this and think through it, because I do think that these strategies, while they are more work, are also probably likely to lead to deeper and lasting learning as well, if the students are able to do it. There’s also the challenge of students who just give up, and then get overwhelmed, and they’re just completely behind. And then they have no motivation to even do a little bit. And so we want to be mindful of that too. But if they’re able to keep up, I’m hopeful at least, that these things should, at least from the research, they should lead to more learning, but who knows.

John: In terms of student reaction, though, student perceptions of what’s most effective is often passive learning and repeated reading. Fluency illusion makes it seem that you’ve mastered the material without being confronted with some type of evidence that you really don’t know this stuff quite as well. And that all the techniques that we’re actively encouraging in teaching centers are giving students more feedback more regularly about what they know, and what they don’t know. And that doesn’t feel as good. And there was a study at Harvard about a year and a half or so ago, where they surveyed students on how they perceived their learning, relative to the actual learning gains they receive across both lecture-based classes and classes that relied on active learning. And there have been a lot of such studies where in general, the students believe that active learning is not as effective yet the learning gains tend to be significantly greater. So there is a bit of a disconnect between what students perceive as being effective and what actually is effective, which also can lead to that perception of busy work that you mentioned before?

Betsy: Yeah, I absolutely agree with that. I think, and this would be a whole other podcast you probably all have done all these podcasts thinking about this issue of student perceptions about learning. I think part of it is what they’re used to. There’s a lot of things that are going into helping all of us understand how we learn and what works and what doesn’t work. And so I think there is a hope for us to try to sort of bring them along with us, I guess I would say, I guess the valuable insight from the studies is that we shouldn’t take for granted that if students say they’re not learning, and if they aren’t learning, that we need to recognize that they may be. And so part of our job is to help them understand, with hopefully concrete evidence that we can show them, “Look, you’re actually learning here in significant ways” &hellipto help them understand why we are choosing these approaches. And it’s not just because we don’t want to teach or we’re lazy, or what are other stories people tell about active learning, moving forward. So I think part of the way we bring them along is to also acknowledge that sometimes there may be assignments that are not useful, and that there may be sometimes things that are overly burdensome in terms of time. And so instead of just always being “You’re wrong, students, you’re wrong here, let us tell you how it is,” to say, “Okay, let’s listen to our students” and say, “Actually, that assignment, it took more time than it was worth. And so we’re going to think creatively together about things that will work for you.” But also acknowledging that there’s a long literature on how people learn that should inform it, and not just perceptions that make a difference.

Rebecca: I think when I’ve even asked students about some of those things like “What do you wish you had more of?” &hellipthey do realize that when you have those little assignments to hold them accountable, and help them practice, I had students asking for more. In the fall, I had students saying “We had a few of those, those were helpful. We wish we had more of those.”

Betsy: Yeah, there’s no question. We saw that in our survey, too. And that’s the reality of anytime you do a study, it’s an average. On average, students think they’re learning less, but they’re always going to be students who, “Oh, I’m aware, I’ve seen this happening.” And they’ll be students who sort of totally missed the boat. But yeah, we saw that for sure. We saw students who appreciated the check-ins, but the number one thing that we saw from our students on various questions was that they wanted more opportunities to work with each other, which, normally, they don’t like that. And there’s literature, right? It’s like, “Oh, I want to be taught by a teacher and not my peer.” But in the pandemic moment when they don’t get to connect with their peers, like socially. So our students are back on campus at Wake Forest. But there’s lots of restrictions on what they’re allowed to do with each other socially. So especially for some of our first-year students who hadn’t made friends yet, this was their opportunity. Classroom collaboration was their opportunity to make friends. And so yes, it was tied to their learning. But they also really just appreciated it and said, “I want to be able to work more, they helped me understand the material more.” So they were calling out both the sort of friendship aspect, the social aspect, and saying, “Oh, it helped me feel more confident in the material, because I could ask questions.” So I certainly think it’s not a universal story, that students are upset about these kinds of active learning and small stakes things. But it’s more universal. I think that they feel like there’s a lot more work. And so that’s what’s so interesting. Rarely do you have a finding or experience where so many people are in an agreement about this. And so it’s just such an interesting thing that I have not met a person who said, “I felt like I had less work.” That’s kind of interesting. But there was one student in our survey, I think I quoted this in our blog post, that was really interesting, where she said, “The courses are easier, but they’re emotionally more difficult.” So the online courses are easier, but it’s emotionally more difficult and more difficult to try hard for. One of my hypotheses was that being in a pandemic makes our capacity to work lower. And so I think that’s part of what that person was getting at. Everything feels like more work, even if it’s the same amount of work. And I am guessing that it’s both that and also maybe a little bit more work too, that’s going on, I’m going to be curious to see what happens in the spring. We’re gonna do our survey again. And we did have some interventions where we talked about this, but there’s no mandates about what people are going to do. So we’re going to ask our faculty, again, what they’re doing. And then we’re going to ask our students and see if things got better. And hopefully, that’ll make us understand maybe which hypotheses are more or less likely to be true? Who knows?

Rebecca: If anything, at least, this is something faculty and students all have in common. We all feel like we have more work.

Betsy: Yeah, well, [LAUGHTER] and actually, we didn’t even mention this. And I didn’t mention in my blog post, because it was already too long, is some of this switch to low-stakes assignments also increases the workload for faculty. You don’t have to assess it all, but many of us are just used to that, so we look at everything and grade everything. And so certainly, we heard a lot on our faculty survey of “I cannot sustain this for another semester.” So, this semester, we may find that many of them have shifted back to fewer, larger assignments. So I’m not sure. We just heard some anecdotes, but I could see that happening too, for their own workload sake as well.

John: In addition to the trauma of the pandemic and all the issues associated with that, I believe you also mentioned the fact that many students signed up for face-to-face classes and just being in an online environment is going to make them less happy. And if you’re not as happy in that environment, it’s going to seem like more work.

Betsy: That’s right. Yeah. And this is where I had a throwback to my own time tracking that I did. Maybe five or six years ago, I did time tracking of my own time and I was fascinated because I wasn’t very good at predicting what I was spending my time on. If I didn’t like being in a meeting, I felt like it dragged on and on and on. If I was reading a book that was really exciting. I thought it was like this [finger snap]. But actually, if I went back, “Oh, I was actually spending a lot of time” or even just working on a design project, I would just lose hours staying up till however many hours in the night because it’s exciting to me, it doesn’t feel like work. And so my guess is that there’s some of that going on, too. And I will say in our survey, there was a group of students who were really unhappy with online learning in general, not specific teachers, not specific strategies&hellip that they did not want online. And so those students, obviously, if they had that much anger and sadness about being online, I can’t imagine that they would be excited and enjoying&hellip like, just another 15 minutes of online would be a slog for them, you know, and so I’m sure that things are slower, because they’re not enjoying it, because they didn’t choose it. And I think that’s a really important thing for all of us in higher ed to be thinking about is that, just because there are some students who are unhappy with online right now doesn’t mean that online itself is the problem. It’s partially giving our students autonomy and choice of how they experience their courses. And there are some of our students who just really want to be in person. And those students are probably also the people who really want to be socializing with their friends. And they aren’t getting any of that right now. And so they’re doubly upset, triply upset, like many of us, and that’s not a good position to be in to enjoy your work&hellip the work is really work. I’m sure that some of that’s going on.

John: I spent a decade working on our faculty assembly one semester. [LAUGHTER]

Betsy: I like that. Yeah, there you go. That’s true, right. Sometimes there’s something that just drags on. Time is tricky like that. Some of our students also commented on just sitting in their dorm rooms all day on their computer screen all day, and leaving to get takeout food and coming back. And they’re in singles, often&hellip a lot of them are in singles, because we de-densified our dorms, like it’s just not a great mode of existence. And so anything they can do to get away from the screen, as Rebecca, as you said, that I think is a really valuable strategy for all of us to try to incorporate into our courses.

Rebecca: I’ve noticed this semester, in my classes, I have really good engagement. They’re synchronous online, I can see people contributing. But there’s a lot less camera use this semester than there was even last semester with some of the same students. And maybe it’s the winter slog, “Oh, the winter won’t end.” But it’s just also just being on screen and feeling almost like you’re in performing mode. I think it’s some of that, too. I’d like to turn my screen off sometimes.

Betsy: I was just gonna say that for those of us that are in committee meetings all the time with our colleagues, like we’re still with screens on all day. And yeah, I absolutely think that there’s just an exhaustion and awareness that there’s another semester of this, we don’t know when it’s going to end. &hellipreally tough, certainly.

Rebecca: So we always wrap up by asking what’s next?

Betsy: Well, if I knew what was next for the fall, I’d be a millionaire right now. Who knows what’s next for the fall? I think that’s the biggest challenge for all of us, as we’re thinking about higher ed, in the near term, at least is what’s going to happen in the fall. But I do think with respect to the topic of this podcast, we often talk about when the pandemic ends. It’s going to be like a trickle, I think. There’s not going to be a sharp ending to it. But whenever we start talking about the future of higher ed in a serious way, I do think there’s going to be a very interesting question about how much do we expect of our students outside of class? And what is an appropriate workload? What is the nature of a credit hour? All of those kinds of questions should be on the table because I know for a fact that many of my faculty, even when they go back to in-person are going to want to keep using the strategies. They’ve read the research that we presented to them this summer, and they see that it’s valuable and that their students are learning and so it’s not as if the workload is going to decrease dramatically, I’m guessing, when we go back to in person, so we may need to have larger conversations about that in higher ed.

Rebecca: Thanks so much for joining us, Betsy. It’s always a pleasure.

Betsy: It was great to be back. I love this podcast. Thanks so much.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

156. Social Annotation

Do you struggle to get students to complete readings or to deeply discuss readings in an online environment? In this episode, Margaret Schmuhl joins us to discuss how a social annotation tool can engage students in conversations with the text and with each other about the text. Maggie is an Assistant Professor in the Department of Criminal Justice at the State University of New York at Oswego. Maggie has also been working with us as the facilitator for our second cohort of faculty in the ACUE program here at Oswego.

Show Notes

Transcript

John: Do you struggle to get students to complete readings or to deeply discuss readings in an online environment? In this episode, we discuss how a social annotation tool can engage students in conversations with the text and with each other about the text.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted byJohn Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer.

Rebecca: Together, we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[MUSIC]

Rebecca: Our guest today is Dr. Margaret Schmuhl, an Assistant Professor in the Department of Criminal Justice at the State University of New York at Oswego. Maggie has also been working with us as the facilitator for our second cohort of faculty in the ACUE program here at Oswego. Welcome back, Maggie.

Maggie: Hi. Good to be back.

John: Good to see you, Maggie. Our teas today are:

Maggie: Well, I’m having an orange spice herbal tea.

Rebecca: That sounds nice and warming.

Maggie: It is. It’s very cozy for a cooler fall day.

Rebecca: I have Scottish breakfast, which apparently is my new default tea.

John: I’m having a ginger peach green tea, which I’ve been having a lot recently, too. We’ve invited you here to talk a little bit about how you’ve introduced the social annotation tool, Hypothesis, in your classes this summer and this fall. Could you talk a little bit about what prompted you to adopt Hypothesis for your classes?

Maggie: Yeah, so a couple of reasons. First, in my spring semester classes, I like to think that my students are very open and honest with me, especially when I asked them if they’ve done the readings. And for the most part, I get a very resounding “Nope,” like, “…haven’t done them.” And I just take a deep breath and carry on with the class, knowing that none of them have done any of these readings. And so, after feeling a bit frustrated for a long time with my classes not actually completing the readings that I’ve carefully curated for the class, I was looking for something that could keep them accountable to those readings, I had had colleagues who would assign reading summaries and such, and that seemed great, but I wanted to be able to see something, I wanted to see how they were understanding the reading. And I think John, you actually inspired me to consider Hypothesis because you had used it in some of your classes. So, when we had been meeting with the ACUE cohort, it was super interesting to me. So, I took a workshop, I think through CELT, with the Hypothesis representative, and it seems like a super easy functional tool. And I really liked that it was embedded right into Blackboard. So, it wasn’t necessarily throwing a lot of new technology out at students. And they didn’t have to create accounts, they didn’t have to go to a third-party website to use the annotation tool. It was something that I could throw right into the module, and all they had to do was click on it and start writing. So, it’s simplicity was super accessible, I think, for my classes.

Rebecca: One of the things that I think is really interesting about Hypothesis as a tool is that, if you’re using it for accountability purposes, it ends up being more of a dialogue with the readings rather than what can be perceived as busy work of summaries, or some of these other things that either just feel annoying to do, or annoying to read as a faculty member. And the same thing can happen with quizzing, too. It’s another thing to grade or another thing to look at. Sometimes that can be really effective. But, it’s a nice different way of doing it. And I think it’s really enjoyable as a faculty member to see how students are looking at materials.

Maggie: Yes, absolutely. Because with reading summaries, there’s an easy way out for students just to like look for a summary on the reading. But when you really want them to start asking questions about the reading, this tool helps them be able to locate certain segments of the reading that they may not have understood or something they found particularly interesting, or were able to connect it back to other classes or other information that we’ve talked about in just a really fluid way. So, yeah, I absolutely agree. That’s one of the big benefits I’ve found with this tool.

John: Did this replace some earlier activity? Or was this a new activity that you introduced in your class?

Maggie: So, actually, I haven’t had it replace anything. This has been more of a tool I’ve used, in addition to discussion posts, and so forth. But now that I’ve had a couple of courses under my belt with this, I do think I’m going to move towards replacing discussion posts. The discussion posts, from students’ feedback, they see discussion posts as just answering the questions that their professors wants, whereas the annotation allows them to pull out things that are interesting to them. And they’re able to engage, they think, in a more natural way than it is on the discussion posts. So, they’re reading through each document and, along the way, they see what their classmates are writing and where’s discussion posts, you have to go back into each of their classmate’s forums to see what they have written. And it seems a little more, I guess, artificial in discussion posts to just kind of comment like,”Oh, I agree. Here’s what I also wrote.” And it seems like a much more casual way of interacting that’s more akin to what we have in the classroom when we are face to face.

John: Do you think it encourages deeper and closer reading of the texts?

Maggie: Oh, definitely. I think a lot of my students have given me the feedback that they’re not just skimming the text anymore. They’re not just looking for the main findings or the points to summarize, but they’re actually considering each part of the text. And as they’re considering each part of the text, they’re using this tool to communicate to me their interpretations of the readings, but also the ways it connects back to their own experiences. So yeah, I found it to be quite invaluable for that kind of engagement.

Rebecca: Do you see it as a way to facilitate or to encourage community building around the content?

Maggie: Yeah, so I think that when I do replace discussion posts, there will probably be a little bit more of that. But, I already see where students are using the reply function. So when they create an annotation, they have an option to reply to another classmate’s annotation. And so I see dialogues begin to unfold between three or four students, whereas in discussion posts, if I tell students: “Okay, engage with someone else on their work,” they’ll pick one person, and they’ll respond to them. But again, it almost becomes like a text message to each other. And in a way, it seems, I think, more natural for them to just quickly write back and forth in response to each other’s questions, as opposed to having something a little more drawn out in a discussion post.

John: So how have students reacted to the use of Hypothesis.

Maggie: For the most part, my students have really enjoyed Hypothesis. Of course, there are some students who find it to be a little tedious. But, for the most part, when I asked them, whether they prefer discussion posts or their annotations, most of them prefer the annotations. They felt like they wouldn’t have completed the readings in a systematic way if it weren’t for Hypothesis. So, they’ve pointed to this level of accountability that the tool gives them to those readings, they actually feel like they’re retaining more information from those readings because of the way that they’re engaging with it. When I have a synchronous session, and we are diving into some of the issues that these readings bring up, engagement in those discussions are much greater than they used to be. I used to feel like I had to tailor questions so if they did the reading, or they didn’t do the reading, they could still participate. But, now I feel like we can actually dive into some of the nuances of that text in a way that we just couldn’t do before, when they didn’t do the reading.

John: it’s a whole lot easier, I think, for students to actually read the text when they have to actively be in the text to do their comments. So, it’s a little more difficult for them to evade doing the readings.

Rebecca: One of the things along those same lines that came up in a reading group discussion that we were holding yesterday was the idea of accountability and faculty talking through the concerns that they had about students being held accountable for things and that they seemed less accountable, or that employers have said that recent graduates seem a little less accountable than they had previously. So, it’s interesting to be able to use some of these tools to encourage accountability. But also, I think, it mimics a more professional experience about how you might engage with materials professionally. And so maybe it just feels more authentic, and therefore it’s easier to be more accountable.

Maggie: Oh, I love that, because I do think that, at least in the context of our careers as academics, we use annotation tools like this all the time, whether it’s in Google Docs, and we’re making comments and we’re working with co-authors and other faculty members on different projects and such, I definitely see where we use those tools and those skills that it’s a good skill set to encourage students to build.

John: Since we have this integrated into Blackboard with an LTI, it’s possible to do grading in the LMS. Have you been grading students on their participation?

Maggie: Yeah, so when I first started using Hypothesis in the summer, I was grading them, but at the time, the grading wasn’t embedded right into the Hypothesis platform. And so I was grading on a separate rubric and grading them sort of apart from each other. But now that I’ve been able to use the grading function right within, it makes grading much easier, because I can simply click on the student’s name, all of their annotations, and all of the replies that they’ve given to other students will show up right there so I can review them, give them a grade, move on to the next students, and it automatically loads right into the grading center. And when I’ve talked to students, they actually, not so surprisingly, said that if it wasn’t graded, they probably wouldn’t have done some of those readings. So, it certainly made me feel better by including this as a graded portion of their final grade, because I think without that incentive, they may not have engaged with it. But, I will say that I require students to do a minimum of three annotations, and I’ve several students who are doing 7, 8, 10, 12, just depending on the reading and their topic of that reading. They seem to be willing to move above and beyond that minimum standard, which I think is pretty cool.

John: I’ve seen exactly the same thing, that even though I did have some minimum specified, most of the students were doing2 to 10 times as much as a minimum when they were using Hypothesis.

Rebecca: Perhaps that attests to, in both of your cases, of actually helping students establish a habit of how to read or you get in the habit of using that tool to read and then you’re reading the whole document anyway, so you just annotate the whole thing.

Maggie: Yeah. And I was afraid that, as students were going through the readings, they would basically stop at the first page and put all of their annotations right on that first page, but I haven’t looked at all of their submissions. We do annotations every week on a reading, and so I’d have to pull it all out and compile that data to see what kind of patterns emerged. But, it seems to me that they are doing these annotations throughout the entire reading, they’re not just going a couple pages in and then being finished with it. Of course, there are students who are like that, but when I’m scrolling through that document, and I get to page 17, there’s still annotations there, which I find encouraging.

Rebecca: Probably, once a couple of students do it, and start modeling that, that becomes the standard of behavior, then people realize, like, well, even I’m not gonna read the whole thing, you got to read parts of the thing. [LAUGHTER]

Maggie: Exactly, yeah. And I’ve had a lot of student feedback that they like seeing what their classmates are writing about, because it’s given them insight into their perspectives on the reading and how it connects to their lives and their experiences. And I think it allows for an engagement in an online platform that I typically tend to enjoy in a physical face-to-face classroom.

Rebecca: And reading can seem like a really lonely activity generally. And if it’s difficult reading, it can feel extra lonely, especially if it’s asynchronous. So it seems like a good way to connect people through reading, which is not a way we generally think about being social.

Maggie: Absolutely. I’m teaching a class on the death penalty this semester. And so there are some Supreme Court cases that they are reading, and they are 200 pages long. Now, I required them to read one opinion and one dissent from the respective justices that are writing those cases. But, with that, they’re not so scared with the 200 pages of reading. They’re not just like totally shutting down and not doing it. They’re still engaging with the material, which is more than I can say wa’s happening in the classroom when we were face to face.

Rebecca: Can you talk a little bit about your future plans in using Hypothesis moving forward? Yeah, so another way I’ve used Hypothesis is for peer review, and I know that John has used Hypothesis for peer review too, so I think he probably has some comments as well on this. But, in my classes that are writing intensive, I like to incorporate some kind of a peer review feedback, because not only are we requiring them to write their papers with peer-reviewed research articles, and so forth, but I want them to understand what that process means by engaging in that. And I think when some of that feedback comes from their peers, they start to feel like the feedback isn’t so over their head, that that feedback is something that they can accomplish, and something that they’re perhaps a little less afraid of, than when it comes directly from me. So, what I really like about Hypothesis is I can create all of their submissions into a PDF, I can assign each student to review a certain number of papers, I typically tend to assign each student a particular paper so that not one paper gets all of the annotations over another. And I give them a requirement of making at least 10 or 15 comments on the paper. And before I know it, it’s actually eased up a lot of work on my own feedback, because they’re catching the things that I now don’t have to spend a whole lot of time, telling them to capitalize a particular word or explaining how to use commas in a particular sentence. And so it’s been really nice, because they can simply highlight, they can make little comments about when a sentence doesn’t sound right to them. And then I can come back, overlay my feedback over atop of it. And then the students have all of that in one place when they go to work on their final drafts and incorporate that feedback. So yeah, as far as planning in the future, I do plan to continue using that as a peer review feedback as well as in my readings. I’m teaching online courses next spring as well, and so I plan to go get some good scans of my readings so that I can allow for them to become annotatable. Is that a word? annotatable?

Rebecca: It is now. [LAUGHTER]

John: I had a similar experience when my students did peer reviews, and they really liked that ability. They like that they could see the comments, they could react to each other. They could reply to each other’s comments and sometimes they’d disagree about whether a change should be made and there were some really good discussions embedded right in the text, right at the point where it was occurring. And then I’d come in, and sometimes I’d say, “Well, you know, I think maybe the original actually worked pretty well here” or something similar. And it did make my work quite a bit easier, because the students were doing a lot of the basic editing. Initially, a lot of the comments were primarily grammatical. But after the first time we did that, we talked about how it worked. And the students were saying it would be nicer if we could get more substantive comments, actually suggesting ways in which we could improve the substance of the paper. And I was going to suggest the same thing, but they brought that up themselves. And they seem to have much more of a sense of ownership of the review process. And that worked really well. Did your students have any concerns or negative reactions about the use of Hypothesis?

Maggie: Yeah, so I have found that the tool seems to be much better suited for my upper-division seminar style classes. I think that, even though I find it to be really useful for my introductory survey courses, the students did not like it as much in those introductory courses. But, it’s hard to know exactly why. Some of them pointed to not wanting to actually engage with other people, which I kind of have to laugh and move on from those comments, because that’s part of the process of these courses, is engaging with other people. But, I do wonder if it’s between discussion posts, and low-stakes quizzes, if adding annotations in a lower-division course becomes a bit overwhelming for them. But, I do think that the benefits of being accountable to those readings and having better discussions because of those readings probably outweighs some of that concern. But, I have had some other student feedback. They didn’t like that there wasn’t specific feedback available for the grading function. So, when you grade in Hypothesis, you just give a number grade, it doesn’t allow you to submit a rubric to indicate different levels of content or grammaticals or whatever it is you want to grade in a rubric form. So I did have some students who wished that there was some more specific feedback available for that. But, it did make me wonder, and it kind of reminded me of some of the reading we were doing in our reading group, the Small Teaching Online, when they were talking about specs grading, I thought that these annotations might be a really good place for that… to incorporate some all-or-nothing kind of grading. But again, with low-stakes grading, it’s not a significant portion of their grades. So I guess that’s just one thing to keep in mind, is that sometimes students want some of that detailed feedback. And that tool doesn’t necessarily give you a place to comment on their annotations, except within the annotations, you certainly can comment by replying to their annotations, which I do.

John: But you don’t want to make it public because of FERPA, and so forth. But you always have the option of not using the grading feature within Hypothesis and just adding a column to the gradebook, attaching a rubric to it, and then just evaluating each student… looking at their comments using the same technique, and then just going to the rubric and adding that to the gradebook. So, there are workarounds.

Maggie: Yeah, and I’ve done it that way as well. That just brought to mind like, maybe I need to go back to using that method for some of these classes. The other thing is that sometimes scans aren’t the best. I do think it’s really better to use articles that are already searchable. Sometimes when you’re scanning material, making them searchable and accessible, is difficult. There’s really good scanners and technology that can help us with that. But, sometimes the students are highlighting certain segments of the text, and it’s jumping to other areas of the paragraph. And so I think with that it takes a little bit of time to complete. I’ve also had some students saying that they don’t like to highlight over other students highlights, but I think that’s more of a personal preference. So I just encourage them to reply, then, to those students’ annotations so that it’s about the same material. And that pushes them to engage with each other a bit. But while there’s certainly some areas that students want different features and improvement on, they overall very much like using this tool in Blackboard… at least that’s been my experience.

John: I suppose one nice side effect of this is the more people who use this, the more it will encourage the creation of accessible PDFs because basically the issue is that you need a text layer that contains all the text where it’s supposed to be basically.

Rebecca: Yeah, and if it’s a fully tagged PDF, it works better in Hypothesis than just an OCR’d PDF, for sure.

Maggie: Yeah, that’s fair. I think it is a great tool for faculty because it really does push them to make all of their readings accessible. So, in terms of accessibility, it’s a good way to push everyone to make their materials accessible.

Rebecca: We always wrap up by asking what’s next?

Maggie: Well, so in terms of using Hypothesis, I’m teaching some upper-division seminar courses next semester online, and so I plan to keep using this for both peer review and for reading comprehension. I’m hoping also that one day, we’ll be able to use inclusive access texts with Hypothesis so that we can move through some of the main readings, especially if we have a textbook, where students are able to annotate together.

Rebecca: I would like to be able to annotate images.

Maggie: Right. Yeah.

Rebecca: Well, thanks so much, Maggie for joining us. It’s always a pleasure to chat.

Maggie: Yes. Thank you for having me.

John: Thank you, Maggie. It’s great talking to you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

148. Active Learning: 6 Feet of Separation

During the fall 2020 semester, many faculty will be working in a classroom environment in which they will be in a classroom using a video conferencing tool to work simultaneously with a mix of remote students online and masked and physically distanced face-to-face students. There are significant challenges in using active learning techniques in this environment. In this episode, Dr. Derek Bruff joins us to explore some active learning strategies that may work under these very unusual circumstances.

Derek is the Director of the Vanderbilt University Center for Teaching and a Principal Senior Lecturer in the Vanderbilt Department of Mathematics. He is the author of Teaching with Classroom Response Systems: Creating Active Learning Environments, as well as his most recent book on Intentional Tech: Principles to Guide the Use of Educational Technology in College Teaching. Derek is also a host of the Leading Lines podcast.

Show Notes

Transcript

John: During the fall 2020 semester, many faculty will be working in a classroom environment in which they will be in a classroom using a video conferencing tool to work simultaneously with a mix of remote students online and masked and physically distanced face-to-face students. There are significant challenges in using active learning techniques in this environment. In this episode, we explore some active learning strategies that may work under these very unusual circumstances.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and

Rebecca: , a graphic designer.

Rebecca: Together, we run the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

[MUSIC]

John: Our guest today is Dr. Derek Bruff. Derek is the Director of the Vanderbilt University Center for Teaching and a Principal Senior Lecturer in the Vanderbilt Department of Mathematics. He is the author of Teaching with Classroom Response Systems: Creating Active Learning Environments, as well as his most recent book on Intentional Tech: Principles to Guide the Use of Educational Technology in College Teaching, which we talked about in an earlier podcast. Derek is also a host of the Leading Lines podcast. Welcome back, Derek.

Derek: Thanks. I’m glad to be here. I’m glad to be back on the podcast. And I just want to say I’ve been very impressed at the work you two have been doing these past several months. I used to say Leading Lines comes out on the first and third Monday of every month. And now I say Leading Lines comes out when it comes out. [LAUGHTER] And so, keeping up the schedule that you guys have had with this podcast and bringing in so many great guests and having so many great interviews, it’s just been a really rich resource for me. And as someone who can’t keep up a regular podcasting schedule right now, I’m just very impressed at what you guys have been doing.

Rebecca: It’s all John.

John: We’ve gotten a lot of help from so many people, such as you, who have agreed to join us and share their thoughts in a really challenging time. And it’s been a really great resource for our faculty too, who are faced with all this uncertainty about the fall.

Rebecca: Me too, because I’m not teaching until the fall. I haven’t taught this spring. [LAUGHTER]

Derek: Now’s a good time to be on sabbatical.

Rebecca: So, today’s teas are. Are you drinking tea, Derek?

Derek: No, I have some dark roast coffee.

Rebecca: Caffeine. [LAUGHTER]

Derek: Yeah.

John: And I have ginger peach green tea today.

Rebecca: I have a summer berry green tea. See, I’m mixing it up, John.

John: That’s a new one.

Rebecca: I gotcha. I gotcha.

Derek: Yeah, sounds lovely.

Rebecca: Actually, you’d be very happy to know, John, that last time I was in Epcot. I got it. [LAUGHTER]

John: We’re recording this in July. It’ll be released probably in early August. And there’s a lot of uncertainty about the fall. Right now, probably most colleges and universities in the country, with a few notable exceptions, have announced that they’re planning to bring students back to campus for face-to-face instruction with reduced seating, with some students coming in remotely (typically through Zoom or some other video conference app), and you recently released a blog post that discuss options for maintaining active learning in this environment where some students will be there in the classroom, spread out to make it hard for them to be in contact with each other, as well as online with a video conference. Maybe you can talk a little bit about that sort of framework in terms of what possibilities there are for people to interact.

Derek: Sure. I wrote this blog post because I’ve been getting so many questions from my faculty at Vanderbilt, trying to imagine what the fall semester will be like. And I gave a presentation based on the blog post at a Vanderbilt faculty town hall the other week, and one of my slides said, “No one has ever done this before.” And I think that’s really important. So, what I’m imagining that a number of faculty will face this fall, and again, different campuses are making different decisions… and even within a single campus, there’s going to be a lot of different configurations… some faculty will be teaching fully online, some faculty will not… and so this is kind of what we’re trying to imagine is that if I’m teaching a class this fall and I’m back on campus, I’m in a classroom, I have some students there in the room with me, but because of social distancing requirements, they’re six feet apart from each other. Maybe we’re all wearing masks, maybe I have a face shield instead of a mask. There’s going to be some variability here. But some students will not be able to come to the classroom, either because the social distancing requirements mean that you can’t hold as many students in the classroom, or maybe they are unable to travel back to get on campus. A lot of our international students are not planning to come back on campus this fall for a variety of reasons. Or maybe you have a student who’s in quarantine, right? They’ve been exposed to COVID and they’re in quarantine for 14 days, and so they can’t come to the classroom. A lot of us teaching this fall. I don’t know how many, but a lot of us, are likely to have these classes where some of the students are in the classroom, but physically distanced and masked, and some students are participating at the same time, but virtually, perhaps through video conferencing tool like Zoom. And you may have some students who actually can’t do either of those. If they’re 12 time zones away, they may have to participate in your class asynchronously in some fashion. That’s a whole ‘nother level of challenge. In my blog post, I just focused on those first two groups of students, the in-person but physically distanced, and then the virtual students may be participating via Zoom. And I’ve been really careful in my terminology of how I describe this, and so I’m calling this a hybrid classroom, because hybrid is sufficiently generic [LAUGHTER] that it would apply to a situation like this. Hybrid typically means some combination of face-to-face and online activities. It’s not quite hyflex. So there’s this term you may have heard, hyflex, which I think means something more specific, where students really have a choice to participate in person, synchronously online, asynchronously online, and they may actually shift from those modalities over the length of the semester. The flex in Hyflex is the kind of student choice and the student autonomy piece and I’m not expecting we’re gonna have a lot of student autonomy this fall. We have some, certainly. Students are electing to be remote-only students or on-campus students, but it doesn’t feel like it’s quite hyflex in terms of the classic model there. That said, though, the folks who teach in a hyflex environment have developed teaching strategies that can work when you have students participating in the classroom and students participating online at the same time. That said, they haven’t had to deal with the physical distancing and the masks. That’s the part that really is novel, and I think it’s going to be important that we as instructors give ourselves a little bit of grace, knowing that literally no one has taught under these conditions in the past, this is new for us, it’s new for our colleagues at other institutions, it’s new for our students. This is going to be really weird and really challenging for them. And frankly, there are a lot who would argue that it might be easier to just teach fully online; that trying to kind of juggle the constraints in this kind of classroom is going to be really challenging for a lot of faculty. And I’ve talked to a lot of faculty who are like, I would just rather teach fully online this fall. And so I don’t want to speak too much into that choice. There’s a lot of factors that go into university decisions about kind of bringing folks back to campus this fall. Our work at the Center for Teaching, we’re trying to help faculty teach as well as they can in whatever conditions they find themselves. We don’t usually get to pick those conditions, right? And so, I just wanted to try to be helpful and so I wrote the blog posts because using technology to foster active learning in the classroom, that’s my jam. That’s what I’ve been writing about and speaking about for a decade and a half now. I wrote my book on teaching with classroom response systems back in 2009…. clickers and polling software… we have tools, actually. This classroom setup sounds really hard, and it will be hard. And there’s stuff about it that I can’t predict in terms of how hard it will be. But we do have some tools and technologies that can help foster more active learning in these types of environments. And so that’s what I wanted to lay out for my faculty colleagues, who couldn’t imagine how this could work at all. And I could see a few ways actually… a few tools that could make it functional. And so I wanted to share those strategies.

John: Before we talk about the specific strategies, maybe we could talk about some of the mechanics. One of the things you suggest is that you’re assuming that the people who are in the classroom will be able to see and hear the people speaking from outside over Zoom or some other videoconference tool, but what about voice going from the classroom to remote participants. Since the in-class students won’t be able to use their own microphones (to avoid possible feedback effects), how will students who are participating remotely be able to hear what other students say in the classroom?

Derek: Right? And that’s where I don’t know that there’s going to be a good answer to that. The audio piece is one of the more challenging pieces of this classroom environment… the students in the classroom getting to hear each other when they’re sitting far apart and wearing masks… but, even more so, the students who are participating virtually. How can they hear the students in the classroom? Presumably, the instructor will be running Zoom off of the classroom computer or their laptop, and they’ll have a webcam and a microphone. If I’m close to my computer when I’m running Zoom, people on the Zoom call can hear me. So, having the virtual students hear the instructor seems fairly straightforward, but the students in the classroom, they’re not going to come anywhere near that microphone. Now we have a few classrooms at Vanderbilt that have some ceiling mounted microphones that are going to help with that, and that will have some capability to pick up the student voices in the room. But, I’m anticipating that’s going to be a real challenge, actually. And so, again, I don’t have a silver bullet, but it does speak to the use of something like a backchannel tool. So like a text chat in a Zoom room or using a third party tool like Twitter, or GroupMe, or Slack, or Discord… a place where you can have a text conversation with all of your students during class. This is often called the backchannel. The front channel, it’s kind of you at the front of the room talking and having conversations with your students. But the backchannel is the text chat that kind of supplements that. And I’ve been doing stuff with backchannel for years. It’s a really interesting way to build community in the classroom, to give voices to more students to kind of create an on-the-fly closed captioning almost or documentation of the discussion that’s happening. It can be really powerful to have a good backchannel. It can also be really challenging. I think a lot of instructors who’ve dabbled with this have realized that when they are at the front of the room leading class, they don’t have the bandwidth to also pay attention to the text chat and see what’s happening there. And so what I’ve recommended is what I learned from Steve Gilbert and Steve Ehrmann years ago, doing webinars to have someone called the “voice of the chat.” Designate someone, maybe it’s a teaching assistant if you’ve got one of those, but it could be a student in the room, and it could rotate among students over time. Their job is to pay attention to the text chat, the backchannel, and then you as the instructor every so often, you would pause and turn it over to the voice of the chat and say, “What’s been happening in the chat? What are the questions that are emerging there? What are some ideas or comments that are really valuable?” Maybe the voice of the chat is someone on your Zoom call, one of your virtual students, because everyone will be able to hear that student. But that way the students who are in the room and the students who are participating virtually can engage in conversation during class, but in the text chat, and then you have these moments where you pull that conversation from the back channel to the front channel, using the voice of the chat. I’ve done this in a lot of online activities, and it works really well. [LAUGHTER] When I’m going to do an online webinar of some sort, I want to have a voice of the chat, someone who can play that role. And so this is actually a pretty proven technique. And I think it’s going to be fairly practical for our classes this fall. I’m glad you asked about this because class discussion. as we think of it in the generic sense, may be the hardest thing to do in this hybrid environment. For me to stand at the front of the room and show them how PowerPoint slides and lecture to my students, that’ll be relatively easy. That’s also something that you could do without students in the room, right? If you’re just gonna lecture then maybe that’s a pre-recorded something that you share with your students. That doesn’t have to be a live interaction of some sort. But the class discussion, the kind of student-to-student piece is going to be really challenging. And so back channel is one way to try to foster some of that in the classroom.

John: So, the students in the room would be encouraged to bring a mobile device to participate in the text chat and to avoid the feedback loop that would result if they were participating in the video chat using audio. That sounds like a really effective solution.

Rebecca: I think one of the other things that you had some interesting ideas about too was group work. One of the reasons why being in class could be appealing to someone is the idea of being able to collaborate or work on something together. But again, same problem as discussions.

Derek: Right. Yeah. So here’s where I’ve done this a couple of times, just because it was fun in my regular classes, is to use a Google sheet as a way to structure groups and their work and their reporting out. And so, years ago, in my stats course, we had an infographics project. So they had to do some data visualization. And so to get them ready for that, I had them look at some sample infographics. And I invited them to essentially crowdsource the rubric that we would use for the infographics they created. I set up a Google sheet that had across the top, it was kind of levels of quality from poor, acceptable, good, to excellent, and each row was blank. And the idea was that the students would work in small groups, they would look at these sample infographics and they would start to identify what are the components of a really good infographic, and each group would pick a different row on the Google spreadsheet and start to flesh out that component and how you would assess it from kind of poor to excellent. I think I had 100 students in the room when I was doing this. And they were working in groups of two or three, and there were all of these anonymous aardvarks all over the Google sheet, adding their ideas for the rubric and it was a little chaotic, but what I wanted from them was more than just a polling question, this wasn’t a multiple choice question. I wanted them to produce something. It was free response, but not just free response, it was a kind of structured free response. And so the Google sheet was a really nice tool for doing this. And so this is what I’m imagining doing thi fall. You can do this in a fully online, kind of a Zoom session, class. Or if you’ve got this kind of hybrid situation, imagine giving your students three questions to discuss in their small groups. You set up a Google sheet, put those questions at the top, one in each column, share that Google sheet with your students, and then send them off to do their small group discussion. As students in the room…. hopefully, this is part of the unknown… if you have two or three students in the classroom, six feet apart from each other wearing masks, will they be able to have a useful discussion as a small group? I hope so. Again, that’s part of the reason for being in the same place at the same time is to have that kind of student-to-student interaction. I don’t know that I would try groups of size six this fall, I might do groups of size two or size three. And the idea is, they would work in small groups. Meanwhile, on Zoom, your students are probably in breakout rooms, again in groups of size two or three, and they’re talking about the questions that you’ve given them, and they are reporting out, each group on a different row of the Google spreadsheet. Now this does a few things. One is you can monitor the Google spreadsheet as students are putting their responses in there. And that allows you to get a sense of how fast they’re moving through the work, when they’re starting to wrap up…. Oh, most of the students have answered questions one and two, but they’re really slowing down on question three. This is helpful information. You can also start to preview their responses and see what ideas are they bringing to the conversation, and that’ll set you up for whatever you do after the group work, to have a sense of what they’re saying. But, I’m also imagining, it’s a nice structured way for the groups to report out, to share, maybe even to focus. It may be that in the classroom, it’s hard for students to hear each other a little bit. And so you could even imagine, if we’ve got three people in our group and three questions, that each of us will draft a response to one question, and then we’ll rotate and revise each other’s drafts. And you can do that right there in the Google doc. This will take some creativity, it may take a little more coordination than you’re used to needing to do for in-class group work. But it’s also nice that, in this case, the Google sheet as a reporting structure would be the same structure for both your in-person and your online students. And so that simplifies things a little bit. And so, I can imagine that kind of technique working pretty well. Again, there’s a bit of an unknown about the students in the classroom and how well they’ll be able to hear each other. But, that would enable a form of group work that I think would be pretty functional. And it wouldn’t have to be a Google sheet. There’s lots of other online collaborative tools that you could use to have students report out in some fashion. There’s these kind of Whiteboard apps where you’ve kind of put sticky notes all over the board. So it could be something more like that. Or maybe they create a PowerPoint or a Google slides, each group has a different slide where they’re gonna put their answers, they’re gonna put their deliverable of some sort. Again, this is not maybe how we want to do group work, but I think it would be functional in the settings that we’re looking at this fall.

Rebecca: I think one thing that you mentioned in your article, which I also strongly advocate for is if you’re going to use some group work techniques, if you establish something that’s consistent so that you don’t have so much startup cost every time you do group work, that that might help too, for that consistency, and then you might get better responses I would imagine over the course of the semester when there’s less cost in terms of figuring out how to do the thing.

Derek: Absolutely. The first couple of times you do it, it’ll be awkward and hard and slow. But after your students have done it a few times, then it’ll be a lot easier to just kind of slide into this mode with your students.

John: You mentioned the use of polling. And when we moved to remote instruction, I continued that using Zoom, but we were completely remote. The way I did it, and I think this was something you recommended, something Erik Mazur had done, is you poll students with challenging questions, and then you have them work in small groups. In Zoom, that’s pretty easy. You send them into breakout rooms with groups of two (or maybe three, if you have an odd number of students.) How would you do that same type of thing in a classroom setting where you want people to engage in active discussions? Might that be a little challenging in the physical room where everyone can hear everyone else, given that they’re spread equidistant apart somehow?

Derek: Yeah. And so you know, I can imagine doing a polling question, having all of your students respond using the same polling tool. And again, this would assume that your in-person students have a device with them that they’re going to use to participate. Now it may be hard for them to do that via Zoom. You’d have to make sure everyone in the room had their microphones turned off and their audio muted because otherwise you’d have too much audio feedback. But if the students in the room were also in Zoom, but kind of silenced and muted, they could participate in the Zoom polling questions. Or you could go to another tool like TopHat or Poll Everywhere, something that lives outside of Zoom and do all of your polling there in parallel to your Zoom session. Either way, this does not seem to be the semester where you want to put a laptop ban in your classroom, we’re gonna need those tools. And you guys know, I’ve been advocating for years for effective intentional use of digital devices in the classroom. [LAUGHTER] So, we’re gonna need it, we’re not gonna have a choice. But now, let’s say you want to have your students turn to their neighbor and chat about the question. Again, in a normal classroom situation, that’s one of the easiest things you can do to build some active learning into your classroom. Give them a good hard question, have them answer it via the poll, then turn to their neighbor and talk it out together, see if they can put their heads together and get the right answer, and then maybe do a second round on the poll and see where things have shifted. It’s a great pedagogical structure. In the hybrid classroom, the turn to your neighbor and chat is going to be challenging, and so you could try to send your online students to breakout rooms and have them talk there and your in-person students pair up and talk to each other six feet apart. Again, until we do some more testing, I don’t know how practical that’s going to be in the classroom, I’m hopeful that it’ll kind of work. It may be that, what in a normal classroom, you might have them turn to their neighbor and talk for 60 seconds, and then move on, that may be too hard to do. And so if you’re going to have them do group work, you’re going to have them spend 10 minutes doing group work because they’re moving to a Google sheet or they’re doing something kind of bigger and more structured. The kind of quick informal pair work may be too challenging. One option that someone suggested to me that I thought was kind of interesting, though, was to have your students in the room, if you have paired them up with your virtual students, you can have the student in the room pull out their phone, put in their earbuds, and FaceTime with their virtual student partner to talk about the question. Again, the first time you do it, there’s a matching problem there, there’s logistics, there’s audio to figure out. The third or fourth time you do it, this may be a lot more fluid and an easier way to have students chat about the question at hand. It also has the added benefit of connecting your virtual students with your in-person students in more intentional ways. And so that could be really helpful for social presence and things like that. Again, a lot of this is going to be trial and error this fall and figuring out what works and what doesn’t work.

John: Since you won’t necessarily have the same number of students online or remote, and it may be difficult to do that pairing, the pairing could work no matter where the other student was. If you’re in a lecture hall that seats 400, and you’ve got 100 people there or 80 people there, they might call someone 100 feet away… 200 feet away…

Derek: Sure. [LAUGHTER]

John: …which could work in the same way as if they were calling someone remotely.

Derek: Yeah. Right. [LAUGHTER] I’m in the southwest corner of the room and my partner is in the northeast corner. Sure. That could work.

Rebecca: We’re far away.

Derek: Right. I want to circle back to this question of why aren’t we just teaching online to begin with? And I think that’s a legitimate question. And I think it’s something that faculty and administrators have to really struggle with. What’s the value pedagogically of classrooms like this? Because a lot of it’s going to be really hard and awkward and, shall we say, sub-optimal. These are not the ways that we want to foster active learning and, like I said, the folks who aren’t fostering active learning, the folks who were just kind of, as the literature says, practicing continuous exposition by the teacher…. That, actually, is going to work no matter what you do this fall. If you’re fully online, if you’re hybrid, if you’re just going to do that, I would argue that that kind of instruction can work just fine online. And maybe that’s not a reason to have people in the room. So, why would you have people in the room? What is the kind of value added there? And one piece, I think, is that we’re all in this together, that this is challenging. I think we’re going to find some students this fall, who don’t want to be in the classroom, taking a health risk of some sort, encountering their instructors or fellow peers, and they’re going to really embrace the online option. I think you’re going to have some students who don’t want to have to stay where they are this fall, they need to come back to campus where they have reliable internet access and laptops that they can access and a library that they can access. We have a lot of students who, when they’re home, are not in conditions that are really conducive to teaching and learning. And so for some students, they’re going to actually welcome the chance to be back on campus and to be a part of that learning community again. And this is hard to talk about, because I think a lot of faculty have very strong reactions and opinions about what the fall is, and being required to teach online or being required to teach in person. But, I just want to put it out there, that I think our students are going to come at this from different perspectives. And so for some students that chance to come into class and awkwardly communicate a little bit with some peers may actually help them feel like they’re more engaged and more part of the learning community. I would also argue that, if we look at not just the individual class session, which may have this weird hybrid, physically distanced quality to it, but if you look at the semester, this fall, a lot of universities are announcing different calendars for the fall, they’re starting later, or they’re starting earlier. They’re finishing by Thanksgiving, they’re not doing fall breaks. We don’t really know what’s going to come this fall. And there’s pretty good odds that at some point, some campuses may need to pivot back fully online. And so if you think about designing a course for this fall, where you’ll have some virtual students, you may have students in vastly different time zones, you may have to pack the whole thing up and move it online at some point during the fall semester. Maybe you’re not assigned to teach the course online, but it’s still, I think, helpful to think about it as an online course, if you could design the course to really function well as a fully online course, and then treat your face-to-face component as a kind of add on, as a supplement, almost like a recitation section. So, there’s a little bit of this in a big lecture hall where you don’t have a lot of kind of student-faculty interaction, anyway. The recitation section is the kind of smaller space where you get to actually engage with peers more and talk about the stuff. And so if you’ve got a course that functions well, so that your assignments are online, a lot of your course communication is online, your key learning activities are online, but the face-to-face components, in this weird hybrid modality, are useful to that and supplemental to that, but if you had to give them up the course wouldn’t fall apart. I think that’s the way to think about this fall: as kind of online first, and then using the face to face to enhance what you can of the learning experience. Build the learning community, have that social interaction, give students a chance to practice and reflect on what they’re learning That’s still super useful. The other way to think about it, I would say, is maybe you’re not willing to kind of think about your entire course moving online right now. But, are there some key elements of your course that you can go ahead and move online at the start of the semester, so that if you have to move the rest of it online later, you’re in a better position. So, I think it was on your podcast that Jessamyn Neuhaus talked about having to learn how to do online assignment submission this spring; that she’d actually never gotten around to learning how to do that, which is fine. It was fine to have paper assignment submission up until the spring but then it became a requirement to do online. So this fall, make sure that you know how to use the assignment submission tool in your course management system and go ahead and plan on having students submit assignments that way. Make sure that you’ve got a good communication pathway with your students using email or the course management system or another tool like Slack or GroupMe, something where you can connect with students, maybe more informally. Go ahead and start using those tools from the beginning, so that if you do have to pivot fully online this fall, you’ve already got some essential components there.

John: That’s basically the approach we taken with our workshops here, and we’ve tried to help sell that to faculty, because it’s a bit of a lift for people who’ve only taught face to face before, by saying anything you create now is going to be something that you can use as a basis for future semesters of your course; that if you have these elements there, you can do a more flipped environment in your classroom, you can use your classroom for more active learning activities, and to the extent to which it results in more possibilities for active learning in the future, I think that’s going to be helpful.

Derek: Yeah, and I’ll add, we’ve been running an Online Course Design Institute at my teaching center all summer… every two weeks, all summer. We’re up over 300 participants in it at this point. A lot of faculty this spring figured out that online wasn’t necessarily as terrible as they thought it might be. They were able to connect with their students in meaningful ways and continue teaching in spite of the circumstance. And so we had a lot of faculty who woke up to some of the possibilities of online teaching this spring and then we’ve been working with faculty. he’ll spend two weeks with us in a pretty intensive institute, learning how to teach online, and a lot of them have a big shift in their opinion about online instruction over the course of those two weeks. They were initially skeptical that it could work nearly as well as face-to-face instruction. and they end the institute thinking, “Okay, this could be pretty exciting, actually, I see a lot of potential here.” And so that’s the other thing that I would suggest, that faculty keep an open mind about really the potential of online teaching. A really well designed online course can work just as well, sometimes even better, than a really well designed face-to-face course. And so it’s okay to kind of lean into that. And to let that be a bigger part of your kind of teaching toolbox this fall.

Rebecca: I think one of the things that you mentioned a little bit earlier in our conversation is like, why are you in person in the first place? What motivates being in person, I think you’re right about the social connection. even seeing other people who are also dedicating time to learning a particular thing could be useful, even if they’re not interacting with each other, and just in the same space at the same time. But also just if you’re there for equipment or other reasons, there might be ways of teaching using a lot of online techniques with the opportunity to have access to tools that they might not have otherwise. And it might be down to like access to a laptop or higher end technology or something that is in a lab or… I teach in a design studio, so some of the more expensive software, faster computers or things like that. So, we’re thinking through the ways that, maybe we don’t really need to be teaching so much, like there could be a lot of learning happening in the classroom at that time and not necessarily a lot of teaching… maybe some coaching and some interactions. But those interactions might actually be happening virtually,

Derek: Right. And you can imagine more of a kind of flipped model where some of the heavy lifting in terms of the teaching, the first exposure to the content is going to happen fully online through pre-recorded lectures or videos of some sort or other resources. And then that class time, as awkward as it is, is still an important part of having students apply things, practice things, get some feedback from someone else. That’s going to be a good model for the fall, I think.

John: Going back to something else you said earlier, the issue of the students who can’t be physically present during class time, there’s also the related issue of students who may not be able to be present virtually during class time if they become ill, or are remote and have limited computer access or bandwidth, or are in a different time zone. Would you recommend that faculty also start thinking about what types of asynchronous activities they can use to provide equivalent learning experiences for those students?

Derek: Yeah, that’s a good question. And again, I think this is the other thing that we’ve seen our faculty, most of our faculty don’t teach online. Our school of nursing has a really robust online program, but outside of that school, most of our faculty don’t have a ton of experience teaching online. So this has been kind of new territory for them. And one of the takeaways that many of them have from our Online Course Design Institute is realizing that you can do a lot of really valuable learning asynchronously online. For a lot of faculty this spring, online meant they had Zoom sessions with their students that essentially replicated what they would have done in the classroom face to face. But if you look at the last 20 years of online higher education, most of that work in higher ed has been asynchronous online learning. You build your course to work well asynchronously. And it’s only in the last couple of years that we’ve had the video conferencing technology that would make a synchronous online component something that you could really lean into in an online course And so thinking about some of your major learning activities and assignments and assessments, not just being online, but being asynchronous online, that’s a really good model to think about. I think one of the impulses is to say, “Well, I’m going to teach in this weird hybrid modality this fall, I’m going to have students in the room, I’m going to have students on Zoom at the same time, some of my students can’t make it during that time, so we’re going to record the Zoom session, and they can watch it later.” And that’s better than nothing, certainly, but watching someone else participate in class is not nearly as effective as participating in class yourself. And so I wouldn’t want faculty to just do that. That’s fine to do. But, I would want them to add something else intentionally to help those asynchronous students engage with the material. And it could be as simple as saying, “I want you to watch this Zoom session. And here are three questions I want you to answer by the end of that 50 minutes.” It could be a different set of questions than the students in the classroom are given to discuss… something a little more active to help them draw out some learning from those recordings. But again, it’s also fine to say, you know what, for this piece of learning, for this module, for this unit, the core learning is going to happen online asynchronously first. And for those who can attend the synchronous session, either in person or via Zoom we’ll do this supplemental piece. And so that’s okay, too. I just keep giving lots of options here. And I’m hoping that helpful. Faculty are gonna have to figure out what’s going to work for them and their students and their comfort zone. I also think faculty are going to have to learn to do new things this fall. During my town hall, I said, “This is going to be an exceptional semester. And so we are going to make some exceptional teaching choices. And that’s okay.” I think for most of us, 2020 has been suboptimal. There’s been massive disappointments in lots of ways and life has gotten harder in so many ways. And yet, we can either stay in bed and not try, or we can get out and try to make it a little bit better somehow. It’s this growth mindset. I think we need to approach the fall semester with a growth mindset to say: “This is gonna be hard. This is gonna be challenging. I’m gonna have to learn some new skills as a teacher. I may have to learn some new technologies. I’m going to try to do that in a way that doesn’t overwhelm me.” Don’t try to take on too much, too fast. But you’ll have to take on some new stuff this fall. And whether that’s active learning with technology in a hybrid classroom, or that’s designing an online course, or using some part of your course management system that you’ve never touched before, but might actually be helpful this fall, we’re all going to be stretching out of our comfort zones this fall. And that’s okay. It’s going to be hard work, but I think if we collaborate and lean on each other a little bit, we’ll be fine.

Rebecca: And it won’t be perfect. And that’ll be fine, too.

Derek: Right. It’s never perfect the first time out.

John: But with all these new tools, it can improve teaching effectiveness in the future. And that’s something we keep reminding people, that, yes, this is a challenge, but you’re learning a lot of new tools that have value beyond this. It’s not just for this one-time emergency, that this could result in some significant improvements in the effectiveness of your teaching later, even though it will be tough.

Derek: Yes, so one of the tools that we’ve been showing people this summer in our online course design institute is a social annotation tool like Hypothesis or Perusall. And it’s mostly our humanities faculty, but they love it. They are just over the moon with what they can do with these social annotation tools. And most of them just haven’t seen it before. It wasn’t on their radar. And it’s super useful in an online course. But, a lot of them are saying, “Oh, I’m just gonna make this a regular part of my courses going forward no matter how I’m teaching, because having students engaged with the text this way, where they’re annotating collaboratively and discussing it in the sidebar, that’s just a really useful learning process that I want to build into all of my courses no matter how I teach them.” So, we’re finding lots of things that we didn’t know were there that we’re going to make use of in 2021, and 21-22. These are going to be permanent parts of our teaching toolbox.

John: In our course redesign workshop for faculty, we included some samples and documents with Hypothesis, and people have been really impressed by the ability to engage and share and give feedback to each other. And I think we’ve got quite a few people who plan to be using it this fall. It’s a great tool. One of the things you recommend in this document is the use of a fishbowl technique. Could you talk a little bit about how that might work in this sort of hybrid environment.

Derek: Sure. And this is a technique that’s been in the literature for a long time, a way to foster discussion in the classroom. And someone mentioned this as a possibility for the hybrid classroom. And I was like, “Oh, yes, actually, that’s a perfect match.” The fishbowl technique classically works like this. You have a small group of students who have a discussion about whatever the topic is. They’re in the fishbowl. The rest of the students are observing from the outside and they’re quiet during the discussion. They’re taking notes, they’re observing. And then after the discussion, you then ask something of the observers, ask them to summarize what they heard or reflect on what they heard. And it can be really helpful if everyone in the fishbowl is advocating for one point of view. And then the folks who are observing have to then kind of summarize that, even if they don’t agree with it. It can really foster intentional listening. There’s lots of things you could do with the fishbowl, but when I thought about the audio context of these hybrid classrooms this fall, having some of your virtual students be in the fishbowl is totally practical. They’re the ones that are going to be easiest to hear across the entire class. You can have five or six students on Zoom, be the fishbowl, have the conversation, the rest of your virtual students and all of your in-person students are then the observers. They’re listening. They’re taking notes. They’re summarizing. I think that’s gonna work really well, actually. And as I’ve shared that idea with a number of faculty here, they’ve been excited to say, “Oh, yeah, that actually fits this context quite well as a structure for discussion.” And especially on some campuses, the virtual students and the face-to-face students are going to flip flop from day to day, there’ll be some students who come to class on Mondays and they do virtual on Wednesdays and the rest of the students are vice versa. And so you could have most of your students have an opportunity to be in the fishbowl at one point or another with this technique. And that way, you get to have some of the richness of that student-to-student discussion. It wouldn’t involve everyone at the same time. But, if you’re really intentional about what you ask the observing students to do with the discussion, I think it can be really productive. Because frankly, if you’ve got 40 students in the classroom, it’s hard to hear from all of them, anyway. You’re only going to hear from five to eight students in a typical discussion. This just centers them in a way and then guides the other students to participate well, in that type of small-group discussion.

Rebecca: I think what you’re pointing out here is the different ways people can participate in speaking isn’t the only way to participate.

Derek: Yeah, or like collaborative notetaking. This is something that a lot of faculty do as a matter of course, anyway, is have students have some shared document where some of the students in the classroom are taking notes on the class discussion. So their role in the discussion is different. They are not there to participate verbally, they are there to do the note taking piece. And that’s an important role. And that would work just fine in this hybrid classroom as well. And so part of this is thinking intentionally about how you want different groups of students to participate in the learning activities, and it’s okay to give them different roles and guide them to different ways to be meaningful participants.

John: You did mention collaborative note taking, wondering how that might be structured in a class of three or four or 500 students. Would it be reasonable perhaps to do that within your LMS using a groups tool to create that, having a shared google doc or something where you share it with a copy link?

Derek: I think if you’ve got 400 students in your class, that’s just a very different teaching context, and it is something about moving online. So I would say that having 75 students in a classroom and 300 students in the classroom, pedagogically, you’re going to use very similar techniques. If you want to foster active learning, then you’re going to have a lot of think-pair-share, a lot of peer instruction, you’ll have some polling. Anything over 50 is going to kind of look the same, pedagogically at least. Some of the logistics change when you have hundreds of students in the room. But, the kind of pedagogical moves that you’re making, I think are somewhat similar. Once you move online, I think there’s a much bigger difference between 50 students online and 300 students online. And so there’s almost a bit of the kind of MOOC mania that may be useful here. Right. So when we had massively open online courses that had thousands of students, there’s less difference between 300 students and 1000 students. And so we might even look to the MOOCs to see what are some techniques that work well at that kind of scale. And that’s where I think having an asynchronously design course makes a lot of sense. If you’ve got 400 students in the course getting them all together on Zoom is going to be a technical nightmare anyway. Let’s just make this course work well as an asynchronous course. The other piece that I would say that if you’ve got a big class and this gets to your point about collaborative note taking or other group structures that you might use, is that social presence is going to be really challenging. When you’ve got that many students, it’s going to be hard for students to feel connected. In the physical classroom, if you’ve got 400 students, at the very least, a given student has the five or six students they sit near every day to form a bit of a local learning community. And even if you don’t ask them to talk to their neighbor about something, they’re still going to talk to each other after class. And so there’s a bit of social presence, social identity, that comes just by virtue of the seating arrangements. In the online class, you’re not going to have that to fall back on. And I would advise instructors that have big classes to really think intentionally about permanent small groups, and to build in some learning activities and maybe even some assessment activities that leverage those permanent small groups. If you put students in groups of five or six students each and they’re going to meet with that same group every week, doing something useful during the semester, they’re gonna feel connected to the course a lot more than if they didn’t have that small group to lean on. We’ve seen this even in our Online Course Design Institute where we have 70 or 75 faculty participate over a two-week period, but we put them all in cohorts of size five or six. And you really get to know your cohort members, and what their courses are, what they’re teaching. And so that would be my recommendation for the bigger classes. And it could be collaborative notetaking. It could be every time you do a small group activity in class, you send them to the same groups so that they begin to develop working relationships with those group members, those are going to be really important for online classes that are large.

John: And you can always create Zoom rooms that have the same groups that you have within your LMS. So that way, the same students would be working together in both environments, synchronously and asynchronously.

Derek: Yeah, absolutely. You will have to learn how to do that. And again, we’re all going to be learning new tools this fall. I totally know that’s a thing you can do. I don’t know how to do that myself yet, but I would have to figure it out.

John: I haven’t done it yet, either. But I am preparing for one of those large classes in the fall. There’s a lot of questions I still have. One of the things I’ve been wondering about is perhaps the use of peer evaluation. I had done some of that earlier, but we had another tool that was specific for that. I’m not quite sure how well that will work within the LMS. And it’s a little scary at this point. But it’s something I am going to explore.

Derek: Yeah.

Rebecca: That’s something when I’ve taken a MOOC, even if I don’t feel overly connected to other people, there’s still some sort of peer evaluation piece where you feel like you’re getting peer-to-peer feedback, at least, even if it’s anonymous feedback, essentially, because you don’t know those individuals. And that can be effective in at least feeling like you’re learning with other people who are also learning. It’s not as effective as some other things, but it still does it a little.

Derek: Yeah, it does.

Rebecca: So we always wrap up by asking what’s next? [LAUGHTER] …and I don’t know, John seems to have me asking that question more frequently, because it feels really stressful to ask someone that right now. [LAUGHTER]

Derek: Well, I keep making the joke that it feels like March 97th. [LAUGHTER] Like, this has just been one long March. There was life before March, and now there’s life now… and time and space have no meaning anymore. So, next is a little ambiguous. What’s next? August…. August is next, right? [LAUGHTER] I can predict that. I think we’re going to have an August this year. [LAUGHTER] It’s really hard to kind of look beyond that. I would say, we’re focusing at my center on getting our faculty ready for the start of the fall semester. And what’s going to happen in the first three weeks of this fall semester, like, we don’t have that figured out yet. We don’t know what kind of programming we’re going to offer. We don’t know what kind of responsiveness we’re going to need. It’s been a lot this summer just to kind of do what we’re doing. And so it’s really hard to look very far out. I will say that, among many other complexities in the year 2020, it’s an election year in the United States, and more generally, we have a lot of protests that happened across the United States and across the world earlier this spring. There’s a lot of hard conversations that people are having right now, whether they’re pandemic related or not. And I don’t think that’s going to go away. I’ve been in triage mode all summer, trying to get faculty ready to teach online or hybrid. And so its been hard to think about all the things that may be challenging about this fall semester, but I do think the hard conversations that we need to have with our students and to help our students have productive hard conversations. That’s something that we’re going to spend at least a little time on in my teaching center in August, trying to help faculty get ready for what will likely be a contentious semester, regardless of the kind of modalities, the online, the hybrid, all that kind of stuff. Just the kinds of conversations that we want to have our students are going to be really challenging this fall. And so I think getting ready to do that well, it’s going to be an important component of what’s next for us.

Rebecca: And I don’t think any of us will be bored. There will be an August, and we will not be bored. [LAUGHTER]

Derek: Yes, those seem like certainties.

John: Well, thank you. It’s been wonderful talking to you and, we really appreciated the blog post as well as all the very many resources that you share on your website.

Rebecca: Yeah, thank you so much.

Derek: You’re quite welcome. We have a great team at the Vanderbilt Center for Teaching and I’m glad to be the Director and to get to share all the great work that my staff do all the time. So, thanks for that.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]